-- Logs begin at Sun 2022-07-24 00:10:26 UTC, end at Sun 2022-07-24 02:55:47 UTC. -- Jul 24 00:57:16.861212 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 24 00:57:16.870264 n-d-master-1 devstack@n-api.service[104223]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 24 00:57:16 2022] *** Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: nodename: n-d-master-1 Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: machine: x86_64 Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: clock source: unix Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: pcre jit disabled Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: detected number of CPU cores: 4 Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: current working directory: / Jul 24 00:57:16.872273 n-d-master-1 devstack@n-api.service[104223]: detected binary path: /usr/bin/uwsgi-core Jul 24 00:57:16.872961 n-d-master-1 devstack@n-api.service[104223]: your processes number limit is 47680 Jul 24 00:57:16.872961 n-d-master-1 devstack@n-api.service[104223]: your memory page size is 4096 bytes Jul 24 00:57:16.872961 n-d-master-1 devstack@n-api.service[104223]: detected max file descriptor number: 2048 Jul 24 00:57:16.872961 n-d-master-1 devstack@n-api.service[104223]: lock engine: pthread robust mutexes Jul 24 00:57:16.872961 n-d-master-1 devstack@n-api.service[104223]: thunder lock: enabled Jul 24 00:57:16.872961 n-d-master-1 devstack@n-api.service[104223]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 24 00:57:16.872961 n-d-master-1 devstack@n-api.service[104223]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 24 00:57:16.916862 n-d-master-1 devstack@n-api.service[104223]: Python main interpreter initialized at 0x55f5305d79c0 Jul 24 00:57:16.916862 n-d-master-1 devstack@n-api.service[104223]: python threads support enabled Jul 24 00:57:16.916862 n-d-master-1 devstack@n-api.service[104223]: your server socket listen backlog is limited to 100 connections Jul 24 00:57:16.916862 n-d-master-1 devstack@n-api.service[104223]: your mercy for graceful operations on workers is 90 seconds Jul 24 00:57:16.917246 n-d-master-1 devstack@n-api.service[104223]: mapped 403077 bytes (393 KB) for 2 cores Jul 24 00:57:16.917322 n-d-master-1 devstack@n-api.service[104223]: *** Operational MODE: preforking *** Jul 24 00:57:16.917555 n-d-master-1 devstack@n-api.service[104223]: *** uWSGI is running in multiple interpreter mode *** Jul 24 00:57:16.917555 n-d-master-1 devstack@n-api.service[104223]: spawned uWSGI master process (pid: 104223) Jul 24 00:57:16.917864 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 24 00:57:16.920758 n-d-master-1 devstack@n-api.service[104223]: spawned uWSGI worker 1 (pid: 104224, cores: 1) Jul 24 00:57:16.920758 n-d-master-1 devstack@n-api.service[104223]: spawned uWSGI worker 2 (pid: 104225, cores: 1) Jul 24 00:57:16.920758 n-d-master-1 devstack@n-api.service[104223]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 24 00:57:17.586978 n-d-master-1 devstack@n-api.service[104225]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 00:57:17.597105 n-d-master-1 devstack@n-api.service[104224]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 00:57:18.722764 n-d-master-1 devstack@n-api.service[104225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.722764 n-d-master-1 devstack@n-api.service[104225]: from cryptography.utils import int_from_bytes Jul 24 00:57:18.723400 n-d-master-1 devstack@n-api.service[104225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.723400 n-d-master-1 devstack@n-api.service[104225]: from cryptography.utils import int_from_bytes Jul 24 00:57:18.730850 n-d-master-1 devstack@n-api.service[104224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.730850 n-d-master-1 devstack@n-api.service[104224]: from cryptography.utils import int_from_bytes Jul 24 00:57:18.731378 n-d-master-1 devstack@n-api.service[104224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.731378 n-d-master-1 devstack@n-api.service[104224]: from cryptography.utils import int_from_bytes Jul 24 00:57:21.268114 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:57:21.268682 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:57:21.268895 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:57:21.269259 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:57:21.269515 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:57:21.269933 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.270264 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.270586 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.270909 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.271240 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.271553 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.271877 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.272195 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.272522 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.272783 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.273099 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.273534 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.273888 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.274203 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.274520 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.274838 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.275141 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.275464 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.275772 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.276272 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.276713 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.277022 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.277336 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.277691 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.278014 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.278323 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.278644 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.278956 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.279281 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.279593 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.279735 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:57:21.280112 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:57:21.280263 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.280347 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.280468 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:57:21.280627 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.280853 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:57:21.280965 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.281070 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:57:21.281337 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.281452 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.281648 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.281772 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.281983 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.282089 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.282305 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.282421 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.282628 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.282739 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.282943 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.283063 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.283267 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.283399 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.283592 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.283733 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.283923 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.284012 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.284237 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.284427 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.284519 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.284599 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.284774 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.284868 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.285123 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.285228 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.285393 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.285562 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.285728 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.285988 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.286079 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.286256 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.286392 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.286566 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.286771 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.286995 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.287245 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.287343 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.287431 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.287526 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.287774 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.287992 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.288116 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.288294 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.288402 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.288572 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.288666 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.289440 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.289573 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.289820 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.289932 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.290240 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.290342 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.290542 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.290629 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.290869 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.290993 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.291178 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.291272 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.291485 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.291585 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.291793 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.291891 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.292437 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.292548 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.292629 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.292707 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.292773 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.292842 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.293041 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.293239 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.293367 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.293509 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.293792 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.293886 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.294047 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.294153 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.294368 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.294523 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.294707 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.294793 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.295012 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.295131 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.295323 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.295416 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.295643 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.295778 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.295959 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.296140 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.296295 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.296430 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.296567 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.296702 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.296838 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.296995 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.297134 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.297286 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.297426 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.297569 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.297762 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.297923 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.298073 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.298213 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.298355 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.298492 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.298646 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.298796 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.298938 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.299078 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.299229 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.299361 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.299501 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.299638 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.299768 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.299901 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.300030 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.300172 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.300310 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.300452 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.300591 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.300723 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.300869 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.301098 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.301232 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.301362 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.301492 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.301621 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.301780 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.301928 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.302058 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.302187 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.302316 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.302445 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.302607 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.302756 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.302891 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.303059 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.303192 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.303379 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.303533 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.303687 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.303819 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.303997 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.304131 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.304314 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.304476 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.305290 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.305439 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.305708 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.305859 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.306225 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.306377 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.306377 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.306618 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.306745 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.306886 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307013 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307154 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307293 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307431 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307557 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307683 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307808 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.307947 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.308104 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.308233 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.308422 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.308563 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.308722 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.308863 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.309033 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.309165 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.309346 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.309486 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.309626 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.309829 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.309962 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.310090 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.310218 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.310345 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.310490 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.310626 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.310800 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.310933 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.311083 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.311203 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.311437 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.311574 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.311700 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.311836 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.311974 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.312101 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.312256 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.312394 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.312548 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.312671 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.312850 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.312984 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.313153 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.313280 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.313519 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.313651 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.313923 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.314077 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.314204 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.314328 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.314452 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.314577 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.314718 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.315014 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.315162 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.315292 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.315420 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.315557 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.315689 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.315827 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.315953 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.316085 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.316280 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.316419 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.316546 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.316685 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.316813 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.316987 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.317131 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.317300 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.317428 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.317601 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.317757 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.317930 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.318070 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.318244 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.318388 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.318547 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.318672 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.318851 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.318983 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.319165 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.319306 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.319461 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.319593 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.319764 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.319901 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.320076 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.320831 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.320831 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.321086 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.321086 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.321408 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.321547 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.321851 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.321851 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.322111 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.322237 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.322363 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.322502 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.322639 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.322755 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.322885 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.323011 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.323145 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.323145 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.323395 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.323520 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.323644 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.323644 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.323876 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.323876 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.324176 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.324338 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.324493 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.324620 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.324746 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.324884 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:21.325067 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.325195 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.325387 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.325517 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.325645 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.325812 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.325943 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.326071 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.326199 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.326378 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.326508 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.326656 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.326782 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.326995 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.327130 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.327301 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.327445 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.327615 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.327747 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.327930 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.328063 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.328234 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.328386 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.328520 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.328645 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.328834 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.328962 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.329148 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.329295 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.329452 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.329591 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.329782 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.329914 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.330090 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.330242 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.330404 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.330543 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.330710 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.330856 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.331004 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.331141 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.331317 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.331499 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.331633 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.331761 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.331949 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.332086 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.332251 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.332379 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.332556 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.332688 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.332865 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.333008 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.333177 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.333309 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.333483 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.333625 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.333822 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.333947 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.334122 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.334253 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.334427 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.334571 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.334732 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.334909 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.335042 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.335222 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.335349 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.335486 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.335656 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.335790 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.336041 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.336178 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.336372 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.336630 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.336770 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.336893 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.337279 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.337421 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.337567 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.337735 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.337893 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.338024 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.338209 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.338356 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.338537 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.338669 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.338853 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.338986 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.339158 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.339289 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.339473 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.339621 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.339781 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.339913 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.340090 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.340221 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.340397 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.340528 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.340706 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.340837 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.341008 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.341143 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.341308 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.341441 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.341627 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.341830 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.341961 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.342087 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.342243 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.342374 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.342544 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.342680 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.342846 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.342998 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.343131 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.343263 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.343436 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.343572 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.343742 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.343889 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.344047 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.344181 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.344363 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.344509 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.344638 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.344787 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.344925 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.345053 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.345225 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.345359 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.345529 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.345711 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.345845 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.345978 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.346175 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.346311 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.346464 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.346655 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.346789 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.346924 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.347103 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.347239 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.347384 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.347516 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.347651 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.347778 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.347953 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.348085 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.348261 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.348401 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.348574 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.348704 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.348882 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.349015 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.349206 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.349339 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.349518 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.349650 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.349914 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.350061 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.350192 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.350331 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.350493 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.350625 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.350797 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.350948 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.351117 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.351251 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.351964 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.352119 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.352291 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.352464 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.352604 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.352730 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.352894 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.353030 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.353195 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.353342 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.353476 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.353626 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.353789 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.353917 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.354079 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.354236 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.354372 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.354490 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.354675 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.354821 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.354978 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.355117 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.355259 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.355449 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.355602 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.355742 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.355896 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.356033 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.356168 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.356305 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.356439 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.356574 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.356767 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.356915 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.357069 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.357204 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.357338 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.357491 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.357628 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.357843 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.357992 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.358127 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.358291 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.358441 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.358610 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.358759 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.358928 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.359072 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.359238 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.359388 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.359550 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.359680 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.359855 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.359988 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.360161 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.360306 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.360474 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.360609 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.360781 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.360915 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.361100 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.361250 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.361405 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.361534 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.361744 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.361881 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.362050 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.362232 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.362362 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.362487 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.362665 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.362795 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.362973 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.363115 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.363270 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.363402 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.363583 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.363724 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.363892 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.364023 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.364198 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.364331 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.364508 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.364693 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.364835 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.364972 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.365118 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.365245 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.365425 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.365730 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.365857 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.365981 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.366110 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.366251 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.366373 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.366514 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.366642 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.366769 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.366947 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.367122 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.367869 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.368042 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.368171 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.368297 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.368473 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.368605 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.368779 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.368983 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.369122 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.369253 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.369429 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.369573 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.369763 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.369907 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.370069 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.370202 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.370393 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.370526 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.370702 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.370845 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.371020 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.371150 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.371330 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.371460 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.371640 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.371772 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.371959 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.372087 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.372267 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.372398 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.372574 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.372703 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.372872 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.372999 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.373174 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.373320 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.373462 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.373596 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.373784 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.373911 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.374096 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.374242 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.374401 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.374544 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.374703 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.374829 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.375012 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.375157 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.375314 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.375443 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.375613 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.375808 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.375943 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.376085 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.376211 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.376512 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.376644 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.376795 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.376929 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.377120 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.377258 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.377434 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.377559 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.377833 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.377975 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.378109 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.378239 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.378371 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.378498 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.378648 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.378787 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.378951 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.379091 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.379233 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.379407 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.379543 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.379709 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.379852 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.380017 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.380149 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.380324 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.380470 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.380638 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.380795 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.380935 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.381068 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.381241 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.381376 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.381548 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.381734 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.381889 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.382013 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.382199 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.382338 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.382534 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.382703 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.382913 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.383123 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.383265 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.383448 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.383593 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.383805 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.383942 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.384114 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.384279 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.384419 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.384569 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.384701 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.384890 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.385024 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.385153 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.385319 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.385465 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.385628 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.385938 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.386074 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.386204 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.386352 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.386485 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.386618 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.386763 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.386910 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.387044 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.387307 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.387444 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.387652 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.387786 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.387961 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.388097 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.388272 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.388409 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.388604 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.388752 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.388898 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.389036 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.389211 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.389352 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.389518 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.389665 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.389869 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.390027 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.390179 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.390450 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.390450 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.390721 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.390878 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.391019 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.391179 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.391324 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.391468 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.391613 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.391764 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.391902 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.392053 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.392194 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.392333 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.392481 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.392684 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.392882 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393024 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393153 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393289 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393416 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393544 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393704 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393850 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.393988 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.394116 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.394252 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.394381 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.394507 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.394636 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.394757 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.394888 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395069 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395199 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395338 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395466 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395608 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395740 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395871 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.395996 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.396139 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.396273 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.396413 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.396597 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.396734 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.396898 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.397046 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.397238 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.397384 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.397565 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.397796 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.397954 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.398103 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.398272 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.398416 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.398648 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.398973 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.399277 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.399424 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.399565 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.399707 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.399851 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.399984 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.400121 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.400252 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.400390 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.400519 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.400656 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.400794 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.400932 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.401120 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.401249 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.401377 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.401505 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.401645 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.401805 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.401933 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.402079 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.402224 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.402363 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.402506 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.402645 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.402802 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.402934 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.403113 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.403244 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.403416 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.403558 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.403721 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.403853 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.404019 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.404152 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.404325 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.404469 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.404632 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.404819 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.404950 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.405087 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.405223 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.405355 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.405523 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.405651 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.405866 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.406014 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.406168 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.406300 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.406466 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.406614 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.406746 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.406894 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.407056 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.407202 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.407346 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.407467 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.407644 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.407799 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.407967 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.408110 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.408274 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.408415 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.408577 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.408728 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.408864 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.409001 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.409172 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.409320 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.409473 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.409609 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.409783 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.409914 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.410077 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.410216 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.410373 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.410510 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.410692 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.410836 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.410988 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.411125 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.411282 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.411429 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.411578 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.411702 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.411837 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.411983 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.412121 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.412245 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.412414 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.412544 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.412709 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.412860 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.412993 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.413121 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.413287 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.413438 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.413571 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.413828 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.414607 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.414756 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.414976 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.415128 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.415349 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.415519 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.415668 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.415802 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.415936 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.416082 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.416278 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.416427 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.416573 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.416708 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.416841 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.416976 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.417121 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.417252 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.417384 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.417570 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.417732 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.417867 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.418025 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.418160 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.418292 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.418425 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.418563 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.418706 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.418956 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.419097 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.419233 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.419367 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.419503 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.419638 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.419782 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.419918 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420047 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420168 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420299 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420451 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420593 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420727 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420858 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.420992 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.421125 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.421271 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.421406 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.421585 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.421827 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.421965 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.422098 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.422252 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.422386 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.422534 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.422671 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.422816 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.422954 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.423099 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.423235 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.423369 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.423501 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.423680 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.423838 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.423983 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.424117 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.424251 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.424392 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.424565 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.424717 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.424849 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.425037 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.425175 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.425307 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.425507 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.425657 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.425822 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.425952 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.426104 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.426238 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.426427 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.426611 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.426769 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.426907 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.427040 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.427222 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.427380 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.427511 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.427704 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.427844 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.427982 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.428117 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.428264 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.428408 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.428540 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.428674 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.428851 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.429094 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.429250 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.429387 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.429545 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.430361 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.430523 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.430669 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.430825 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.430970 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.431096 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.431297 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.431420 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.431615 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.431755 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.431934 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.432143 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.432291 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.432457 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.432605 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.432863 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.433018 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.433182 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.433303 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.433504 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.433658 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.433975 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.434119 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.434281 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.434432 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.434622 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.434769 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.434949 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.435153 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.435295 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.435446 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.435578 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.435864 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.436016 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.436164 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.436301 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.436487 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.436627 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.436763 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.437066 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.437210 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.437373 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.437585 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.437789 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.438011 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.438172 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.438308 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.438595 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.438753 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.438890 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.439029 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.439186 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.439437 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.439580 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.439870 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.440019 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.440168 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.440345 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.440485 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.440746 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.440888 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.441092 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.441248 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.441385 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.441746 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.441889 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.442041 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.442179 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.442331 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.442467 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.442593 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.442718 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.442910 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.443060 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.443199 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.443329 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.443526 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.443660 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.443861 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.444001 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.444194 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.444343 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.444509 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.444638 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.444828 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.444980 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.445191 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.445332 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.445509 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.445757 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.445913 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.446082 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.446201 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.446318 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.446464 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.446647 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.446773 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.446943 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.447073 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.447258 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.447399 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.447579 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.447719 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.447867 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.447999 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.448167 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.448293 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.448478 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.448617 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.448778 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.448913 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.449084 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.449210 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.449405 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.449561 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.449730 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.449887 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.450031 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.450158 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.450327 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.450488 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.450623 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.450760 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.450922 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.451068 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.451216 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.451365 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.451526 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.451677 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.451814 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.451946 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.452139 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.452274 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.452450 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.452586 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.452772 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.452926 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.453097 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.453247 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.453398 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.453535 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.453798 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.453955 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.454104 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.454242 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.454379 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.454529 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.454665 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.454800 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.454945 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.455078 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.455210 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.455396 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.455533 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.455682 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.455872 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.456005 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.456136 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.456270 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.456422 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.456561 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.456746 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.456887 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.457021 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.457155 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.457335 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.457643 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.457818 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.457980 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.458168 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.458302 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.458436 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.458593 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.458728 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.458865 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.459010 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.459175 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.459378 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.459511 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.459651 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.459780 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.459914 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.460052 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.460205 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.460339 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.460472 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.460611 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.460774 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.461131 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.461286 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.461452 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.461577 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.461806 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.461951 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.462367 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.462512 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.462658 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.462797 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.462953 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.463100 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.463255 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.463400 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.463542 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.463681 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.463833 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.463974 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.464170 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.464318 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.464456 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.464601 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.464789 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.464950 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.465104 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.465250 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.465400 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.465607 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.465786 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.465987 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.466126 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.466256 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.466393 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.466528 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.466714 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467023 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467023 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467294 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467432 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467559 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467707 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467840 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.467975 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.468121 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.468237 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.468372 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.468524 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.468659 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.468795 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.468929 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.469118 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.469328 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.469478 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.469622 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.469867 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.470009 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.470307 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.470472 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.470626 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.470769 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.470940 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.471088 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.471255 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.471405 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.471572 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.471717 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.471884 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.472025 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.472196 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.472359 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.472496 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.472631 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.472807 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.472947 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.473096 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.473244 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.473411 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.473545 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.473748 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.473888 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.474039 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.474285 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.474432 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.474570 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.474704 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.474842 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.474992 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.475127 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.475263 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.475400 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.475538 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.475735 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.475888 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.476076 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.476216 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.476969 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.477241 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.477399 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.477561 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.477796 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.477963 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.478100 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.478238 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.478454 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.478594 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.478742 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.478881 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.479019 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.479155 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.479304 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.479452 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.479587 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.479725 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.479891 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.480043 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.480188 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.480325 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.480498 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.480620 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.480809 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.480966 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.481109 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.481248 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.481431 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.481576 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.481799 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.481963 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.482100 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.482235 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.482426 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.482568 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.482714 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.482865 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.483003 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.483138 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.483315 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.483576 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.483731 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.483889 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.484041 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.484208 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.484346 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.484516 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.484671 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.484810 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.484952 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.485126 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.485270 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.485410 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.485555 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.485727 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.485919 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.486063 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.486253 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.486411 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.486562 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.486709 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.486847 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.486988 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.487177 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.487324 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.487464 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.487594 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.487736 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.487875 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.488005 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.488154 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.488285 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.488416 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.488541 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.488726 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.488873 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.489073 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.489251 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.489386 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.489598 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.489774 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.489939 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.490085 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.490261 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.490388 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.490580 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.490894 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.491037 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.491195 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.491320 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.491516 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.491642 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.491822 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.491962 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.492732 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.492914 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.493040 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.493193 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.493515 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.493638 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.493781 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.493880 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.493963 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.494112 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.494271 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.494421 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.494583 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.494729 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.494899 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.495031 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.495214 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.495337 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.495524 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.495638 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.495836 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.495974 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.496147 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.496271 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.496454 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.496540 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.496766 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.496911 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.497058 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.497186 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.497371 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.497494 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.497701 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.497845 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.498009 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.498155 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.498306 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.498436 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.498631 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.498792 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.498926 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.499053 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.499181 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.499311 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.499474 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.499625 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.499758 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.499892 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.500062 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.500151 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.500366 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.500461 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.500718 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.500854 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.501038 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.501132 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.501340 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.501426 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.501645 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.501811 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.501982 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.502076 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.502289 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.502375 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.502608 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.502717 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.502917 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.503031 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.503223 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.503351 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.503570 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.503675 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.503885 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.504052 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.504295 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.504430 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.504618 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.504760 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.504938 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.505077 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.505259 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.505410 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.505569 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.505762 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.505929 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.506064 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.506272 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.506393 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.506604 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.506689 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.506935 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.507091 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.507244 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.507386 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.507529 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.507661 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.507887 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.507991 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.508228 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.508325 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.508495 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.508581 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.508802 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.508922 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.509104 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.509189 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.509407 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.509543 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.509735 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.509868 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.510040 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.510176 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.510341 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.510494 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.510640 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.510748 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.510942 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.511033 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.511253 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.511405 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.511543 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.511676 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.511856 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.511994 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.512130 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.512231 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.512435 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.512529 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.512738 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.512824 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.513042 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.513140 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.513350 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.513436 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.513649 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.513776 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.513977 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.514063 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.514280 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.514366 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.514585 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.514671 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.514895 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.514997 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.515193 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.515285 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.515545 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.515639 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.515861 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.515994 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.516185 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.516317 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.516495 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.516637 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.516800 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.516914 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.517112 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.517198 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.517428 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.517528 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.517760 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.517851 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.518076 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.518151 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.518381 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.518475 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.518707 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.518789 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.519020 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.519102 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.519336 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.519430 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.519652 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.519734 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.519949 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.520022 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.520248 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.520342 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.520549 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.520641 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.520861 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.520946 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.521173 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.521266 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.521477 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.521569 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.521803 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.521892 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.522103 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.522189 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.522415 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.522509 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.522698 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.522800 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.522999 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.523084 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.523399 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.523654 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.523789 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.523926 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524047 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524133 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524282 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524421 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524583 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524729 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524862 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.524996 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.525168 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.525294 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.525471 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.525602 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.525782 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.525900 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.526086 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.526259 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.526464 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.526591 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.526701 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.526825 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.526952 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.527126 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.527267 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.527440 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.527586 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.527772 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.527914 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.528101 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.528258 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.528446 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.528580 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.528762 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.528902 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.529065 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.529211 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.529386 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.529499 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.529723 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.529829 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.530027 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.530114 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.530345 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.530432 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.530592 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:57:21.530678 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.530954 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.531282 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.531591 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.531892 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.532199 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.532507 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.532812 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.533116 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.533442 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.533803 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.534108 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.534430 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.534744 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.535057 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.535366 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.535675 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.536001 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.536307 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.536615 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.536922 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.537228 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.537534 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.537876 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.538186 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.538495 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.538813 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.539666 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.539993 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.540321 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.540629 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.540957 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.541281 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.541621 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.541953 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.542294 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.542619 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.542932 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.543240 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.543538 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:21.543781 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:57:21.594210 n-d-master-1 devstack@n-api.service[104225]: INFO dbcounter [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Registered counter for database nova_api Jul 24 00:57:21.606184 n-d-master-1 devstack@n-api.service[104224]: INFO dbcounter [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Registered counter for database nova_api Jul 24 00:57:21.708650 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_db.sqlalchemy.engines [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.716477 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writer thread running {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:21.719203 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_db.sqlalchemy.engines [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.725631 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writer thread running {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:21.773113 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.context [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=104225) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 00:57:21.777720 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 00:57:21.779322 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 00:57:21.780115 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 00:57:21.781513 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.context [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=104224) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 00:57:21.782293 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 00:57:21.784305 n-d-master-1 devstack@n-api.service[104225]: INFO dbcounter [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Registered counter for database nova_cell0 Jul 24 00:57:21.785430 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_concurrency.lockutils [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 00:57:21.787126 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_concurrency.lockutils [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 00:57:21.787916 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_concurrency.lockutils [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 00:57:21.788181 n-d-master-1 devstack@n-api.service[104225]: INFO dbcounter [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Registered counter for database nova_cell1 Jul 24 00:57:21.790983 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_concurrency.lockutils [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 00:57:21.793014 n-d-master-1 devstack@n-api.service[104224]: INFO dbcounter [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Registered counter for database nova_cell0 Jul 24 00:57:21.796482 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_db.sqlalchemy.engines [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.797022 n-d-master-1 devstack@n-api.service[104224]: INFO dbcounter [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Registered counter for database nova_cell1 Jul 24 00:57:21.798246 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_db.sqlalchemy.engines [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.804780 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writer thread running {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:21.806330 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writer thread running {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:21.806457 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_db.sqlalchemy.engines [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.808535 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_db.sqlalchemy.engines [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.813864 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writer thread running {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:21.815435 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writer thread running {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:21.955081 n-d-master-1 devstack@n-api.service[104225]: INFO dbcounter [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Registered counter for database nova_cell0 Jul 24 00:57:21.960063 n-d-master-1 devstack@n-api.service[104224]: INFO dbcounter [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Registered counter for database nova_cell0 Jul 24 00:57:21.965476 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_db.sqlalchemy.engines [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.969013 n-d-master-1 devstack@n-api.service[104224]: DEBUG oslo_db.sqlalchemy.engines [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:21.970073 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writer thread running {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:21.973347 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writer thread running {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:22.311023 n-d-master-1 devstack@n-api.service[104225]: WARNING keystonemiddleware.auth_token [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 00:57:22.314363 n-d-master-1 devstack@n-api.service[104224]: WARNING keystonemiddleware.auth_token [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 00:57:22.318336 n-d-master-1 devstack@n-api.service[104225]: WARNING keystonemiddleware.auth_token [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 00:57:22.322175 n-d-master-1 devstack@n-api.service[104224]: WARNING keystonemiddleware.auth_token [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 00:57:22.665922 n-d-master-1 devstack@n-api.service[104224]: WARNING keystonemiddleware.auth_token [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 00:57:22.667250 n-d-master-1 devstack@n-api.service[104225]: WARNING keystonemiddleware.auth_token [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 00:57:22.671799 n-d-master-1 devstack@n-api.service[104224]: WARNING keystonemiddleware.auth_token [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 00:57:22.673174 n-d-master-1 devstack@n-api.service[104225]: WARNING keystonemiddleware.auth_token [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 00:57:22.677022 n-d-master-1 devstack@n-api.service[104224]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5305d79c0 pid: 104224 (default app) Jul 24 00:57:22.678431 n-d-master-1 devstack@n-api.service[104225]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5305d79c0 pid: 104225 (default app) Jul 24 00:57:22.679106 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:57:22.680371 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-71dca608-2ac1-4105-9c75-fd954fe59523 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001793 Jul 24 00:57:22.680784 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Sun Jul 24 00:57:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:58:40.970266 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:58:40.971482 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Jul 24 00:58:40.971893 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:58:40.983494 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writing DB stats nova_api:SELECT=3 {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.984353 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writing DB stats nova_cell1:SELECT=3 {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.985080 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writing DB stats nova_cell0:SELECT=3 {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.985988 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.854844 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-b7274d7e-2a03-4947-aa31-4b68421ddf05 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:58:41.884898 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-b7274d7e-2a03-4947-aa31-4b68421ddf05 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.906759 Jul 24 00:58:41.885790 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 00:58:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:44.645432 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:58:44.647216 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-56969014-3fc9-4e67-88a5-bd46b3a33254 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 24 00:58:44.648106 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 2/4] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:58:45.227191 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-21c8f369-5f5f-4f5d-82b3-6855e9c53140 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "disk": 1, "ram": 256, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:45.262437 n-d-master-1 devstack@n-api.service[104224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 00:58:45.262437 n-d-master-1 devstack@n-api.service[104224]: warnings.warn(msg) Jul 24 00:58:45.299258 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-21c8f369-5f5f-4f5d-82b3-6855e9c53140 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.644608 Jul 24 00:58:45.312183 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 3/5] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:58:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 00:58:45.322463 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writing DB stats nova_api:SELECT=3 {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:45.323679 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writing DB stats nova_cell1:SELECT=3 {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:45.324587 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writing DB stats nova_cell0:SELECT=3 {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:45.325752 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:45.592988 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-6fba64b0-0624-4a5b-81fc-66eac99a698d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:45.597160 n-d-master-1 devstack@n-api.service[104225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 00:58:45.597160 n-d-master-1 devstack@n-api.service[104225]: warnings.warn(msg) Jul 24 00:58:45.695380 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-6fba64b0-0624-4a5b-81fc-66eac99a698d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.379874 Jul 24 00:58:45.696425 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 3/6] 10.222.0.27 () {64 vars in 1335 bytes} [Sun Jul 24 00:58:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:48.323757 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-21c8f369-5f5f-4f5d-82b3-6855e9c53140 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:58:48.325835 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-21c8f369-5f5f-4f5d-82b3-6855e9c53140 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002861 Jul 24 00:58:48.326910 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 4/7] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:58:48 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:58:49.357308 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-6348b613-593c-486d-9525-d3fc4c2a0e08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "ram": 512, "id": "d1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:49.397349 n-d-master-1 devstack@n-api.service[104225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 00:58:49.397349 n-d-master-1 devstack@n-api.service[104225]: warnings.warn(msg) Jul 24 00:58:49.431304 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-6348b613-593c-486d-9525-d3fc4c2a0e08 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.094984 Jul 24 00:58:49.432550 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 4/8] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:58:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:58:49.449256 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-bf747dc8-cc06-44c5-8ade-b40ae46753e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:49.451541 n-d-master-1 devstack@n-api.service[104224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 00:58:49.451541 n-d-master-1 devstack@n-api.service[104224]: warnings.warn(msg) Jul 24 00:58:49.555544 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-bf747dc8-cc06-44c5-8ade-b40ae46753e1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110183 Jul 24 00:58:49.557078 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 5/9] 10.222.0.27 () {64 vars in 1335 bytes} [Sun Jul 24 00:58:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:52.105107 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-6348b613-593c-486d-9525-d3fc4c2a0e08 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:58:52.106146 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-6348b613-593c-486d-9525-d3fc4c2a0e08 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 24 00:58:52.106812 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:58:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:58:53.072559 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-a517081a-051f-444f-ab59-c256755d2be0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:53.096279 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-a517081a-051f-444f-ab59-c256755d2be0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.982962 Jul 24 00:58:53.105647 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 6/11] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:58:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:58:53.111592 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-4cd80b08-e21f-4516-91c4-1630d62d85a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:53.143065 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-4cd80b08-e21f-4516-91c4-1630d62d85a0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035747 Jul 24 00:58:53.144697 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 6/12] 10.222.0.27 () {64 vars in 1335 bytes} [Sun Jul 24 00:58:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:56.075136 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-a517081a-051f-444f-ab59-c256755d2be0 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:58:56.076375 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-a517081a-051f-444f-ab59-c256755d2be0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001924 Jul 24 00:58:56.077165 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 7/13] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:58:56.737468 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-7db9eeef-6349-47d2-9202-72a712d5e5b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:56.760187 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-7db9eeef-6349-47d2-9202-72a712d5e5b1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.672326 Jul 24 00:58:56.761189 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 7/14] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:58:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:58:56.775213 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-c4cab28f-1643-49da-9e24-d80debcc27fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:56.809825 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-c4cab28f-1643-49da-9e24-d80debcc27fb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038946 Jul 24 00:58:56.811114 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 8/15] 10.222.0.27 () {64 vars in 1335 bytes} [Sun Jul 24 00:58:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 00:58:59.308182 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-7db9eeef-6349-47d2-9202-72a712d5e5b1 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:58:59.309927 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-7db9eeef-6349-47d2-9202-72a712d5e5b1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Jul 24 00:58:59.310596 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 8/16] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:58:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:58:59.972854 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-9c0199c1-9057-4489-9dac-71ebc46642e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "ram": 4096}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:58:59.995701 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-9c0199c1-9057-4489-9dac-71ebc46642e6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.677494 Jul 24 00:58:59.996596 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 9/17] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:58:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:00.012981 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-09e65073-0cbe-4c3d-bbde-5a10258ccbd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:00.059022 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-09e65073-0cbe-4c3d-bbde-5a10258ccbd7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053663 Jul 24 00:59:00.059794 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 9/18] 10.222.0.27 () {64 vars in 1335 bytes} [Sun Jul 24 00:59:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:59:02.868501 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-9c0199c1-9057-4489-9dac-71ebc46642e6 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:02.870923 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-9c0199c1-9057-4489-9dac-71ebc46642e6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003394 Jul 24 00:59:02.871467 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 10/19] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:03.504527 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-8e6444cf-d186-4d99-96f0-b118718eeb3c admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:03.534779 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-8e6444cf-d186-4d99-96f0-b118718eeb3c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.656488 Jul 24 00:59:03.552433 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 10/20] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 00:59:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 00:59:06.519149 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-9c0199c1-9057-4489-9dac-71ebc46642e6 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:06.520765 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-9c0199c1-9057-4489-9dac-71ebc46642e6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Jul 24 00:59:06.521431 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 11/21] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:07.146934 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-c7a1e3c4-4cb7-4032-848c-d6ab866ac0cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "ram": 512}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:07.170950 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-c7a1e3c4-4cb7-4032-848c-d6ab866ac0cd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.639738 Jul 24 00:59:07.171730 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 11/22] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:59:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:07.188601 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-95c19db9-0e4b-42b8-9f54-3cb5b9793527 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:07.223322 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-95c19db9-0e4b-42b8-9f54-3cb5b9793527 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041122 Jul 24 00:59:07.223932 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 12/23] 10.222.0.27 () {64 vars in 1332 bytes} [Sun Jul 24 00:59:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:59:09.880287 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-c7a1e3c4-4cb7-4032-848c-d6ab866ac0cd admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:09.882022 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-c7a1e3c4-4cb7-4032-848c-d6ab866ac0cd admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002441 Jul 24 00:59:09.882570 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 00:59:10.468633 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-bc10eb6c-1e26-44af-ab4b-05892c0955dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:10.494870 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-bc10eb6c-1e26-44af-ab4b-05892c0955dc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.603398 Jul 24 00:59:10.495875 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 13/25] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:59:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:10.513003 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-1f81fedb-4fcb-440c-b4c9-70763596de65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:10.550846 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-1f81fedb-4fcb-440c-b4c9-70763596de65 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043463 Jul 24 00:59:10.551429 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 13/26] 10.222.0.27 () {64 vars in 1332 bytes} [Sun Jul 24 00:59:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:59:13.014983 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-bc10eb6c-1e26-44af-ab4b-05892c0955dc admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:13.016268 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-bc10eb6c-1e26-44af-ab4b-05892c0955dc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jul 24 00:59:13.016690 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 00:59:13.564334 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-23f03dd7-a8f3-4f54-aac3-b49ec82364c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:13.586256 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-23f03dd7-a8f3-4f54-aac3-b49ec82364c1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.559429 Jul 24 00:59:13.586866 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 14/28] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:59:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:13.601402 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-992b9c8e-8b3d-486a-b618-4ee21406a2b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:13.605826 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.629156 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-992b9c8e-8b3d-486a-b618-4ee21406a2b4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033637 Jul 24 00:59:13.629770 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 15/29] 10.222.0.27 () {64 vars in 1332 bytes} [Sun Jul 24 00:59:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 00:59:15.981435 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-23f03dd7-a8f3-4f54-aac3-b49ec82364c1 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:15.982454 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-23f03dd7-a8f3-4f54-aac3-b49ec82364c1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 24 00:59:15.982856 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:16.421780 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-a3bbd358-f404-44a7-b203-c39ff4fbc88a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "vcpus": 4, "id": "4"}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:16.442813 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-a3bbd358-f404-44a7-b203-c39ff4fbc88a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453753 Jul 24 00:59:16.444573 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 16/31] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:59:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:16.457477 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-1ea3f199-5b3f-4df3-a6e1-5f64b378c80b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:16.486947 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-1ea3f199-5b3f-4df3-a6e1-5f64b378c80b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033646 Jul 24 00:59:16.488233 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 16/32] 10.222.0.27 () {64 vars in 1332 bytes} [Sun Jul 24 00:59:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:59:18.832487 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-a3bbd358-f404-44a7-b203-c39ff4fbc88a admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:18.833510 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-a3bbd358-f404-44a7-b203-c39ff4fbc88a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 24 00:59:18.834314 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 17/33] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:19.289620 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-50fe87ff-67f3-415c-8ce0-c9833a044871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:19.294862 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.310802 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-50fe87ff-67f3-415c-8ce0-c9833a044871 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.469073 Jul 24 00:59:19.311360 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 17/34] 10.222.0.27 () {64 vars in 1282 bytes} [Sun Jul 24 00:59:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:19.323447 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-ea7a0a28-f121-4f62-9dad-8c8fc7bbd9dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:19.347089 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-ea7a0a28-f121-4f62-9dad-8c8fc7bbd9dd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027514 Jul 24 00:59:19.347791 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 18/35] 10.222.0.27 () {64 vars in 1332 bytes} [Sun Jul 24 00:59:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 00:59:42.790474 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-50fe87ff-67f3-415c-8ce0-c9833a044871 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:42.791542 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-50fe87ff-67f3-415c-8ce0-c9833a044871 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Jul 24 00:59:42.791977 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 18/36] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 00:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:42.803269 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.333347 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-a533db9b-8914-4fde-a95b-812db18e42d6 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:43.354721 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-a533db9b-8914-4fde-a95b-812db18e42d6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.555730 Jul 24 00:59:43.355383 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 19/37] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 00:59:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 00:59:44.607113 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-50fe87ff-67f3-415c-8ce0-c9833a044871 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:44.609303 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-50fe87ff-67f3-415c-8ce0-c9833a044871 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003119 Jul 24 00:59:44.610303 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 19/38] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:45.292017 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-34d49eed-2a51-4398-b154-786b9a38efb4 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:45.298709 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.wsgi [None req-34d49eed-2a51-4398-b154-786b9a38efb4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-34d49eed-2a51-4398-b154-786b9a38efb4 admin admin] Request method failure captured: Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: Accept: application/json Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: Accept-Encoding: gzip, deflate Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: Connection: keep-alive Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: Content-Length: 0 Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: Host: 10.222.0.27 Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: Openstack-Api-Version: compute 2.90 Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: Openstack-System-Scope: None Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: User-Agent: python-novaclient Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Auth-Token: gAAAAABi3JmA63rVFBSiCtPlO5TgDEwegPULctJnlkY2xTuNt1_A4fj1esle2LZ5zipv163xZyjwmqAT9cWAkpBl6TTfILFObED48jVRrfDTCRFD6fn0k7SEeqh2jNEF-WTqBIx6ApMcljaoOdKj6tEtQnTtz_m4HU6-sCY8-F_x3WuuvnUQr_A Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Domain-Id: None Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Domain-Name: None Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Identity-Status: Confirmed Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Is-Admin-Project: True Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Project-Domain-Id: default Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Project-Domain-Name: Default Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Project-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Project-Name: admin Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Role: admin,reader,member Jul 24 00:59:45.303072 n-d-master-1 devstack@n-api.service[104224]: X-Roles: admin,reader,member Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a456f944370a42eaa59b5a1926c8339d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-Tenant: admin Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-Tenant-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-Tenant-Name: admin Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-User: admin Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-User-Domain-Id: default Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-User-Domain-Name: Default Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-User-Id: e0e735ce611649f28deffe005a930461 Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: X-User-Name: admin Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: method: > Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: exception: Flavor 42 could not be found. Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: action_args: {'id': '42'} Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 00:59:45.305480 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:45.307054 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.309696 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-34d49eed-2a51-4398-b154-786b9a38efb4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 00:59:45.312381 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-34d49eed-2a51-4398-b154-786b9a38efb4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.525553 Jul 24 00:59:45.312381 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 00:59:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 527 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:45.318502 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-f90f400c-c8ce-4360-a0e1-bdc8d8b88666 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:45.346922 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-f90f400c-c8ce-4360-a0e1-bdc8d8b88666 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034074 Jul 24 00:59:45.347565 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 20/40] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 00:59:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 00:59:45.360401 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-5169f46c-f8a6-480b-8431-302a71ee88b6 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:45.394825 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-5169f46c-f8a6-480b-8431-302a71ee88b6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.039681 Jul 24 00:59:45.395479 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 00:59:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 00:59:45.407387 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-7ed3c228-83a6-401b-8113-63440ff8f86e admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:45.414436 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.wsgi [None req-7ed3c228-83a6-401b-8113-63440ff8f86e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-7ed3c228-83a6-401b-8113-63440ff8f86e admin admin] Request method failure captured: Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: Accept: application/json Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: Accept-Encoding: gzip, deflate Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: Connection: keep-alive Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: Content-Length: 0 Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: Host: 10.222.0.27 Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: Openstack-Api-Version: compute 2.90 Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: Openstack-System-Scope: None Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: User-Agent: python-novaclient Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Auth-Token: gAAAAABi3JmA63rVFBSiCtPlO5TgDEwegPULctJnlkY2xTuNt1_A4fj1esle2LZ5zipv163xZyjwmqAT9cWAkpBl6TTfILFObED48jVRrfDTCRFD6fn0k7SEeqh2jNEF-WTqBIx6ApMcljaoOdKj6tEtQnTtz_m4HU6-sCY8-F_x3WuuvnUQr_A Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Domain-Id: None Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Domain-Name: None Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Identity-Status: Confirmed Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Is-Admin-Project: True Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Project-Domain-Id: default Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Project-Domain-Name: Default Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Project-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Project-Name: admin Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Role: admin,reader,member Jul 24 00:59:45.418025 n-d-master-1 devstack@n-api.service[104225]: X-Roles: admin,reader,member Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a456f944370a42eaa59b5a1926c8339d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-Tenant: admin Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-Tenant-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-Tenant-Name: admin Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-User: admin Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-User-Domain-Id: default Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-User-Domain-Name: Default Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-User-Id: e0e735ce611649f28deffe005a930461 Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: X-User-Name: admin Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: method: > Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: exception: Flavor 42 could not be found. Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: action_args: {'id': '42'} Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 00:59:45.419668 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:45.420722 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:45.422955 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-7ed3c228-83a6-401b-8113-63440ff8f86e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 00:59:45.425020 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-7ed3c228-83a6-401b-8113-63440ff8f86e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016051 Jul 24 00:59:45.425020 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 21/42] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 00:59:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:46.487748 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-5169f46c-f8a6-480b-8431-302a71ee88b6 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:46.488918 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-5169f46c-f8a6-480b-8431-302a71ee88b6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Jul 24 00:59:46.489523 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:47.110155 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-0823972d-aa41-40ae-8dab-e388d7f50a0f admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:47.116954 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.wsgi [None req-0823972d-aa41-40ae-8dab-e388d7f50a0f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-0823972d-aa41-40ae-8dab-e388d7f50a0f admin admin] Request method failure captured: Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: Accept: application/json Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: Accept-Encoding: gzip, deflate Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: Connection: keep-alive Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: Content-Length: 0 Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: Host: 10.222.0.27 Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: Openstack-Api-Version: compute 2.90 Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: Openstack-System-Scope: None Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: User-Agent: python-novaclient Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Auth-Token: gAAAAABi3JmChPhO5p--RDZtD1frS31f5e8pQ2zO57kSGdj5hvzrTs6P6GZEE960FfwGMDg3ofW3PTZM7qPg8FjhjVHxiNqp0ei2l6FB6OCJN1ScfwxX18qsj5yVShLpRMfAQu99mjRzyRkjtQmo9_lG7bvrmLztn7eY2XHcYAXF25KIV4omEWc Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Domain-Id: None Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Domain-Name: None Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Identity-Status: Confirmed Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Is-Admin-Project: True Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Project-Domain-Id: default Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Project-Domain-Name: Default Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Project-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Project-Name: admin Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Role: admin,reader,member Jul 24 00:59:47.118865 n-d-master-1 devstack@n-api.service[104225]: X-Roles: admin,reader,member Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a456f944370a42eaa59b5a1926c8339d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-Tenant: admin Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-Tenant-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-Tenant-Name: admin Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-User: admin Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-User-Domain-Id: default Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-User-Domain-Name: Default Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-User-Id: e0e735ce611649f28deffe005a930461 Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: X-User-Name: admin Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: method: > Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: exception: Flavor 84 could not be found. Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: action_args: {'id': '84'} Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 00:59:47.120523 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:47.121405 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.122479 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-0823972d-aa41-40ae-8dab-e388d7f50a0f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 00:59:47.124072 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-0823972d-aa41-40ae-8dab-e388d7f50a0f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.482977 Jul 24 00:59:47.124072 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 00:59:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:47.130282 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-942a7b42-56ca-458d-bd71-cc3fc83b90f9 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:47.145825 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-942a7b42-56ca-458d-bd71-cc3fc83b90f9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019041 Jul 24 00:59:47.146429 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 00:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 00:59:47.158109 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-3fa9f8ff-7377-49ef-ad66-aa1cc194ecd5 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:47.173464 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-3fa9f8ff-7377-49ef-ad66-aa1cc194ecd5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019752 Jul 24 00:59:47.174092 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 00:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 00:59:47.185270 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-23c8620e-a4c0-4b50-b459-9d7313f2a700 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:47.191159 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.wsgi [None req-23c8620e-a4c0-4b50-b459-9d7313f2a700 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-23c8620e-a4c0-4b50-b459-9d7313f2a700 admin admin] Request method failure captured: Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: Accept: application/json Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: Accept-Encoding: gzip, deflate Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: Connection: keep-alive Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: Content-Length: 0 Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: Host: 10.222.0.27 Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: Openstack-Api-Version: compute 2.90 Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: Openstack-System-Scope: None Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: User-Agent: python-novaclient Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Auth-Token: gAAAAABi3JmChPhO5p--RDZtD1frS31f5e8pQ2zO57kSGdj5hvzrTs6P6GZEE960FfwGMDg3ofW3PTZM7qPg8FjhjVHxiNqp0ei2l6FB6OCJN1ScfwxX18qsj5yVShLpRMfAQu99mjRzyRkjtQmo9_lG7bvrmLztn7eY2XHcYAXF25KIV4omEWc Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Domain-Id: None Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Domain-Name: None Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Identity-Status: Confirmed Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Is-Admin-Project: True Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Project-Domain-Id: default Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Project-Domain-Name: Default Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Project-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Project-Name: admin Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Role: admin,reader,member Jul 24 00:59:47.192857 n-d-master-1 devstack@n-api.service[104224]: X-Roles: admin,reader,member Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a456f944370a42eaa59b5a1926c8339d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-Tenant: admin Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-Tenant-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-Tenant-Name: admin Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-User: admin Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-User-Domain-Id: default Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-User-Domain-Name: Default Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-User-Id: e0e735ce611649f28deffe005a930461 Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: X-User-Name: admin Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: method: > Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: exception: Flavor 84 could not be found. Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: action_args: {'id': '84'} Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 00:59:47.194963 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:47.195945 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:47.197088 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-23c8620e-a4c0-4b50-b459-9d7313f2a700 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 00:59:47.198124 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-23c8620e-a4c0-4b50-b459-9d7313f2a700 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013127 Jul 24 00:59:47.198457 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 24/47] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 00:59:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 24 00:59:48.337929 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-3fa9f8ff-7377-49ef-ad66-aa1cc194ecd5 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:48.338966 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-3fa9f8ff-7377-49ef-ad66-aa1cc194ecd5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 24 00:59:48.339412 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 24/48] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:48.931481 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-92c90454-16fd-457f-927c-7d933d010408 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:48.937219 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.wsgi [None req-92c90454-16fd-457f-927c-7d933d010408 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-92c90454-16fd-457f-927c-7d933d010408 admin admin] Request method failure captured: Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: Accept: application/json Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: Accept-Encoding: gzip, deflate Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: Connection: keep-alive Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: Content-Length: 0 Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: Host: 10.222.0.27 Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: Openstack-Api-Version: compute 2.90 Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: Openstack-System-Scope: None Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: User-Agent: python-novaclient Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Auth-Token: gAAAAABi3JmESK0aYrtiR36JoQfjzCuDUw45f4mX8BxP_yMz6OSZqZtnRHlgnkBxUGO7fRYgpj6pTugRhOq4Jha9OykPWkci69FjLW_-qOuSA22jRO1_4QbzjrKXxg7NXPocNvI8yM3SBETgncj2oxweEgOewmLKLIYHyX85tuByNrjzSXpUJvw Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Domain-Id: None Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Domain-Name: None Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Identity-Status: Confirmed Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Is-Admin-Project: True Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Project-Domain-Id: default Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Project-Domain-Name: Default Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Project-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Project-Name: admin Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Role: admin,reader,member Jul 24 00:59:48.938753 n-d-master-1 devstack@n-api.service[104224]: X-Roles: admin,reader,member Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a456f944370a42eaa59b5a1926c8339d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-Tenant: admin Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-Tenant-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-Tenant-Name: admin Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-User: admin Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-User-Domain-Id: default Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-User-Domain-Name: Default Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-User-Id: e0e735ce611649f28deffe005a930461 Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: X-User-Name: admin Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: method: > Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: exception: Flavor 451 could not be found. Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: action_args: {'id': '451'} Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 00:59:48.940063 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:48.940946 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: ERROR nova.api.openstack.wsgi Jul 24 00:59:48.941986 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-92c90454-16fd-457f-927c-7d933d010408 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 00:59:48.943196 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-92c90454-16fd-457f-927c-7d933d010408 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.460254 Jul 24 00:59:48.943196 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 25/49] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 00:59:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 462 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:48.950142 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-febcf406-4e55-4b31-931e-5cf2c12045e3 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:48.964500 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-febcf406-4e55-4b31-931e-5cf2c12045e3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017916 Jul 24 00:59:48.965062 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 25/50] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 00:59:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 00:59:48.974883 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:48.990354 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018965 Jul 24 00:59:48.990902 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 26/51] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 00:59:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 00:59:49.000681 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-1a851e69-2464-4b18-adee-478aff759667 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:49.006128 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.wsgi [None req-1a851e69-2464-4b18-adee-478aff759667 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-1a851e69-2464-4b18-adee-478aff759667 admin admin] Request method failure captured: Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: Accept: application/json Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: Accept-Encoding: gzip, deflate Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: Connection: keep-alive Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: Content-Length: 0 Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: Host: 10.222.0.27 Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: Openstack-Api-Version: compute 2.90 Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: Openstack-System-Scope: None Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: User-Agent: python-novaclient Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Auth-Token: gAAAAABi3JmESK0aYrtiR36JoQfjzCuDUw45f4mX8BxP_yMz6OSZqZtnRHlgnkBxUGO7fRYgpj6pTugRhOq4Jha9OykPWkci69FjLW_-qOuSA22jRO1_4QbzjrKXxg7NXPocNvI8yM3SBETgncj2oxweEgOewmLKLIYHyX85tuByNrjzSXpUJvw Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Domain-Id: None Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Domain-Name: None Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Identity-Status: Confirmed Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Is-Admin-Project: True Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Openstack-Nova-Api-Version: 2.90 Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Project-Domain-Id: default Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Project-Domain-Name: Default Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Project-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Project-Name: admin Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Role: admin,reader,member Jul 24 00:59:49.008137 n-d-master-1 devstack@n-api.service[104225]: X-Roles: admin,reader,member Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a456f944370a42eaa59b5a1926c8339d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a456f944370a42eaa59b5a1926c8339d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-Tenant: admin Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-Tenant-Id: a456f944370a42eaa59b5a1926c8339d Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-Tenant-Name: admin Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-User: admin Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-User-Domain-Id: default Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-User-Domain-Name: Default Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-User-Id: e0e735ce611649f28deffe005a930461 Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: X-User-Name: admin Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: method: > Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: exception: Flavor 451 could not be found. Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: action_args: {'id': '451'} Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 00:59:49.009786 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:49.010738 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: ERROR nova.api.openstack.wsgi Jul 24 00:59:49.011800 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-1a851e69-2464-4b18-adee-478aff759667 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 00:59:49.012780 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-1a851e69-2464-4b18-adee-478aff759667 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012700 Jul 24 00:59:49.012780 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 26/52] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 00:59:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 24 00:59:49.995114 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:49.996119 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 24 00:59:49.996515 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:50.549049 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-1b45d377-7455-46d4-94f1-02f6a6f6ab65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:50.569369 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-1b45d377-7455-46d4-94f1-02f6a6f6ab65 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.430256 Jul 24 00:59:50.570065 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 27/54] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Jul 24 00:59:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:51.566336 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:51.567393 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 24 00:59:51.567905 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:52.120780 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-94ba4e9a-8233-42a7-9e8c-e21d0be38136 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:52.139092 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-94ba4e9a-8233-42a7-9e8c-e21d0be38136 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.429513 Jul 24 00:59:52.139657 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 28/56] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Jul 24 00:59:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:53.159478 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:53.160497 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 24 00:59:53.160915 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 29/57] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:53.699691 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-e5fdffd2-9eed-4703-a42b-8d2b96f496ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:53.717790 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-e5fdffd2-9eed-4703-a42b-8d2b96f496ae admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.416231 Jul 24 00:59:53.718348 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 29/58] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Jul 24 00:59:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:54.700879 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:54.701953 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 24 00:59:54.702358 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 30/59] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:55.260978 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-66a4f9b8-4774-4429-b475-051169ddc82a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 00:59:55.283658 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-66a4f9b8-4774-4429-b475-051169ddc82a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.442285 Jul 24 00:59:55.284218 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 30/60] 10.222.0.27 () {64 vars in 1235 bytes} [Sun Jul 24 00:59:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:56.313391 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:56.314494 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 24 00:59:56.314892 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 31/61] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 00:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 00:59:56.875102 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-ae5a39ea-79d7-4693-b078-7e678ac5ff76 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 00:59:56.894118 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-ae5a39ea-79d7-4693-b078-7e678ac5ff76 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.438286 Jul 24 00:59:56.894654 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 31/62] 10.222.0.27 () {60 vars in 1202 bytes} [Sun Jul 24 00:59:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:00:51.107166 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:00:51.108183 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-041eac54-17a7-466d-9556-6aeddfe221ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 24 01:00:51.108611 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 32/63] 10.222.0.27 () {54 vars in 930 bytes} [Sun Jul 24 01:00:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:00:51.120494 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:51.535839 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-3702d59a-9143-4aa0-8801-7e2b74e5992d admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:00:51.556660 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-3702d59a-9143-4aa0-8801-7e2b74e5992d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441564 Jul 24 01:00:51.557268 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 32/64] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 01:00:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:00:51.583374 n-d-master-1 devstack@n-api.service[104224]: DEBUG dbcounter [-] [104224] Writing DB stats nova_api:SELECT=14 {{(pid=104224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:51.588332 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-f7aa2331-a2f4-45e4-a30f-0250f8267762 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:00:51.596880 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-f7aa2331-a2f4-45e4-a30f-0250f8267762 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015074 Jul 24 01:00:51.597446 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 33/65] 10.222.0.27 () {60 vars in 1282 bytes} [Sun Jul 24 01:00:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:00:51.610160 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-a5583980-b196-4072-90fe-f816cd7e9911 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:00:51.619219 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-a5583980-b196-4072-90fe-f816cd7e9911 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012783 Jul 24 01:00:51.619786 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 33/66] 10.222.0.27 () {60 vars in 1285 bytes} [Sun Jul 24 01:00:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:00:51.633004 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-3ea12c45-4d4d-4172-a1bc-20759708d000 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:00:51.641391 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-3ea12c45-4d4d-4172-a1bc-20759708d000 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012775 Jul 24 01:00:51.642013 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 34/67] 10.222.0.27 () {60 vars in 1285 bytes} [Sun Jul 24 01:00:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:00:51.654746 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-b9655201-916a-45f0-a571-50f308a105bd admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:00:51.663076 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-b9655201-916a-45f0-a571-50f308a105bd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012034 Jul 24 01:00:51.663675 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 34/68] 10.222.0.27 () {60 vars in 1282 bytes} [Sun Jul 24 01:00:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:06:27.533168 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-3ea12c45-4d4d-4172-a1bc-20759708d000 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:27.534228 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-3ea12c45-4d4d-4172-a1bc-20759708d000 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 24 01:06:27.534633 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 35/69] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 01:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:06:27.676999 n-d-master-1 devstack@n-api.service[104225]: DEBUG dbcounter [-] [104225] Writing DB stats nova_api:SELECT=6 {{(pid=104225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:27.819854 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-24c305fd-7d85-4627-ad5a-8e412ac668d8 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:27.821023 n-d-master-1 devstack@n-api.service[104225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:06:27.821023 n-d-master-1 devstack@n-api.service[104225]: warnings.warn(msg) Jul 24 01:06:27.822255 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-24c305fd-7d85-4627-ad5a-8e412ac668d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:06:27.822696 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-24c305fd-7d85-4627-ad5a-8e412ac668d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:06:27.823483 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-24c305fd-7d85-4627-ad5a-8e412ac668d8 admin admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:06:27.823910 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-24c305fd-7d85-4627-ad5a-8e412ac668d8 admin admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:06:27.864399 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-24c305fd-7d85-4627-ad5a-8e412ac668d8 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.188787 Jul 24 01:06:27.864911 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 35/70] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:06:27 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:06:28.693717 n-d-master-1 devstack@n-api.service[104224]: DEBUG nova.api.openstack.wsgi [None req-3ea12c45-4d4d-4172-a1bc-20759708d000 admin admin] Calling method '>' {{(pid=104224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:28.694724 n-d-master-1 devstack@n-api.service[104224]: INFO nova.api.openstack.requestlog [None req-3ea12c45-4d4d-4172-a1bc-20759708d000 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 24 01:06:28.695135 n-d-master-1 devstack@n-api.service[104224]: [pid: 104224|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1074 bytes} [Sun Jul 24 01:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:06:28.885803 n-d-master-1 devstack@n-api.service[104225]: DEBUG nova.api.openstack.wsgi [None req-7a4053e0-1d5e-4b12-ba2a-ce1a0791da20 admin admin] Calling method '>' {{(pid=104225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:06:28.886970 n-d-master-1 devstack@n-api.service[104225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:06:28.886970 n-d-master-1 devstack@n-api.service[104225]: warnings.warn(msg) Jul 24 01:06:28.888161 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-7a4053e0-1d5e-4b12-ba2a-ce1a0791da20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:06:28.888591 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-7a4053e0-1d5e-4b12-ba2a-ce1a0791da20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:06:28.889368 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-7a4053e0-1d5e-4b12-ba2a-ce1a0791da20 admin admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:06:28.889826 n-d-master-1 devstack@n-api.service[104225]: DEBUG oslo_concurrency.lockutils [None req-7a4053e0-1d5e-4b12-ba2a-ce1a0791da20 admin admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:06:28.913801 n-d-master-1 devstack@n-api.service[104225]: INFO nova.api.openstack.requestlog [None req-7a4053e0-1d5e-4b12-ba2a-ce1a0791da20 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.080611 Jul 24 01:06:28.914366 n-d-master-1 devstack@n-api.service[104225]: [pid: 104225|app: 0|req: 36/72] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:06:28 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:07:16.645078 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 24 01:07:16.645923 n-d-master-1 devstack@n-api.service[104223]: Sun Jul 24 01:07:16 2022 - graceful shutdown triggered... Jul 24 01:07:16.646461 n-d-master-1 devstack@n-api.service[104224]: Gracefully killing worker 1 (pid: 104224)... Jul 24 01:07:16.647123 n-d-master-1 devstack@n-api.service[104225]: Gracefully killing worker 2 (pid: 104225)... Jul 24 01:07:17.646699 n-d-master-1 devstack@n-api.service[104223]: worker 1 buried after 1 seconds Jul 24 01:07:17.646699 n-d-master-1 devstack@n-api.service[104223]: worker 2 buried after 1 seconds Jul 24 01:07:17.646699 n-d-master-1 devstack@n-api.service[104223]: goodbye to uWSGI. Jul 24 01:07:17.648247 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 24 01:07:17.648804 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 24 01:07:17.651499 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 24 01:07:17.668032 n-d-master-1 devstack@n-api.service[119544]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 24 01:07:17 2022] *** Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: nodename: n-d-master-1 Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: machine: x86_64 Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: clock source: unix Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: pcre jit disabled Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: detected number of CPU cores: 4 Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: current working directory: / Jul 24 01:07:17.670088 n-d-master-1 devstack@n-api.service[119544]: detected binary path: /usr/bin/uwsgi-core Jul 24 01:07:17.671009 n-d-master-1 devstack@n-api.service[119544]: your processes number limit is 47680 Jul 24 01:07:17.671009 n-d-master-1 devstack@n-api.service[119544]: your memory page size is 4096 bytes Jul 24 01:07:17.671009 n-d-master-1 devstack@n-api.service[119544]: detected max file descriptor number: 2048 Jul 24 01:07:17.671009 n-d-master-1 devstack@n-api.service[119544]: lock engine: pthread robust mutexes Jul 24 01:07:17.671009 n-d-master-1 devstack@n-api.service[119544]: thunder lock: enabled Jul 24 01:07:17.671009 n-d-master-1 devstack@n-api.service[119544]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 24 01:07:17.671009 n-d-master-1 devstack@n-api.service[119544]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 24 01:07:17.715563 n-d-master-1 devstack@n-api.service[119544]: Python main interpreter initialized at 0x563a6da609c0 Jul 24 01:07:17.715834 n-d-master-1 devstack@n-api.service[119544]: python threads support enabled Jul 24 01:07:17.715977 n-d-master-1 devstack@n-api.service[119544]: your server socket listen backlog is limited to 100 connections Jul 24 01:07:17.716099 n-d-master-1 devstack@n-api.service[119544]: your mercy for graceful operations on workers is 90 seconds Jul 24 01:07:17.716532 n-d-master-1 devstack@n-api.service[119544]: mapped 403077 bytes (393 KB) for 2 cores Jul 24 01:07:17.716765 n-d-master-1 devstack@n-api.service[119544]: *** Operational MODE: preforking *** Jul 24 01:07:17.717193 n-d-master-1 devstack@n-api.service[119544]: *** uWSGI is running in multiple interpreter mode *** Jul 24 01:07:17.717336 n-d-master-1 devstack@n-api.service[119544]: spawned uWSGI master process (pid: 119544) Jul 24 01:07:17.717661 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 24 01:07:17.720258 n-d-master-1 devstack@n-api.service[119544]: spawned uWSGI worker 1 (pid: 119561, cores: 1) Jul 24 01:07:17.720258 n-d-master-1 devstack@n-api.service[119544]: spawned uWSGI worker 2 (pid: 119562, cores: 1) Jul 24 01:07:17.720258 n-d-master-1 devstack@n-api.service[119544]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 24 01:07:18.382389 n-d-master-1 devstack@n-api.service[119562]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 01:07:18.396388 n-d-master-1 devstack@n-api.service[119561]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 24 01:07:19.593731 n-d-master-1 devstack@n-api.service[119562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:07:19.593731 n-d-master-1 devstack@n-api.service[119562]: from cryptography.utils import int_from_bytes Jul 24 01:07:19.594688 n-d-master-1 devstack@n-api.service[119562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:07:19.594688 n-d-master-1 devstack@n-api.service[119562]: from cryptography.utils import int_from_bytes Jul 24 01:07:19.600222 n-d-master-1 devstack@n-api.service[119561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:07:19.600222 n-d-master-1 devstack@n-api.service[119561]: from cryptography.utils import int_from_bytes Jul 24 01:07:19.601047 n-d-master-1 devstack@n-api.service[119561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 01:07:19.601047 n-d-master-1 devstack@n-api.service[119561]: from cryptography.utils import int_from_bytes Jul 24 01:07:21.999816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 01:07:22.000339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 01:07:22.000825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 01:07:22.001194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 01:07:22.001450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 01:07:22.001870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.002199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.002524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.002843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.003184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.003493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.004032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.004519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.004860 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.005128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.006107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.006449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.006782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.007100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.007419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.007748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.008057 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.008390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.008699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.009204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.010612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.010612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.010612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.010969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.011236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.011482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.011798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.012109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.012427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.012747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.013153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.013471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.013807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.014125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.015193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.015756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.016170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.016478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.016805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.017114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.017448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.017797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.018121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.018450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.018760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.019070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.019386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.019705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.020016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.020325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.020578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.020889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.021210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.021535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.021886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.022140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.022391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.022711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.023033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.023343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.023652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.023960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.024267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.024574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.024879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.025185 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.025525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.025850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.026165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.026487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.026796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.027114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.027520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.027774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.028081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.028429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.028746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.029056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.029373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.029720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.030062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.030436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.030745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.031068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.031400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.031707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.031959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.032263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.032569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.032891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.033196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.033502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.033828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.034135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.034441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.034745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.035050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.035357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.035662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.035967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.036281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.036586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.036896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.037216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.037536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.037867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.038174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.038486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.038791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.039628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.039628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.039942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.040094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.040301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.040604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.041001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.041310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.041618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.041962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.042264 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.042572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.042901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.043212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.043519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.043811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.044113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.044417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.044719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.045029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.045331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.045631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.046103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.046400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.046711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.047016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.047323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.047640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.047978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.048316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.048664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.048978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.049307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.049637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.049977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.050289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.050601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.050991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.051235 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.051564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.051856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.052169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.052487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.052814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.053131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.053972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.053972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.054260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.054431 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.054916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.055092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.055318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.055741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.056074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.056439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.056801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.057094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.057453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.057734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.058047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.058377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.058715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.059027 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.059347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.059659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.059969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.060277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.060589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.060897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.061238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.062323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.062642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.062956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.063277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.063589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.063900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.064208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.064514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.065109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.065109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.065422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.065716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.066056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.066366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.066673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.067011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.067316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.067630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.067936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.068246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.068556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.068866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.069258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.069471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.069876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.070282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.070590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.070914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.071303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.071523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.071839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.072161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.072466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.072779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.073091 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.073413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.073744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.074084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.074395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.074724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.075030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.075359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.075678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.075997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.076301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.076612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.076970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.077856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.078166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.078486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.078794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.079196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.079399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.079703 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.080006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.080332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.080640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.080941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.081245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.081551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.081919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.082223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.082566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.082899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.083216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.083538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.083852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.084164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.084474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.084781 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.085091 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.085399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.085809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.086122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.086441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.086751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.087065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.087373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.087694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.087999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.088317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.088655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.088989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.089306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.089628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.089964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.090278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.090587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.090897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.091208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.091516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.091878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.092352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.092632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.092993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.093319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.093635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.094011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.094318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.094635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.094967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.095302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.095643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.095934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.096258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.096570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.096883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.097193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.097642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.097979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.098296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.098613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.098928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.099234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.099540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.099853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.100160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.100463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.101021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.101336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.101654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.102097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.102421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.102875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.103429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.103429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.103710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.104022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.104414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.104721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.105026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.105369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.105695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.106010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.106325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.106646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.106954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.107277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.107580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.107891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.108349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.108779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.109067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.109383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.109789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.110022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.110335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.110659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.111016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.111328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.111574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 01:07:22.112264 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.112428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 01:07:22.112600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.112600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.112894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 01:07:22.113068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.113243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 01:07:22.113243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 01:07:22.113522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.113701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.113804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.113892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.114061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.114199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.114282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.114410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.114505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.114724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.114911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.115038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.115169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.115574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.115717 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.115835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.115997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.116130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.116276 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.116276 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.116644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.116644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.116893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.117030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.117120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.117208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.117287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.118352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.118538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.118695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.118855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.119119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.119387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.119642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.119897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.120096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.120254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.120421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.120583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.120749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.120901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.121095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.121260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.121421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.121596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.121787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.121787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.121787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.123334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.124672 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.124857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.125023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.125176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.125338 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.125502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.125693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.125867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.126028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.126181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.126346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.126508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.126667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.126831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.126983 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.127154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.127306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.127458 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.127609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.127609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.127609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.127609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.128194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.128354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.128515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.128673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.128673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.128992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.129153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.129312 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.129463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.129623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.129826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.129989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.130143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.130294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.130445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.130611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.130772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.130942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.131095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.131253 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.131414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.131580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.131734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.131885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.132063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.132744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.132926 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.133310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.133479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.133651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.133854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.134017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.134181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.134343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.134497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.134647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.134808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.134961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.135121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.135281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.135440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.135592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.135758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.135919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.136085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.136085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.136390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.136390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.136698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.136851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.137014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.137182 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.137342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.137493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.137656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.137850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.138005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.138157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.138319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.138478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.138637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.138799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.138959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.139119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.139280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.139465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.139662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.139826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.139979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.140142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.140302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.140461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.140623 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.140775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.140926 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.141078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.141236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.141389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.141549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.141549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.141884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.142043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.142204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.142478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.142835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.143004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.143166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.143519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.143690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.143845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.144006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.144166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.144331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.144491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.144643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.144803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.144803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.145110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.145263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.145415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.145567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.145765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.145932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.146103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.146274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.146435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.146588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.146749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.146903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.147066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.147218 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.147377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.147529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.147688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.147848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.148008 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.148167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.148338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.148505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.148665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.148824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.148976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.149134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.149294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.149456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.149616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.149795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.149960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.150119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.150282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.150528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.150692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.150692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.150991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.151151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.151310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.151472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.151633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.151785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.151944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.152096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.152265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.152447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.152852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.153025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.153188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.153341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.153783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.153949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.154102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.154263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.154416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.154568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.154730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.154890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.155574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.155765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.155919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.156070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.156230 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.156390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.156550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.156712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.156873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.157025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.157177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.157338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.157498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.157660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.157850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.158017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.158177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.158330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.158481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.158481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.158791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.158945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.159097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.159255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.159417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.159569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.159731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.159883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.160042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.160201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.160367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.160527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.160679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.160837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.160998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.161149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.161309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.161461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.161612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.161833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.161998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.162170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.162324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.162483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.162643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.163005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.163165 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.163332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.163497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.163863 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.164028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.164190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.164358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.164520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.164683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.164836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.164988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 01:07:22.165147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.165301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.165467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.165620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.165798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.165952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.166115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.166287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.166454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.166454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.166760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.166921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.167082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.167248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.167409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.167561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.167713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.167864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.168016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.168180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.168351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.168504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.168655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.168806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.168957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.169117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.169269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.169269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.169580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.169580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.169914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.170076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.170229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.170229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.170543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.170783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.171049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.171775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.171966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.172131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.172285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.172436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.172603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.172756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.172937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.173218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.173373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.173531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.173727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.173727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.174248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.174401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.174553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.174719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.174879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.175032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.175192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.175343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.175513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.175676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.175837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.176004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.176157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.176318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.176493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.176663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.176824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.176984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.177138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.177302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.177505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.177701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.177864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.178017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.178168 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.178318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.178481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.178481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.178481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.178481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.179053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.179212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.179378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.179541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.179693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.179851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.180011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.180170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.180332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.180493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.180646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.180804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.180964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.181125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.181277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.181428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.181601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.181789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.181952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.182130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.182284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.182444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.182598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.182758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.182911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.183074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.183259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.183420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.183579 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.183743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.183903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.184232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.184401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.184555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.184714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.184869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.185107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.185282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.185438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.185590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.185808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.185974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.186151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.186345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.186600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.186800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.186966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.187119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.187283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.187450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.187604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.187765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.187919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.188071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.188237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.188404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.188566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.188721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.188881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.189048 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.189202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.189355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.189515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.189690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.189852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.190019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.190181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.190350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.190511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.190664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.190815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.190982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.191136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.191288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.191450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.191610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.191763 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.191927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.192118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.192285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.192459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.192620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.192866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193337 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.193905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.194377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.194532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.194704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.194867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.195029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.195182 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.195334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.195494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.195647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.195813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.195813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.196102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.196102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.196401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.196578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.196741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.196901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.197062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.197223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.197375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.197556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.197736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.197905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.198066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.198228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.198389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.198556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.198719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.198879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.199040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.199201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.199361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.199523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.199675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.199835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.199994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.200146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.200308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.200468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.200620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.200788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.200950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.201118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.201285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.201285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.201612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.201854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.202057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.202215 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.202376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.202376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.202667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.202819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.202983 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.203142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.203304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.203457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.203615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.203777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.203929 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.204096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.204257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.204417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.204576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.204728 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.204900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.205063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.205223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.205376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.205528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.205699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.205859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.206024 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.206178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.206330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.206481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.206641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.206802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.206973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.207135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.207288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.207446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.207606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.207766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.207926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.208086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.208240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.208399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.208550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.208550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.208869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.208869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.209985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.210445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.210605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.210770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.210927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.211080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.211232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.211398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.211558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.211710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.211864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.212021 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.212176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.212341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.212504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.212657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.212820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.212971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.213136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.213296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.213450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.213608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.213862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.214040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.214204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.214365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.214526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.214678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.214830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.215004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.215172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.215325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.215325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.215631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.215791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.215944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.216108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.216261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.216419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.216573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.216724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.216894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.217047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.217206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.217365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.218073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.218244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.218411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.218565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.218725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.218914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.219076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.219229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.219389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.219566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.219720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.219872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.220955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.221254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.221414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.221583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.221774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.221931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.222096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.222256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.222415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.222578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.222739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.222739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.223132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.223132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.223432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.223585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.223755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.223923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.224086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.224246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.224400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.224551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.224709 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.224871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.225025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.225177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.225338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.225498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.225953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.226119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.226272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.226431 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.226591 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.226750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.226909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.227078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.227240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.227392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.227898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.228068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.228224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.228397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.228559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.228719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.228891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.229172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.229341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.229503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.229663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.229908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.230061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.230226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.230393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.230547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.230709 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.230876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.231975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.232273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.232441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.232607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.232771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.232937 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.233090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.233321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.233503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.233665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.233844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.234015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.234249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.234420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.234574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.234733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.234908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.235075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.235237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.235397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.235560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.235713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.235865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.236015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.236166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.236317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.236482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.236650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.236650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.236960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.237120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.237280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.237447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.237610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.237801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.237964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.238124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.238287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.238446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.238600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.238752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.238903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.239074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.239241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.239394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.239553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.239706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.239865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.240025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.240192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.240352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.240505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.240656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.240817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.240979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.241140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.241292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.241451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.241603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.241801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.241974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.242136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.242289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.242447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.242447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.242751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.242914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.243090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.243252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.243463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.243631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.243784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.243952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.244113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.244274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.244427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.244620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.244857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.245019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.245183 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.245344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.245496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.245706 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.245883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.246039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.246191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.246342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.246500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.246702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.246867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.247022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.247181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.247352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.247505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.247665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.247829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.247990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.248143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.248295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.248455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.248618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.249292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.249455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.249609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.249795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.250014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.250189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.250343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.250502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.250662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.250822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.250982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.251153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.251316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.251476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.251629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.251781 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.251952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.252105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.252265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.252425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.252577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.252729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.252889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.253052 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.253203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.253364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.253562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.253739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.253916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.254089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.254243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.254396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.254548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.254699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.254860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.255020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.255172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.255324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.255478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.255643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.255806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.255977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.256138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.256298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.256462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.256625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.256785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.256945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.257106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.257266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.257419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.257587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.257809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.257966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.258129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.258292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.258454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.258615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.258775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.258927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.259086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.259247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.259414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.259569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.259569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.259873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.260025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.260187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.260348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.260500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.260653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.260811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.260964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.261115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.261280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.261447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.261608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.261810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.261966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.262132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.262296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.262447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.262606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.262760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.262921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.263091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.263244 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.263402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.263595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.263714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.263846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.263941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.264048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.264153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.264261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.264345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.264439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.265996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.266998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.267992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.268995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.269928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.270918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271691 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.271962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272244 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272244 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.272410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.273610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.274789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.274789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.274789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.275033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.275303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.275616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.276040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.276357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.276673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.277001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.277329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.277660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.277994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.278324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.278640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.278971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.279291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.279607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.279926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.280293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.281280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.281627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.281988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.282326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.282773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.283105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.283426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.283758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.284110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.284580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.284713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.285030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.285340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.285651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.286007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.286318 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.286634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.286950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.287267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.287575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.287887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.288214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.288525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.288853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.289178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.289505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.289858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.290171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.290499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.290819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.291129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.291439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.291748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.292096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.292407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.292732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.293069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.293403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.293741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.294084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.294435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.294798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.295064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.295395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.295742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.296266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.297063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.297380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.297724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.298030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.298349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.298660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.298971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.299279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.299610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.299921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.300246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.300561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.300870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.301187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.301653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.301940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.302575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.302575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.302825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.303156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.303489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.303803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.304138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.304463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.304929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.305304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.305457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.305722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.306047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.306368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.306685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.307003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.307320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.307642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.308232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.308562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.308889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.309199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.309531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.309940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.310339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.310575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.310897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.336567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.338436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.338436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.338436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.338436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.338436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.338436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.338436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.339539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.341273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.342914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.344857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.352261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.353300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.354959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.355733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.356679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.357615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.359535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.360351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.361926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.362647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.362647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.362868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.363060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.363388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.363705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.364040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.364391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.364727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.365061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.365373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.365708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.366021 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.366337 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.366665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.366981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.367292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.367600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.367916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.368223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.368532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.368840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.369151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.369461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.369799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.370108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.370413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.370721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.371029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.371335 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.371644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.371955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.372263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.372569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.372878 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.373186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.373523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.373935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.375332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.375678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.376005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.376339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.376670 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.376992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.377322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.377652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.377996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.378340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.378655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.378972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.379293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.379606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.379921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.380417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.380594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.380927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.381245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.381574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.381923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.382254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.382576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.382895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.383232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.383553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.383865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.384181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.384497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.384812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.385132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.385448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.385784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.386106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.386436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.386764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.387097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.387414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.387747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.388080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.388436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.388755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.389108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.389500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.390370 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.390691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.391005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 01:07:22.391253 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 01:07:22.422390 n-d-master-1 devstack@n-api.service[119562]: INFO dbcounter [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Registered counter for database nova_api Jul 24 01:07:22.444573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_db.sqlalchemy.engines [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.451681 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writer thread running {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:22.512542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.context [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=119562) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 01:07:22.516657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:07:22.518261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:07:22.519106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:07:22.521073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:07:22.523093 n-d-master-1 devstack@n-api.service[119562]: INFO dbcounter [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Registered counter for database nova_cell0 Jul 24 01:07:22.527211 n-d-master-1 devstack@n-api.service[119562]: INFO dbcounter [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Registered counter for database nova_cell1 Jul 24 01:07:22.535520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_db.sqlalchemy.engines [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.536341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_db.sqlalchemy.engines [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.544038 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writer thread running {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:22.545436 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writer thread running {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:22.548458 n-d-master-1 devstack@n-api.service[119561]: INFO dbcounter [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Registered counter for database nova_api Jul 24 01:07:22.569743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_db.sqlalchemy.engines [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.576364 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writer thread running {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:22.637401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.context [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=119561) load_cells /opt/stack/nova/nova/context.py:464}} Jul 24 01:07:22.642291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:07:22.643923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:07:22.644760 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:07:22.646799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:07:22.648825 n-d-master-1 devstack@n-api.service[119561]: INFO dbcounter [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Registered counter for database nova_cell0 Jul 24 01:07:22.653334 n-d-master-1 devstack@n-api.service[119561]: INFO dbcounter [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Registered counter for database nova_cell1 Jul 24 01:07:22.661402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_db.sqlalchemy.engines [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.663907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_db.sqlalchemy.engines [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.673084 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writer thread running {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:22.673428 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writer thread running {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:22.698721 n-d-master-1 devstack@n-api.service[119562]: INFO dbcounter [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Registered counter for database nova_cell0 Jul 24 01:07:22.706478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_db.sqlalchemy.engines [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.711433 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writer thread running {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:22.826423 n-d-master-1 devstack@n-api.service[119561]: INFO dbcounter [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Registered counter for database nova_cell0 Jul 24 01:07:22.836311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_db.sqlalchemy.engines [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 01:07:22.841695 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writer thread running {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 01:07:23.034840 n-d-master-1 devstack@n-api.service[119562]: WARNING keystonemiddleware.auth_token [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:07:23.042213 n-d-master-1 devstack@n-api.service[119562]: WARNING keystonemiddleware.auth_token [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:07:23.168339 n-d-master-1 devstack@n-api.service[119561]: WARNING keystonemiddleware.auth_token [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:07:23.176460 n-d-master-1 devstack@n-api.service[119561]: WARNING keystonemiddleware.auth_token [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:07:23.410740 n-d-master-1 devstack@n-api.service[119562]: WARNING keystonemiddleware.auth_token [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:07:23.417115 n-d-master-1 devstack@n-api.service[119562]: WARNING keystonemiddleware.auth_token [None req-94e89918-10e5-48a1-bf1c-f9cdd68624f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:07:23.424928 n-d-master-1 devstack@n-api.service[119562]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563a6da609c0 pid: 119562 (default app) Jul 24 01:07:23.526856 n-d-master-1 devstack@n-api.service[119561]: WARNING keystonemiddleware.auth_token [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 24 01:07:23.533596 n-d-master-1 devstack@n-api.service[119561]: WARNING keystonemiddleware.auth_token [None req-ecaa64e9-b6e8-4de6-af77-d18b5128269e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 24 01:07:23.539868 n-d-master-1 devstack@n-api.service[119561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563a6da609c0 pid: 119561 (default app) Jul 24 01:08:09.624222 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:09.626412 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:09.627679 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:09.628948 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.522412 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.523274 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.524038 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.529972 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:11.233968 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f4938cf9-268b-4514-a035-ae809767450b tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1281294467", "ram": 512, "vcpus": 1, "disk": 10, "id": 273295361, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:11.251953 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:11.251953 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:11.295866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f4938cf9-268b-4514-a035-ae809767450b tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.684338 Jul 24 01:08:11.296605 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:09 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:11.543437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Calling method '.version_select at 0x7f05f9c62e50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:11.545554 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:11.545554 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:11.552965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=119562) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 24 01:08:11.554209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.554832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.584533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.585310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.602162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.602659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.618171 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ce2b1ef-70d4-4eae-9878-6bf093105ded tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.320014 Jul 24 01:08:11.619332 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1207 bytes} [Sun Jul 24 01:08:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:08:11.679886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c38dd6af-6df6-432d-8a80-04214327acf2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Calling method '.version_select at 0x7f05f9c64ca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:11.682750 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:11.682750 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:11.684334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c38dd6af-6df6-432d-8a80-04214327acf2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.685549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c38dd6af-6df6-432d-8a80-04214327acf2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.686681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c38dd6af-6df6-432d-8a80-04214327acf2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.687307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c38dd6af-6df6-432d-8a80-04214327acf2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.734909 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c38dd6af-6df6-432d-8a80-04214327acf2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.228282 Jul 24 01:08:11.736191 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:08:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:11.758565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-30d70b78-0ec5-4ea5-a055-74056507244d tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:11.760452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30d70b78-0ec5-4ea5-a055-74056507244d tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.761118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30d70b78-0ec5-4ea5-a055-74056507244d tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.761945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30d70b78-0ec5-4ea5-a055-74056507244d tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.762556 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30d70b78-0ec5-4ea5-a055-74056507244d tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.824937 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-30d70b78-0ec5-4ea5-a055-74056507244d tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.204424 Jul 24 01:08:11.827790 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1163 bytes} [Sun Jul 24 01:08:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:11.833611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d889cca2-5881-4662-bc1b-85e705b743c3 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:11.837135 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:11.837135 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:11.875263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-217279a2-4783-427d-91ec-46809fb86abb tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:11.876869 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:11.876869 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:11.878704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-217279a2-4783-427d-91ec-46809fb86abb tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.879345 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-217279a2-4783-427d-91ec-46809fb86abb tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.880159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-217279a2-4783-427d-91ec-46809fb86abb tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:11.880818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-217279a2-4783-427d-91ec-46809fb86abb tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:11.905236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d889cca2-5881-4662-bc1b-85e705b743c3 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/273295361/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076061 Jul 24 01:08:11.906172 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 4/5] 10.222.0.27 () {60 vars in 1220 bytes} [Sun Jul 24 01:08:11 2022] POST /compute/v2.1/flavors/273295361/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:11.923027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-217279a2-4783-427d-91ec-46809fb86abb tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.185328 Jul 24 01:08:11.924806 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2/6] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:08:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:11.992635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '.version_select at 0x7f05f9b33ee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:11.993537 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:11.993537 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:12.002740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=119561) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 24 01:08:12.004368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:12.005020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:12.040160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37794cf8-ab47-4ff3-9a44-353506c2a23b tempest-AZAdminNegativeTestJSON-1237827228 tempest-AZAdminNegativeTestJSON-1237827228-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:12.041169 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.041169 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:12.042796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:12.043227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:12.043887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-37794cf8-ab47-4ff3-9a44-353506c2a23b tempest-AZAdminNegativeTestJSON-1237827228 tempest-AZAdminNegativeTestJSON-1237827228-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'edb236adac344c1e8dc1701f972c4ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0b26f8e49543df86e6bde6f426d56a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37794cf8-ab47-4ff3-9a44-353506c2a23b tempest-AZAdminNegativeTestJSON-1237827228 tempest-AZAdminNegativeTestJSON-1237827228-project] Request method failure captured: Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt4IguT6UURjbwAuB6MK-IP5sPyY3t9cqzzIdHCic6ctRZ77kOsCABjFJuwrx60JA3YUsE3EptJSIPHYbuYCC3DQj1_Iv8wfirqK0dQjCLkAErZHw9ZsTT6ZbmhB4HRgwxwJDZH_EnoeGSH2Bo0mUGC-AvFRuc-YSox5j-2prI_jIw Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 7e0b26f8e49543df86e6bde6f426d56a Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1237827228 Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:08:12.048131 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e0b26f8e49543df86e6bde6f426d56a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e0b26f8e49543df86e6bde6f426d56a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e0b26f8e49543df86e6bde6f426d56a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e0b26f8e49543df86e6bde6f426d56a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AZAdminNegativeTestJSON-1237827228 Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 7e0b26f8e49543df86e6bde6f426d56a Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1237827228 Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AZAdminNegativeTestJSON-1237827228-project Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: edb236adac344c1e8dc1701f972c4ad4 Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AZAdminNegativeTestJSON-1237827228-project Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 24 01:08:12.049181 n-d-master-1 devstack@n-api.service[119562]: action_args: {} Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:12.049802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 24 01:08:12.050660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.054026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37794cf8-ab47-4ff3-9a44-353506c2a23b tempest-AZAdminNegativeTestJSON-1237827228 tempest-AZAdminNegativeTestJSON-1237827228-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:12.055237 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-37794cf8-ab47-4ff3-9a44-353506c2a23b tempest-AZAdminNegativeTestJSON-1237827228 tempest-AZAdminNegativeTestJSON-1237827228-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.147663 Jul 24 01:08:12.062447 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 5/7] 10.222.0.27 () {58 vars in 1184 bytes} [Sun Jul 24 01:08:11 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 155 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:12.062574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:12.062910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:12.070351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-628ad48f-ff7d-4249-aea1-3a51213ae090 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1124027011"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:12.073451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fc91397a-464b-4ff0-8384-724ff8cfef66 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.147375 Jul 24 01:08:12.074704 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.074704 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:12.077238 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3/8] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:08:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:12.078925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-628ad48f-ff7d-4249-aea1-3a51213ae090 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Generated uuid 94b18391-f72a-472c-830b-809ae2bf4a45 for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:08:12.205292 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-628ad48f-ff7d-4249-aea1-3a51213ae090 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.140396 Jul 24 01:08:12.213748 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 6/9] 10.222.0.27 () {62 vars in 1204 bytes} [Sun Jul 24 01:08:12 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:12.214695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d0564bd7-4654-4984-8dc9-dce824476d06 tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:12.215558 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.215558 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:12.217295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0564bd7-4654-4984-8dc9-dce824476d06 tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:12.217772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0564bd7-4654-4984-8dc9-dce824476d06 tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:12.218602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0564bd7-4654-4984-8dc9-dce824476d06 tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:12.219036 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0564bd7-4654-4984-8dc9-dce824476d06 tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:12.282162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d0564bd7-4654-4984-8dc9-dce824476d06 tempest-AZAdminV2TestJSON-238082598 tempest-AZAdminV2TestJSON-238082598-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.070918 Jul 24 01:08:12.286351 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 7/10] 10.222.0.27 () {58 vars in 1184 bytes} [Sun Jul 24 01:08:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:12.302479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6906ccd6-0d0f-4fdd-a3df-3d70c71a6aa8 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Calling method '.version_select at 0x7f05f9af34c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:12.303429 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.303429 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:12.304881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6906ccd6-0d0f-4fdd-a3df-3d70c71a6aa8 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '00d0e7c10b7d4268af4d0947569f1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe7f092bc74aeb8d8d7c1990d97e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6906ccd6-0d0f-4fdd-a3df-3d70c71a6aa8 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Request method failure captured: Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt3283-hSKxKYgpL_Z3SKnn911zW1HJ72g1OdlPTYcARlhrHIV67dE_u2iEzg7l-QXa8woEuhaH8NNjZzGb0kIZScvyt9CTJpvtnu2i1jHonGgfNQ_L2NH37p4mfUddFR3u4JWyX2fpxHIKzN6MLp2FV6_8mSIDir-ALrYe2LyPzXE Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:08:12.317709 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24fe7f092bc74aeb8d8d7c1990d97e91", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 00d0e7c10b7d4268af4d0947569f1fce Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:08:12.318742 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:12.319458 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 24 01:08:12.320279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.321522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6906ccd6-0d0f-4fdd-a3df-3d70c71a6aa8 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:12.321522 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6906ccd6-0d0f-4fdd-a3df-3d70c71a6aa8 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.226085 Jul 24 01:08:12.325089 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 4/11] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:08:12 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 248 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:12.331759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8b1c364-02e4-4ff8-90e3-4bf94c3c9ef5 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1209065785"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:12.466815 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.466815 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:12.627276 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8b1c364-02e4-4ff8-90e3-4bf94c3c9ef5 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.300409 Jul 24 01:08:12.628286 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 5/12] 10.222.0.27 () {62 vars in 1209 bytes} [Sun Jul 24 01:08:12 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:12.633619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d42219f2-a2c3-4c5f-a34a-b034c18d0a93 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Calling method '.version_select at 0x7f05f9a934c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:12.634963 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.634963 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:12.638552 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d42219f2-a2c3-4c5f-a34a-b034c18d0a93 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '00d0e7c10b7d4268af4d0947569f1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe7f092bc74aeb8d8d7c1990d97e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d42219f2-a2c3-4c5f-a34a-b034c18d0a93 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Request method failure captured: Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt3283-hSKxKYgpL_Z3SKnn911zW1HJ72g1OdlPTYcARlhrHIV67dE_u2iEzg7l-QXa8woEuhaH8NNjZzGb0kIZScvyt9CTJpvtnu2i1jHonGgfNQ_L2NH37p4mfUddFR3u4JWyX2fpxHIKzN6MLp2FV6_8mSIDir-ALrYe2LyPzXE Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:08:12.643589 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24fe7f092bc74aeb8d8d7c1990d97e91", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 00d0e7c10b7d4268af4d0947569f1fce Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'n-d-master-1'} Jul 24 01:08:12.644945 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:12.645730 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 24 01:08:12.646839 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.652980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d42219f2-a2c3-4c5f-a34a-b034c18d0a93 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:12.654337 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d42219f2-a2c3-4c5f-a34a-b034c18d0a93 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.025093 Jul 24 01:08:12.660069 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 6/13] 10.222.0.27 () {58 vars in 1187 bytes} [Sun Jul 24 01:08:12 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:12.673171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5cec5ef-1359-4bfe-934b-8743d80882ba tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:12.674156 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.674156 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:12.693618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e5cec5ef-1359-4bfe-934b-8743d80882ba tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.032379 Jul 24 01:08:12.694886 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 7/14] 10.222.0.27 () {60 vars in 1189 bytes} [Sun Jul 24 01:08:12 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:12.701158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-019bf5b4-aa0b-46bf-8773-0e58acf49be3 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Calling method '.version_select at 0x7f05f9a93700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:12.709449 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.709449 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:12.746840 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-019bf5b4-aa0b-46bf-8773-0e58acf49be3 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-019bf5b4-aa0b-46bf-8773-0e58acf49be3 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:08:12.761851 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'nonexistent_hostname'} Jul 24 01:08:12.763494 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:08:12.764381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 24 01:08:12.765912 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:12.767762 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:12.770187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-019bf5b4-aa0b-46bf-8773-0e58acf49be3 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:12.771969 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-019bf5b4-aa0b-46bf-8773-0e58acf49be3 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.075315 Jul 24 01:08:12.779089 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1211 bytes} [Sun Jul 24 01:08:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:08:12.785753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b0406a0a-b4c2-4231-9c62-b7faddd48653 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:12.787612 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.787612 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:12.799275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0406a0a-b4c2-4231-9c62-b7faddd48653 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:12.799898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0406a0a-b4c2-4231-9c62-b7faddd48653 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:12.972268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-54f47ad2-1359-4dee-92f7-56aa49581d8d tempest-FlavorsExtraSpecsTestJSON-319905182 tempest-FlavorsExtraSpecsTestJSON-319905182-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:12.998222 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-54f47ad2-1359-4dee-92f7-56aa49581d8d tempest-FlavorsExtraSpecsTestJSON-319905182 tempest-FlavorsExtraSpecsTestJSON-319905182-project] 10.222.0.27 "GET /compute/v2.1/flavors/273295361/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.709757 Jul 24 01:08:12.999828 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1199 bytes} [Sun Jul 24 01:08:12 2022] GET /compute/v2.1/flavors/273295361/os-extra_specs => generated 66 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.010116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3574fecb-f213-4f23-a3e4-4fa20c8bc46f tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Calling method '.version_select at 0x7f05f9a56dc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.011694 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.011694 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.014264 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3574fecb-f213-4f23-a3e4-4fa20c8bc46f tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '00d0e7c10b7d4268af4d0947569f1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe7f092bc74aeb8d8d7c1990d97e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3574fecb-f213-4f23-a3e4-4fa20c8bc46f tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Request method failure captured: Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt3283-hSKxKYgpL_Z3SKnn911zW1HJ72g1OdlPTYcARlhrHIV67dE_u2iEzg7l-QXa8woEuhaH8NNjZzGb0kIZScvyt9CTJpvtnu2i1jHonGgfNQ_L2NH37p4mfUddFR3u4JWyX2fpxHIKzN6MLp2FV6_8mSIDir-ALrYe2LyPzXE Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:08:13.017442 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24fe7f092bc74aeb8d8d7c1990d97e91", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 00d0e7c10b7d4268af4d0947569f1fce Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'n-d-master-1'} Jul 24 01:08:13.018758 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:13.019551 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 24 01:08:13.020701 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.022585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3574fecb-f213-4f23-a3e4-4fa20c8bc46f tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.024467 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3574fecb-f213-4f23-a3e4-4fa20c8bc46f tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.023293 Jul 24 01:08:13.030617 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 9/17] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:13.037046 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5c7a39b8-63d5-46cb-9b84-2a28fa7b8bf3 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.039539 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.039539 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.075017 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5c7a39b8-63d5-46cb-9b84-2a28fa7b8bf3 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/273295361/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041589 Jul 24 01:08:13.076635 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 10/18] 10.222.0.27 () {60 vars in 1220 bytes} [Sun Jul 24 01:08:13 2022] POST /compute/v2.1/flavors/273295361/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.085145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fda73e69-15d9-4125-a72a-602a408b93bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Calling method '.version_select at 0x7f05f81e9ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.094985 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fda73e69-15d9-4125-a72a-602a408b93bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fda73e69-15d9-4125-a72a-602a408b93bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:08:13.099073 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'nonexistent_hostname'} Jul 24 01:08:13.100522 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.101432 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.102331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.104593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fda73e69-15d9-4125-a72a-602a408b93bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.107373 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fda73e69-15d9-4125-a72a-602a408b93bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027961 Jul 24 01:08:13.113773 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 11/19] 10.222.0.27 () {58 vars in 1190 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:08:13.130349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43b15881-de34-45ee-971b-da44a022b5bb tempest-FlavorsExtraSpecsTestJSON-319905182 tempest-FlavorsExtraSpecsTestJSON-319905182-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.142753 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43b15881-de34-45ee-971b-da44a022b5bb tempest-FlavorsExtraSpecsTestJSON-319905182 tempest-FlavorsExtraSpecsTestJSON-319905182-project] 10.222.0.27 "GET /compute/v2.1/flavors/273295361/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030170 Jul 24 01:08:13.143657 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 12/20] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/flavors/273295361/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.159899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b84fee7e-3055-4c27-a7e0-0b5a7585e958 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Calling method '.version_select at 0x7f05f9a56e50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.160463 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.160463 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.166602 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b84fee7e-3055-4c27-a7e0-0b5a7585e958 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '00d0e7c10b7d4268af4d0947569f1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe7f092bc74aeb8d8d7c1990d97e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b84fee7e-3055-4c27-a7e0-0b5a7585e958 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Request method failure captured: Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt3283-hSKxKYgpL_Z3SKnn911zW1HJ72g1OdlPTYcARlhrHIV67dE_u2iEzg7l-QXa8woEuhaH8NNjZzGb0kIZScvyt9CTJpvtnu2i1jHonGgfNQ_L2NH37p4mfUddFR3u4JWyX2fpxHIKzN6MLp2FV6_8mSIDir-ALrYe2LyPzXE Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:08:13.170902 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24fe7f092bc74aeb8d8d7c1990d97e91", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 00d0e7c10b7d4268af4d0947569f1fce Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'n-d-master-1'} Jul 24 01:08:13.172039 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:13.172770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 24 01:08:13.173785 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.175917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b84fee7e-3055-4c27-a7e0-0b5a7585e958 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.175917 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b84fee7e-3055-4c27-a7e0-0b5a7585e958 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.028932 Jul 24 01:08:13.175917 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 13/21] 10.222.0.27 () {58 vars in 1193 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:13.188869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e988240-6274-4d14-899f-dd88a0e8aa22 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.228064 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e988240-6274-4d14-899f-dd88a0e8aa22 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/273295361/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051334 Jul 24 01:08:13.229141 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 14/22] 10.222.0.27 () {60 vars in 1220 bytes} [Sun Jul 24 01:08:13 2022] POST /compute/v2.1/flavors/273295361/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.235203 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-571aa6ce-2475-4f42-a09c-ae369c7e8f67 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Calling method '.version_select at 0x7f05f81e93a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.250210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-571aa6ce-2475-4f42-a09c-ae369c7e8f67 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-571aa6ce-2475-4f42-a09c-ae369c7e8f67 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:08:13.259537 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'nonexistent_hostname'} Jul 24 01:08:13.260661 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:08:13.261262 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 24 01:08:13.262151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-571aa6ce-2475-4f42-a09c-ae369c7e8f67 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-571aa6ce-2475-4f42-a09c-ae369c7e8f67 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.032472 Jul 24 01:08:13.263798 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 15/23] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:08:13.274900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6089761f-c03b-4d7f-ae50-f63c96a5b0f3 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.294928 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6089761f-c03b-4d7f-ae50-f63c96a5b0f3 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/273295361/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030509 Jul 24 01:08:13.297852 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 16/24] 10.222.0.27 () {58 vars in 1199 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/flavors/273295361/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.309296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9f33526-c3e4-4ab2-b5fb-1431bdf0232b tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Calling method '.version_select at 0x7f05f814bf70>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.311396 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.311396 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.313409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c9f33526-c3e4-4ab2-b5fb-1431bdf0232b tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '00d0e7c10b7d4268af4d0947569f1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe7f092bc74aeb8d8d7c1990d97e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9f33526-c3e4-4ab2-b5fb-1431bdf0232b tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Request method failure captured: Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt3283-hSKxKYgpL_Z3SKnn911zW1HJ72g1OdlPTYcARlhrHIV67dE_u2iEzg7l-QXa8woEuhaH8NNjZzGb0kIZScvyt9CTJpvtnu2i1jHonGgfNQ_L2NH37p4mfUddFR3u4JWyX2fpxHIKzN6MLp2FV6_8mSIDir-ALrYe2LyPzXE Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:08:13.316184 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24fe7f092bc74aeb8d8d7c1990d97e91", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 00d0e7c10b7d4268af4d0947569f1fce Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'n-d-master-1'} Jul 24 01:08:13.317307 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:13.317998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 24 01:08:13.318874 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.319640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9f33526-c3e4-4ab2-b5fb-1431bdf0232b tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.320702 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9f33526-c3e4-4ab2-b5fb-1431bdf0232b tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.019466 Jul 24 01:08:13.327377 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 17/25] 10.222.0.27 () {58 vars in 1190 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:13.332894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5408a47-5d4c-4cdd-afcf-d4063b1ba069 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.336629 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.336629 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.396333 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5408a47-5d4c-4cdd-afcf-d4063b1ba069 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/273295361/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.072974 Jul 24 01:08:13.400994 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 18/26] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:08:13 2022] PUT /compute/v2.1/flavors/273295361/os-extra_specs/hw:numa_nodes => generated 22 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.408086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cadebc08-30dd-4c75-b5fd-455fe8911449 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Calling method '.version_select at 0x7f05f81e9160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.420481 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-cadebc08-30dd-4c75-b5fd-455fe8911449 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cadebc08-30dd-4c75-b5fd-455fe8911449 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:08:13.422723 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'nonexistent_hostname'} Jul 24 01:08:13.423813 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:08:13.424547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 24 01:08:13.425404 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.426332 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.428576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cadebc08-30dd-4c75-b5fd-455fe8911449 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.429851 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cadebc08-30dd-4c75-b5fd-455fe8911449 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.027118 Jul 24 01:08:13.430950 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 19/27] 10.222.0.27 () {58 vars in 1214 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:08:13.435951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e7bec33-1602-45a8-a54a-2e9c9da8df1b tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.458508 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e7bec33-1602-45a8-a54a-2e9c9da8df1b tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/273295361/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026126 Jul 24 01:08:13.465875 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 20/28] 10.222.0.27 () {58 vars in 1199 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/flavors/273295361/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.474430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df0247e3-5fa4-4aa6-ac80-8d885f943e34 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Action: 'update', calling method: .version_select at 0x7f05f814bb80>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df0247e3-5fa4-4aa6-ac80-8d885f943e34 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 51 Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:08:13.505323 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: {"status": "enable", "maintenance_mode": "invalid"} Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.506710 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'disable', Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'Enable', Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'Disable', Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance: Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'invalid' Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.507535 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.510951 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.512042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.512042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:08:13.512042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:08:13.512042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.512042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.515628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df0247e3-5fa4-4aa6-ac80-8d885f943e34 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.516976 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-df0247e3-5fa4-4aa6-ac80-8d885f943e34 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.050020 Jul 24 01:08:13.517753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 21/29] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:08:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:08:13.523810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92a3b26a-04df-4969-9742-0ccdee8191ce tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.527455 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.527455 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.535916 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b0406a0a-b4c2-4231-9c62-b7faddd48653 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.755180 Jul 24 01:08:13.542668 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 9/30] 10.222.0.27 () {62 vars in 1231 bytes} [Sun Jul 24 01:08:12 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:13.552836 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fdad0ad-4bb1-4aed-bb1b-2be29e3b45bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Action: 'update', calling method: .version_select at 0x7f05f81884c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fdad0ad-4bb1-4aed-bb1b-2be29e3b45bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 51 Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:08:13.561469 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: {"status": "invalid", "maintenance_mode": "enable"} Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:08:13.563093 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'disable', Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'Enable', Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'Disable', Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance: Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'invalid' Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.563881 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.566130 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fdad0ad-4bb1-4aed-bb1b-2be29e3b45bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7fdad0ad-4bb1-4aed-bb1b-2be29e3b45bb tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.019692 Jul 24 01:08:13.567559 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 10/31] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:08:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:08:13.578595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d964ec5-89be-48e1-beec-123e108de955 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.580105 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.580105 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:13.580908 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92a3b26a-04df-4969-9742-0ccdee8191ce tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/273295361/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.060843 Jul 24 01:08:13.582694 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 22/32] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:08:13 2022] DELETE /compute/v2.1/flavors/273295361/os-extra_specs/hw:numa_nodes => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:08:13.592933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-91182124-ce91-4959-ac45-2d5e038a6ca4 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Action: 'update', calling method: .version_select at 0x7f05f814baf0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.594649 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.594649 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.596489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-91182124-ce91-4959-ac45-2d5e038a6ca4 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '00d0e7c10b7d4268af4d0947569f1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fe7f092bc74aeb8d8d7c1990d97e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-91182124-ce91-4959-ac45-2d5e038a6ca4 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Request method failure captured: Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 50 Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt3283-hSKxKYgpL_Z3SKnn911zW1HJ72g1OdlPTYcARlhrHIV67dE_u2iEzg7l-QXa8woEuhaH8NNjZzGb0kIZScvyt9CTJpvtnu2i1jHonGgfNQ_L2NH37p4mfUddFR3u4JWyX2fpxHIKzN6MLp2FV6_8mSIDir-ALrYe2LyPzXE Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:08:13.600417 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24fe7f092bc74aeb8d8d7c1990d97e91", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24fe7f092bc74aeb8d8d7c1990d97e91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 24fe7f092bc74aeb8d8d7c1990d97e91 Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-24047320 Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 00d0e7c10b7d4268af4d0947569f1fce Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-24047320-project Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: {"status": "enable", "maintenance_mode": "enable"} Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 24 01:08:13.601891 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:13.602740 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 24 01:08:13.603890 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.605615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d964ec5-89be-48e1-beec-123e108de955 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:13.605615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d964ec5-89be-48e1-beec-123e108de955 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:13.607410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-91182124-ce91-4959-ac45-2d5e038a6ca4 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.610336 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-91182124-ce91-4959-ac45-2d5e038a6ca4 tempest-HostsAdminNegativeTestJSON-24047320 tempest-HostsAdminNegativeTestJSON-24047320-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.025786 Jul 24 01:08:13.611578 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 23/33] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:08:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:13.621646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da5d4cdf-d8ab-4441-8e8d-b8fe5f979b04 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.665014 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da5d4cdf-d8ab-4441-8e8d-b8fe5f979b04 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/273295361/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.051601 Jul 24 01:08:13.670655 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 24/34] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:08:13 2022] DELETE /compute/v2.1/flavors/273295361/os-extra_specs/hw:cpu_policy => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:08:13.677842 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73114f78-ca04-4a92-bff7-35617e9ba8c2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Action: 'update', calling method: .version_select at 0x7f05f814bd30>, body: {"status": null, "maintenance_mode": null} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73114f78-ca04-4a92-bff7-35617e9ba8c2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 42 Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:08:13.680905 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: {"status": null, "maintenance_mode": null} Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 24 01:08:13.682221 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'disable', Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'Enable', Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'Disable', Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance: Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi None Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.682882 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.684394 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.685929 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:08:13.685929 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:08:13.685929 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 24 01:08:13.685929 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.685929 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73114f78-ca04-4a92-bff7-35617e9ba8c2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.685929 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73114f78-ca04-4a92-bff7-35617e9ba8c2 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.011161 Jul 24 01:08:13.692654 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 25/35] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:08:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:08:13.705084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-615b82a7-e2b8-4346-a593-ea0285eb8fe6 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.733119 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-615b82a7-e2b8-4346-a593-ea0285eb8fe6 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/273295361/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033317 Jul 24 01:08:13.743771 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 26/36] 10.222.0.27 () {58 vars in 1199 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/flavors/273295361/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:13.753118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d182a5d9-f717-489e-bc56-9272f5c3c287 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Action: 'update', calling method: .version_select at 0x7f05f81e93a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:13.763449 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.hosts [None req-d182a5d9-f717-489e-bc56-9272f5c3c287 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Enabling host nonexistent_hostname. Jul 24 01:08:13.773789 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:13.787247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d182a5d9-f717-489e-bc56-9272f5c3c287 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d182a5d9-f717-489e-bc56-9272f5c3c287 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Request method failure captured: Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 50 Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt6YMTxQSwfcTONrii3uwReU-VRRYZmH176mXePKJmAHeV6McXPXJhWsoWvVZMSp8LPFcBZD3TYu6_jRwmdxF5PNueYUWUfApQh5ajjg7VMYJBnSrTM8qsWqby5CAyHzW3LqCvhbPKEqVWZkXbm6cpNzpMwSDpoeeccI-OeKS7IR2Y Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:08:13.789204 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d00d5448f99d408b971c39511ef29def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d00d5448f99d408b971c39511ef29def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d00d5448f99d408b971c39511ef29def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d00d5448f99d408b971c39511ef29def Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1519441721 Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9ba87bab49345f9a34545b224e53627 Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1519441721-project-admin Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: {"status": "enable", "maintenance_mode": "enable"} Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.790743 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 24 01:08:13.792709 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:08:13.793553 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:13.796753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d182a5d9-f717-489e-bc56-9272f5c3c287 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:13.798997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d182a5d9-f717-489e-bc56-9272f5c3c287 tempest-HostsAdminNegativeTestJSON-1519441721 tempest-HostsAdminNegativeTestJSON-1519441721-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045387 Jul 24 01:08:13.798997 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 27/37] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 01:08:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:08:13.820534 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-426c6bec-2817-4d59-978d-b2f48e98de27 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.821303 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.821303 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:13.841395 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d964ec5-89be-48e1-beec-123e108de955 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.267540 Jul 24 01:08:13.848735 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 11/38] 10.222.0.27 () {62 vars in 1231 bytes} [Sun Jul 24 01:08:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:13.864083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a4fea9d4-6e40-4d3c-919f-af9968c0b445 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.866823 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:13.866823 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:13.891872 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-426c6bec-2817-4d59-978d-b2f48e98de27 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/273295361" status: 202 len: 0 microversion: 2.1 time: 0.099289 Jul 24 01:08:13.898846 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 28/39] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:08:13 2022] DELETE /compute/v2.1/flavors/273295361 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:08:13.908208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf1c0e2a-1b90-453f-9f49-06ee3aa55541 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:13.931799 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a4fea9d4-6e40-4d3c-919f-af9968c0b445 tempest-AggregatesAdminTestV241-1261245805 tempest-AggregatesAdminTestV241-1261245805-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.081801 Jul 24 01:08:13.934465 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 12/40] 10.222.0.27 () {60 vars in 1192 bytes} [Sun Jul 24 01:08:13 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:13.983955 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf1c0e2a-1b90-453f-9f49-06ee3aa55541 tempest-FlavorsExtraSpecsTestJSON-915218794 tempest-FlavorsExtraSpecsTestJSON-915218794-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082843 Jul 24 01:08:13.985043 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 29/41] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:08:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:14.000301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-385fdd4e-1471-461f-ba1a-4682494430b8 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1900694500", "name": "tempest-test_aggregate-2131060954"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:14.044014 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:14.044014 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:14.045440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-385fdd4e-1471-461f-ba1a-4682494430b8 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid c5bc5290-aad6-46e3-81fe-9753a132d446 for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:08:14.133723 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-385fdd4e-1471-461f-ba1a-4682494430b8 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.154299 Jul 24 01:08:14.134651 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 13/42] 10.222.0.27 () {60 vars in 1164 bytes} [Sun Jul 24 01:08:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:14.146572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fc08ce30-b593-431a-9735-c1b40a18d38e tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:14.147587 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:14.147587 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:14.173050 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fc08ce30-b593-431a-9735-c1b40a18d38e tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.030964 Jul 24 01:08:14.173639 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 30/43] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:08:14 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:14.186300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6485cb4b-b14f-4f2a-bd6e-20397a44083e tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:14.188871 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:14.188871 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:14.205760 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6485cb4b-b14f-4f2a-bd6e-20397a44083e tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:14.206442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6485cb4b-b14f-4f2a-bd6e-20397a44083e tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:14.452444 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6485cb4b-b14f-4f2a-bd6e-20397a44083e tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.271675 Jul 24 01:08:14.454413 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 14/44] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:08:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:08:15.866131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1800715205", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "availability_zone": "tempest-test_az-1900694500"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:15.892728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:15.894448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:15.895519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:15.896311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:16.923829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:08:17.365311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:08:17.365963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:08:17.366451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:08:17.366870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:08:17.367287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:08:17.393986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:17.394782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:17.395689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:17.396342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:17.433263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Getting quotas for project 3d121ab923474b2ca0c274a943530dd2. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:08:17.443591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Getting quotas for user 1416426260704ceca5211082c2399bca and project 3d121ab923474b2ca0c274a943530dd2. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:08:17.457123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:08:17.460556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:08:17.526732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-533a0321-bde0-4326-9304-e5107f5e5c16 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.201365 Jul 24 01:08:17.528741 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 31/45] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:08:17.539261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71af4697-393e-40b5-b92a-456929a41f66 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:17.540708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71af4697-393e-40b5-b92a-456929a41f66 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:19.715556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71af4697-393e-40b5-b92a-456929a41f66 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:19.732851 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71af4697-393e-40b5-b92a-456929a41f66 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1243 microversion: 2.1 time: 2.198354 Jul 24 01:08:19.744459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 15/46] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:17 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1243 bytes in 2210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:20.758281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:20.762305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:20.856524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:20.862792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:20.863841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:20.864304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:21.485307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:21.513791 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3d5bb52-df4e-4415-a49c-afa2f8abbbd7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1299 microversion: 2.1 time: 0.765461 Jul 24 01:08:21.515727 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 32/47] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:20 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1299 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:22.541282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:22.542929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:22.573196 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:22.584761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:22.585592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:22.587125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:22.587934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:23.292190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:23.317408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4e24c04-16ed-4221-ab57-a116d7482662 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1297 microversion: 2.1 time: 0.787899 Jul 24 01:08:23.318245 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 16/48] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:22 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1297 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:24.337218 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:24.338286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:24.365786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:24.366238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:24.367053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:24.367502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:25.432552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:25.475527 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f7e40f8a-c76b-4075-8277-a188d55c1185 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 1.133296 Jul 24 01:08:25.484982 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 33/49] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:24 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:25.990345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-350d178b-8630-4ac6-84a5-a7a8dc45b088 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1820253795", "id": 625667658, "os-flavor-access:is_public": "False"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:26.002781 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:26.002781 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:26.177628 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-350d178b-8630-4ac6-84a5-a7a8dc45b088 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 1.068230 Jul 24 01:08:26.183289 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 17/50] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:25 2022] POST /compute/v2.1/flavors => generated 428 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:26.198485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-992cafb8-c31a-4ac4-946d-73002b6ca2da tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "90cf85a867284439b836757fcb5c67eb"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:26.202679 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:26.202679 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:26.488721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:26.490113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:26.563160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:26.569112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:26.571282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:26.573853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:27.413464 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:27.452043 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:27.500577 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-992cafb8-c31a-4ac4-946d-73002b6ca2da tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/625667658/action" status: 200 len: 96 microversion: 2.1 time: 1.309092 Jul 24 01:08:27.508399 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 34/51] 10.222.0.27 () {60 vars in 1196 bytes} [Sun Jul 24 01:08:26 2022] POST /compute/v2.1/flavors/625667658/action => generated 96 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:08:28.372430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9100aff0-e878-4ca3-ac28-448648a87f9d tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-812530748", "id": 1646327616, "os-flavor-access:is_public": "True"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:28.374432 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:28.374432 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:28.437872 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9100aff0-e878-4ca3-ac28-448648a87f9d tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.927349 Jul 24 01:08:28.441568 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 35/52] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:08:27 2022] POST /compute/v2.1/flavors => generated 470 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:29.096848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:29.112424 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-164c43fb-dbe7-4098-b222-d581bf25b378 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 2.630852 Jul 24 01:08:29.131143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 18/53] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:26 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:29.155430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67e8b595-7c80-4397-aba0-90c8a5232313 tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:29.159999 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:29.159999 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:29.248148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d71735dd-2701-4079-85ec-a7f696714f21 tempest-FlavorsAccessTestJSON-421673637 tempest-FlavorsAccessTestJSON-421673637-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:29.343668 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d71735dd-2701-4079-85ec-a7f696714f21 tempest-FlavorsAccessTestJSON-421673637 tempest-FlavorsAccessTestJSON-421673637-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5830 microversion: 2.1 time: 0.898196 Jul 24 01:08:29.345000 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 36/54] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:08:28 2022] GET /compute/v2.1/flavors/detail => generated 5830 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:29.551081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4d32355-0cff-40f9-becf-dafeddf5c4e6 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:29.552868 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:29.552868 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:29.555836 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c4d32355-0cff-40f9-becf-dafeddf5c4e6 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4d32355-0cff-40f9-becf-dafeddf5c4e6 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665-project-admin] Request method failure captured: Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JuMI62RoMfvw4orR62Jr7-HCtuoY9LZH4kh5E7XoHDQWJs-ZmXCkj2xL3cq9TxEAKyznlec0kxoxqP_0lRICXTyK-zxoiK7MtGrr7ybM_fZd9xI6IRlkOUXaixN6ZZBLjHaxLF4viQ2E5yJMBrr36d_rNzS2jYegv0v4kZBZyJzVmI Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 483ee3c24c6f4b11a40a522283ff6141 Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:08:29.570232 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/483ee3c24c6f4b11a40a522283ff6141"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/483ee3c24c6f4b11a40a522283ff6141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_483ee3c24c6f4b11a40a522283ff6141", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/483ee3c24c6f4b11a40a522283ff6141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 483ee3c24c6f4b11a40a522283ff6141 Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-949660665-project-admin Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: e763340456414377b4e65edfca7d0e24 Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-949660665-project-admin Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid timestamp for date invalid_time Jul 24 01:08:29.571658 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'invalid_time'} Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:29.572484 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 24 01:08:29.573861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:29.575802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4d32355-0cff-40f9-becf-dafeddf5c4e6 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:29.576876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c4d32355-0cff-40f9-becf-dafeddf5c4e6 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665 tempest-InstanceUsageAuditLogNegativeTestJSON-949660665-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.230411 Jul 24 01:08:29.579514 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 37/55] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 234 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:29.582402 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67e8b595-7c80-4397-aba0-90c8a5232313 tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1646327616/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.447250 Jul 24 01:08:29.583864 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 19/56] 10.222.0.27 () {62 vars in 1264 bytes} [Sun Jul 24 01:08:29 2022] POST /compute/v2.1/flavors/1646327616/os-extra_specs => generated 62 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:29.592108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81d73f66-5be8-402b-b3d3-6614e766d30a tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "90cf85a867284439b836757fcb5c67eb"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:29.593883 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:29.593883 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:29.728817 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:29.787624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-558b97b1-2058-4838-ba42-b124c929227b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05f814baf0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:29.788761 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:29.788761 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:29.790029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-558b97b1-2058-4838-ba42-b124c929227b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:29.790493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-558b97b1-2058-4838-ba42-b124c929227b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:29.791322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-558b97b1-2058-4838-ba42-b124c929227b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:29.791771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-558b97b1-2058-4838-ba42-b124c929227b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:29.897220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-558b97b1-2058-4838-ba42-b124c929227b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.316231 Jul 24 01:08:29.908983 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 38/57] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:08:29 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:30.001182 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-81d73f66-5be8-402b-b3d3-6614e766d30a tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/625667658/action" status: 200 len: 21 microversion: 2.1 time: 0.414491 Jul 24 01:08:30.014615 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 20/58] 10.222.0.27 () {60 vars in 1196 bytes} [Sun Jul 24 01:08:29 2022] POST /compute/v2.1/flavors/625667658/action => generated 21 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:30.020136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e48a311-b364-48f1-b25f-a822a17a9198 tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.020914 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.020914 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:30.108174 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e48a311-b364-48f1-b25f-a822a17a9198 tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1646327616" status: 202 len: 0 microversion: 2.86 time: 0.091890 Jul 24 01:08:30.109937 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 21/59] 10.222.0.27 () {60 vars in 1201 bytes} [Sun Jul 24 01:08:30 2022] DELETE /compute/v2.1/flavors/1646327616 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:08:30.119159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0671be12-daf8-46a9-8c85-0c75c2f4184b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05f8047550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.124006 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.124006 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:30.130397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0671be12-daf8-46a9-8c85-0c75c2f4184b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:30.132480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0671be12-daf8-46a9-8c85-0c75c2f4184b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:30.133485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0671be12-daf8-46a9-8c85-0c75c2f4184b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:30.139263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0671be12-daf8-46a9-8c85-0c75c2f4184b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:30.172348 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:30.227616 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0671be12-daf8-46a9-8c85-0c75c2f4184b tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.108802 Jul 24 01:08:30.235318 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 22/60] 10.222.0.27 () {58 vars in 1138 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:30.253252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcc02c53-55b4-4dd5-be82-ef6bb6fc37f7 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.254351 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.254351 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:30.255802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bcc02c53-55b4-4dd5-be82-ef6bb6fc37f7 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b4e34a1a1c3841efb8535f57b22e20cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4babc53ae094b53817a8f635b66b264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcc02c53-55b4-4dd5-be82-ef6bb6fc37f7 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Request method failure captured: Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JuIxgSflMm8XR5MNVAtfi8QqicRS8G_MZrhdgjBIhpGuMb45zJbuXozo4-jIB1Ucfip0Kthj9O51kBlu9BAuy9EJGmaMFAfaj_5FvBgv-pPU0rAgh5pSsN98Bvlu6TtKeXAH8PnrntqcT3CpVxY5mfZLnZS827sOO9ybyDMCcAwwuo Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: c4babc53ae094b53817a8f635b66b264 Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:08:30.258805 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c4babc53ae094b53817a8f635b66b264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4babc53ae094b53817a8f635b66b264"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c4babc53ae094b53817a8f635b66b264", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4babc53ae094b53817a8f635b66b264"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: c4babc53ae094b53817a8f635b66b264 Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b4e34a1a1c3841efb8535f57b22e20cf Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:08:30.259922 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: action_args: {} Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:30.260496 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 24 01:08:30.261467 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:30.264108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcc02c53-55b4-4dd5-be82-ef6bb6fc37f7 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:30.264602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-74b261c3-e1dc-4375-8241-7b11ab71f42c tempest-FlavorsAccessTestJSON-421673637 tempest-FlavorsAccessTestJSON-421673637-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.274138 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bcc02c53-55b4-4dd5-be82-ef6bb6fc37f7 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.355701 Jul 24 01:08:30.279063 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 39/61] 10.222.0.27 () {58 vars in 1184 bytes} [Sun Jul 24 01:08:29 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 366 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:30.304424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b447205-0767-4b69-97bd-008979ed3acb tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.321546 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-74b261c3-e1dc-4375-8241-7b11ab71f42c tempest-FlavorsAccessTestJSON-421673637 tempest-FlavorsAccessTestJSON-421673637-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082111 Jul 24 01:08:30.323329 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 23/62] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:30.339987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.341471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:30.358248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:30.359019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:30.360021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:30.360689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:30.367196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b447205-0767-4b69-97bd-008979ed3acb tempest-FlavorMetadataValidation-1356788226 tempest-FlavorMetadataValidation-1356788226-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.090495 Jul 24 01:08:30.371123 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 40/63] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:08:30.382329 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f390660-cdd6-4bfc-9a87-333772adc3e1 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05ebf58a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.389908 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.389908 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:30.392656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f390660-cdd6-4bfc-9a87-333772adc3e1 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:30.395263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f390660-cdd6-4bfc-9a87-333772adc3e1 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:30.396317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f390660-cdd6-4bfc-9a87-333772adc3e1 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:30.396773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f390660-cdd6-4bfc-9a87-333772adc3e1 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:30.463967 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f390660-cdd6-4bfc-9a87-333772adc3e1 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.090677 Jul 24 01:08:30.470425 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 41/64] 10.222.0.27 () {58 vars in 1144 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:30.484515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2958e91d-65e8-4de3-9a67-bc3b19190a05 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.498304 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.498304 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:30.499658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2958e91d-65e8-4de3-9a67-bc3b19190a05 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b4e34a1a1c3841efb8535f57b22e20cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4babc53ae094b53817a8f635b66b264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2958e91d-65e8-4de3-9a67-bc3b19190a05 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Request method failure captured: Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-24%2001:08:30 HTTP/1.1 Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JuIxgSflMm8XR5MNVAtfi8QqicRS8G_MZrhdgjBIhpGuMb45zJbuXozo4-jIB1Ucfip0Kthj9O51kBlu9BAuy9EJGmaMFAfaj_5FvBgv-pPU0rAgh5pSsN98Bvlu6TtKeXAH8PnrntqcT3CpVxY5mfZLnZS827sOO9ybyDMCcAwwuo Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: c4babc53ae094b53817a8f635b66b264 Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:08:30.503696 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c4babc53ae094b53817a8f635b66b264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4babc53ae094b53817a8f635b66b264"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c4babc53ae094b53817a8f635b66b264", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4babc53ae094b53817a8f635b66b264"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: c4babc53ae094b53817a8f635b66b264 Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b4e34a1a1c3841efb8535f57b22e20cf Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:08:30.504840 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2022-07-24 01:08:30'} Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:08:30.505460 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:08:30.511540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2958e91d-65e8-4de3-9a67-bc3b19190a05 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:08:30.512848 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2958e91d-65e8-4de3-9a67-bc3b19190a05 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585 tempest-InstanceUsageAuditLogNegativeTestJSON-1593618585-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-24 01:08:30" status: 403 len: 128 microversion: 2.1 time: 0.033557 Jul 24 01:08:30.515146 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 42/65] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-24%2001%3A08%3A30 => generated 128 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:30.531908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e366728-8dad-4b30-9472-09bef191e0ec tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.537499 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.537499 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:30.594011 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e366728-8dad-4b30-9472-09bef191e0ec tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/625667658" status: 202 len: 0 microversion: 2.1 time: 0.074352 Jul 24 01:08:30.603003 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 43/66] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:08:30 2022] DELETE /compute/v2.1/flavors/625667658 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:08:30.608179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f2b04b8-929c-42a9-af4d-b8bcdf943c81 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.696841 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f2b04b8-929c-42a9-af4d-b8bcdf943c81 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090784 Jul 24 01:08:30.700814 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 44/67] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:30.726321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-977eba26-d62b-464b-87d1-3ff6d0b088bd tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-708392214", "id": 428543405, "os-flavor-access:is_public": "False"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:30.738074 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.738074 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:30.830590 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-977eba26-d62b-464b-87d1-3ff6d0b088bd tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.092122 Jul 24 01:08:30.831936 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 45/68] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:30 2022] POST /compute/v2.1/flavors => generated 427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:30.855803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-33db1745-a718-42ff-bdb5-6d2dfbc03aa5 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:30.863742 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:30.863742 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:30.929185 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-33db1745-a718-42ff-bdb5-6d2dfbc03aa5 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/428543405/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.089741 Jul 24 01:08:30.931074 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 46/69] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/flavors/428543405/os-flavor-access => generated 21 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:30.967356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9c62433-bafb-47e7-9b46-8df502f4829c tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:31.061198 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9c62433-bafb-47e7-9b46-8df502f4829c tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/428543405" status: 202 len: 0 microversion: 2.1 time: 0.113853 Jul 24 01:08:31.068437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 47/70] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:08:30 2022] DELETE /compute/v2.1/flavors/428543405 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:08:31.084320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-372f81c1-722c-44cb-b2ff-0f455193fe39 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:31.146923 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-372f81c1-722c-44cb-b2ff-0f455193fe39 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075212 Jul 24 01:08:31.149367 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 48/71] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:08:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:08:31.907759 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6b428792-fed8-41f9-af42-ecf51f9397a2 req-c356f206-ec04-473d-b11c-4c5b20c6645b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c3fd965-0867-487a-b713-84476aaeb577", "tag": "214d8991-554c-4755-ab1c-1ba67de2d4c4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:31.943812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6b428792-fed8-41f9-af42-ecf51f9397a2 req-c356f206-ec04-473d-b11c-4c5b20c6645b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:31.945194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6b428792-fed8-41f9-af42-ecf51f9397a2 req-c356f206-ec04-473d-b11c-4c5b20c6645b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:32.004115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6b428792-fed8-41f9-af42-ecf51f9397a2 req-c356f206-ec04-473d-b11c-4c5b20c6645b service nova] Creating event network-changed:214d8991-554c-4755-ab1c-1ba67de2d4c4 for instance 8c3fd965-0867-487a-b713-84476aaeb577 on n-h1-master-1 Jul 24 01:08:32.004655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6b428792-fed8-41f9-af42-ecf51f9397a2 req-c356f206-ec04-473d-b11c-4c5b20c6645b service nova] Acquired lock "compute-rpcapi-router" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:08:32.006488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8afd2f04-3e22-4392-bfbc-0f44070d1ab0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:32.011570 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8afd2f04-3e22-4392-bfbc-0f44070d1ab0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:32.013142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8afd2f04-3e22-4392-bfbc-0f44070d1ab0 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:32.016260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8afd2f04-3e22-4392-bfbc-0f44070d1ab0 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:32.047620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.compute.rpcapi [None req-8afd2f04-3e22-4392-bfbc-0f44070d1ab0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 24 01:08:32.051847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8afd2f04-3e22-4392-bfbc-0f44070d1ab0 None None] Releasing lock "compute-rpcapi-router" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:08:32.089483 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8afd2f04-3e22-4392-bfbc-0f44070d1ab0 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.851464 Jul 24 01:08:32.091252 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 49/72] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:32.246170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:32.261145 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b869c0af-8e5a-4d1a-b217-2e5dfc945abe tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 1.925379 Jul 24 01:08:32.275623 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 24/73] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:30 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:33.282131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:33.283713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:33.304749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:33.305390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:33.306407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:33.306993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:34.065838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:34.079492 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80e76390-ef56-4de4-a10b-24e0c161bf3d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.804539 Jul 24 01:08:34.080096 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 50/74] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:33 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:35.099359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:35.101557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:35.156516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:35.157607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:35.166165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:35.167321 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:35.934981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:35.954611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bceb1e4a-5983-464f-8a1a-f86d72c0edff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.861080 Jul 24 01:08:35.955619 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 25/75] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:35 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:36.261632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bec97143-5b59-4087-a46c-9f790fd3c23f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:36.303048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bec97143-5b59-4087-a46c-9f790fd3c23f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.404036 Jul 24 01:08:36.306984 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 51/76] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:08:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:36.791084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-80074692-341f-4db7-9e06-5e316de322ba tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-433463804", "id": 1384251660, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:36.848849 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:36.848849 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:36.882336 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-80074692-341f-4db7-9e06-5e316de322ba tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.567849 Jul 24 01:08:36.888678 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 26/77] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:36 2022] POST /compute/v2.1/flavors => generated 424 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:36.894068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-729fd804-95bc-4371-8288-aa48faa67cb5 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:36.904746 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-729fd804-95bc-4371-8288-aa48faa67cb5 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014328 Jul 24 01:08:36.910276 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 52/78] 10.222.0.27 () {58 vars in 1181 bytes} [Sun Jul 24 01:08:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:08:36.928120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef989041-1788-478c-85ec-26c5f0ef82b9 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-522008656", "id": 2025549651, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:36.978879 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef989041-1788-478c-85ec-26c5f0ef82b9 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.066233 Jul 24 01:08:36.982927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:36.983614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 27/79] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:36 2022] POST /compute/v2.1/flavors => generated 424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:36.990597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:36.995476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f71fbd42-ce47-476b-9d69-5ce2a6f76924 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:37.000271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:37.001867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:37.002995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:37.003692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:37.017963 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f71fbd42-ce47-476b-9d69-5ce2a6f76924 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026746 Jul 24 01:08:37.021650 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 28/80] 10.222.0.27 () {58 vars in 1181 bytes} [Sun Jul 24 01:08:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:08:37.033697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-adb59df2-8614-425f-9195-fd077a9ef130 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Action: 'create', calling method: .version_select at 0x7f05ebed69d0>, body: {"keypair": {"name": "tempest-keypair-238947261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR2VNdazxAaco7dVVQ3L/jmyK0qYT/FKQvRgeXNz39/Ipq9AOstWJm5LnmVWQRfSrxfWqBd1KaSyso0jt0HucvJvwL3FXKWjJeHgUOTzTR4YcWv3QREkC/CkwJDrXyOJw=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:37.101950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-adb59df2-8614-425f-9195-fd077a9ef130 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Getting quotas for project 913058bc11904339a05f4784fee6f1a1. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:08:37.117726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-adb59df2-8614-425f-9195-fd077a9ef130 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Getting quotas for user b3861659794d4aa699ca3e984999a1fe and project 913058bc11904339a05f4784fee6f1a1. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:08:37.227657 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-adb59df2-8614-425f-9195-fd077a9ef130 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198103 Jul 24 01:08:37.228308 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 29/81] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:08:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:37.691859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:37.700829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bce19e19-0c49-499b-84f3-329fe44daa04 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.732193 Jul 24 01:08:37.701499 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 53/82] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:36 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:08:38.721159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:38.723240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:38.741641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:38.744377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:38.746788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:38.749782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:39.380716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:39.399429 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ed08d7a-b803-4918-b848-1ea174142abb tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.683237 Jul 24 01:08:39.400962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 30/83] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:38 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:40.421429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:40.422644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:40.429759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:40.432514 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:40.436024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:40.438027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:40.490763 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=47 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:40.981943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:40.992765 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-229df822-cea5-43d1-9a8b-df6a2e23fd17 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.579127 Jul 24 01:08:40.997379 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 54/84] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:40 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:41.447807 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:41.977391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Calling method '.version_select at 0x7f05ebedeca0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:41.979252 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:41.979252 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:41.980097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Calling method '.version_select at 0x7f05ebe89d30>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:41.981797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:41.981946 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:41.981946 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:41.982594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:41.983467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:41.985115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:41.988133 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=55 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:42.032919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.034417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.034987 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.035605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.049782 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:42.058189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.060700 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.072674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.077451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d0676b9-3985-4898-954f-d767013fd33a tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.634057 Jul 24 01:08:42.077711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.078347 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 31/85] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:08:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:42.089287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:42.092722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:42.100151 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f931fa0-5a99-4208-b556-211e7c2df177 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.260654 Jul 24 01:08:42.101630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 55/86] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:08:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:42.116093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.116866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03f65d18-4cb0-4444-9b8e-fd78584a5ba9 tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Calling method '.version_select at 0x7f05ebedee50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:42.117263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.117859 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:42.117859 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:42.119494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03f65d18-4cb0-4444-9b8e-fd78584a5ba9 tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.123174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03f65d18-4cb0-4444-9b8e-fd78584a5ba9 tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.133420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.134161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.172224 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:42.178115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03f65d18-4cb0-4444-9b8e-fd78584a5ba9 tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.179797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03f65d18-4cb0-4444-9b8e-fd78584a5ba9 tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.212504 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03f65d18-4cb0-4444-9b8e-fd78584a5ba9 tempest-HypervisorAdminV228Test-1875886466 tempest-HypervisorAdminV228Test-1875886466-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.107466 Jul 24 01:08:42.214223 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 56/87] 10.222.0.27 () {60 vars in 1192 bytes} [Sun Jul 24 01:08:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:42.229125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Calling method '.version_select at 0x7f05ebedeb80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:42.231278 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:42.231278 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:42.234544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.236427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.323603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.328617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.467070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.469614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.487774 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-432c9244-fd21-49f1-961c-75e440300477 tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.270130 Jul 24 01:08:42.498774 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 57/88] 10.222.0.27 () {58 vars in 1211 bytes} [Sun Jul 24 01:08:42 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 196 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:42.532295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-419856116", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "2025549651", "adminPass": "***", "networks": [{"uuid": "231851c3-f058-45c6-859c-c923dfade6c4"}], "security_groups": [{"name": "tempest-securitygroup--2032468166"}], "key_name": "tempest-keypair-238947261", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:42.866019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] validate_networks() for [('231851c3-f058-45c6-859c-c923dfade6c4', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:08:42.930036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:42.941030 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31e2ec8b-7043-4159-9777-a8ad8b3252e7 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.855095 Jul 24 01:08:42.942122 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 32/89] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:42 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:42.947009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Calling method '.version_select at 0x7f05ebeb2160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:42.948047 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:42.948047 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:42.950285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.951239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.970624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.971581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.985497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:42.986869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:42.995363 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7dd942e4-7de0-492c-9310-36c80c9acc8f tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052043 Jul 24 01:08:43.001733 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 33/90] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:08:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:43.009090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc69139b-77fb-4050-8012-f35ca524ba9e tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Calling method '.version_select at 0x7f05ebeb2790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:43.010261 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:43.010261 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:43.012813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc69139b-77fb-4050-8012-f35ca524ba9e tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:43.013527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc69139b-77fb-4050-8012-f35ca524ba9e tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:43.036932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc69139b-77fb-4050-8012-f35ca524ba9e tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:43.038132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc69139b-77fb-4050-8012-f35ca524ba9e tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:43.050265 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc69139b-77fb-4050-8012-f35ca524ba9e tempest-HypervisorAdminUnderV252Test-1594844521 tempest-HypervisorAdminUnderV252Test-1594844521-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.046561 Jul 24 01:08:43.061752 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 34/91] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:08:43 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:43.969387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:43.984031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:44.015611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:44.016235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:44.017173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:44.017870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:44.687157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:08:44.688178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:08:44.689758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:08:44.691071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:08:44.697173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:08:44.718230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:44.720525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:44.721416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:44.728548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:44.812032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Getting quotas for project 913058bc11904339a05f4784fee6f1a1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:08:44.812408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:44.818127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Getting quotas for user b3861659794d4aa699ca3e984999a1fe and project 913058bc11904339a05f4784fee6f1a1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:08:44.832920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a764916-1f62-4543-b583-ae21b5b8e85f tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.875765 Jul 24 01:08:44.836689 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 35/92] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:43 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:44.847291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:08:44.852935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:08:44.973041 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-433996a8-02d8-4f45-80be-30bb92595af3 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.472677 Jul 24 01:08:44.975309 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 58/93] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:08:44.987625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45938b44-0ab0-46da-99d5-c5e8bef4d5a1 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:44.988933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45938b44-0ab0-46da-99d5-c5e8bef4d5a1 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:45.168782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45938b44-0ab0-46da-99d5-c5e8bef4d5a1 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:45.178086 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45938b44-0ab0-46da-99d5-c5e8bef4d5a1 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1263 microversion: 2.1 time: 0.194727 Jul 24 01:08:45.196954 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 36/94] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:44 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:45.857246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:45.858698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:45.878445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:45.879983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:45.889513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:45.891830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:46.204759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e018c1b0-feef-487e-bb07-48d0b5d40a5d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:46.205420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e018c1b0-feef-487e-bb07-48d0b5d40a5d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:46.588351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e018c1b0-feef-487e-bb07-48d0b5d40a5d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:46.603523 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e018c1b0-feef-487e-bb07-48d0b5d40a5d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1263 microversion: 2.1 time: 0.402637 Jul 24 01:08:46.604115 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 37/95] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:46 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1263 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:46.998910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:47.007417 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1ccae19-557b-491a-b82a-a643acb802ee tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 1.156345 Jul 24 01:08:47.024153 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 59/96] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:45 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:47.624429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:47.625732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:47.640780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:47.651712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:47.652720 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:47.653178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:47.947292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:47.959287 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b77bc730-8cd3-4236-a086-c7eafc2a85a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1323 microversion: 2.1 time: 0.339980 Jul 24 01:08:47.960267 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 38/97] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:47 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:48.025590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:48.026256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:48.042405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:48.047910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:48.049039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:48.055149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:48.956977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:48.997881 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb6bb40f-6ad2-4294-ae02-dfbaea335ac5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.976133 Jul 24 01:08:49.010034 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 60/98] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:48 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:49.021710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:49.030031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:49.051934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:49.053024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:49.054444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:49.059403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:49.210895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c92d43c1-1045-4a7f-935d-b4cb5e1428c6 req-2cd7717a-c5f7-4c65-b22a-4ded916b5985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3fd965-0867-487a-b713-84476aaeb577", "name": "network-vif-plugged", "status": "completed", "tag": "214d8991-554c-4755-ab1c-1ba67de2d4c4"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:49.250742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c92d43c1-1045-4a7f-935d-b4cb5e1428c6 req-2cd7717a-c5f7-4c65-b22a-4ded916b5985 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:49.254105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c92d43c1-1045-4a7f-935d-b4cb5e1428c6 req-2cd7717a-c5f7-4c65-b22a-4ded916b5985 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:49.336424 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c92d43c1-1045-4a7f-935d-b4cb5e1428c6 req-2cd7717a-c5f7-4c65-b22a-4ded916b5985 service nova] Creating event network-vif-plugged:214d8991-554c-4755-ab1c-1ba67de2d4c4 for instance 8c3fd965-0867-487a-b713-84476aaeb577 on n-h1-master-1 Jul 24 01:08:49.337428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c92d43c1-1045-4a7f-935d-b4cb5e1428c6 req-2cd7717a-c5f7-4c65-b22a-4ded916b5985 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:08:49.341471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-defd91f5-f8b0-47d0-b218-7aaf584136d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:49.345050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-defd91f5-f8b0-47d0-b218-7aaf584136d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:49.346105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-defd91f5-f8b0-47d0-b218-7aaf584136d5 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:49.352340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-defd91f5-f8b0-47d0-b218-7aaf584136d5 None None] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:49.376230 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.rpcapi [None req-defd91f5-f8b0-47d0-b218-7aaf584136d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 24 01:08:49.378811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-defd91f5-f8b0-47d0-b218-7aaf584136d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:08:49.436699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:49.448181 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c2c32c5b-f737-41c2-9eec-53f8d2deedb9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1321 microversion: 2.1 time: 0.435857 Jul 24 01:08:49.459274 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-defd91f5-f8b0-47d0-b218-7aaf584136d5 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.002475 Jul 24 01:08:49.460243 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 61/99] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:49 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:49.460459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 39/100] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:08:50.023823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:50.024883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:50.055558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:50.062421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:50.067940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:50.072538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:50.403246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb0e0484-beeb-4e85-b770-248717b4546b tempest-InstanceUsageAuditLogTestJSON-1076246141 tempest-InstanceUsageAuditLogTestJSON-1076246141-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:50.408726 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:50.408726 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:50.470161 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb0e0484-beeb-4e85-b770-248717b4546b tempest-InstanceUsageAuditLogTestJSON-1076246141 tempest-InstanceUsageAuditLogTestJSON-1076246141-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-24 01:08:49" status: 200 len: 318 microversion: 2.1 time: 0.492711 Jul 24 01:08:50.471552 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 62/101] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:08:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-24%2001%3A08%3A49 => generated 318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:50.490864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fba707b7-8790-4b8e-ad45-e864954dbd56 tempest-InstanceUsageAuditLogTestJSON-1076246141 tempest-InstanceUsageAuditLogTestJSON-1076246141-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:50.492192 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:50.492192 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:08:50.516523 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fba707b7-8790-4b8e-ad45-e864954dbd56 tempest-InstanceUsageAuditLogTestJSON-1076246141 tempest-InstanceUsageAuditLogTestJSON-1076246141-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.029262 Jul 24 01:08:50.517692 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 63/102] 10.222.0.27 () {58 vars in 1184 bytes} [Sun Jul 24 01:08:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:08:50.535706 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:50.536856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:50.546131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:50.547010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:50.548068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:50.548910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:51.565005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:51.581709 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16520771-e757-4228-9337-f648eb9b1f38 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1321 microversion: 2.1 time: 1.057242 Jul 24 01:08:51.591315 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 64/103] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:50 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1321 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:51.921513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:51.937179 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f16a47d9-56cd-421f-9f76-47c1013c87a5 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 1.920234 Jul 24 01:08:51.937790 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 40/104] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:50 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:52.610424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:52.611154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:52.619615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1602586401", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "0b0a25ed-fae4-4f81-a013-333d811349fa"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:52.630287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:52.630287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:52.631351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:52.631792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:52.700375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] validate_networks() for [('0b0a25ed-fae4-4f81-a013-333d811349fa', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:08:52.880791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:52.897199 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b4ffeb4-b400-4577-9987-3b8c973bb505 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1321 microversion: 2.1 time: 0.286077 Jul 24 01:08:52.898173 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 41/105] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:52 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:52.955908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:52.956722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:52.968255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:52.968255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:52.971804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:52.972337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:53.484482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:53.517391 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87436863-7944-43bb-bc96-95693523157a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1339 microversion: 2.1 time: 0.564259 Jul 24 01:08:53.520367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 42/106] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:52 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1339 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:53.772442 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Calling method '.version_select at 0x7f05ebe89dc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:53.774154 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:53.774154 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:53.775666 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:53.776306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:53.831996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:53.837219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:53.884343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:53.885041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:53.898617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:53.899213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:53.929260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:53.930069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:53.939657 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a902fa0a-4263-4ce5-8707-39e133f1a12b tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.417577 Jul 24 01:08:53.940835 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 43/107] 10.222.0.27 () {60 vars in 1242 bytes} [Sun Jul 24 01:08:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:08:53.953853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:53.954731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:53.962263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:53.963378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:53.964958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:53.965883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.102968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:54.116518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7efd014c-0d57-4566-aeb3-28c39e60a4f0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1321 microversion: 2.1 time: 0.174268 Jul 24 01:08:54.125802 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 44/108] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:53 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:54.139143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Calling method '.version_select at 0x7f05ebebb940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:54.140943 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:54.140943 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:54.148193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.149132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.171418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:08:54.171975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:08:54.172877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:08:54.173509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:08:54.174095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:08:54.178056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.178988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.195257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.195711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.196524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.196963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.202654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.203344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.216798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.217488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.251396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:08:54.256597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for user 40b5fc3b4b6d43ab9342da568567140d and project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:08:54.269114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.269618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.273920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:08:54.276744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:08:54.291441 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a9200e6-8372-4c7e-bc09-b511754042af tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.164372 Jul 24 01:08:54.292037 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 45/109] 10.222.0.27 () {60 vars in 1221 bytes} [Sun Jul 24 01:08:54 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:54.305433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e9b546f-1d9d-472a-aafa-dabcf79b12c4 tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Calling method '.version_select at 0x7f05ebe68af0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:54.312746 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:54.312746 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:08:54.315513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e9b546f-1d9d-472a-aafa-dabcf79b12c4 tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.318087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e9b546f-1d9d-472a-aafa-dabcf79b12c4 tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.358048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e9b546f-1d9d-472a-aafa-dabcf79b12c4 tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.358509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e9b546f-1d9d-472a-aafa-dabcf79b12c4 tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.377456 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e9b546f-1d9d-472a-aafa-dabcf79b12c4 tempest-HypervisorAdminV253TestBase-370305129 tempest-HypervisorAdminV253TestBase-370305129-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/71ea3c69-8e99-469c-9484-2ff549cff944" status: 200 len: 792 microversion: 2.53 time: 0.077699 Jul 24 01:08:54.386201 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 46/110] 10.222.0.27 () {60 vars in 1297 bytes} [Sun Jul 24 01:08:54 2022] GET /compute/v2.1/os-hypervisors/71ea3c69-8e99-469c-9484-2ff549cff944 => generated 792 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:08:54.425192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3382c90-54c8-4efe-9850-20ea250a2a4c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.058537 Jul 24 01:08:54.432484 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 65/111] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:08:54.438930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8493021d-6312-4f1c-a8bc-72b1e341fd54 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:54.439615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8493021d-6312-4f1c-a8bc-72b1e341fd54 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:54.536778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:54.540862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:54.554844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.558265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.561016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:54.562427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:54.767969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8493021d-6312-4f1c-a8bc-72b1e341fd54 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:54.796547 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8493021d-6312-4f1c-a8bc-72b1e341fd54 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1211 microversion: 2.1 time: 0.361029 Jul 24 01:08:54.803304 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 47/112] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:54 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1211 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:55.139250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:55.139992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:55.151070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:55.153912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:55.155383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:55.158342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:55.213634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:55.237421 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-93cde7be-ea6f-4c33-ab8a-d129f893a8e3 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1488 microversion: 2.1 time: 0.695961 Jul 24 01:08:55.238923 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 66/113] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:54 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1488 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:08:55.257081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be69001d-c62d-4e4b-8edd-0f9f5a4c2de9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:55.257735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be69001d-c62d-4e4b-8edd-0f9f5a4c2de9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:55.292016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be69001d-c62d-4e4b-8edd-0f9f5a4c2de9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:55.293055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be69001d-c62d-4e4b-8edd-0f9f5a4c2de9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:55.308751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be69001d-c62d-4e4b-8edd-0f9f5a4c2de9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:55.309215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be69001d-c62d-4e4b-8edd-0f9f5a4c2de9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:55.473493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:55.491380 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5b6b2ae-7c7e-4908-8206-84d9786522d7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1321 microversion: 2.1 time: 0.357878 Jul 24 01:08:55.505455 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 48/114] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:55 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:08:55.818696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7e5a575-bf3f-44e2-97af-f475c0f2861b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:55.819809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a7e5a575-bf3f-44e2-97af-f475c0f2861b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:56.010652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7e5a575-bf3f-44e2-97af-f475c0f2861b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:56.029730 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a7e5a575-bf3f-44e2-97af-f475c0f2861b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1211 microversion: 2.1 time: 0.213308 Jul 24 01:08:56.031539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 49/115] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:55 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1211 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:56.511493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:56.512487 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:56.525089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:56.525654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:56.530692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:56.531472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:56.564158 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:56.609283 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be69001d-c62d-4e4b-8edd-0f9f5a4c2de9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1639 microversion: 2.1 time: 1.356440 Jul 24 01:08:56.622667 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 67/116] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:55 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1639 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:56.644139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:56.645503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:56.663266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:56.663901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:56.666168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:56.671956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:56.760989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:08:56.917112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:56.928495 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf46e047-bb9d-44b2-a359-2bb827fa7f56 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1321 microversion: 2.1 time: 0.422081 Jul 24 01:08:56.938080 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 50/117] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:56 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:57.049301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:57.050261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:57.064699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:57.070646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:57.071607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:57.072031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:57.313556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-981a90ab-ad34-488c-be96-b53c42119fe0 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 204 len: 0 microversion: 2.1 time: 0.677841 Jul 24 01:08:57.314213 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 68/118] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:08:56 2022] DELETE /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:08:57.326818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:57.332639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:57.350434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:57.358001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:57.359131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:57.364517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:57.522467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:57.541902 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f15494c-3149-49d9-9a5d-a7e877305695 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1271 microversion: 2.1 time: 0.496580 Jul 24 01:08:57.542014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 51/119] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:57 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1271 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:08:57.806361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:57.825768 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-49d29bd2-1455-4926-9bdc-997f4e625eff tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1494 microversion: 2.1 time: 0.506738 Jul 24 01:08:57.830934 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 69/120] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:57 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1494 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:08:57.952846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:57.962328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:57.966534 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:57.974055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:57.974832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:57.976690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:57.977162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:58.559951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:58.560584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:58.576295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:58.576755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:58.577568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:58.578035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:59.025524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:59.033886 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3c0b3fc-0442-4023-addf-c5431516a7b9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1269 microversion: 2.1 time: 0.479252 Jul 24 01:08:59.037017 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 70/121] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:58 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1269 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:59.048626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:08:59.049258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:08:59.077802 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:59.078292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:59.079092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:08:59.079533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:08:59.299813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:59.311367 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32d377c2-8b73-4e5d-aec3-808c3e62aa67 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 1.364016 Jul 24 01:08:59.315604 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 52/122] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:57 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:59.371001 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:59.562038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1357475237", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:08:59.647851 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:08:59.660026 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11713917-acb9-49d5-a514-2c65dee0cc86 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1494 microversion: 2.1 time: 0.619023 Jul 24 01:08:59.660648 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 71/123] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:08:59 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1494 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:08:59.688521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:00.060245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:00.060871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:00.077322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:00.078083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:00.079033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:00.079625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:00.413399 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:00.563033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:00.576757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad64f9ba-3707-4bf9-9164-250d6f9e702f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1269 microversion: 2.1 time: 0.520995 Jul 24 01:09:00.593699 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 72/124] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:00 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1269 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:00.596411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:00.602321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:00.625989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:00.626714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:00.627777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:00.628462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:00.751157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:00.754299 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:00.755050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:00.755816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:00.757409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:00.782401 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=13 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:00.785813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:00.786355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:00.787558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:00.788076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:00.821463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Getting quotas for project 3a66209b0c5f43928a52519ee8f5edbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:00.828504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Getting quotas for user d9d620962dcc40a8afaf6f97ae605eec and project 3a66209b0c5f43928a52519ee8f5edbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:00.844732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:00.850069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:00.939378 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f2ee7399-edc7-46a0-b6de-6548fe03180f tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620736 Jul 24 01:09:00.940609 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 53/125] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:01.308564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-917a101c-07a9-48f1-ae96-88e7c4e3b247 req-1ea5a8a1-4408-47e5-9f0b-142fa068d6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7321071-81d5-42f4-b1ec-3e089a82ff19", "tag": "f8164791-2c87-4117-8705-7b9e3a4c67cd"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:01.345204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-917a101c-07a9-48f1-ae96-88e7c4e3b247 req-1ea5a8a1-4408-47e5-9f0b-142fa068d6d3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:01.345933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-917a101c-07a9-48f1-ae96-88e7c4e3b247 req-1ea5a8a1-4408-47e5-9f0b-142fa068d6d3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:01.412945 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-917a101c-07a9-48f1-ae96-88e7c4e3b247 req-1ea5a8a1-4408-47e5-9f0b-142fa068d6d3 service nova] Creating event network-changed:f8164791-2c87-4117-8705-7b9e3a4c67cd for instance c7321071-81d5-42f4-b1ec-3e089a82ff19 on n-h2-master-1 Jul 24 01:09:01.450409 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-917a101c-07a9-48f1-ae96-88e7c4e3b247 req-1ea5a8a1-4408-47e5-9f0b-142fa068d6d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.497189 Jul 24 01:09:01.458299 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 54/126] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:01.499184 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:01.503879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:01.541698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:01.544244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:01.546630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:01.548828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:01.604133 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:01.624041 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef79ec71-24b8-4b34-9282-a776bb35a3fc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 1.040520 Jul 24 01:09:01.624651 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 73/127] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:00 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:01.676391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5377af4-3cc9-45bc-b222-5f4d9f47d03a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:01.677855 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5377af4-3cc9-45bc-b222-5f4d9f47d03a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:02.056972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:02.077591 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bbadba70-11d1-4a36-90fa-8e03ddac0fc4 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1452 microversion: 2.1 time: 0.614284 Jul 24 01:09:02.089925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 55/128] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:01 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1452 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:02.094315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:02.095317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:02.122508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5377af4-3cc9-45bc-b222-5f4d9f47d03a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:02.133665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:02.135313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:02.139026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:02.142363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:02.173943 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5377af4-3cc9-45bc-b222-5f4d9f47d03a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1222 microversion: 2.1 time: 0.545576 Jul 24 01:09:02.184937 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 74/129] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:01 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1222 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:02.198584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e011df1b-72a9-43ad-9996-dfb6624d0307 req-44a07a61-b451-4da0-b939-2c5b11b906a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3fd965-0867-487a-b713-84476aaeb577", "name": "network-vif-deleted", "tag": "214d8991-554c-4755-ab1c-1ba67de2d4c4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:02.223970 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e011df1b-72a9-43ad-9996-dfb6624d0307 req-44a07a61-b451-4da0-b939-2c5b11b906a8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:02.226624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e011df1b-72a9-43ad-9996-dfb6624d0307 req-44a07a61-b451-4da0-b939-2c5b11b906a8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:02.266510 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e011df1b-72a9-43ad-9996-dfb6624d0307 req-44a07a61-b451-4da0-b939-2c5b11b906a8 service nova] Creating event network-vif-deleted:214d8991-554c-4755-ab1c-1ba67de2d4c4 for instance 8c3fd965-0867-487a-b713-84476aaeb577 on n-h1-master-1 Jul 24 01:09:02.286905 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e011df1b-72a9-43ad-9996-dfb6624d0307 req-44a07a61-b451-4da0-b939-2c5b11b906a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100032 Jul 24 01:09:02.291382 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 75/130] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:02.628942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:02.639077 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9c16cad-26e9-40de-aaeb-d9eb37ee1228 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.556730 Jul 24 01:09:02.646567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:02.648022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:02.654678 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 56/131] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:02 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:02.679114 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:02.681481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:02.685453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:02.687690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.113537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:03.118531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:03.144191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:03.144719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.145704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:03.146146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.215787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:03.217123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.217793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lazy-loading 'fault' on Instance uuid 8c3fd965-0867-487a-b713-84476aaeb577 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:09:03.326236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:03.337869 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9df238f-4f5d-4084-8339-a2ad467aa846 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 0.697495 Jul 24 01:09:03.340660 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 76/132] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:02 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:03.345909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:03.347059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:03.355521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:03.356266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.357095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:03.357710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.411762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1416426260704ceca5211082c2399bca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d121ab923474b2ca0c274a943530dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:03.424029 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e90629d2-4608-4886-8fa4-d429078b572a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 200 len: 1329 microversion: 2.1 time: 0.329000 Jul 24 01:09:03.424806 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 57/133] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:03 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 1329 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:03.516688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:03.530234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13ef59aa-862b-468d-8b2d-a0a8f4cf2ac5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1302 microversion: 2.1 time: 0.188124 Jul 24 01:09:03.539963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 77/134] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:03 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1302 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:03.657843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:03.658469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:03.665797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:03.669415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.671357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:03.672680 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:03.809510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bfd06350-005d-4d6c-b411-75664aad236c tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] Calling method '.version_select at 0x7f05ebe509d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:03.810500 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:03.810500 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:03.827260 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bfd06350-005d-4d6c-b411-75664aad236c tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.274952 Jul 24 01:09:03.832992 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 58/135] 10.222.0.27 () {60 vars in 1225 bytes} [Sun Jul 24 01:09:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:09:03.842833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23d29a8c-6999-45fd-9b49-b19b79d703f0 tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebe89700>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:03.849320 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:03.849320 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:04.086261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:04.109809 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c22bd0c-7d50-4eda-982c-01e6f1bbfd69 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.455776 Jul 24 01:09:04.114440 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 78/136] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:03 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:04.149860 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23d29a8c-6999-45fd-9b49-b19b79d703f0 tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.314809 Jul 24 01:09:04.153246 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 59/137] 10.222.0.27 () {62 vars in 1246 bytes} [Sun Jul 24 01:09:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:09:04.161599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a64bf3f2-8bad-4de0-9129-c0d0d386c483 tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] Calling method '.version_select at 0x7f05ebec23a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:04.162712 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:04.162712 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:04.189770 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a64bf3f2-8bad-4de0-9129-c0d0d386c483 tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.031812 Jul 24 01:09:04.197546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 79/138] 10.222.0.27 () {60 vars in 1225 bytes} [Sun Jul 24 01:09:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:09:04.204217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2503e54-3c98-4d76-9b1a-7df9cf485412 tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebe68af0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:04.314408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2503e54-3c98-4d76-9b1a-7df9cf485412 tempest-QuotaClassesAdmin257Test-1253212613 tempest-QuotaClassesAdmin257Test-1253212613-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.115995 Jul 24 01:09:04.315726 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 60/139] 10.222.0.27 () {62 vars in 1246 bytes} [Sun Jul 24 01:09:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:09:04.359750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:04.360128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b37e68b7-903c-452f-9f1a-194385fe80e2 req-c24b3845-b356-43af-8aab-061104b1609f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975740f0-20a6-4d5b-8e57-766c11d09594", "tag": "cebc9e40-12d5-4535-ae92-0157bc5f293e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:04.360946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:04.382546 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:04.406134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.407543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.416465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.417157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.422520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b37e68b7-903c-452f-9f1a-194385fe80e2 req-c24b3845-b356-43af-8aab-061104b1609f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.425236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b37e68b7-903c-452f-9f1a-194385fe80e2 req-c24b3845-b356-43af-8aab-061104b1609f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.464524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b37e68b7-903c-452f-9f1a-194385fe80e2 req-c24b3845-b356-43af-8aab-061104b1609f service nova] Creating event network-changed:cebc9e40-12d5-4535-ae92-0157bc5f293e for instance 975740f0-20a6-4d5b-8e57-766c11d09594 on n-h2-master-1 Jul 24 01:09:04.479159 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b37e68b7-903c-452f-9f1a-194385fe80e2 req-c24b3845-b356-43af-8aab-061104b1609f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129548 Jul 24 01:09:04.482809 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 80/140] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:04.503316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:04.512639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:04.533470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.534344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.535437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.536184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.573195 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] HTTP exception thrown: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Request method failure captured: Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 HTTP/1.1 Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt4oTMf4hpiguVuwKtNM67oaFG_QaxVYo1SLVhYqX9U-Y9A3Ytm_nQet8ug4SaamyFVtNC6CkzW1n_7Cf9nYYwEuPRCgjZNhBXM9k4eY1cQg1jsL541NDmtCsjx1PIqXvhPj0BolF2WTGaaSTmCnQSmjzBanetyksJDlePGwttRf40 Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 3d121ab923474b2ca0c274a943530dd2 Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:04.577717 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d121ab923474b2ca0c274a943530dd2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 3d121ab923474b2ca0c274a943530dd2 Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminTestJSON-1609986828-project Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1416426260704ceca5211082c2399bca Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminTestJSON-1609986828-project Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:04.578974 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8c3fd965-0867-487a-b713-84476aaeb577'} Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:04.579599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:04.580637 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:04.583424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Returning 404 to user: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:04.584499 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0503ae9c-05c0-48e2-ad3b-e8997a77319a tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 404 len: 111 microversion: 2.1 time: 0.100351 Jul 24 01:09:04.585462 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 81/141] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:04 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:04.596013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:04.601553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:04.618761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.619582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.621549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.623283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.741798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:04.755162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aeb4704b-1117-4167-8b84-930c328c7955 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1302 microversion: 2.1 time: 0.166725 Jul 24 01:09:04.757845 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 82/142] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:04 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1302 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:04.775854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e07edcf9-c4ce-428d-b459-d9d73eb1d8f3 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:04.782775 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:04.782775 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:04.811223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e07edcf9-c4ce-428d-b459-d9d73eb1d8f3 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:04.812666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e07edcf9-c4ce-428d-b459-d9d73eb1d8f3 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:04.936665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:04.955552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-09a01dd9-53f4-4f31-85df-59bcb0bb0d6a tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 0.602018 Jul 24 01:09:04.956166 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 61/143] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:04 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:05.133689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:05.134630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:05.147382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:05.147863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:05.148656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:05.149095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:05.418279 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e07edcf9-c4ce-428d-b459-d9d73eb1d8f3 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.657677 Jul 24 01:09:05.419523 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 83/144] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:05.434010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75aef7d1-b3b4-4126-b976-6af92a38d5b7 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:05.435566 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:05.435566 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:05.449313 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:05.488342 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75aef7d1-b3b4-4126-b976-6af92a38d5b7 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.062475 Jul 24 01:09:05.492950 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 84/145] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:05 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 24 01:09:05.506212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0decc2f-e711-496b-8293-7c0f765723bd tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1322111821"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:05.507915 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:05.507915 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:05.510934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-a0decc2f-e711-496b-8293-7c0f765723bd tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid 8f592c52-0e32-4a5f-91c1-3d47cda6af8f for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:05.544677 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0decc2f-e711-496b-8293-7c0f765723bd tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043029 Jul 24 01:09:05.550422 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 85/146] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:05.556802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b82be552-d5d6-4272-9a54-02c5cb19cef5 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:05.558662 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:05.558662 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:05.569512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b82be552-d5d6-4272-9a54-02c5cb19cef5 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:05.570152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b82be552-d5d6-4272-9a54-02c5cb19cef5 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:05.733642 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b82be552-d5d6-4272-9a54-02c5cb19cef5 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.181451 Jul 24 01:09:05.734623 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 86/147] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:05.747329 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-283c43e8-e0de-4210-a5ba-687eb9ddd67c tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:05.749132 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:05.749132 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:05.759383 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-283c43e8-e0de-4210-a5ba-687eb9ddd67c tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.016835 Jul 24 01:09:05.760536 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 87/148] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:09:05 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:05.775489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-77b74b6d-d054-467f-acea-235de96217af tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:05.780341 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:05.780341 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:05.792995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77b74b6d-d054-467f-acea-235de96217af tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:05.793906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77b74b6d-d054-467f-acea-235de96217af tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:05.809964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:05.819618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-533c024f-22fb-4539-96ca-433ad804b9db tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.691541 Jul 24 01:09:05.820209 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 62/149] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:05 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:05.834892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:05.835520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:05.857836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:05.859233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:05.860192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:05.860788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:06.002930 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-77b74b6d-d054-467f-acea-235de96217af tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.232478 Jul 24 01:09:06.005804 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 88/150] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:06.016176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:06.017272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:06.037813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:06.042472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:06.043423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:06.043862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:06.900684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:06.909181 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7b7a37fe-f80e-4c99-bd4f-65f453235695 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 0.903954 Jul 24 01:09:06.910718 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 89/151] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:06 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:06.915958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd9f34b3-69b2-4363-9f2f-b5a123661c6b tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:06.916579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:06.917454 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:06.917454 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:06.926232 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f3caf746-83da-4c10-92ee-fe040e5c4aca tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 1.095112 Jul 24 01:09:06.929392 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 63/152] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:05 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:06.947513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:06.951436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:06.965648 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd9f34b3-69b2-4363-9f2f-b5a123661c6b tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.050653 Jul 24 01:09:06.967930 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 90/153] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:06 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:06.982564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:06.984488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:06.986323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-10d0007d-7953-4e51-a9b9-493588818f5c tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1899128970"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:06.989059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:06.989567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:06.991133 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:06.991133 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:06.992642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-10d0007d-7953-4e51-a9b9-493588818f5c tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid 62958176-acdc-4932-a125-509c624c359e for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:07.051563 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-10d0007d-7953-4e51-a9b9-493588818f5c tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077471 Jul 24 01:09:07.060952 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 91/154] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:07.070414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d510d5b-d259-419d-8b2a-276cfc8a9725 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:07.071616 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:07.071616 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:07.083458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d510d5b-d259-419d-8b2a-276cfc8a9725 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:07.083915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d510d5b-d259-419d-8b2a-276cfc8a9725 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:07.343590 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d510d5b-d259-419d-8b2a-276cfc8a9725 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.280064 Jul 24 01:09:07.346846 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 92/155] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:07 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:07.366678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e659197e-05c5-494f-809d-d221557e3eaa tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:07.369388 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:07.369388 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:07.400824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e659197e-05c5-494f-809d-d221557e3eaa tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.048134 Jul 24 01:09:07.407539 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 93/156] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:09:07 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:07.422638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-62a8c3ca-7aa3-49e9-b03e-bc0f019bd7fd tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:07.426847 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:07.426847 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:07.449859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62a8c3ca-7aa3-49e9-b03e-bc0f019bd7fd tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:07.450605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62a8c3ca-7aa3-49e9-b03e-bc0f019bd7fd tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:07.637288 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-62a8c3ca-7aa3-49e9-b03e-bc0f019bd7fd tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.228233 Jul 24 01:09:07.639396 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 94/157] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:07 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:07.655382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-12837a7f-7fc9-42a0-8ad9-a14654619b87 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:07.700157 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:07.700157 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:07.748351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:07.784348 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ba95738-4e21-432d-b8de-f389416b30ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.851509 Jul 24 01:09:07.785613 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 64/158] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:06 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:07.833508 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-12837a7f-7fc9-42a0-8ad9-a14654619b87 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.183364 Jul 24 01:09:07.834384 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 95/159] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:07 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:07.847760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2fcdd776-24d8-4ace-a3f2-8018875c0324 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1535554371"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:07.850044 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:07.850044 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:07.852306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-2fcdd776-24d8-4ace-a3f2-8018875c0324 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid b6dea0f2-df81-4d01-8574-2fbc9207ce14 for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:07.898478 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2fcdd776-24d8-4ace-a3f2-8018875c0324 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054613 Jul 24 01:09:07.902079 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 65/160] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:07.916663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b636dd6-2136-4e6c-9ba7-4a9af1b3bdf9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:07.919407 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:07.919407 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:07.935187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:07.935821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:07.941632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b636dd6-2136-4e6c-9ba7-4a9af1b3bdf9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:07.942597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b636dd6-2136-4e6c-9ba7-4a9af1b3bdf9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:07.957581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:07.958495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:07.960357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:07.960811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:08.172775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b636dd6-2136-4e6c-9ba7-4a9af1b3bdf9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.264977 Jul 24 01:09:08.174303 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 96/161] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:07 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:08.186045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:08.187256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:08.196203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:08.197110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:08.198140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:08.198838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:08.534594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:08.549432 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33319fdf-78b3-4633-8332-25caaeaa398c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 0.625655 Jul 24 01:09:08.550430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 66/162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:07 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:08.555392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-abb5f806-e44e-48b1-a196-5bd628a674a9 req-5e4d64d0-dd8c-4309-bc04-203e59f25cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55b23bf-6ab5-4630-aa96-71a49a0200b0", "tag": "25ee93de-d0c7-486f-a871-8077bc634061"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:08.577928 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=11,nova_api:UPDATE=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:08.583203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-abb5f806-e44e-48b1-a196-5bd628a674a9 req-5e4d64d0-dd8c-4309-bc04-203e59f25cac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:08.583658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-abb5f806-e44e-48b1-a196-5bd628a674a9 req-5e4d64d0-dd8c-4309-bc04-203e59f25cac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:08.615114 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-abb5f806-e44e-48b1-a196-5bd628a674a9 req-5e4d64d0-dd8c-4309-bc04-203e59f25cac service nova] Creating event network-changed:25ee93de-d0c7-486f-a871-8077bc634061 for instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 on n-h1-master-1 Jul 24 01:09:08.630677 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-abb5f806-e44e-48b1-a196-5bd628a674a9 req-5e4d64d0-dd8c-4309-bc04-203e59f25cac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078829 Jul 24 01:09:08.636893 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 67/163] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:08.649777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1308d058-3b1b-48be-a394-e6442877a775 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:08.659446 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:08.659446 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:08.682258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1308d058-3b1b-48be-a394-e6442877a775 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:08.683302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1308d058-3b1b-48be-a394-e6442877a775 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:08.891710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:08.892662 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1308d058-3b1b-48be-a394-e6442877a775 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.248304 Jul 24 01:09:08.893742 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 68/164] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:08 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:08.907908 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d9e3b996-5cca-43fb-8312-2699e9bfbdc3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 0.732130 Jul 24 01:09:08.909752 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 97/165] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:08 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:08.927015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9ece664a-9606-4166-b059-426f2ec65ac1 req-0238696a-1c03-4d94-9e3a-6ff9519d47bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7321071-81d5-42f4-b1ec-3e089a82ff19", "name": "network-vif-plugged", "status": "completed", "tag": "f8164791-2c87-4117-8705-7b9e3a4c67cd"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:08.927968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:08.929213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:08.940716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:08.942510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:08.944328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:08.944985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:08.964371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9ece664a-9606-4166-b059-426f2ec65ac1 req-0238696a-1c03-4d94-9e3a-6ff9519d47bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:08.964823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9ece664a-9606-4166-b059-426f2ec65ac1 req-0238696a-1c03-4d94-9e3a-6ff9519d47bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.008749 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9ece664a-9606-4166-b059-426f2ec65ac1 req-0238696a-1c03-4d94-9e3a-6ff9519d47bf service nova] Creating event network-vif-plugged:f8164791-2c87-4117-8705-7b9e3a4c67cd for instance c7321071-81d5-42f4-b1ec-3e089a82ff19 on n-h2-master-1 Jul 24 01:09:09.022746 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9ece664a-9606-4166-b059-426f2ec65ac1 req-0238696a-1c03-4d94-9e3a-6ff9519d47bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110628 Jul 24 01:09:09.030435 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 98/166] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.038068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2fb4ab08-fd3e-4acf-ac2c-ee5ccc288b93 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.039290 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.039290 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.080841 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2fb4ab08-fd3e-4acf-ac2c-ee5ccc288b93 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.048658 Jul 24 01:09:09.082051 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 99/167] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:09 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:09.093499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11440e0d-33b9-4b48-8cb2-1c7973f1ac20 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-13954815"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:09.100473 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.100473 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.102488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-11440e0d-33b9-4b48-8cb2-1c7973f1ac20 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid ca4cec55-cf28-48ad-bcc7-6022f412dfd3 for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:09.158770 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11440e0d-33b9-4b48-8cb2-1c7973f1ac20 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.070352 Jul 24 01:09:09.161189 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 100/168] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:09 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:09:09.184049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2768d70e-e8df-454e-b67d-95ef8ff6c0b2 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05ebe03160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.187797 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.187797 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.190916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2768d70e-e8df-454e-b67d-95ef8ff6c0b2 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.192114 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2768d70e-e8df-454e-b67d-95ef8ff6c0b2 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.193839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2768d70e-e8df-454e-b67d-95ef8ff6c0b2 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.195561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2768d70e-e8df-454e-b67d-95ef8ff6c0b2 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.240249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2768d70e-e8df-454e-b67d-95ef8ff6c0b2 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.077612 Jul 24 01:09:09.247812 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 101/169] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:09:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.255145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7c8990e-ed47-4a82-a66a-6d0b108274ae tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.256136 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.256136 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.302124 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7c8990e-ed47-4a82-a66a-6d0b108274ae tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.052822 Jul 24 01:09:09.304597 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 102/170] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:09.313102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e597939d-75a5-4895-92a1-4e305795209f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05ebec2550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.315966 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.315966 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.319448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e597939d-75a5-4895-92a1-4e305795209f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.320358 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e597939d-75a5-4895-92a1-4e305795209f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.321746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e597939d-75a5-4895-92a1-4e305795209f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.323072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e597939d-75a5-4895-92a1-4e305795209f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.367425 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e597939d-75a5-4895-92a1-4e305795209f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.061188 Jul 24 01:09:09.368882 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 103/171] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:09 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.374999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b77d9c8-6b27-40f0-9a4e-4c1b2c3bfebb tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.378149 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.378149 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.385250 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8b77d9c8-6b27-40f0-9a4e-4c1b2c3bfebb tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b77d9c8-6b27-40f0-9a4e-4c1b2c3bfebb tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Request method failure captured: Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt7xD7RQIX_lvpT-3EGp95Yxc2vdN3PMmL4kSq6Dkbmx2qfxYFOTaCA4MvUIrS-wLxHMEWgu6CdD0FOZ7Q5BJGw6gN49q5iPF2wCqV8fIDZms4_pKdOnnDllduBELW-aAd6R8Fe-g4z1eJsqyCwTovbi-PX6FCYZkyzK03QX-pvl_k Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:09.403661 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9016477f5fb4f8ca9ae1e2cd9140f1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 827c014b86144856912587798bc424cc Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: exception: Aggregate 6 could not be found. Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6'} Jul 24 01:09:09.404993 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:09.405789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 24 01:09:09.408002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.412082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b77d9c8-6b27-40f0-9a4e-4c1b2c3bfebb tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:09.413985 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b77d9c8-6b27-40f0-9a4e-4c1b2c3bfebb tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.043702 Jul 24 01:09:09.415316 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 104/172] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:09:09 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:09.422728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fdb4baa-61b2-492d-a2a2-a9becc5b8472 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05ebda7280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.425015 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.425015 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.426889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fdb4baa-61b2-492d-a2a2-a9becc5b8472 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.428419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fdb4baa-61b2-492d-a2a2-a9becc5b8472 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.429515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fdb4baa-61b2-492d-a2a2-a9becc5b8472 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.431921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fdb4baa-61b2-492d-a2a2-a9becc5b8472 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.454225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:09.474556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fdb4baa-61b2-492d-a2a2-a9becc5b8472 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.057632 Jul 24 01:09:09.475289 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 105/173] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:09:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.481975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dbb638f0-2778-4a38-9c43-70bf7f4b11ee tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-81917194"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:09.485060 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.485060 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.486489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-dbb638f0-2778-4a38-9c43-70bf7f4b11ee tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid 2fb32035-9cab-4b11-9565-884bd0b09a8c for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:09.490127 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7eb7c7e0-4e49-474a-a0b7-aa33dc238993 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.592549 Jul 24 01:09:09.494816 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 69/174] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:08 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:09.505277 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:09.513409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa573f23-0ec9-410d-b34f-d9fd282f0004 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.515193 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.515193 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:09.519733 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dbb638f0-2778-4a38-9c43-70bf7f4b11ee tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.042918 Jul 24 01:09:09.521064 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 106/175] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:09 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.527976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0f6131b-c447-4d8b-9faa-46bbf2b7f499 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05ebcf01f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.529154 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.529154 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.538660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0f6131b-c447-4d8b-9faa-46bbf2b7f499 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.539410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0f6131b-c447-4d8b-9faa-46bbf2b7f499 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.566559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0f6131b-c447-4d8b-9faa-46bbf2b7f499 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.567297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0f6131b-c447-4d8b-9faa-46bbf2b7f499 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.575648 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-aa573f23-0ec9-410d-b34f-d9fd282f0004 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa573f23-0ec9-410d-b34f-d9fd282f0004 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Request method failure captured: Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt7xD7RQIX_lvpT-3EGp95Yxc2vdN3PMmL4kSq6Dkbmx2qfxYFOTaCA4MvUIrS-wLxHMEWgu6CdD0FOZ7Q5BJGw6gN49q5iPF2wCqV8fIDZms4_pKdOnnDllduBELW-aAd6R8Fe-g4z1eJsqyCwTovbi-PX6FCYZkyzK03QX-pvl_k Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:09.581150 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9016477f5fb4f8ca9ae1e2cd9140f1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 827c014b86144856912587798bc424cc Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: exception: Aggregate 6 could not be found. Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6'} Jul 24 01:09:09.583831 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:09.585405 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:09.588126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:09.593192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:09.593192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:09.593192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:09.593192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 24 01:09:09.593192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:09.593192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa573f23-0ec9-410d-b34f-d9fd282f0004 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:09.593192 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa573f23-0ec9-410d-b34f-d9fd282f0004 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.089958 Jul 24 01:09:09.593979 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0f6131b-c447-4d8b-9faa-46bbf2b7f499 tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.068758 Jul 24 01:09:09.593979 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 107/176] 10.222.0.27 () {58 vars in 1169 bytes} [Sun Jul 24 01:09:09 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 467 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.596311 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 70/177] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:09.600388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b760b6df-8ebf-4a35-b9cb-2efe9d71933c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:09.601579 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.601579 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.602012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.602671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:09.611177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.611420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b760b6df-8ebf-4a35-b9cb-2efe9d71933c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.611792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b760b6df-8ebf-4a35-b9cb-2efe9d71933c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.612732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.613781 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.614546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.800233 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b760b6df-8ebf-4a35-b9cb-2efe9d71933c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 240 microversion: 2.1 time: 0.204561 Jul 24 01:09:09.802077 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 108/178] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:09 2022] POST /compute/v2.1/os-aggregates/7/action => generated 240 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.811491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-120b8442-0046-4604-b01e-68efd25a4e1a tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1697432843", "name": "tempest-test_aggregate-385074960"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:09.844676 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.844676 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.845801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-120b8442-0046-4604-b01e-68efd25a4e1a tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid 4f374497-7cbb-4c1f-b72e-ef2923a89fb8 for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:09.891190 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-120b8442-0046-4604-b01e-68efd25a4e1a tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.087529 Jul 24 01:09:09.900667 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 109/179] 10.222.0.27 () {60 vars in 1164 bytes} [Sun Jul 24 01:09:09 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.900667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4b16374-99d8-49d0-bd5d-57af00ddc95f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Calling method '.version_select at 0x7f05ebda7d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:09.900667 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.900667 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.906852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4b16374-99d8-49d0-bd5d-57af00ddc95f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.907331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4b16374-99d8-49d0-bd5d-57af00ddc95f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.922397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4b16374-99d8-49d0-bd5d-57af00ddc95f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.923254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4b16374-99d8-49d0-bd5d-57af00ddc95f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:09.951499 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c4b16374-99d8-49d0-bd5d-57af00ddc95f tempest-HostsAdminTestJSON-2108267236 tempest-HostsAdminTestJSON-2108267236-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.058125 Jul 24 01:09:09.953057 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 110/180] 10.222.0.27 () {58 vars in 1169 bytes} [Sun Jul 24 01:09:09 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 598 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:09.969004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c964ffe2-2d34-414c-b9d2-44c9bba42d0e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:09.973591 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:09.973591 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:09.987139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:09.990684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c964ffe2-2d34-414c-b9d2-44c9bba42d0e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:09.995894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c964ffe2-2d34-414c-b9d2-44c9bba42d0e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:10.000322 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-481b3a61-fc12-44ad-8741-daa02206b442 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 0.402733 Jul 24 01:09:10.001574 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:10.003127 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 71/181] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:09 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:10.017062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd0b5472-df0d-40d0-a809-39f92300e3a4 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:10.018473 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.018473 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:10.061921 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cd0b5472-df0d-40d0-a809-39f92300e3a4 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.057199 Jul 24 01:09:10.062705 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c964ffe2-2d34-414c-b9d2-44c9bba42d0e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-master-1. Jul 24 01:09:10.063523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 72/182] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:10 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:10.071969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:10.073977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:10.082319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:10.083150 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:10.084263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:10.084823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c964ffe2-2d34-414c-b9d2-44c9bba42d0e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 39 Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:10.086460 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: {"add_host": {"host": "n-h1-master-1"}} Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:10.087877 n-d-master-1 devstack@n-api.service[119562]: exception: Aggregate 7 already has host n-h1-master-1. Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result.read() Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:09:10.088800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi session.flush() Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 01:09:10.090035 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 01:09:10.092320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:09:10.094389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result.read() Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 24, 1, 9, 10, 45861), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 7}] Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.097533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-master-1. Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.098900 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-master-1. Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:10.100307 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:10.105121 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-master-1. Jul 24 01:09:10.105121 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.105121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c964ffe2-2d34-414c-b9d2-44c9bba42d0e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-master-1. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:10.105121 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c964ffe2-2d34-414c-b9d2-44c9bba42d0e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.147366 Jul 24 01:09:10.111550 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 111/183] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:09 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 24 01:09:10.135085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ea76153c-f747-4a9a-b60b-ff8b8e0dd917 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:10.136554 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.136554 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:10.159143 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ea76153c-f747-4a9a-b60b-ff8b8e0dd917 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ea76153c-f747-4a9a-b60b-ff8b8e0dd917 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Request method failure captured: Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt7xD7RQIX_lvpT-3EGp95Yxc2vdN3PMmL4kSq6Dkbmx2qfxYFOTaCA4MvUIrS-wLxHMEWgu6CdD0FOZ7Q5BJGw6gN49q5iPF2wCqV8fIDZms4_pKdOnnDllduBELW-aAd6R8Fe-g4z1eJsqyCwTovbi-PX6FCYZkyzK03QX-pvl_k Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:10.160793 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9016477f5fb4f8ca9ae1e2cd9140f1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 827c014b86144856912587798bc424cc Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: exception: Aggregate 8 could not be found. Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8'} Jul 24 01:09:10.162998 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.163719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 24 01:09:10.165205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.180921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ea76153c-f747-4a9a-b60b-ff8b8e0dd917 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:10.184948 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ea76153c-f747-4a9a-b60b-ff8b8e0dd917 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.072407 Jul 24 01:09:10.197145 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 112/184] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:09:10 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:10.211470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b07c7f6a-e3be-4a7b-8c78-8768a1d022be tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:10.230976 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.230976 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:10.246752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b07c7f6a-e3be-4a7b-8c78-8768a1d022be tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:10.247544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b07c7f6a-e3be-4a7b-8c78-8768a1d022be tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:10.429056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:10.443278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a599dc23-1c7c-4b61-a448-7637ed3ee399 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 0.378306 Jul 24 01:09:10.448599 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 73/185] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:10 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:10.453022 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b07c7f6a-e3be-4a7b-8c78-8768a1d022be tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 225 microversion: 2.1 time: 0.254711 Jul 24 01:09:10.455611 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 113/186] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:10 2022] POST /compute/v2.1/os-aggregates/7/action => generated 225 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:10.459871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a33d343-9605-4756-b8ab-2eaea5abd1ac tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:10.461107 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.461107 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:10.473105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fe1367ae-409c-469b-8c3a-6a7d9aa88ca4 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:10.485653 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9a33d343-9605-4756-b8ab-2eaea5abd1ac tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a33d343-9605-4756-b8ab-2eaea5abd1ac tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Request method failure captured: Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt7xD7RQIX_lvpT-3EGp95Yxc2vdN3PMmL4kSq6Dkbmx2qfxYFOTaCA4MvUIrS-wLxHMEWgu6CdD0FOZ7Q5BJGw6gN49q5iPF2wCqV8fIDZms4_pKdOnnDllduBELW-aAd6R8Fe-g4z1eJsqyCwTovbi-PX6FCYZkyzK03QX-pvl_k Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:10.488017 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9016477f5fb4f8ca9ae1e2cd9140f1f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9016477f5fb4f8ca9ae1e2cd9140f1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e9016477f5fb4f8ca9ae1e2cd9140f1f Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-525300773 Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 827c014b86144856912587798bc424cc Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminTestJSON-525300773-project-admin Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: exception: Aggregate 8 could not be found. Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8'} Jul 24 01:09:10.489440 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:10.490327 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:10.491395 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:10.492574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:10.492574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:10.492574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:10.492574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 24 01:09:10.492574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:10.492988 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.492988 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:10.497482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a33d343-9605-4756-b8ab-2eaea5abd1ac tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:10.498641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a33d343-9605-4756-b8ab-2eaea5abd1ac tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.048624 Jul 24 01:09:10.502348 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 74/187] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:10 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:10.513188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51894943-ae1f-4eb4-8a20-8d8bdc782e0d tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1835690144"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:10.521880 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.521880 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:10.523486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-51894943-ae1f-4eb4-8a20-8d8bdc782e0d tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid 25aacf57-a4f7-4938-8ecb-713e6662a036 for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:10.570479 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fe1367ae-409c-469b-8c3a-6a7d9aa88ca4 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.103205 Jul 24 01:09:10.571636 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 114/188] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:10 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:10.583222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:10.591149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-51894943-ae1f-4eb4-8a20-8d8bdc782e0d tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080846 Jul 24 01:09:10.592378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:10.592746 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 75/189] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:10.606410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:10.606831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:10.607629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:10.608749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:10.612296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c1311b7-2bbe-4886-b2d0-7b35a6d9f269 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-776469628"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:10.615311 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.615311 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:10.617596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-7c1311b7-2bbe-4886-b2d0-7b35a6d9f269 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid 31a3d18f-60ce-432c-be05-ed7210f900a0 for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:10.657781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c1311b7-2bbe-4886-b2d0-7b35a6d9f269 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062775 Jul 24 01:09:10.671863 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 76/190] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:10.681081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00c23533-38c6-44b6-ba18-69f88dca9882 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:10.683695 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.683695 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:10.697814 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00c23533-38c6-44b6-ba18-69f88dca9882 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.025820 Jul 24 01:09:10.708848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 77/191] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:09:10 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:10.809832 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:10.944636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:10.956766 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3a47b0c-c5d8-4161-bd62-d18afd785ace tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.380970 Jul 24 01:09:10.959410 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 115/192] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:10 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:10.965938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8bb3fee2-5be0-47db-b680-f8cb8dabbc73 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:10.969141 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:10.969141 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:11.023847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8bb3fee2-5be0-47db-b680-f8cb8dabbc73 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.061452 Jul 24 01:09:11.025902 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 116/193] 10.222.0.27 () {60 vars in 1190 bytes} [Sun Jul 24 01:09:10 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:11.039624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:11.046639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:11.064870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:11.065625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:11.067572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:11.069243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:11.347760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-feb2b927-76ed-4374-a81b-e7dfdcf1ac48 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:11.350060 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:11.350060 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:11.351435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-feb2b927-76ed-4374-a81b-e7dfdcf1ac48 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'f1a30d650263498d9d81b314b4fca6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd53a8a88895489eb82bd671379ee52a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-feb2b927-76ed-4374-a81b-e7dfdcf1ac48 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Request method failure captured: Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 39 Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt4bM_JV1YMjmhU7TxJy8S-LEpOoOf-qWWd1A8JHg52ZP03OaiPVBy7c2s71lYP0yPOwtz8SqfNW7YvbWv9PcXdsP5SUxEQMVx3V4y5kjta1Z_LG9dUscEknzD6vqI39rGI-b8DTk0WZkv1frCfqH7Vl8tdzLfnBKV5NUi0dzKDTpA Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:11.353314 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd53a8a88895489eb82bd671379ee52a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f1a30d650263498d9d81b314b4fca6f0 Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: {"add_host": {"host": "n-h1-master-1"}} Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:11.355013 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:11.355936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 24 01:09:11.356943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:11.366585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-feb2b927-76ed-4374-a81b-e7dfdcf1ac48 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:11.367828 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-feb2b927-76ed-4374-a81b-e7dfdcf1ac48 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.657064 Jul 24 01:09:11.368419 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 78/194] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:10 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 659 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:11.377373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb1f3a24-f6f0-480e-b181-891e20354710 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:11.389519 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:11.389519 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:11.403060 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb1f3a24-f6f0-480e-b181-891e20354710 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.029389 Jul 24 01:09:11.417251 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 79/195] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:09:11 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:11.428998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2364a227-5c0e-478d-ba5a-2be4c7d86a78 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:11.430052 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:11.430052 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:11.479935 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2364a227-5c0e-478d-ba5a-2be4c7d86a78 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.061165 Jul 24 01:09:11.486513 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 80/196] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:11 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:11.492492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aaa3b8ae-0dd6-4a10-8d9e-491f40bcb0be tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:11.494073 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:11.494073 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:11.528528 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aaa3b8ae-0dd6-4a10-8d9e-491f40bcb0be tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.039986 Jul 24 01:09:11.535239 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 81/197] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:11 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:11.543048 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:11.543960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:11.554208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:11.555353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:11.556642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:11.557355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:12.195723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:12.212852 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e3c9b37-7ff2-4ac2-85ca-9c3acb4960ea tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1389 microversion: 2.1 time: 1.184443 Jul 24 01:09:12.215382 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 117/198] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:11 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1389 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:12.227220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:12.230630 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:12.239664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1683eb0c-6f9a-4661-9953-d8dd6048d677 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-901629813"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:12.247119 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.247119 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:12.248570 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8b520046-b246-4b77-9348-9d41bab13082 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 0.716784 Jul 24 01:09:12.250380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-1683eb0c-6f9a-4661-9953-d8dd6048d677 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid ad53a75c-0a7a-4304-bb20-fcc8eeb23c1c for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:12.253177 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 82/199] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:11 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:12.270604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3c1b426-a4a1-4db4-b66b-024819b8df4a tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1213304386", "availability_zone": "tempest-test_az-1849263006"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:12.351208 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1683eb0c-6f9a-4661-9953-d8dd6048d677 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.132289 Jul 24 01:09:12.354128 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 118/200] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:12.370861 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.370861 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:12.376440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:12.377989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-c3c1b426-a4a1-4db4-b66b-024819b8df4a tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid 49ca10ca-ab1e-4607-8d5b-4aace7d01a6b for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:12.380289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:12.411361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:12.416483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:12.419643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:12.421458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:12.460411 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c3c1b426-a4a1-4db4-b66b-024819b8df4a tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.200423 Jul 24 01:09:12.462175 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 83/201] 10.222.0.27 () {60 vars in 1164 bytes} [Sun Jul 24 01:09:12 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:12.491243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-887687251"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:12.504426 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.504426 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:12.526797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:12.527500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:12.554117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:12.554840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:12.564372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-887687251 could not be found. Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 57 Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:12.566636 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: {"add_host": {"host": "tempest-nonexist_host-887687251"}} Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:12.567921 n-d-master-1 devstack@n-api.service[119561]: exception: Compute host tempest-nonexist_host-887687251 could not be found. Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-887687251'}}} Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-887687251' is not mapped to any cell Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.568702 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 24 01:09:12.569922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-887687251 could not be found. Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-887687251 could not be found. Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.571063 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.572196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.572196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:12.572196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:12.572196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:12.572196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:12.572196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-887687251 could not be found. Jul 24 01:09:12.572196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.575778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-887687251 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:12.577314 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e6b8a30-9070-4cfd-8aad-6e739e606ee9 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.110749 Jul 24 01:09:12.578178 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 84/202] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:12.584495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e843168d-2840-450e-a3ff-e9ae712e0842 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1213304386_new", "availability_zone": "tempest-test_az-1849263006_new"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:12.670959 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.670959 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:12.718745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e843168d-2840-450e-a3ff-e9ae712e0842 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:12.719447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e843168d-2840-450e-a3ff-e9ae712e0842 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:12.771463 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e843168d-2840-450e-a3ff-e9ae712e0842 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.191836 Jul 24 01:09:12.773185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 85/203] 10.222.0.27 () {60 vars in 1172 bytes} [Sun Jul 24 01:09:12 2022] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:12.780609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d16cf48f-2ab8-4184-945b-9e1b6b45e997 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:12.782148 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.782148 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:12.814274 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d16cf48f-2ab8-4184-945b-9e1b6b45e997 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.037858 Jul 24 01:09:12.814975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 86/204] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:12 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:12.822602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-21d5efda-78ae-47bd-bbbd-63d407b55705 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:12.823843 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.823843 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:12.837737 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-21d5efda-78ae-47bd-bbbd-63d407b55705 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.021602 Jul 24 01:09:12.839924 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 87/205] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:09:12 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:12.845708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16bd84c0-81b1-4ecd-a191-033d01451715 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16bd84c0-81b1-4ecd-a191-033d01451715 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 283 Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:12.848995 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:12.850307 n-d-master-1 devstack@n-api.service[119561]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:09:12.851195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:09:12.851810 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:09:12.852776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:09:12.855833 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:09:12.855833 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.855833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16bd84c0-81b1-4ecd-a191-033d01451715 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:12.855833 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16bd84c0-81b1-4ecd-a191-033d01451715 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009609 Jul 24 01:09:12.856555 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 88/206] 10.222.0.27 () {60 vars in 1164 bytes} [Sun Jul 24 01:09:12 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:09:12.860972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-792df46b-d387-4349-9736-c2fcd1cc8dbe tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:12.862449 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.862449 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:12.894863 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-792df46b-d387-4349-9736-c2fcd1cc8dbe tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041461 Jul 24 01:09:12.896998 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 89/207] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:12 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:12.903642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-27042389-26df-4e1f-bf05-87044460647c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-27042389-26df-4e1f-bf05-87044460647c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 27 Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:12.906793 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: {"aggregate": {"name": ""}} Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:12.908042 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi '' Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:12.908772 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:09:12.910764 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:12.911884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-27042389-26df-4e1f-bf05-87044460647c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:12.911884 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-27042389-26df-4e1f-bf05-87044460647c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011484 Jul 24 01:09:12.911884 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 90/208] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:12 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:09:12.931150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fab5102-f062-4aff-a960-c9fcaba1fbd9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-477830788"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:12.943671 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:12.943671 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:12.945564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-7fab5102-f062-4aff-a960-c9fcaba1fbd9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Generated uuid 9e793352-9a00-4175-8b33-436235fb6c3d for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:13.008693 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7fab5102-f062-4aff-a960-c9fcaba1fbd9 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097436 Jul 24 01:09:13.010411 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 91/209] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:13.020797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-108b7636-289f-4a32-b551-470dfe6dd0b2 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1724302324"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:13.023364 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:13.023364 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:13.024864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-108b7636-289f-4a32-b551-470dfe6dd0b2 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'f1a30d650263498d9d81b314b4fca6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd53a8a88895489eb82bd671379ee52a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-108b7636-289f-4a32-b551-470dfe6dd0b2 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Request method failure captured: Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 60 Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt4bM_JV1YMjmhU7TxJy8S-LEpOoOf-qWWd1A8JHg52ZP03OaiPVBy7c2s71lYP0yPOwtz8SqfNW7YvbWv9PcXdsP5SUxEQMVx3V4y5kjta1Z_LG9dUscEknzD6vqI39rGI-b8DTk0WZkv1frCfqH7Vl8tdzLfnBKV5NUi0dzKDTpA Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:13.032403 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd53a8a88895489eb82bd671379ee52a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f1a30d650263498d9d81b314b4fca6f0 Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: {"aggregate": {"name": "tempest-test_aggregate-1724302324"}} Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:13.033902 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1724302324'}}} Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:13.034754 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:13.036045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 24 01:09:13.037592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.037592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-108b7636-289f-4a32-b551-470dfe6dd0b2 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:13.037592 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-108b7636-289f-4a32-b551-470dfe6dd0b2 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021785 Jul 24 01:09:13.037592 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 92/210] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:13 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:13.049462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1f93ed1-b5ba-4578-9c4b-8d9b3dd8b2e4 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:13.051265 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:13.051265 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:13.066041 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d1f93ed1-b5ba-4578-9c4b-8d9b3dd8b2e4 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.027083 Jul 24 01:09:13.066973 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 93/211] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:09:13 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:13.075092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3355a890-cf6d-4660-9e31-30d2f7797520 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1039326028"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:13.076655 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:13.076655 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:13.078649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-3355a890-cf6d-4660-9e31-30d2f7797520 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid a8758add-3837-4afb-9179-7f153d9e3f9d for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:13.143272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3355a890-cf6d-4660-9e31-30d2f7797520 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073441 Jul 24 01:09:13.148831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 94/212] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:13.169619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:13.179354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-571ff9de-0a7e-47a6-8b36-4e7326af441c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.821709 Jul 24 01:09:13.180536 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 119/213] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:12 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:13.187021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-faf5439a-558d-4f3b-a38c-c767df0d879e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1039326028"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:13.189141 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:13.189141 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:13.190565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-faf5439a-558d-4f3b-a38c-c767df0d879e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid bce8fb00-b6c5-47a1-b220-729aafd3ae5c for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:13.191996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d0d9f3b-bb58-4398-b20b-4db0f4bfc650 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:13.204160 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-faf5439a-558d-4f3b-a38c-c767df0d879e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1039326028 already exists. Jul 24 01:09:13.204740 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:13.204740 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-faf5439a-558d-4f3b-a38c-c767df0d879e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 60 Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:13.206803 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: {"aggregate": {"name": "tempest-test_aggregate-1039326028"}} Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:13.208194 n-d-master-1 devstack@n-api.service[119562]: exception: Aggregate tempest-test_aggregate-1039326028 already exists. Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1039326028'}}} Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 24 01:09:13.208964 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1039326028 already exists. Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:13.210159 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1039326028 already exists. Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1039326028 already exists. Jul 24 01:09:13.212136 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:13.215384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-faf5439a-558d-4f3b-a38c-c767df0d879e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1039326028 already exists. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:13.216551 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-faf5439a-558d-4f3b-a38c-c767df0d879e tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.034616 Jul 24 01:09:13.217752 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 120/214] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:13 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 36 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:13.232415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-799e58a0-786a-421d-baa2-4c2d7b7affb0 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:13.236575 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:13.237661 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:13.237661 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:13.304502 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-799e58a0-786a-421d-baa2-4c2d7b7affb0 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.076735 Jul 24 01:09:13.307494 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 121/215] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:13 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:13.333041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:13.333843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:13.358450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:13.358909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:13.359723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:13.360189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:13.377950 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d0d9f3b-bb58-4398-b20b-4db0f4bfc650 tempest-AggregatesAdminTestJSON-525300773 tempest-AggregatesAdminTestJSON-525300773-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.220151 Jul 24 01:09:13.388758 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 95/216] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:13 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:13.418116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:13.423127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:13.474443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:13.475128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:13.482244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:13.488609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.012001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:14.023417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1e4c83d3-8147-4b22-814a-ddfd71dc76be tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 0.632930 Jul 24 01:09:14.024661 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 96/217] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:13 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:14.034399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:14.045538 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-624410c7-e177-48e7-a993-968c3e5bee3b tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1588 microversion: 2.1 time: 0.734020 Jul 24 01:09:14.048680 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 122/218] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:13 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1588 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:14.052206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33280639-941b-4edf-8b38-e89bd474a61d tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2076708897"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:14.054289 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:14.054289 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:14.057098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-33280639-941b-4edf-8b38-e89bd474a61d tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid 36afd48a-5372-4550-a88c-302b8392509b for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:14.061354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:14.063878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:14.075293 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.080596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.081829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.084538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.109041 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33280639-941b-4edf-8b38-e89bd474a61d tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.079810 Jul 24 01:09:14.111888 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 97/219] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:14.131007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de410f66-5a33-415f-bee7-ba9ccb8f62a7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:14.132620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de410f66-5a33-415f-bee7-ba9ccb8f62a7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:14.143277 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] HTTP exception thrown: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Request method failure captured: Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 HTTP/1.1 Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt4oTMf4hpiguVuwKtNM67oaFG_QaxVYo1SLVhYqX9U-Y9A3Ytm_nQet8ug4SaamyFVtNC6CkzW1n_7Cf9nYYwEuPRCgjZNhBXM9k4eY1cQg1jsL541NDmtCsjx1PIqXvhPj0BolF2WTGaaSTmCnQSmjzBanetyksJDlePGwttRf40 Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 3d121ab923474b2ca0c274a943530dd2 Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:14.149052 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d121ab923474b2ca0c274a943530dd2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 3d121ab923474b2ca0c274a943530dd2 Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminTestJSON-1609986828-project Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1416426260704ceca5211082c2399bca Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminTestJSON-1609986828-project Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.150324 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8c3fd965-0867-487a-b713-84476aaeb577'} Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:14.151750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.155131 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.158811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Returning 404 to user: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:14.161147 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1163ad37-c5a4-49bd-87b0-cfc42d7d813d tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 404 len: 111 microversion: 2.1 time: 0.111195 Jul 24 01:09:14.162903 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 123/220] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:09:14 2022] DELETE /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:14.164354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de410f66-5a33-415f-bee7-ba9ccb8f62a7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.167745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de410f66-5a33-415f-bee7-ba9ccb8f62a7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.169944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de410f66-5a33-415f-bee7-ba9ccb8f62a7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.170727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de410f66-5a33-415f-bee7-ba9ccb8f62a7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.179269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-07008802-a053-4060-9e5c-85503d8084fe tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:14.180534 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:14.180534 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:14.185006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-07008802-a053-4060-9e5c-85503d8084fe tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'f1a30d650263498d9d81b314b4fca6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd53a8a88895489eb82bd671379ee52a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-07008802-a053-4060-9e5c-85503d8084fe tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Request method failure captured: Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt4bM_JV1YMjmhU7TxJy8S-LEpOoOf-qWWd1A8JHg52ZP03OaiPVBy7c2s71lYP0yPOwtz8SqfNW7YvbWv9PcXdsP5SUxEQMVx3V4y5kjta1Z_LG9dUscEknzD6vqI39rGI-b8DTk0WZkv1frCfqH7Vl8tdzLfnBKV5NUi0dzKDTpA Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:14.194573 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd53a8a88895489eb82bd671379ee52a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f1a30d650263498d9d81b314b4fca6f0 Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 24 01:09:14.195725 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '15'} Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:14.196356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 24 01:09:14.197302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.202628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-07008802-a053-4060-9e5c-85503d8084fe tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:14.203819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-07008802-a053-4060-9e5c-85503d8084fe tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.039108 Jul 24 01:09:14.207410 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 124/221] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:14 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:14.215143 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=24 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:14.484398 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=32,nova_cell0:UPDATE=7 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:14.554453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1825785707", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:14.651971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:14.687145 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de410f66-5a33-415f-bee7-ba9ccb8f62a7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.564861 Jul 24 01:09:14.688104 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 98/222] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:09:14 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19/os-interface => generated 284 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:14.700522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:14.701071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] [instance: 8c3fd965-0867-487a-b713-84476aaeb577] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:14.707849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.708473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.709403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.709887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.740484 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] HTTP exception thrown: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Request method failure captured: Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 HTTP/1.1 Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt4oTMf4hpiguVuwKtNM67oaFG_QaxVYo1SLVhYqX9U-Y9A3Ytm_nQet8ug4SaamyFVtNC6CkzW1n_7Cf9nYYwEuPRCgjZNhBXM9k4eY1cQg1jsL541NDmtCsjx1PIqXvhPj0BolF2WTGaaSTmCnQSmjzBanetyksJDlePGwttRf40 Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 3d121ab923474b2ca0c274a943530dd2 Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:14.742833 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d121ab923474b2ca0c274a943530dd2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d121ab923474b2ca0c274a943530dd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 3d121ab923474b2ca0c274a943530dd2 Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1609986828 Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminTestJSON-1609986828-project Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1416426260704ceca5211082c2399bca Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminTestJSON-1609986828-project Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.745293 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8c3fd965-0867-487a-b713-84476aaeb577'} Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:14.747755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. Jul 24 01:09:14.758598 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:14.763371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] Returning 404 to user: Instance 8c3fd965-0867-487a-b713-84476aaeb577 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:14.763371 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa02c00d-c7a1-486e-b0f5-18d1caf36513 tempest-AggregatesAdminTestJSON-1609986828 tempest-AggregatesAdminTestJSON-1609986828-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577" status: 404 len: 111 microversion: 2.1 time: 0.049057 Jul 24 01:09:14.769404 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 99/223] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:14 2022] GET /compute/v2.1/servers/8c3fd965-0867-487a-b713-84476aaeb577 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:14.785181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:14.786119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:14.797646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.798152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:14.799271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:14.799802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:15.644075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:15.674158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03464b87-8401-4731-8a48-3c92d3aecd41 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.895968 Jul 24 01:09:15.680667 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 100/224] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:14 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:15.701704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3802cd8-a651-4927-b54b-700d2510b72f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:15.703119 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:15.703119 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:15.772947 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e3802cd8-a651-4927-b54b-700d2510b72f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.090272 Jul 24 01:09:15.775780 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 101/225] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:15 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:15.801827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:15.803025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:15.829718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:15.830833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:15.832278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:15.833077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:16.357955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:16.358525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:16.358862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:16.359413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:16.359908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:16.396246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:16.403611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:16.404798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:16.405478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:16.457210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Getting quotas for project c028787727e34a489f5a99f937538b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:16.483090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Getting quotas for user bfd5b02713f54950b7a5fae18bf4d485 and project c028787727e34a489f5a99f937538b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:16.508605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:16.512640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:16.600479 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f9ca991-4ef2-4b9c-9cc6-27037cd2012c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390855 Jul 24 01:09:16.610018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:16.614007 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 125/226] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:16.621500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a4ca748-ebad-41eb-ba17-c2f819043212 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:16.622732 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:16.622732 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:16.638272 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3a4ca748-ebad-41eb-ba17-c2f819043212 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a4ca748-ebad-41eb-ba17-c2f819043212 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:16.641796 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: exception: Aggregate -1 could not be found. Jul 24 01:09:16.642955 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '-1'} Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 24 01:09:16.643589 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.644621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:16.645658 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:16.645658 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:16.645658 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:16.645658 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:16.645658 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 24 01:09:16.645658 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.647340 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78d058be-fe45-4896-853e-65771829deb2 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 0.861560 Jul 24 01:09:16.652106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a4ca748-ebad-41eb-ba17-c2f819043212 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:16.653833 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a4ca748-ebad-41eb-ba17-c2f819043212 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.038087 Jul 24 01:09:16.654589 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 102/227] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:15 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:16.657215 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 126/228] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:16 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:16.681947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aaddc9a2-2a9c-4756-b4b7-06826681e41f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2076768888"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:16.686500 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:16.686500 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:16.688878 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-aaddc9a2-2a9c-4756-b4b7-06826681e41f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid 42b228e0-3d7e-4735-9c9c-5f16e5609981 for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:16.710068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:16.711993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:16.731281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:16.733621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:16.737396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:16.739696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:16.829529 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aaddc9a2-2a9c-4756-b4b7-06826681e41f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.163123 Jul 24 01:09:16.841523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 103/229] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:16.875241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf31a19a-526a-490d-a4db-329f911e859e tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:16.904420 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:16.904420 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:16.906027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf31a19a-526a-490d-a4db-329f911e859e tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'f1a30d650263498d9d81b314b4fca6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd53a8a88895489eb82bd671379ee52a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf31a19a-526a-490d-a4db-329f911e859e tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Request method failure captured: Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt4bM_JV1YMjmhU7TxJy8S-LEpOoOf-qWWd1A8JHg52ZP03OaiPVBy7c2s71lYP0yPOwtz8SqfNW7YvbWv9PcXdsP5SUxEQMVx3V4y5kjta1Z_LG9dUscEknzD6vqI39rGI-b8DTk0WZkv1frCfqH7Vl8tdzLfnBKV5NUi0dzKDTpA Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:16.908662 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd53a8a88895489eb82bd671379ee52a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f1a30d650263498d9d81b314b4fca6f0 Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 24 01:09:16.909880 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '16'} Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:16.910521 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 24 01:09:16.911561 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:16.916454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf31a19a-526a-490d-a4db-329f911e859e tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:16.922178 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf31a19a-526a-490d-a4db-329f911e859e tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.064662 Jul 24 01:09:16.929013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 104/230] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:16 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:16.942930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3dc6db0b-4708-4440-812b-2b327ddec760 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:16.944101 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:16.944101 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:17.004496 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3dc6db0b-4708-4440-812b-2b327ddec760 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.065121 Jul 24 01:09:17.005704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 105/231] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:16 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:17.020689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b30919d-81c2-4dbf-94f6-5c5628747eea tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:17.021815 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:17.021815 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:17.048144 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6b30919d-81c2-4dbf-94f6-5c5628747eea tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b30919d-81c2-4dbf-94f6-5c5628747eea tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:17.055856 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: exception: Aggregate -1 could not be found. Jul 24 01:09:17.057058 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '-1'} Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:17.057793 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 24 01:09:17.059190 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.064996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b30919d-81c2-4dbf-94f6-5c5628747eea tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:17.069433 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b30919d-81c2-4dbf-94f6-5c5628747eea tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.054198 Jul 24 01:09:17.072768 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 106/232] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:17 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:09:17.085911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8e5de7f-c325-4e8c-beb8-5e8ffbb0ee32 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:17.087918 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:17.087918 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:17.089395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d8e5de7f-c325-4e8c-beb8-5e8ffbb0ee32 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'f1a30d650263498d9d81b314b4fca6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd53a8a88895489eb82bd671379ee52a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8e5de7f-c325-4e8c-beb8-5e8ffbb0ee32 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Request method failure captured: Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt4bM_JV1YMjmhU7TxJy8S-LEpOoOf-qWWd1A8JHg52ZP03OaiPVBy7c2s71lYP0yPOwtz8SqfNW7YvbWv9PcXdsP5SUxEQMVx3V4y5kjta1Z_LG9dUscEknzD6vqI39rGI-b8DTk0WZkv1frCfqH7Vl8tdzLfnBKV5NUi0dzKDTpA Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:17.096676 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd53a8a88895489eb82bd671379ee52a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f1a30d650263498d9d81b314b4fca6f0 Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 24 01:09:17.097849 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:17.098639 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 24 01:09:17.099654 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:17.108756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8e5de7f-c325-4e8c-beb8-5e8ffbb0ee32 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:17.110212 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d8e5de7f-c325-4e8c-beb8-5e8ffbb0ee32 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.029402 Jul 24 01:09:17.112188 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 107/233] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:09:17 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:09:17.156376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fdd16601-ec63-401e-b8d0-b12483f53a0c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-212112151"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:17.159025 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:17.159025 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:17.160806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.aggregate [None req-fdd16601-ec63-401e-b8d0-b12483f53a0c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid a38e8758-b549-43af-b3dc-c6425ef24cfd for aggregate {{(pid=119561) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:17.276826 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fdd16601-ec63-401e-b8d0-b12483f53a0c tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.155824 Jul 24 01:09:17.277444 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 108/234] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:17.297429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1348881609", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:17.449130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:18.550074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:18.605196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf67a721-e5f6-4fda-be60-5d53415172c4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 1.898308 Jul 24 01:09:18.614925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 127/235] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:16 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:18.633552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f6385182-dc2b-4aa1-9774-05a9e71b8733 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:18.657199 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:18.657199 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:18.687371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6385182-dc2b-4aa1-9774-05a9e71b8733 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:18.688185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6385182-dc2b-4aa1-9774-05a9e71b8733 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:18.752135 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10,nova_api:DELETE=5 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:19.068601 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f6385182-dc2b-4aa1-9774-05a9e71b8733 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.451319 Jul 24 01:09:19.069508 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 128/236] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:18 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:19.076059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2645aa18-0ba1-4283-a09e-d20f88208d01 req-0187ea79-bd13-4f54-9d52-08b1b592af5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975740f0-20a6-4d5b-8e57-766c11d09594", "name": "network-vif-plugged", "status": "completed", "tag": "cebc9e40-12d5-4535-ae92-0157bc5f293e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:19.101266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:19.103263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:19.106866 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:19.108188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:19.109053 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:19.148430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:19.150173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:19.152377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:19.153553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:19.181542 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2645aa18-0ba1-4283-a09e-d20f88208d01 req-0187ea79-bd13-4f54-9d52-08b1b592af5a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:19.182563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2645aa18-0ba1-4283-a09e-d20f88208d01 req-0187ea79-bd13-4f54-9d52-08b1b592af5a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:19.201093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Getting quotas for project c028787727e34a489f5a99f937538b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:19.211751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Getting quotas for user bfd5b02713f54950b7a5fae18bf4d485 and project c028787727e34a489f5a99f937538b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:19.235335 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2645aa18-0ba1-4283-a09e-d20f88208d01 req-0187ea79-bd13-4f54-9d52-08b1b592af5a service nova] Creating event network-vif-plugged:cebc9e40-12d5-4535-ae92-0157bc5f293e for instance 975740f0-20a6-4d5b-8e57-766c11d09594 on n-h2-master-1 Jul 24 01:09:19.254211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2645aa18-0ba1-4283-a09e-d20f88208d01 req-0187ea79-bd13-4f54-9d52-08b1b592af5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182299 Jul 24 01:09:19.255942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:19.256812 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 129/237] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:19.266528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:19.267137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:19.268455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:19.280955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:19.282136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:19.283796 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:19.284745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:19.399418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c659664-518f-4e7a-a14d-edafd1f95b56 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109333 Jul 24 01:09:19.400095 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 109/238] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:19.440455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:19.459557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:19.501295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:19.502216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:19.503677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:19.504466 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:20.368238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:20.383542 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a41437d9-129d-418d-b297-fd018bc8a98d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 200 len: 1588 microversion: 2.1 time: 0.982327 Jul 24 01:09:20.387231 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 110/239] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:19 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 1588 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:20.403404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0caf4505-4855-488f-a415-5ed7f8b7e220 req-6b20dfda-10a5-41b2-a7d1-2b8254a83e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7321071-81d5-42f4-b1ec-3e089a82ff19", "tag": "f8164791-2c87-4117-8705-7b9e3a4c67cd"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:20.414405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:20.423021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0caf4505-4855-488f-a415-5ed7f8b7e220 req-6b20dfda-10a5-41b2-a7d1-2b8254a83e69 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:20.423782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0caf4505-4855-488f-a415-5ed7f8b7e220 req-6b20dfda-10a5-41b2-a7d1-2b8254a83e69 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:20.431384 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f88db72b-51ef-4e61-a95a-b1b3d9813196 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 1.172695 Jul 24 01:09:20.437692 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 130/240] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:19 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:20.455840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6ec3c96-44c2-416a-9b14-b6a7e6c8af98 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:20.464709 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0caf4505-4855-488f-a415-5ed7f8b7e220 req-6b20dfda-10a5-41b2-a7d1-2b8254a83e69 service nova] Creating event network-changed:f8164791-2c87-4117-8705-7b9e3a4c67cd for instance c7321071-81d5-42f4-b1ec-3e089a82ff19 on n-h2-master-1 Jul 24 01:09:20.469472 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:20.469472 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:20.471025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b6ec3c96-44c2-416a-9b14-b6a7e6c8af98 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'f1a30d650263498d9d81b314b4fca6f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd53a8a88895489eb82bd671379ee52a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6ec3c96-44c2-416a-9b14-b6a7e6c8af98 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Request method failure captured: Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 42 Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt4bM_JV1YMjmhU7TxJy8S-LEpOoOf-qWWd1A8JHg52ZP03OaiPVBy7c2s71lYP0yPOwtz8SqfNW7YvbWv9PcXdsP5SUxEQMVx3V4y5kjta1Z_LG9dUscEknzD6vqI39rGI-b8DTk0WZkv1frCfqH7Vl8tdzLfnBKV5NUi0dzKDTpA Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:20.479846 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd53a8a88895489eb82bd671379ee52a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd53a8a88895489eb82bd671379ee52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: dd53a8a88895489eb82bd671379ee52a Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624 Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f1a30d650263498d9d81b314b4fca6f0 Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1047809624-project Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: {"remove_host": {"host": "n-h1-master-1"}} Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:20.481367 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:20.482470 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 24 01:09:20.483730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:20.485159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6ec3c96-44c2-416a-9b14-b6a7e6c8af98 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:20.486732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6ec3c96-44c2-416a-9b14-b6a7e6c8af98 tempest-AggregatesAdminNegativeTestJSON-1047809624 tempest-AggregatesAdminNegativeTestJSON-1047809624-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.046629 Jul 24 01:09:20.490596 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 131/241] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:20 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:20.500567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f66011f6-60cd-4b73-8263-147cbb25f4e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:20.501429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f66011f6-60cd-4b73-8263-147cbb25f4e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:20.513573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0caf4505-4855-488f-a415-5ed7f8b7e220 req-6b20dfda-10a5-41b2-a7d1-2b8254a83e69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115343 Jul 24 01:09:20.514629 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 111/242] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:20.538133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:20.543463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:20.569555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:20.570414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:20.571625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:20.581066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:20.670221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f66011f6-60cd-4b73-8263-147cbb25f4e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:20.682918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f66011f6-60cd-4b73-8263-147cbb25f4e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1214 microversion: 2.1 time: 0.186980 Jul 24 01:09:20.687442 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 132/243] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:20 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:20.696874 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-83df3294-a464-4f8c-acd2-95ea287d473f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:20.705141 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:20.705141 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:20.728837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83df3294-a464-4f8c-acd2-95ea287d473f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:20.731627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83df3294-a464-4f8c-acd2-95ea287d473f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:20.978000 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-83df3294-a464-4f8c-acd2-95ea287d473f tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.286414 Jul 24 01:09:20.978799 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 133/244] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:20 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:20.995224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-20659a66-370b-4fe2-87ee-db948c6ebc4a tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:20.997422 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:20.997422 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:21.064985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:21.074753 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-177c157e-fe28-434b-a061-6a662c7bdb25 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1311 microversion: 2.1 time: 0.558602 Jul 24 01:09:21.077248 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-20659a66-370b-4fe2-87ee-db948c6ebc4a tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.091022 Jul 24 01:09:21.080829 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 134/245] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 24 01:09:21.093952 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 112/246] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:20 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1311 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:21.100028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a43b8085-c255-4760-bcb0-d98c1b2bb89d tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-287082009"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:21.104675 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:21.104675 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:21.106337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-a43b8085-c255-4760-bcb0-d98c1b2bb89d tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Generated uuid 645787f9-9e63-45ec-9644-a86ff65e9697 for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:09:21.189071 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a43b8085-c255-4760-bcb0-d98c1b2bb89d tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093715 Jul 24 01:09:21.192623 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 135/247] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:09:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:21.202412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:21.203854 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:21.203854 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:21.220531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:21.221067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:21.239796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:21.240265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:21.263832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.compute.aggregates [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 24 01:09:21.264368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Request method failure captured: Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 42 Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt7kBf-63JXhlcB8-UDhAOLZU06I6YUQSoEH8zF2wouPb9YEl9NLahxZbcvcimJHI8Yb0or_gshlD_qT8dvDFa5MhPrGdZbGMJIbNIfDZqLX6-Sbx4ZTLEVrUKHsg6U2kX_oaQ1bcFZ5Joz4L2geD3SrCJ-0J-P9caG3ToeKllYGqA Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:21.270547 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ec749645f4f431da4417b69517c577f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ec749645f4f431da4417b69517c577f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ec749645f4f431da4417b69517c577f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 0ec749645f4f431da4417b69517c577f Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285 Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: df49d297ac6149d89812ad6595b43103 Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: {"remove_host": {"host": "nonexist_host"}} Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:21.271931 n-d-master-1 devstack@n-api.service[119561]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 24 01:09:21.272855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 24 01:09:21.274174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.275659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:21.277029 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:21.277029 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:21.277029 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:21.277029 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:21.277029 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 24 01:09:21.277029 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:21.279108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:21.280969 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7837fff9-966b-4549-bd14-e1df023a3e3b tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.082939 Jul 24 01:09:21.285483 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 113/248] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:09:21 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:21.292522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3b76b1a-81e5-4f93-9019-12954f175838 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:21.293605 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:21.293605 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:21.336621 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3b76b1a-81e5-4f93-9019-12954f175838 tempest-AggregatesAdminNegativeTestJSON-2015990285 tempest-AggregatesAdminNegativeTestJSON-2015990285-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.048739 Jul 24 01:09:21.337482 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 136/249] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:21 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 24 01:09:21.390423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-bb97f9b0-ea86-473c-9b23-34be61c12bcd req-0ee70aff-af34-4b13-b451-0d5de7bdfb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55b23bf-6ab5-4630-aa96-71a49a0200b0", "name": "network-vif-plugged", "status": "completed", "tag": "25ee93de-d0c7-486f-a871-8077bc634061"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:21.413895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bb97f9b0-ea86-473c-9b23-34be61c12bcd req-0ee70aff-af34-4b13-b451-0d5de7bdfb44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:21.414671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bb97f9b0-ea86-473c-9b23-34be61c12bcd req-0ee70aff-af34-4b13-b451-0d5de7bdfb44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:21.437477 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-bb97f9b0-ea86-473c-9b23-34be61c12bcd req-0ee70aff-af34-4b13-b451-0d5de7bdfb44 service nova] Creating event network-vif-plugged:25ee93de-d0c7-486f-a871-8077bc634061 for instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 on n-h1-master-1 Jul 24 01:09:21.449581 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-bb97f9b0-ea86-473c-9b23-34be61c12bcd req-0ee70aff-af34-4b13-b451-0d5de7bdfb44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063269 Jul 24 01:09:21.464509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:21.465812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:21.477172 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 114/250] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:21.479818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:21.483143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:21.484255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:21.489983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:22.472794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc5cc705-efd1-424a-9e56-6ed3265feb10 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Calling method '.version_select at 0x7f05ebe68ca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:22.473800 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:22.473800 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:22.480996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc5cc705-efd1-424a-9e56-6ed3265feb10 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f22e08f30fbd4508b91385ff807ee1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8249364e75f4359877fce7cf0eebd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc5cc705-efd1-424a-9e56-6ed3265feb10 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Request method failure captured: Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Ju_Mb0FIWqNRkdIbv7obKQAKgonEEddzRh9y23QyzoDc3iQiGfki1L0P1AMaapLAm2AhkMNZQxIDJvccAw9-rwi3vY-UzYi-oinBqQFIE6pkhSGTfU45RROKbDgTqYdLRYt-yJHar1211R9M30EvV5G-jRuURphpoqwbsga_AMw7NU Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:22.483473 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8249364e75f4359877fce7cf0eebd6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f22e08f30fbd4508b91385ff807ee1ac Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:09:22.484779 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:22.486013 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 24 01:09:22.487237 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:22.488250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc5cc705-efd1-424a-9e56-6ed3265feb10 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:22.488250 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc5cc705-efd1-424a-9e56-6ed3265feb10 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.803712 Jul 24 01:09:22.492354 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 115/251] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:09:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 812 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:09:22.509197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:22.512320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:22.555779 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:22.566485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:22.568025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:22.575584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:22.575786 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:22.587681 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0fac6536-3764-4178-953a-35099b80461d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1322 microversion: 2.1 time: 1.134740 Jul 24 01:09:22.601789 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 137/252] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:21 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1322 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:22.615200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:22.622662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:22.646095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:22.647051 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:22.653875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:22.654828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:22.969495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:23.003122 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ce322a4-bf7c-41e6-88bb-fa512a0d2357 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1266 microversion: 2.1 time: 0.509123 Jul 24 01:09:23.006975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 116/253] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:22 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1266 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:23.022585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dae4978-cbea-4dbf-bfb7-19d133457678 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Calling method '.version_select at 0x7f05f8103700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:23.023437 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:23.023437 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:23.024891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dae4978-cbea-4dbf-bfb7-19d133457678 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f22e08f30fbd4508b91385ff807ee1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8249364e75f4359877fce7cf0eebd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dae4978-cbea-4dbf-bfb7-19d133457678 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Request method failure captured: Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Ju_Mb0FIWqNRkdIbv7obKQAKgonEEddzRh9y23QyzoDc3iQiGfki1L0P1AMaapLAm2AhkMNZQxIDJvccAw9-rwi3vY-UzYi-oinBqQFIE6pkhSGTfU45RROKbDgTqYdLRYt-yJHar1211R9M30EvV5G-jRuURphpoqwbsga_AMw7NU Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:23.047353 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8249364e75f4359877fce7cf0eebd6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f22e08f30fbd4508b91385ff807ee1ac Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:09:23.048613 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:23.049340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 24 01:09:23.050843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:23.051801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dae4978-cbea-4dbf-bfb7-19d133457678 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:23.051801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dae4978-cbea-4dbf-bfb7-19d133457678 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.039240 Jul 24 01:09:23.061200 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 117/254] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:23 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:23.078223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea7a6e3b-284d-4be3-b4b2-bc11298dcd5e tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Calling method '.version_select at 0x7f05ebe7bc10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:23.079183 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:23.079183 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:23.080624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea7a6e3b-284d-4be3-b4b2-bc11298dcd5e tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f22e08f30fbd4508b91385ff807ee1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8249364e75f4359877fce7cf0eebd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea7a6e3b-284d-4be3-b4b2-bc11298dcd5e tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Request method failure captured: Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Ju_Mb0FIWqNRkdIbv7obKQAKgonEEddzRh9y23QyzoDc3iQiGfki1L0P1AMaapLAm2AhkMNZQxIDJvccAw9-rwi3vY-UzYi-oinBqQFIE6pkhSGTfU45RROKbDgTqYdLRYt-yJHar1211R9M30EvV5G-jRuURphpoqwbsga_AMw7NU Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:23.096135 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8249364e75f4359877fce7cf0eebd6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f22e08f30fbd4508b91385ff807ee1ac Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:09:23.097641 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:23.098432 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 24 01:09:23.099534 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:23.100724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea7a6e3b-284d-4be3-b4b2-bc11298dcd5e tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:23.108470 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea7a6e3b-284d-4be3-b4b2-bc11298dcd5e tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.044546 Jul 24 01:09:23.141771 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 118/255] 10.222.0.27 () {58 vars in 1178 bytes} [Sun Jul 24 01:09:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:23.659944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Calling method '.version_select at 0x7f05fa512e50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:23.662940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:23.663413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:23.700328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:23.700790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:23.743055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:23.744010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:23.770567 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8dbb6c2a-31c4-4483-ab67-3deef579946a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.638947 Jul 24 01:09:23.790892 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 119/256] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:23.886814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bffd4b26-c475-4b19-bb8a-de1fca02c8bc tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1061510917", "id": 54907964, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:23.890421 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:23.890421 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:23.920301 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bffd4b26-c475-4b19-bb8a-de1fca02c8bc tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.124521 Jul 24 01:09:23.921337 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 120/257] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:23 2022] POST /compute/v2.1/flavors => generated 424 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:23.938762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:23.940825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:23.951612 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:23.952167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:23.953252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:23.953850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:23.977153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:23.991218 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-662f7270-9dfe-4f98-8d68-d3974ba158f3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1494 microversion: 2.1 time: 1.386573 Jul 24 01:09:23.992248 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 138/258] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:22 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1494 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:24.019746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5092102-44dd-494f-b585-705cbbe12692 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Calling method '.version_select at 0x7f05eba61af0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:24.021515 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:24.021515 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:24.023928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d5092102-44dd-494f-b585-705cbbe12692 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f22e08f30fbd4508b91385ff807ee1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8249364e75f4359877fce7cf0eebd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5092102-44dd-494f-b585-705cbbe12692 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Request method failure captured: Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Ju_Mb0FIWqNRkdIbv7obKQAKgonEEddzRh9y23QyzoDc3iQiGfki1L0P1AMaapLAm2AhkMNZQxIDJvccAw9-rwi3vY-UzYi-oinBqQFIE6pkhSGTfU45RROKbDgTqYdLRYt-yJHar1211R9M30EvV5G-jRuURphpoqwbsga_AMw7NU Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:24.028619 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8249364e75f4359877fce7cf0eebd6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f22e08f30fbd4508b91385ff807ee1ac Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1'} Jul 24 01:09:24.030314 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:24.031180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 24 01:09:24.032141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:24.042885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5092102-44dd-494f-b585-705cbbe12692 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:24.045207 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5092102-44dd-494f-b585-705cbbe12692 tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.042804 Jul 24 01:09:24.046896 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 139/259] 10.222.0.27 () {58 vars in 1172 bytes} [Sun Jul 24 01:09:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:24.063023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-71f8c764-90c6-4af6-bcd5-61efd296da85 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:24.064259 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:24.064259 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:24.100355 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-71f8c764-90c6-4af6-bcd5-61efd296da85 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/54907964" status: 202 len: 0 microversion: 2.1 time: 0.049505 Jul 24 01:09:24.102298 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 140/260] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:24 2022] DELETE /compute/v2.1/flavors/54907964 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:24.293064 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6332ed23-46da-4fbe-a142-5ef5c96dbef7 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:24.294047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6332ed23-46da-4fbe-a142-5ef5c96dbef7 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:24.301261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6332ed23-46da-4fbe-a142-5ef5c96dbef7 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:24.301747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6332ed23-46da-4fbe-a142-5ef5c96dbef7 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:24.302783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6332ed23-46da-4fbe-a142-5ef5c96dbef7 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:24.304242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6332ed23-46da-4fbe-a142-5ef5c96dbef7 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.053042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:25.067376 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b29d2847-d0fa-47e5-9aaf-89127be8e10e tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1472 microversion: 2.1 time: 1.144288 Jul 24 01:09:25.069332 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 121/261] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:23 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1472 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:25.074429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:25.075380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:25.083769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:25.084524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.085828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:25.086436 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.175498 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6332ed23-46da-4fbe-a142-5ef5c96dbef7 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1645 microversion: 2.1 time: 1.071161 Jul 24 01:09:25.178421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 141/262] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:24 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1645 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:25.197856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1cd5f67-a67a-4e70-81b1-f164ebe61208 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Calling method '.version_select at 0x7f05eba73b80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:25.200844 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:25.200844 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:25.204848 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-e1cd5f67-a67a-4e70-81b1-f164ebe61208 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] HTTP exception thrown: Hypervisor with ID 'ebf2e688-9c80-46f4-802f-858fbc983159' could not be found. Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1cd5f67-a67a-4e70-81b1-f164ebe61208 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Request method failure captured: Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hypervisors/ebf2e688-9c80-46f4-802f-858fbc983159/uptime HTTP/1.1 Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvBcT5Aio9T_aXE5Z6cy1Tl1CaaHoWyADcj9jn2xZnVIQONRfkTIaDptxrFxrNtTIe3Z1Tjv1gGfXIty90dHjHkptGN7jpyIj5-IlkOq4rnZQK7z2biHtkGVazGtbtsyN7vLLZ7xQ0CLY1oRZ68LB112-MxTnNKzNjAW221XkDg8Z0 Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 222bab9a1b974b4abc3219746c8606e0 Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-13173998 Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:25.215252 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/222bab9a1b974b4abc3219746c8606e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/222bab9a1b974b4abc3219746c8606e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_222bab9a1b974b4abc3219746c8606e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/222bab9a1b974b4abc3219746c8606e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-13173998 Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 222bab9a1b974b4abc3219746c8606e0 Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-13173998 Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 407c887cb9244591a3d4557e2222889d Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: exception: Hypervisor with ID 'ebf2e688-9c80-46f4-802f-858fbc983159' could not be found. Jul 24 01:09:25.216550 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ebf2e688-9c80-46f4-802f-858fbc983159'} Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ebf2e688-9c80-46f4-802f-858fbc983159' Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 24 01:09:25.217246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ebf2e688-9c80-46f4-802f-858fbc983159' could not be found. Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:25.219979 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.221269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.221269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:25.221269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:25.221269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:25.221269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:25.221269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ebf2e688-9c80-46f4-802f-858fbc983159' could not be found. Jul 24 01:09:25.221269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.224033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1cd5f67-a67a-4e70-81b1-f164ebe61208 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Returning 404 to user: Hypervisor with ID 'ebf2e688-9c80-46f4-802f-858fbc983159' could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:25.226165 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1cd5f67-a67a-4e70-81b1-f164ebe61208 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/ebf2e688-9c80-46f4-802f-858fbc983159/uptime" status: 404 len: 123 microversion: 2.1 time: 0.045715 Jul 24 01:09:25.232876 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 142/263] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 01:09:25 2022] GET /compute/v2.1/os-hypervisors/ebf2e688-9c80-46f4-802f-858fbc983159/uptime => generated 123 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:25.256043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:25.272693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-878d189f-d42e-4db0-ba53-eab24543d9d6 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:25.275718 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-063a3f9e-b1c2-4064-8b37-7af4dbb53918 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1272 microversion: 2.1 time: 0.202197 Jul 24 01:09:25.281989 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 122/264] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:25 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:25.360657 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-878d189f-d42e-4db0-ba53-eab24543d9d6 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.125944 Jul 24 01:09:25.361276 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 143/265] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:25 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:25.375337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15893691-26dd-484c-9ee0-b01703eec77d tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:25.375971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15893691-26dd-484c-9ee0-b01703eec77d tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:25.399184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15893691-26dd-484c-9ee0-b01703eec77d tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:25.399831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15893691-26dd-484c-9ee0-b01703eec77d tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.400733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15893691-26dd-484c-9ee0-b01703eec77d tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:25.401941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15893691-26dd-484c-9ee0-b01703eec77d tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.633925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7fc86ea-cc2c-4ab5-b5cd-12f082880ced tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:25.638929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7fc86ea-cc2c-4ab5-b5cd-12f082880ced tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] [instance: c1d6bb6f-0b17-4c02-8867-fdfc47715eca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:25.661819 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-f7fc86ea-cc2c-4ab5-b5cd-12f082880ced tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] HTTP exception thrown: Instance c1d6bb6f-0b17-4c02-8867-fdfc47715eca could not be found. Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7fc86ea-cc2c-4ab5-b5cd-12f082880ced tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Request method failure captured: Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/c1d6bb6f-0b17-4c02-8867-fdfc47715eca/action HTTP/1.1 Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 15 Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Juq9B_C3QJZ8OTa33wBF31mUJiwBngMDFUMa3uCPZTObWmeLpeuLMzJeGlMpvWRsxDr5YHFbtmSIQvQpdXRjizvYp_7cgc9QonF9GFRsj-4syg3-NzMrh3pMxQQrZRSc16PE5Ltkrit_UbHL3aJgbGlKbB6SXCEekqKxoYvIXjpZVk Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:25.670230 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a09785ffe2da4839a184914bfacfebc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: a250ab409dd8445b910baf57f2e80b48 Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: {"migrate": {}} Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:25.672480 n-d-master-1 devstack@n-api.service[119561]: exception: Instance c1d6bb6f-0b17-4c02-8867-fdfc47715eca could not be found. Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c1d6bb6f-0b17-4c02-8867-fdfc47715eca', 'body': {'migrate': {}}} Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d6bb6f-0b17-4c02-8867-fdfc47715eca could not be found. Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:25.673880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d6bb6f-0b17-4c02-8867-fdfc47715eca could not be found. Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d6bb6f-0b17-4c02-8867-fdfc47715eca could not be found. Jul 24 01:09:25.675909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:25.682452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7fc86ea-cc2c-4ab5-b5cd-12f082880ced tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Returning 404 to user: Instance c1d6bb6f-0b17-4c02-8867-fdfc47715eca could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:25.682452 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7fc86ea-cc2c-4ab5-b5cd-12f082880ced tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/c1d6bb6f-0b17-4c02-8867-fdfc47715eca/action" status: 404 len: 111 microversion: 2.1 time: 0.388977 Jul 24 01:09:25.688822 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 123/266] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:09:25 2022] POST /compute/v2.1/servers/c1d6bb6f-0b17-4c02-8867-fdfc47715eca/action => generated 111 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:25.717900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Calling method '.version_select at 0x7f05ebe50b80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:25.721850 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:25.721850 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:25.731871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:25.735992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.816684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:25.820860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.873226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:25.877219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:25.915445 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15893691-26dd-484c-9ee0-b01703eec77d tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1645 microversion: 2.1 time: 0.549450 Jul 24 01:09:25.931141 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 144/267] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:25 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1645 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:25.940155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60552bf2-3147-4a71-91f4-54d5e4eb391a tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.246555 Jul 24 01:09:25.944083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b48c035-b0f0-447b-8511-44e3dfe29b6f tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-258255752", "id": 1908448566, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:25.944784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 124/268] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:25.947468 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:25.947468 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:25.963692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1799484968", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:25.976461 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b48c035-b0f0-447b-8511-44e3dfe29b6f tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.042775 Jul 24 01:09:25.980374 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 145/269] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:25 2022] POST /compute/v2.1/flavors => generated 416 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:25.990649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2a2f3093-0912-4754-bb08-49f444e17dee tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:25.997434 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:25.997434 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:26.000619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2f3093-0912-4754-bb08-49f444e17dee tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:26.001138 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2f3093-0912-4754-bb08-49f444e17dee tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:26.001974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2f3093-0912-4754-bb08-49f444e17dee tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:26.002430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2f3093-0912-4754-bb08-49f444e17dee tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:26.066211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2a2f3093-0912-4754-bb08-49f444e17dee tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083952 Jul 24 01:09:26.069039 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 146/270] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:09:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:26.072129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:26.080752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce8b9a96-5a7a-4ca2-845b-430f518af55d tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Calling method '.version_select at 0x7f05eba61550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:26.083050 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:26.083050 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:26.085782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ce8b9a96-5a7a-4ca2-845b-430f518af55d tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f22e08f30fbd4508b91385ff807ee1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8249364e75f4359877fce7cf0eebd6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce8b9a96-5a7a-4ca2-845b-430f518af55d tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Request method failure captured: Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Ju_Mb0FIWqNRkdIbv7obKQAKgonEEddzRh9y23QyzoDc3iQiGfki1L0P1AMaapLAm2AhkMNZQxIDJvccAw9-rwi3vY-UzYi-oinBqQFIE6pkhSGTfU45RROKbDgTqYdLRYt-yJHar1211R9M30EvV5G-jRuURphpoqwbsga_AMw7NU Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:26.089551 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8249364e75f4359877fce7cf0eebd6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8249364e75f4359877fce7cf0eebd6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: f8249364e75f4359877fce7cf0eebd6b Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516 Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f22e08f30fbd4508b91385ff807ee1ac Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1006429516-project Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1'} Jul 24 01:09:26.092204 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:26.093605 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 24 01:09:26.095888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:26.100542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce8b9a96-5a7a-4ca2-845b-430f518af55d tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:26.103196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ce8b9a96-5a7a-4ca2-845b-430f518af55d tempest-HypervisorAdminNegativeTestJSON-1006429516 tempest-HypervisorAdminNegativeTestJSON-1006429516-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.031309 Jul 24 01:09:26.105164 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 147/271] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:09:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:26.116684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e138e160-9257-4620-8604-bd65d2fe996c tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:26.168332 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e138e160-9257-4620-8604-bd65d2fe996c tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.060940 Jul 24 01:09:26.177847 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 148/272] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:26 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:26.184712 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:26.188710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:26.218055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:26.218927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:26.219982 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:26.220606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:26.445275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lazy-loading 'flavor' on Instance uuid 975740f0-20a6-4d5b-8e57-766c11d09594 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:09:26.591078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Going to try to live migrate instance to n-h1-master-1 {{(pid=119562) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:09:27.081065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:27.081910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:27.082122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:27.082557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:27.082968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:27.104499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:27.105413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:27.106519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:27.107169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:27.149654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Getting quotas for project 3a66209b0c5f43928a52519ee8f5edbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:27.153537 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:27.174074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Getting quotas for user d9d620962dcc40a8afaf6f97ae605eec and project 3a66209b0c5f43928a52519ee8f5edbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:27.192365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:27.195020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:27.296022 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33a56231-d89b-4c00-9669-a42179297a03 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349415 Jul 24 01:09:27.299935 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 125/273] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:27.313098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3134d09a-e8e5-41dd-b798-00f6e83e5747 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Calling method '.version_select at 0x7f05ebd0a040>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:27.315676 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:27.315676 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:27.319528 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3134d09a-e8e5-41dd-b798-00f6e83e5747 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] HTTP exception thrown: Hypervisor with ID 'fa7217bd-1f3b-48a6-ae7a-ebec2de604c2' could not be found. Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3134d09a-e8e5-41dd-b798-00f6e83e5747 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Request method failure captured: Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hypervisors/fa7217bd-1f3b-48a6-ae7a-ebec2de604c2 HTTP/1.1 Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvBcT5Aio9T_aXE5Z6cy1Tl1CaaHoWyADcj9jn2xZnVIQONRfkTIaDptxrFxrNtTIe3Z1Tjv1gGfXIty90dHjHkptGN7jpyIj5-IlkOq4rnZQK7z2biHtkGVazGtbtsyN7vLLZ7xQ0CLY1oRZ68LB112-MxTnNKzNjAW221XkDg8Z0 Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 222bab9a1b974b4abc3219746c8606e0 Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-13173998 Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:27.352950 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/222bab9a1b974b4abc3219746c8606e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/222bab9a1b974b4abc3219746c8606e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_222bab9a1b974b4abc3219746c8606e0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/222bab9a1b974b4abc3219746c8606e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-13173998 Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 222bab9a1b974b4abc3219746c8606e0 Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-13173998 Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 407c887cb9244591a3d4557e2222889d Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: exception: Hypervisor with ID 'fa7217bd-1f3b-48a6-ae7a-ebec2de604c2' could not be found. Jul 24 01:09:27.355856 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'fa7217bd-1f3b-48a6-ae7a-ebec2de604c2'} Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fa7217bd-1f3b-48a6-ae7a-ebec2de604c2' Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 24 01:09:27.357388 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:09:27.360249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fa7217bd-1f3b-48a6-ae7a-ebec2de604c2' could not be found. Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fa7217bd-1f3b-48a6-ae7a-ebec2de604c2' could not be found. Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:27.364511 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3134d09a-e8e5-41dd-b798-00f6e83e5747 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] Returning 404 to user: Hypervisor with ID 'fa7217bd-1f3b-48a6-ae7a-ebec2de604c2' could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:27.366043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3134d09a-e8e5-41dd-b798-00f6e83e5747 tempest-HypervisorAdminNegativeTestJSON-13173998 tempest-HypervisorAdminNegativeTestJSON-13173998-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/fa7217bd-1f3b-48a6-ae7a-ebec2de604c2" status: 404 len: 123 microversion: 2.1 time: 0.057846 Jul 24 01:09:27.371261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 126/274] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:09:27 2022] GET /compute/v2.1/os-hypervisors/fa7217bd-1f3b-48a6-ae7a-ebec2de604c2 => generated 123 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:27.376965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-744c59af-d744-4c59-8887-fa6f762e0187 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:27.377885 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:27.377885 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:27.411539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-744c59af-d744-4c59-8887-fa6f762e0187 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1908448566" status: 202 len: 0 microversion: 2.1 time: 0.038966 Jul 24 01:09:27.414264 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 127/275] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:09:27 2022] DELETE /compute/v2.1/flavors/1908448566 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:27.427916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:27.432526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:27.445612 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:27.449894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:27.451114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:27.452267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:27.949326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:27.978435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78bc65ac-3a5b-4787-9863-450106f8c216 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.561971 Jul 24 01:09:27.983657 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 128/276] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:27 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:28.007696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-39050bff-7e49-4439-8243-b8669f1f41c6 req-476553e1-6f79-4a2a-8f0a-9148c655eebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47daf830-dbdf-42ca-ab4a-7fa63658b66a", "tag": "d50c538b-1612-4fad-b54b-93a3c2ceaccb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:28.044839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-39050bff-7e49-4439-8243-b8669f1f41c6 req-476553e1-6f79-4a2a-8f0a-9148c655eebb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:28.052926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-39050bff-7e49-4439-8243-b8669f1f41c6 req-476553e1-6f79-4a2a-8f0a-9148c655eebb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:28.119935 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-39050bff-7e49-4439-8243-b8669f1f41c6 req-476553e1-6f79-4a2a-8f0a-9148c655eebb service nova] Creating event network-changed:d50c538b-1612-4fad-b54b-93a3c2ceaccb for instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a on n-h1-master-1 Jul 24 01:09:28.141034 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-39050bff-7e49-4439-8243-b8669f1f41c6 req-476553e1-6f79-4a2a-8f0a-9148c655eebb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149955 Jul 24 01:09:28.147592 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 129/277] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:28.158764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a2b4b69-39a3-49b8-b2d1-c0be5af91af3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:28.169363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2a2b4b69-39a3-49b8-b2d1-c0be5af91af3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:28.317499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2a2b4b69-39a3-49b8-b2d1-c0be5af91af3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:28.327261 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a2b4b69-39a3-49b8-b2d1-c0be5af91af3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1222 microversion: 2.1 time: 0.177502 Jul 24 01:09:28.329436 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 130/278] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:28 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:28.340961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f96753a5-8f0b-4d4f-bc44-d7c6c2073a03 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:28.412104 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f96753a5-8f0b-4d4f-bc44-d7c6c2073a03 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.080494 Jul 24 01:09:28.425848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 131/279] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:28 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:28.441920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5704fb99-a53b-423c-bd4b-c1ce95e5cace tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2039517475", "id": 2077708944, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:28.443851 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:28.443851 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:28.473788 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5704fb99-a53b-423c-bd4b-c1ce95e5cace tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.035984 Jul 24 01:09:28.480656 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 132/280] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:28 2022] POST /compute/v2.1/flavors => generated 429 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:28.487347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d707eba9-0dd3-4cb7-9736-1fbf7b54c8a9 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:28.488367 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:28.488367 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:28.536442 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d707eba9-0dd3-4cb7-9736-1fbf7b54c8a9 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2077708944" status: 202 len: 0 microversion: 2.1 time: 0.050625 Jul 24 01:09:28.545461 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 133/281] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:09:28 2022] DELETE /compute/v2.1/flavors/2077708944 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:09:28.567846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-65aab2ea-8916-4284-b59e-85b419ac6631 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:28.685384 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-65aab2ea-8916-4284-b59e-85b419ac6631 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.135759 Jul 24 01:09:28.686048 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 134/282] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:28 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:28.717703 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-01a1e441-5d6e-44ba-866f-810aad94a8ae tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-356417352", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:28.804953 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-01a1e441-5d6e-44ba-866f-810aad94a8ae tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.097368 Jul 24 01:09:28.815691 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 135/283] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:28 2022] POST /compute/v2.1/flavors => generated 506 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:28.832513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b1bb722-c3b8-41ce-8730-5c17a1e46d6c tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:28.904538 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b1bb722-c3b8-41ce-8730-5c17a1e46d6c tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/9fefd1bd-ddca-4a58-b5ed-4d2251687848" status: 202 len: 0 microversion: 2.1 time: 0.078592 Jul 24 01:09:28.907372 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 136/284] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:09:28 2022] DELETE /compute/v2.1/flavors/9fefd1bd-ddca-4a58-b5ed-4d2251687848 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:28.919019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be8faf62-af90-4394-92b7-74119fdd77ea tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:28.983665 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be8faf62-af90-4394-92b7-74119fdd77ea tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.066234 Jul 24 01:09:28.987816 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 137/285] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:28 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:29.006466 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:29.007517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:29.069428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:29.070533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:29.070732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:29.071171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:29.611291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:29.628204 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36f6037c-09f6-4b07-a742-8df1c3448a9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.631041 Jul 24 01:09:29.630078 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 138/286] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:28 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:29.640401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0cf5bab8-303a-42aa-9eac-71d8d6f2971c tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1288311957", "id": "cede2edd-7c41-4118-8c55-2d2d35bb9eb0", "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:29.644244 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:29.644244 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:29.668083 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0cf5bab8-303a-42aa-9eac-71d8d6f2971c tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035735 Jul 24 01:09:29.669015 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 139/287] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:29 2022] POST /compute/v2.1/flavors => generated 507 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:29.688594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:29.706719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:29.745091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:29.750263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:29.754881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:29.768723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:30.046640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:30.057694 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:30.097037 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a249227-88df-4598-8ad8-fc92d307da34 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1274 microversion: 2.1 time: 0.426015 Jul 24 01:09:30.110050 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 140/288] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:29 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1274 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:30.143729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b09dfd0-2bbe-4e98-be4c-182558d3d29b tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:30.145723 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:30.145723 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:30.184512 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b09dfd0-2bbe-4e98-be4c-182558d3d29b tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/cede2edd-7c41-4118-8c55-2d2d35bb9eb0" status: 202 len: 0 microversion: 2.1 time: 0.048216 Jul 24 01:09:30.185362 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 141/289] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:09:30 2022] DELETE /compute/v2.1/flavors/cede2edd-7c41-4118-8c55-2d2d35bb9eb0 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:30.200495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c7938f26-1cfe-4b33-aaf4-27fc8b82cf8c req-efb49216-f7a3-4dc9-8a34-55b774a9af9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8a845b-e3fb-48d2-8b69-183a831b96e3", "tag": "7ba985c1-2254-4edb-adf4-2e9d68bd70a9"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:30.250110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c7938f26-1cfe-4b33-aaf4-27fc8b82cf8c req-efb49216-f7a3-4dc9-8a34-55b774a9af9e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:30.252970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c7938f26-1cfe-4b33-aaf4-27fc8b82cf8c req-efb49216-f7a3-4dc9-8a34-55b774a9af9e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:30.286568 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c7938f26-1cfe-4b33-aaf4-27fc8b82cf8c req-efb49216-f7a3-4dc9-8a34-55b774a9af9e service nova] Creating event network-changed:7ba985c1-2254-4edb-adf4-2e9d68bd70a9 for instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 on n-h2-master-1 Jul 24 01:09:30.297422 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c7938f26-1cfe-4b33-aaf4-27fc8b82cf8c req-efb49216-f7a3-4dc9-8a34-55b774a9af9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104194 Jul 24 01:09:30.299648 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 142/290] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:30.320688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fd76f9e6-0839-4aa3-b9c6-a2e2d0257a7a tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:30.389639 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fd76f9e6-0839-4aa3-b9c6-a2e2d0257a7a tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.085748 Jul 24 01:09:30.391333 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 143/291] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:30 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:30.420055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-10cac6df-12ec-428e-af4b-153e52d7a2e6 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1542700363", "id": 340157189, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:30.422031 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:30.422031 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:30.456220 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-10cac6df-12ec-428e-af4b-153e52d7a2e6 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.043877 Jul 24 01:09:30.456909 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 144/292] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:30 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:09:30.470643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ae8b1af-30d5-466a-bfce-6348217f687e tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:30.481914 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ae8b1af-30d5-466a-bfce-6348217f687e tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/340157189" status: 200 len: 411 microversion: 2.1 time: 0.016118 Jul 24 01:09:30.490009 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 145/293] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:30 2022] GET /compute/v2.1/flavors/340157189 => generated 411 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:30.683427 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:31.191543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c1ae8a1-cab1-43b4-bd6a-82b7c3d86e7a tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:31.235067 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c1ae8a1-cab1-43b4-bd6a-82b7c3d86e7a tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.742773 Jul 24 01:09:31.249014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 146/294] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:30 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:31.266786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:31.270860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:31.299124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:31.300450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:31.301501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:31.302293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:32.106548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:32.168459 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00f2191f-9d8f-47c9-954f-02fe4f4d42ac tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.905486 Jul 24 01:09:32.189407 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 147/295] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:31 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:32.195351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:32.196838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:32.206594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:32.207625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:32.208705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:32.209412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:32.380497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:32.394528 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b86dfc76-daa2-4f6f-a2a9-db3c5b02db88 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1280 microversion: 2.1 time: 0.203538 Jul 24 01:09:32.406553 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 148/296] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:32 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:32.446577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa982454-5b0f-4054-b225-d2156fb8265e tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:32.449810 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:32.449810 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:32.503005 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa982454-5b0f-4054-b225-d2156fb8265e tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/340157189" status: 202 len: 0 microversion: 2.1 time: 0.094322 Jul 24 01:09:32.505236 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 149/297] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:09:32 2022] DELETE /compute/v2.1/flavors/340157189 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:32.521292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf00bb0b-6237-4b82-b3e4-de819247aafb tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:32.618019 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf00bb0b-6237-4b82-b3e4-de819247aafb tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.105173 Jul 24 01:09:32.619707 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 150/298] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:32 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:32.640565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bcfad5d-13a3-4c01-bf7b-a712590434a3 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1272278307", "id": 97243409, "os-flavor-access:is_public": "False"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:32.650308 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:32.650308 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:32.696752 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bcfad5d-13a3-4c01-bf7b-a712590434a3 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.061490 Jul 24 01:09:32.706212 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 151/299] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:32 2022] POST /compute/v2.1/flavors => generated 424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:09:32.730572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f4f7e34-daaf-44cc-bc45-afcb3ec66017 tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "97243409"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:32.750958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-2f4f7e34-daaf-44cc-bc45-afcb3ec66017 tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] HTTP exception thrown: Flavor 97243409 could not be found. Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f4f7e34-daaf-44cc-bc45-afcb3ec66017 tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] Request method failure captured: Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 105 Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvA19cS5I4bmNTynuT57haRktgpQjYm0Q3XA6OkeebcYqGsmUjKuLhP3cu_ZontQ9HPb02m2g5qtOCLkwW8JSQBNgd3UdBaJwm_F0yskXBmzQq6u3grbr10hyKEd-I8pypFe9fikAWMDTO2BnsNls9tdTgqk2zkwvm1jX_uLG3h06s Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 69a0aac42f6042fa92a841f661d06e3f Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsAdminTestJSON-1305393361 Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:32.756358 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69a0aac42f6042fa92a841f661d06e3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69a0aac42f6042fa92a841f661d06e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69a0aac42f6042fa92a841f661d06e3f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69a0aac42f6042fa92a841f661d06e3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsAdminTestJSON-1305393361 Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 69a0aac42f6042fa92a841f661d06e3f Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1305393361 Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsAdminTestJSON-1305393361-project Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c5f9ae6edb5c404d85403c6a351ff245 Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsAdminTestJSON-1305393361-project Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "test", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "97243409"}} Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:32.757702 n-d-master-1 devstack@n-api.service[119561]: exception: Flavor 97243409 could not be found. Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '97243409'}}} Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 97243409 could not be found. Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:32.758541 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 97243409 could not be found. Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:32.759695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:32.760995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:32.760995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:32.760995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:32.760995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 97243409 could not be found. Jul 24 01:09:32.760995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:32.764018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f4f7e34-daaf-44cc-bc45-afcb3ec66017 tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] Returning 400 to user: Flavor 97243409 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:32.766741 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f4f7e34-daaf-44cc-bc45-afcb3ec66017 tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.048932 Jul 24 01:09:32.771320 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 152/300] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:32 2022] POST /compute/v2.1/servers => generated 79 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:32.782941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-726697b7-bc6a-4a77-844c-627c8d911f14 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:32.791699 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=16 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:32.837975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-726697b7-bc6a-4a77-844c-627c8d911f14 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/97243409" status: 202 len: 0 microversion: 2.1 time: 0.064144 Jul 24 01:09:32.840252 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 153/301] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:09:32 2022] DELETE /compute/v2.1/flavors/97243409 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:32.855316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-223cad37-d20f-42e3-ba83-027482624e26 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:32.891511 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-223cad37-d20f-42e3-ba83-027482624e26 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.043922 Jul 24 01:09:32.908503 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 154/302] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:32 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:32.916439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6643b452-be96-4cc3-b24d-24512d2db397 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1461081611", "id": 2012556847, "os-flavor-access:is_public": "False"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:32.941703 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6643b452-be96-4cc3-b24d-24512d2db397 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.029152 Jul 24 01:09:32.949996 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 155/303] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:32 2022] POST /compute/v2.1/flavors => generated 415 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:09:32.956920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-52208c42-239a-4ca7-8164-cb57ffc0bae8 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1394279318", "id": 1634022913, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:32.982908 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-52208c42-239a-4ca7-8164-cb57ffc0bae8 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030094 Jul 24 01:09:32.991995 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 156/304] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:33.002732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f084a7dd-a4a5-49de-a1b2-13b7a3a1cec5 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:33.031932 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f084a7dd-a4a5-49de-a1b2-13b7a3a1cec5 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.034440 Jul 24 01:09:33.033078 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 157/305] 10.222.0.27 () {58 vars in 1168 bytes} [Sun Jul 24 01:09:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:33.067647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f67f0fb2-a632-4935-8604-ea57c8662f51 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:33.081176 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f67f0fb2-a632-4935-8604-ea57c8662f51 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.020062 Jul 24 01:09:33.082206 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 158/306] 10.222.0.27 () {58 vars in 1176 bytes} [Sun Jul 24 01:09:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:33.097111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-54fd12e5-951a-4dfe-9240-c1c7b2ae1e54 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:33.130445 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-54fd12e5-951a-4dfe-9240-c1c7b2ae1e54 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.036977 Jul 24 01:09:33.132445 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 159/307] 10.222.0.27 () {58 vars in 1170 bytes} [Sun Jul 24 01:09:33 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:33.163447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7734587-12e7-4d95-952d-65bf055d3597 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:33.209638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7734587-12e7-4d95-952d-65bf055d3597 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.064161 Jul 24 01:09:33.218422 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 160/308] 10.222.0.27 () {58 vars in 1168 bytes} [Sun Jul 24 01:09:33 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:33.231235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:33.232498 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:33.245300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:33.246102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:33.247164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:33.247949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:33.890961 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04d4dbd7-36a3-44f9-8ce6-94fa829830b3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594/action" status: 202 len: 0 microversion: 2.1 time: 7.710719 Jul 24 01:09:33.894641 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 149/309] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:09:26 2022] POST /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594/action => generated 0 bytes in 7716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:33.906982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-433b421d-02d8-43ed-95c5-fd8b1df92313 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:33.956757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-433b421d-02d8-43ed-95c5-fd8b1df92313 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6223 microversion: 2.1 time: 0.058175 Jul 24 01:09:33.958809 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 150/310] 10.222.0.27 () {58 vars in 1168 bytes} [Sun Jul 24 01:09:33 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6223 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:33.966611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:33.967296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:33.980738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:33.981273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:33.982670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:33.983136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:34.009004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:34.029307 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:34.042352 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c834c27-cf7d-4ef8-a06d-ae1170407b1e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.814336 Jul 24 01:09:34.052915 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 161/311] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:33 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:34.061826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:34.066145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:34.086405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:34.088932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:34.092973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:34.092973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:34.778211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:34.789257 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6fe3120a-af7d-4f64-b879-b05584cb75b8 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 0.828753 Jul 24 01:09:34.801207 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 151/312] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:33 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:34.813282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fd7cb176-48cc-4db2-87a3-c7c4acb70f66 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:34.837297 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fd7cb176-48cc-4db2-87a3-c7c4acb70f66 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6223 microversion: 2.1 time: 0.034669 Jul 24 01:09:34.838704 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 152/313] 10.222.0.27 () {58 vars in 1174 bytes} [Sun Jul 24 01:09:34 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6223 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:34.844646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0c40b4af-3490-4142-89c7-8a081e71cbce req-ed714897-d2ac-427c-a7c3-52c7daf4a7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47daf830-dbdf-42ca-ab4a-7fa63658b66a", "name": "network-vif-plugged", "status": "completed", "tag": "d50c538b-1612-4fad-b54b-93a3c2ceaccb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:34.857765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0c40b4af-3490-4142-89c7-8a081e71cbce req-ed714897-d2ac-427c-a7c3-52c7daf4a7a8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:34.858214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0c40b4af-3490-4142-89c7-8a081e71cbce req-ed714897-d2ac-427c-a7c3-52c7daf4a7a8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:34.889499 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0c40b4af-3490-4142-89c7-8a081e71cbce req-ed714897-d2ac-427c-a7c3-52c7daf4a7a8 service nova] Creating event network-vif-plugged:d50c538b-1612-4fad-b54b-93a3c2ceaccb for instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a on n-h1-master-1 Jul 24 01:09:34.905019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0c40b4af-3490-4142-89c7-8a081e71cbce req-ed714897-d2ac-427c-a7c3-52c7daf4a7a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064435 Jul 24 01:09:34.907383 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 153/314] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:34.917395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42fdfcdd-b974-499e-a074-19e34c714e9a tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:34.958967 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42fdfcdd-b974-499e-a074-19e34c714e9a tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6223 microversion: 2.1 time: 0.047770 Jul 24 01:09:34.960131 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 154/315] 10.222.0.27 () {58 vars in 1172 bytes} [Sun Jul 24 01:09:34 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6223 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:34.999657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0d16b411-b521-40cb-86d0-510bb5c43a22 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.061772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0d16b411-b521-40cb-86d0-510bb5c43a22 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6223 microversion: 2.1 time: 0.071787 Jul 24 01:09:35.062679 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 155/316] 10.222.0.27 () {58 vars in 1168 bytes} [Sun Jul 24 01:09:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6223 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:35.070092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.071164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:35.080234 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:35.081013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:35.082119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:35.082782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:35.188678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:35.219881 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-999fecec-6f8c-4e69-9736-05edbb157400 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 1.173781 Jul 24 01:09:35.222013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 162/317] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:34 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:35.256024 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d36d1ba2-f018-4a9c-aeab-54349d252435 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.261347 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:35.261347 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:35.347472 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d36d1ba2-f018-4a9c-aeab-54349d252435 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1634022913" status: 202 len: 0 microversion: 2.1 time: 0.123476 Jul 24 01:09:35.349316 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 163/318] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:09:35 2022] DELETE /compute/v2.1/flavors/1634022913 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:35.377033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dcd16ff-23f1-4492-b560-c13f43e05b4d tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.422044 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dcd16ff-23f1-4492-b560-c13f43e05b4d tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.064360 Jul 24 01:09:35.434644 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 164/319] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:35 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:35.451682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29f37192-91a9-4cc5-825c-77f0d7402d62 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.493892 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29f37192-91a9-4cc5-825c-77f0d7402d62 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2012556847" status: 202 len: 0 microversion: 2.1 time: 0.049497 Jul 24 01:09:35.497232 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 165/320] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:09:35 2022] DELETE /compute/v2.1/flavors/2012556847 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:09:35.529922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8b8608cf-7987-426c-a1bb-62731f6ff654 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.589364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8b8608cf-7987-426c-a1bb-62731f6ff654 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.081117 Jul 24 01:09:35.611781 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 166/321] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:35 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:35.626281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-588fa034-c132-48a6-a2a8-0a553fe05361 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-113810459", "id": 1696118783, "os-flavor-access:is_public": "False"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:35.628219 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:35.628219 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:35.668004 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-588fa034-c132-48a6-a2a8-0a553fe05361 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.043842 Jul 24 01:09:35.669734 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 167/322] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:09:35.688337 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dd5d49cc-c528-485d-b760-cb714b8bf0b0 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.798518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dd5d49cc-c528-485d-b760-cb714b8bf0b0 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.120970 Jul 24 01:09:35.799728 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 168/323] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:35 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:35.820686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:35.821759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:35.846371 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:35.846933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:35.848399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:35.849268 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:36.019241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:36.033268 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:36.065738 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af6add6a-0d05-49f2-b6c1-8a51aa56ab01 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.999876 Jul 24 01:09:36.070676 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 156/324] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:35 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:36.091682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb622810-cf0a-43a0-906b-7f9f91f49d9b tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:36.214049 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb622810-cf0a-43a0-906b-7f9f91f49d9b tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.139117 Jul 24 01:09:36.215424 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 157/325] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:36 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:36.236785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be819004-2cb6-4e32-bd73-82f5c9450024 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:36.245068 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:36.245068 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:36.296217 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be819004-2cb6-4e32-bd73-82f5c9450024 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1696118783" status: 202 len: 0 microversion: 2.1 time: 0.068745 Jul 24 01:09:36.300551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 158/326] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:09:36 2022] DELETE /compute/v2.1/flavors/1696118783 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:09:36.321475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:36.323287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:36.346154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:36.347125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:36.348938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:36.350010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:36.427304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:36.451118 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc295913-659b-432e-a24b-81904369dc2d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 0.643982 Jul 24 01:09:36.454987 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 169/327] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:35 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:36.488390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64a81b85-06eb-40e2-be48-cac9650567a2 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:36.568608 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64a81b85-06eb-40e2-be48-cac9650567a2 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.109874 Jul 24 01:09:36.573481 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 170/328] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:36 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:37.132201 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:37.136730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:37.155468 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a843e03c-449b-4227-85e1-b32d652bc7f6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.851543 Jul 24 01:09:37.156737 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 159/329] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:36 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:37.179313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-578892d9-6deb-449d-8b0c-9ac140b4a843 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-364735988", "id": 1884503135, "os-flavor-access:is_public": "True"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:37.183320 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:37.183320 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:37.212085 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-578892d9-6deb-449d-8b0c-9ac140b4a843 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.053232 Jul 24 01:09:37.216925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 160/330] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:37.233969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:37.236898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:37.251995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.253085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:37.258641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.259448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:37.533158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Calling method '.version_select at 0x7f05f8188ca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:37.534965 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:37.534965 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:37.535673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.536262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:37.642819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.647064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:37.677947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.679127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:37.696347 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2ebef88-eb3e-44b9-8fe4-5790dc82383f tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.120648 Jul 24 01:09:37.709066 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 171/331] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:37.718663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d4c6e709-e68f-4c00-bdb6-7e27e8c40568 req-8de4a522-ba2b-4a73-84d9-e240a2fc8b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218ba9eb-01c0-40ad-ba00-41c77f237321", "tag": "c6fefab9-f9bd-4d28-be6d-43329982b608"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:37.735828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d4c6e709-e68f-4c00-bdb6-7e27e8c40568 req-8de4a522-ba2b-4a73-84d9-e240a2fc8b68 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.738086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d4c6e709-e68f-4c00-bdb6-7e27e8c40568 req-8de4a522-ba2b-4a73-84d9-e240a2fc8b68 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:37.766490 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d4c6e709-e68f-4c00-bdb6-7e27e8c40568 req-8de4a522-ba2b-4a73-84d9-e240a2fc8b68 service nova] Creating event network-changed:c6fefab9-f9bd-4d28-be6d-43329982b608 for instance 218ba9eb-01c0-40ad-ba00-41c77f237321 on n-h1-master-1 Jul 24 01:09:37.778658 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d4c6e709-e68f-4c00-bdb6-7e27e8c40568 req-8de4a522-ba2b-4a73-84d9-e240a2fc8b68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066621 Jul 24 01:09:37.780891 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 172/332] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:37.799134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7e20789-3bbc-4e94-9b0f-9cb680393535 tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:37.831205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7e20789-3bbc-4e94-9b0f-9cb680393535 tempest-FlavorsAdminTestJSON-1305393361 tempest-FlavorsAdminTestJSON-1305393361-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.048584 Jul 24 01:09:37.832314 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 173/333] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:37 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:37.837280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:37.839095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:37.847176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.848262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:37.848559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:37.849378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:38.046888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:38.057103 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78554ff9-a49e-4fd8-b24b-9b6eea01b1ab tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.838125 Jul 24 01:09:38.070863 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 161/334] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:37 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:38.324593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:38.328778 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:38.342005 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-187214c1-3c23-4425-8f51-09bec3df0bc5 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 0.508426 Jul 24 01:09:38.361553 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 174/335] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:37 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:38.371402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca2c0d40-82fa-431d-982d-6741a1495e71 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:38.373170 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:38.373170 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:38.403063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca2c0d40-82fa-431d-982d-6741a1495e71 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1884503135" status: 202 len: 0 microversion: 2.1 time: 0.039153 Jul 24 01:09:38.403978 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 175/336] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:09:38 2022] DELETE /compute/v2.1/flavors/1884503135 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:38.416169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:38.417261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:38.430998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:38.432519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:38.434136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:38.434964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:38.435245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15c3a203-b88f-41bb-83bc-3a9c658f861f tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Calling method '.version_select at 0x7f05eba38790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:38.436124 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:38.436124 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:38.437614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-15c3a203-b88f-41bb-83bc-3a9c658f861f tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '96a45526bcbd48c2a255fb736e8cb94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae313a73b87e46b8bba18fc93f680fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15c3a203-b88f-41bb-83bc-3a9c658f861f tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Request method failure captured: Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvONgR4vVCjqY3diCqmsGoJ5pkWv0O46worF_jPq-JoI_nkQSEYymQ1xirZ1GMtv22arM51pz0xtuM-_J7OZjSOViepwHy7fJAG9SfHsA90Wad4J42g0Xw1mnjfrcvAwWOEqEAH_3nvxW1uVBNInHx6YUP6Mlo3FSJB4ET7HWNH0ec Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: ae313a73b87e46b8bba18fc93f680fc2 Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704661160 Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:38.439905 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae313a73b87e46b8bba18fc93f680fc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae313a73b87e46b8bba18fc93f680fc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae313a73b87e46b8bba18fc93f680fc2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae313a73b87e46b8bba18fc93f680fc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1704661160 Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: ae313a73b87e46b8bba18fc93f680fc2 Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704661160 Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 96a45526bcbd48c2a255fb736e8cb94a Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 24 01:09:38.441477 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'n-h1-master-1'} Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:38.442389 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 24 01:09:38.443590 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:38.446031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15c3a203-b88f-41bb-83bc-3a9c658f861f tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:38.448004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15c3a203-b88f-41bb-83bc-3a9c658f861f tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.374815 Jul 24 01:09:38.449391 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 162/337] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:09:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 378 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:38.550623 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1670111939", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:38.561888 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=11 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:38.642738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:38.862161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:38.875553 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1d8dffab-39a4-484f-acd4-ecb4de6e177f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.469247 Jul 24 01:09:38.876933 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 176/338] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:38 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:38.883172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-adbf31e2-0a3e-4c1b-a94b-2c63bba50912 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:38.933710 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-adbf31e2-0a3e-4c1b-a94b-2c63bba50912 tempest-FlavorsAdminTestJSON-1942131855 tempest-FlavorsAdminTestJSON-1942131855-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.054970 Jul 24 01:09:38.938993 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 177/339] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:38 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:38.944620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b79157ca-9c57-4212-86ff-a502c8d32618 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Calling method '.version_select at 0x7f05ebc60f70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:38.946868 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:38.946868 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:38.951357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b79157ca-9c57-4212-86ff-a502c8d32618 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:38.954891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b79157ca-9c57-4212-86ff-a502c8d32618 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:38.975156 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b79157ca-9c57-4212-86ff-a502c8d32618 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b79157ca-9c57-4212-86ff-a502c8d32618 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Request method failure captured: Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvQxUoN0nA4ARXg77OtwSgI6BWLth6hffQef0LDAtImgUbq8V6x0uAUuMdUM8IhEtXgEa-0d_23dqKjz6R_-oqR46drdsWLCLLNXSzYzk2A_VEkQNZ_R9bb3nSa6c3TtouSM15Jx11GrN4r0g1n0vJStp8SbzDmRJhEOpZ67tDyJq0 Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: ae9b8dfe882846c490521313a74d78da Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1612929213 Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:38.984757 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae9b8dfe882846c490521313a74d78da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae9b8dfe882846c490521313a74d78da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae9b8dfe882846c490521313a74d78da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae9b8dfe882846c490521313a74d78da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1612929213 Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: ae9b8dfe882846c490521313a74d78da Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1612929213 Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: e19f1628b0044d99a21c2d70165ca207 Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 24 01:09:38.988060 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:38.989834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b79157ca-9c57-4212-86ff-a502c8d32618 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b79157ca-9c57-4212-86ff-a502c8d32618 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.051977 Jul 24 01:09:38.997964 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 178/340] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:09:38 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:39.014564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c1a9d971-1557-4437-968f-4023f011e27a req-1239aefd-a1a4-4643-956e-0ce80b9dfdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8a845b-e3fb-48d2-8b69-183a831b96e3", "name": "network-vif-plugged", "status": "completed", "tag": "7ba985c1-2254-4edb-adf4-2e9d68bd70a9"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:39.049036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c1a9d971-1557-4437-968f-4023f011e27a req-1239aefd-a1a4-4643-956e-0ce80b9dfdcc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.050274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c1a9d971-1557-4437-968f-4023f011e27a req-1239aefd-a1a4-4643-956e-0ce80b9dfdcc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.092302 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c1a9d971-1557-4437-968f-4023f011e27a req-1239aefd-a1a4-4643-956e-0ce80b9dfdcc service nova] Creating event network-vif-plugged:7ba985c1-2254-4edb-adf4-2e9d68bd70a9 for instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 on n-h2-master-1 Jul 24 01:09:39.104744 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c1a9d971-1557-4437-968f-4023f011e27a req-1239aefd-a1a4-4643-956e-0ce80b9dfdcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104716 Jul 24 01:09:39.114363 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 179/341] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:39.128593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Calling method '.version_select at 0x7f05ebd079d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:39.131195 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:39.131195 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:39.134825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.136048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.175680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.177295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.207125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.207548 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.218970 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00325cca-124d-47ef-8c84-bdd4fbd46cd5 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.101523 Jul 24 01:09:39.220251 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 180/342] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:09:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:39.234424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:39.235537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:39.244971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.245941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.246997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.247796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.532150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:39.532981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:39.533899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:39.534779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:39.535519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:39.573012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.575581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.578563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.579736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.640486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Getting quotas for project 7a228611da9b47f785568447a4caa0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:39.661653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Getting quotas for user 1070815bb60c44fcb6a586fd2d1f6e71 and project 7a228611da9b47f785568447a4caa0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:39.703195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:39.705864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:39.790186 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2032c009-45cf-43ea-b49b-45df30ba4107 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339426 Jul 24 01:09:39.791410 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 163/343] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:39.796687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ea4bc19-1eab-489e-8d2d-399375edfa07 tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Calling method '.version_select at 0x7f05eba389d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:39.797931 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:39.797931 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:39.799766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5ea4bc19-1eab-489e-8d2d-399375edfa07 tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '96a45526bcbd48c2a255fb736e8cb94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae313a73b87e46b8bba18fc93f680fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ea4bc19-1eab-489e-8d2d-399375edfa07 tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Request method failure captured: Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvONgR4vVCjqY3diCqmsGoJ5pkWv0O46worF_jPq-JoI_nkQSEYymQ1xirZ1GMtv22arM51pz0xtuM-_J7OZjSOViepwHy7fJAG9SfHsA90Wad4J42g0Xw1mnjfrcvAwWOEqEAH_3nvxW1uVBNInHx6YUP6Mlo3FSJB4ET7HWNH0ec Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: ae313a73b87e46b8bba18fc93f680fc2 Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704661160 Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:09:39.801794 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae313a73b87e46b8bba18fc93f680fc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae313a73b87e46b8bba18fc93f680fc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae313a73b87e46b8bba18fc93f680fc2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae313a73b87e46b8bba18fc93f680fc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1704661160 Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: ae313a73b87e46b8bba18fc93f680fc2 Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704661160 Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 96a45526bcbd48c2a255fb736e8cb94a Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 24 01:09:39.802994 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1'} Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:09:39.803745 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 24 01:09:39.804750 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:39.808294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ea4bc19-1eab-489e-8d2d-399375edfa07 tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:39.809603 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5ea4bc19-1eab-489e-8d2d-399375edfa07 tempest-HypervisorAdminNegativeUnderV252Test-1704661160 tempest-HypervisorAdminNegativeUnderV252Test-1704661160-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016867 Jul 24 01:09:39.810723 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 164/344] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:09:39 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:39.833129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:39.848638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:39.868488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.869019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.870466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:39.875801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:39.905214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:39.921294 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b37b008-cc67-4f6a-9a62-fdd58e224efc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.689760 Jul 24 01:09:39.922002 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 181/345] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:39 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:39.936970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7a2415c-8be5-40c4-b685-e1d816b172c4 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:39.938048 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7a2415c-8be5-40c4-b685-e1d816b172c4 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:40.044837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7a2415c-8be5-40c4-b685-e1d816b172c4 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:40.055782 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7a2415c-8be5-40c4-b685-e1d816b172c4 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1220 microversion: 2.1 time: 0.132508 Jul 24 01:09:40.058071 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 182/346] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:39 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:40.069308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77841dfd-8a91-49e3-91ac-c72f27c98db3 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Calling method '.version_select at 0x7f05ebed64c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:40.070293 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:40.070293 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:40.072577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77841dfd-8a91-49e3-91ac-c72f27c98db3 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:40.073592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77841dfd-8a91-49e3-91ac-c72f27c98db3 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:40.083753 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-77841dfd-8a91-49e3-91ac-c72f27c98db3 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] HTTP exception thrown: No hypervisor matching '33df3fc3-6270-4ae5-a4ab-f8024403c036' could be found. Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77841dfd-8a91-49e3-91ac-c72f27c98db3 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Request method failure captured: Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-hypervisors/33df3fc3-6270-4ae5-a4ab-f8024403c036/servers HTTP/1.1 Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvQxUoN0nA4ARXg77OtwSgI6BWLth6hffQef0LDAtImgUbq8V6x0uAUuMdUM8IhEtXgEa-0d_23dqKjz6R_-oqR46drdsWLCLLNXSzYzk2A_VEkQNZ_R9bb3nSa6c3TtouSM15Jx11GrN4r0g1n0vJStp8SbzDmRJhEOpZ67tDyJq0 Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: ae9b8dfe882846c490521313a74d78da Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1612929213 Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:40.085836 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae9b8dfe882846c490521313a74d78da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae9b8dfe882846c490521313a74d78da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae9b8dfe882846c490521313a74d78da", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae9b8dfe882846c490521313a74d78da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1612929213 Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: ae9b8dfe882846c490521313a74d78da Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1612929213 Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: e19f1628b0044d99a21c2d70165ca207 Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: exception: No hypervisor matching '33df3fc3-6270-4ae5-a4ab-f8024403c036' could be found. Jul 24 01:09:40.086990 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '33df3fc3-6270-4ae5-a4ab-f8024403c036'} Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '33df3fc3-6270-4ae5-a4ab-f8024403c036' could be found. Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:40.087740 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:40.089236 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:40.089236 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:40.089236 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:40.089236 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:40.089236 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '33df3fc3-6270-4ae5-a4ab-f8024403c036' could be found. Jul 24 01:09:40.089236 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:40.092178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77841dfd-8a91-49e3-91ac-c72f27c98db3 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] Returning 404 to user: No hypervisor matching '33df3fc3-6270-4ae5-a4ab-f8024403c036' could be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:40.095243 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-77841dfd-8a91-49e3-91ac-c72f27c98db3 tempest-HypervisorAdminNegativeUnderV252Test-1612929213 tempest-HypervisorAdminNegativeUnderV252Test-1612929213-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/33df3fc3-6270-4ae5-a4ab-f8024403c036/servers" status: 404 len: 123 microversion: 2.1 time: 0.033848 Jul 24 01:09:40.101826 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 183/347] 10.222.0.27 () {58 vars in 1280 bytes} [Sun Jul 24 01:09:40 2022] GET /compute/v2.1/os-hypervisors/33df3fc3-6270-4ae5-a4ab-f8024403c036/servers => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:40.115180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-15656e83-7ac8-4663-b953-b867efb6883b req-fb7269c4-12b2-4232-8556-59d77155cb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975740f0-20a6-4d5b-8e57-766c11d09594", "name": "network-vif-unplugged", "status": "completed", "tag": "cebc9e40-12d5-4535-ae92-0157bc5f293e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:40.141583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15656e83-7ac8-4663-b953-b867efb6883b req-fb7269c4-12b2-4232-8556-59d77155cb93 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:40.142497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15656e83-7ac8-4663-b953-b867efb6883b req-fb7269c4-12b2-4232-8556-59d77155cb93 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:40.181305 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-15656e83-7ac8-4663-b953-b867efb6883b req-fb7269c4-12b2-4232-8556-59d77155cb93 service nova] Creating event network-vif-unplugged:cebc9e40-12d5-4535-ae92-0157bc5f293e for instance 975740f0-20a6-4d5b-8e57-766c11d09594 on n-h2-master-1 Jul 24 01:09:40.194159 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-15656e83-7ac8-4663-b953-b867efb6883b req-fb7269c4-12b2-4232-8556-59d77155cb93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090277 Jul 24 01:09:40.195137 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 184/348] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:40.206944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:40.207824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:40.221548 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:40.225432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:40.229595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:40.230186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:40.585283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:40.624895 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-22808d32-5115-49f0-be87-ceedc70f8c5a tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 0.812438 Jul 24 01:09:40.632245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 165/349] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:39 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:40.796299 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:40.812072 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-388e502d-fd88-4706-80d7-1ee53e94a9df tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.615469 Jul 24 01:09:40.813274 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 185/350] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:40 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:40.957524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:40.958164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:40.997218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.010473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.014247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.019043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.089447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:41.092169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:41.108684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.110221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.112631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.113468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.227070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:41.265035 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c0bce6a-a50d-4d97-8bc7-1887e7b81454 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1224 microversion: 2.1 time: 0.183456 Jul 24 01:09:41.265805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 186/351] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:41 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1224 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:41.412396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:41.433131 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-25ca33d6-fbaa-4d54-9e4e-3bffc58f8a77 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1314 microversion: 2.1 time: 0.484806 Jul 24 01:09:41.456421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 166/352] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:40 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:41.650595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:41.652148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:41.660156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.661149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.662791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.663849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.837911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:41.838409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:41.866188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.866633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.873190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:41.874672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:41.933611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:41.959863 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7cb591c0-3cb4-4661-93b3-27bbd683c567 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 0.313253 Jul 24 01:09:41.966426 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 187/353] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:41 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:42.163672 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:42.176843 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a41bf5b-f384-43cf-8b87-21c214d2140f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.343123 Jul 24 01:09:42.178806 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 167/354] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:41 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:42.304178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:42.305704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:42.318347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:42.319335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:42.324446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:42.326090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:42.549932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:42.592905 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9f756b05-5762-40be-a0e0-9a9b25362dd7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1280 microversion: 2.1 time: 0.304947 Jul 24 01:09:42.601413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1424796075", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:42.606459 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 168/355] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:42 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1280 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:42.625989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b29cff66-3ccf-4a8f-aaf9-a8be74975f59 req-0347816c-dc77-4740-9ca9-a5b7643f0d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975740f0-20a6-4d5b-8e57-766c11d09594", "tag": "cebc9e40-12d5-4535-ae92-0157bc5f293e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:42.646492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b29cff66-3ccf-4a8f-aaf9-a8be74975f59 req-0347816c-dc77-4740-9ca9-a5b7643f0d9a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:42.648131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b29cff66-3ccf-4a8f-aaf9-a8be74975f59 req-0347816c-dc77-4740-9ca9-a5b7643f0d9a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:42.673833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:42.674390 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b29cff66-3ccf-4a8f-aaf9-a8be74975f59 req-0347816c-dc77-4740-9ca9-a5b7643f0d9a service nova] Creating event network-changed:cebc9e40-12d5-4535-ae92-0157bc5f293e for instance 975740f0-20a6-4d5b-8e57-766c11d09594 on n-h2-master-1 Jul 24 01:09:42.684410 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b29cff66-3ccf-4a8f-aaf9-a8be74975f59 req-0347816c-dc77-4740-9ca9-a5b7643f0d9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074267 Jul 24 01:09:42.685708 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 169/356] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:42.693264 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:42.694175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:42.702124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:42.702705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:42.703955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:42.704465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:43.137616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:43.158090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb0abd77-0518-4157-8ea0-b2f9254be197 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1464 microversion: 2.1 time: 0.470717 Jul 24 01:09:43.169458 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 170/357] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:42 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1464 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:43.179941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:43.180433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:43.180973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:43.181469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:43.182082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:43.196687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:43.198312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:43.199714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:43.200334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:43.201286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:43.203102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:43.223121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:43.226279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:43.229309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:43.229941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:43.233864 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:43.239700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Getting quotas for project aa9af5838d3645b2acad12161d65b6bc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:43.245530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Getting quotas for user 7fe15455304f4fe4a990a1d32e0d1c28 and project aa9af5838d3645b2acad12161d65b6bc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:43.280587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:43.283190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:43.345266 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69862144-af46-4833-95f5-e3adbcc1204b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376861 Jul 24 01:09:43.345499 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 188/358] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:43.350505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:43.351596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:43.358950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:43.359407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:43.360493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:43.360939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.191751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:44.207436 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c8bac1be-50ad-4f49-a3d8-4543005e6198 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 1.022499 Jul 24 01:09:44.209196 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 171/359] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:43 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:44.217495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:44.218826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:44.227997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.229070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.230690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.231798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.367862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:44.377586 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f87d335-340c-4d16-b723-ba9ca3217766 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1463 microversion: 2.1 time: 1.030768 Jul 24 01:09:44.378389 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 189/360] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:43 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1463 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:44.393878 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:44.394835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:44.408328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.409157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.412552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.413388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.421483 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:44.665489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:44.683619 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-51412123-c2b0-4599-ada8-5ef979b25942 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1215 microversion: 2.1 time: 0.293944 Jul 24 01:09:44.684217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 190/361] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:44 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1215 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:44.693460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:44.693460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:44.699091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.699558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.700358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.700798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:44.865008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:44.901319 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d4dcd030-56b5-4efa-ac95-f76b80103baf tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.690184 Jul 24 01:09:44.902951 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 172/362] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:44 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:44.935721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-74e30b00-0e33-4e0a-a66a-231a777bcb2e req-ed8c2ebd-a32b-4cb8-bc99-bb520559f8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218ba9eb-01c0-40ad-ba00-41c77f237321", "name": "network-vif-plugged", "status": "completed", "tag": "c6fefab9-f9bd-4d28-be6d-43329982b608"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:44.954336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-74e30b00-0e33-4e0a-a66a-231a777bcb2e req-ed8c2ebd-a32b-4cb8-bc99-bb520559f8b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:44.954939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-74e30b00-0e33-4e0a-a66a-231a777bcb2e req-ed8c2ebd-a32b-4cb8-bc99-bb520559f8b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.016900 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-74e30b00-0e33-4e0a-a66a-231a777bcb2e req-ed8c2ebd-a32b-4cb8-bc99-bb520559f8b9 service nova] Creating event network-vif-plugged:c6fefab9-f9bd-4d28-be6d-43329982b608 for instance 218ba9eb-01c0-40ad-ba00-41c77f237321 on n-h1-master-1 Jul 24 01:09:45.037761 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:45.047091 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-74e30b00-0e33-4e0a-a66a-231a777bcb2e req-ed8c2ebd-a32b-4cb8-bc99-bb520559f8b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139417 Jul 24 01:09:45.050738 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 173/363] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:45.076169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-833460968", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "47daf830-dbdf-42ca-ab4a-7fa63658b66a"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:45.084396 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c0994240-3270-4803-971a-207ef4fa939f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1320 microversion: 2.1 time: 0.399094 Jul 24 01:09:45.089972 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 191/364] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:44 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:45.103642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3c3e6e34-9d29-4883-8170-d79272c87346 req-3c2be133-d8a2-4c12-92d5-ad1dac6aefd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f09cbc-4e61-4153-9fae-de17316bae52", "tag": "53f21240-3ada-4187-82fd-9e3814713254"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:45.136142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3c3e6e34-9d29-4883-8170-d79272c87346 req-3c2be133-d8a2-4c12-92d5-ad1dac6aefd8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.138331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3c3e6e34-9d29-4883-8170-d79272c87346 req-3c2be133-d8a2-4c12-92d5-ad1dac6aefd8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.175776 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3c3e6e34-9d29-4883-8170-d79272c87346 req-3c2be133-d8a2-4c12-92d5-ad1dac6aefd8 service nova] Creating event network-changed:53f21240-3ada-4187-82fd-9e3814713254 for instance d0f09cbc-4e61-4153-9fae-de17316bae52 on n-h2-master-1 Jul 24 01:09:45.184628 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3c3e6e34-9d29-4883-8170-d79272c87346 req-3c2be133-d8a2-4c12-92d5-ad1dac6aefd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087506 Jul 24 01:09:45.188494 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 192/365] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:09:45.229277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:45.230362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:45.240527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.241128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.245036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.246092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.261747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:45.801915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:45.813182 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-924f632f-e143-4465-afca-f6c332affa7d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 0.589850 Jul 24 01:09:45.814463 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 193/366] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:45 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:45.830188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:45.831055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:45.841592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.842499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.843540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.844214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.935401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:45.935911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:45.936573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:45.937057 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:45.937538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:45.938442 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:45.954742 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba165912-e951-4484-855d-1ec9c1690766 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1277 microversion: 2.1 time: 0.137901 Jul 24 01:09:45.955077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.955537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.956617 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 194/367] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:45 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:45.956810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.956810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.977243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:45.979861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:45.982094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Getting quotas for project c028787727e34a489f5a99f937538b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:45.987436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Getting quotas for user bfd5b02713f54950b7a5fae18bf4d485 and project c028787727e34a489f5a99f937538b6f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:45.989936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.990769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:45.991821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:45.992519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:46.002850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:46.005610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:46.083341 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e7d3c2b6-a873-4197-b3ca-7bd3d9a19403 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029030 Jul 24 01:09:46.084633 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 174/368] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:46.102576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c5f08e74-70d8-42d2-b382-d15008445589 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:46.105399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c5f08e74-70d8-42d2-b382-d15008445589 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:46.266838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c5f08e74-70d8-42d2-b382-d15008445589 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:46.274997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c5f08e74-70d8-42d2-b382-d15008445589 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1213 microversion: 2.1 time: 0.183160 Jul 24 01:09:46.279891 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 175/369] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:46 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:46.295316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:46.298450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:46.313081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:46.313545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:46.314383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:46.314829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:46.406737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:46.419827 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e5146c58-808f-48f4-80c6-c11779328299 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.455252 Jul 24 01:09:46.420967 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 195/370] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:45 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:46.647563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:46.671515 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-51c5b143-bb02-4c1f-b740-e61c632ac840 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1320 microversion: 2.1 time: 0.388151 Jul 24 01:09:46.672822 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 176/371] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:46 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:46.738363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77f7acaf-207a-4e5a-920e-f797abc7e6c8 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Calling method '.version_select at 0x7f05f9af34c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:46.832753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:46.834030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:46.845400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:46.847016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:46.848632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:46.849580 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.025698 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-77f7acaf-207a-4e5a-920e-f797abc7e6c8 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb" status: 200 len: 371 microversion: 2.1 time: 0.561352 Jul 24 01:09:47.026296 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 196/372] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:09:46 2022] GET /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb => generated 371 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:47.038647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:47.039616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:47.048154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.048799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.049787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.050417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.162344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:47.174985 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-233593b3-447d-494e-98ff-b50edbef3dc1 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1277 microversion: 2.1 time: 0.147584 Jul 24 01:09:47.175966 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 197/373] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:47 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:47.180797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9573c383-75e2-484e-af24-65ae28adf51f tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebe89700>, body: {"quota_set": {"ram": "5120"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:47.207444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:47.216484 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c50d8cb-89ec-4ff9-8755-443a12c0dd68 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1322 microversion: 2.1 time: 0.389223 Jul 24 01:09:47.225696 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 177/374] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:46 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:47.292599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:47.294758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:47.305566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.306618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.308604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.309478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.395543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:47.409170 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2951147-94bf-4e36-a847-ba7c60f95c2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1265 microversion: 2.1 time: 0.121094 Jul 24 01:09:47.409795 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 178/375] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:47 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:47.448663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:47.449544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:47.457157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.457998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.458977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.459577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.639968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9573c383-75e2-484e-af24-65ae28adf51f tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.640776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9573c383-75e2-484e-af24-65ae28adf51f tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.642291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9573c383-75e2-484e-af24-65ae28adf51f tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.643033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9573c383-75e2-484e-af24-65ae28adf51f tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.690042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:47.709244 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-314ec296-be84-4c0f-a1fc-ffd912958ee7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.263682 Jul 24 01:09:47.731525 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 179/376] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:47 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:09:47.742770 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9573c383-75e2-484e-af24-65ae28adf51f tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb" status: 200 len: 328 microversion: 2.1 time: 0.565123 Jul 24 01:09:47.743995 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 198/377] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:09:47 2022] PUT /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb => generated 328 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:47.764082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:47.765748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:47.776505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.777579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:47.778864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:47.779547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:48.044565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee3a279d-93d6-4fbc-b869-44c96205ccc5 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Action: 'create', calling method: .version_select at 0x7f05eb8f6940>, body: {"keypair": {"name": "tempest-keypair-681683523", "type": "ssh", "user_id": "8ab14ea4975247678ed6149476a7a5e9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb0sETvIEE8r1uvrCNrKOZm5/RrwIemzyHJ/0ay9Rgap8WrVuz0JTlGemTH4PuoYBbaqJSV75c0XBIM+zf9Xiandi5SuJotWI/ji42Re8Leo3b3JteDzJiBhAoo17Qn/w=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:48.155830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ee3a279d-93d6-4fbc-b869-44c96205ccc5 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Getting quotas for project a261276146c640edaa4332fadb380e3b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:48.169907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ee3a279d-93d6-4fbc-b869-44c96205ccc5 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Getting quotas for user 140ef31e874849489295a2a4c90d3f68 and project a261276146c640edaa4332fadb380e3b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:48.222527 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee3a279d-93d6-4fbc-b869-44c96205ccc5 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.489145 Jul 24 01:09:48.223696 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 180/378] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:09:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 492 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:09:48.230493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75b6cc7d-e3a7-4103-8e10-41e9917bee74 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:48.252828 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75b6cc7d-e3a7-4103-8e10-41e9917bee74 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb" status: 202 len: 0 microversion: 2.1 time: 0.026985 Jul 24 01:09:48.255753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 181/379] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:09:48 2022] DELETE /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:48.265908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:48.267391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:48.278230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:48.279184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:48.281066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:48.281498 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:48.281607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:48.292002 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:48.297300 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-574b9843-6d94-4c94-90d2-296b37972383 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1320 microversion: 2.1 time: 0.551718 Jul 24 01:09:48.314302 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 199/380] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:47 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1320 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:48.328253 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:48.329869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:48.344674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:48.346562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:48.348443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:48.349284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:48.725731 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:48.741141 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-049bfec9-f1ea-4631-894b-65aa5e5bf728 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1319 microversion: 2.1 time: 0.483732 Jul 24 01:09:48.743227 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 182/381] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:48 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:48.753742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61a281ba-107f-4c48-aed6-e34a396c43c0 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Action: 'create', calling method: .version_select at 0x7f05eb935550>, body: {"keypair": {"name": "tempest-keypair-1569825865", "type": "ssh", "user_id": "8ab14ea4975247678ed6149476a7a5e9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9FF3dBMD+rNxUCWrHnOhp5Xo0gPhwFj8kyT/a8dltUtePSWGlh9VBrEduL61tamU/hqpLrPk/B1W/iHIpxTcvmLpmmgw+uXdiZ22z4o/thSFNv3LZJ33RJtBS01mFkAA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:48.756518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:48.782761 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36bc96c1-bf16-4406-929f-d5b37621536d tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1471 microversion: 2.1 time: 0.466071 Jul 24 01:09:48.784189 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 200/382] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:48 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:48.794250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8e575b4c-71b1-424c-997e-69df1de24835 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Calling method '.version_select at 0x7f05ebd07ca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:48.799775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-61a281ba-107f-4c48-aed6-e34a396c43c0 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Getting quotas for project a261276146c640edaa4332fadb380e3b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:48.835630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-61a281ba-107f-4c48-aed6-e34a396c43c0 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Getting quotas for user 140ef31e874849489295a2a4c90d3f68 and project a261276146c640edaa4332fadb380e3b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:48.903247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61a281ba-107f-4c48-aed6-e34a396c43c0 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.156759 Jul 24 01:09:48.904278 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 183/383] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:09:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:09:48.924560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:48.932157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:48.950627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:48.951436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:48.960019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:48.960791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.001418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8e575b4c-71b1-424c-997e-69df1de24835 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb" status: 200 len: 371 microversion: 2.1 time: 0.215540 Jul 24 01:09:49.002056 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 201/384] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:09:48 2022] GET /compute/v2.1/os-quota-sets/c995ff06771a42d3befd5dc44f5c49fb => generated 371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:49.007021 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:49.007643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:49.022950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.023567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.024432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.024995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.220538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:49.235097 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-71b819b3-0eb8-4e1a-a816-494360a3bcdb tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1271 microversion: 2.1 time: 0.326123 Jul 24 01:09:49.236444 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 184/385] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:48 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1271 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:49.259435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:49.260595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:49.272611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.273429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.274885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.275706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.336326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lazy-loading 'flavor' on Instance uuid 218ba9eb-01c0-40ad-ba00-41c77f237321 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:09:49.471175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:49.488385 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eab47cfe-5a06-4090-8c62-7e10427780c8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.483832 Jul 24 01:09:49.489416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1bff7e56-f39f-4bb5-8ef6-1bc96524660c tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321/action" status: 202 len: 0 microversion: 2.1 time: 0.237365 Jul 24 01:09:49.489720 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 202/386] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:49 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:49.492492 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 185/387] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:09:49 2022] POST /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:09:49.496380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c994a0e1-635f-4051-a9c7-0b538e8980ea req-29b1cb91-81b9-44d6-89c9-5532690f2d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b", "tag": "66d9cb8a-e682-463f-8d7e-19a8fff0c76f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:49.506353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5600c10a-a17a-45ad-a450-a3e16bde6a5d tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Calling method '.version_select at 0x7f05eba0ae50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:49.530175 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5600c10a-a17a-45ad-a450-a3e16bde6a5d tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-681683523?user_id=8ab14ea4975247678ed6149476a7a5e9" status: 200 len: 511 microversion: 2.10 time: 0.034355 Jul 24 01:09:49.532602 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 186/388] 10.222.0.27 () {60 vars in 1336 bytes} [Sun Jul 24 01:09:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-681683523?user_id=8ab14ea4975247678ed6149476a7a5e9 => generated 511 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:09:49.535583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c994a0e1-635f-4051-a9c7-0b538e8980ea req-29b1cb91-81b9-44d6-89c9-5532690f2d06 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.536280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c994a0e1-635f-4051-a9c7-0b538e8980ea req-29b1cb91-81b9-44d6-89c9-5532690f2d06 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.545722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffe49276-6159-4f86-90a2-61fe6b23d5c5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Calling method '.version_select at 0x7f05ebec2310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:49.555641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c994a0e1-635f-4051-a9c7-0b538e8980ea req-29b1cb91-81b9-44d6-89c9-5532690f2d06 service nova] Creating event network-changed:66d9cb8a-e682-463f-8d7e-19a8fff0c76f for instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b on n-h1-master-1 Jul 24 01:09:49.562499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c994a0e1-635f-4051-a9c7-0b538e8980ea req-29b1cb91-81b9-44d6-89c9-5532690f2d06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070766 Jul 24 01:09:49.563272 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 203/389] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:49.569714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:49.571296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:49.581248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.581753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.582571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.583251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.852226 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffe49276-6159-4f86-90a2-61fe6b23d5c5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68/defaults" status: 200 len: 371 microversion: 2.1 time: 0.317702 Jul 24 01:09:49.862778 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 187/390] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:09:49 2022] GET /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68/defaults => generated 371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:49.862778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0c5e2464-dbbc-4350-a7fb-121b4b1c0bfa tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:49.862778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0c5e2464-dbbc-4350-a7fb-121b4b1c0bfa tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:49.869074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5e2464-dbbc-4350-a7fb-121b4b1c0bfa tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.869848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5e2464-dbbc-4350-a7fb-121b4b1c0bfa tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:49.870777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5e2464-dbbc-4350-a7fb-121b4b1c0bfa tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:49.871275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5e2464-dbbc-4350-a7fb-121b4b1c0bfa tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:50.030080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:50.063290 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c65fceb-86dd-4c81-9555-6f02b6b6ad4d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1320 microversion: 2.1 time: 0.497982 Jul 24 01:09:50.074530 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 204/391] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:49 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:50.079339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61581367-50ee-4f3b-a452-a1330d117225 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Action: 'create', calling method: .version_select at 0x7f05f9af34c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-131672488", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJEsKhwDL41pkoGqpGKCwtqvy4QqfvLo0PJjbGzNnGhPYlRV/NsKDs1WlXHYD7BtESy3Kee+PsftQh7Z69adnLA+Xk2KRQo4cXMsMrEVr3LRMFx9Wh8AZEdvIIEACfv1g=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:50.098725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-61581367-50ee-4f3b-a452-a1330d117225 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Getting quotas for project a261276146c640edaa4332fadb380e3b. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:50.118880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-61581367-50ee-4f3b-a452-a1330d117225 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Getting quotas for user 140ef31e874849489295a2a4c90d3f68 and project a261276146c640edaa4332fadb380e3b. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:50.159082 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-61581367-50ee-4f3b-a452-a1330d117225 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.083204 Jul 24 01:09:50.160236 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 205/392] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:09:50 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:09:50.167065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:50.168577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:50.179501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:50.180171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:50.183331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:50.183978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:50.779649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:50.807219 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e7fe9b9e-49d4-4e3b-9703-4c2fb4bc180d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1319 microversion: 2.1 time: 0.642175 Jul 24 01:09:50.807953 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 206/393] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:50 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:50.821775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-99f54214-4264-42ba-9841-5a3e90c299ef req-1b3b4457-b210-41d0-8338-36a943d71747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975740f0-20a6-4d5b-8e57-766c11d09594", "name": "network-vif-unplugged", "status": "completed", "tag": "cebc9e40-12d5-4535-ae92-0157bc5f293e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:50.836158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-99f54214-4264-42ba-9841-5a3e90c299ef req-1b3b4457-b210-41d0-8338-36a943d71747 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:50.837332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-99f54214-4264-42ba-9841-5a3e90c299ef req-1b3b4457-b210-41d0-8338-36a943d71747 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:50.852164 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-99f54214-4264-42ba-9841-5a3e90c299ef req-1b3b4457-b210-41d0-8338-36a943d71747 service nova] Creating event network-vif-unplugged:cebc9e40-12d5-4535-ae92-0157bc5f293e for instance 975740f0-20a6-4d5b-8e57-766c11d09594 on n-h2-master-1 Jul 24 01:09:50.858730 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-99f54214-4264-42ba-9841-5a3e90c299ef req-1b3b4457-b210-41d0-8338-36a943d71747 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049113 Jul 24 01:09:50.859763 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 207/394] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:50.866102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3036468a-a4a2-4fac-84ac-9b09b2ce6598 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Calling method '.version_select at 0x7f05ebd0a1f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:50.870548 n-d-master-1 devstack@n-api.service[119561]: WARNING oslo_db.sqlalchemy.utils [None req-3036468a-a4a2-4fac-84ac-9b09b2ce6598 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 24 01:09:50.879690 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3036468a-a4a2-4fac-84ac-9b09b2ce6598 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=8ab14ea4975247678ed6149476a7a5e9" status: 200 len: 725 microversion: 2.10 time: 0.018506 Jul 24 01:09:50.880560 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 208/395] 10.222.0.27 () {60 vars in 1258 bytes} [Sun Jul 24 01:09:50 2022] GET /compute/v2.1/os-keypairs?user_id=8ab14ea4975247678ed6149476a7a5e9 => generated 725 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:09:50.891229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-650dc900-b383-41d1-9061-de4fe70b7bd0 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebbc2c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:51.032871 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0c5e2464-dbbc-4350-a7fb-121b4b1c0bfa tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1630 microversion: 2.1 time: 1.177946 Jul 24 01:09:51.038957 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 188/396] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:49 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1630 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:51.056174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:51.060449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:51.064319 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:51.093564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.100279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.103420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.104597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.147456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-650dc900-b383-41d1-9061-de4fe70b7bd0 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.147923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-650dc900-b383-41d1-9061-de4fe70b7bd0 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.152971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-650dc900-b383-41d1-9061-de4fe70b7bd0 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.153534 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-650dc900-b383-41d1-9061-de4fe70b7bd0 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.268617 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-650dc900-b383-41d1-9061-de4fe70b7bd0 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6" status: 200 len: 328 microversion: 2.1 time: 0.386709 Jul 24 01:09:51.269266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 209/397] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:09:50 2022] PUT /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6 => generated 328 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:51.279539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:51.280675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:51.288516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.289213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.290966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.291939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.631866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:51.644099 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dae89dab-9ae3-4401-bc56-7a30f671f70e tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.603582 Jul 24 01:09:51.645513 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 189/398] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:51 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:51.658735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-505ef737-09f3-4551-b328-103195036fa3 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Calling method '.version_select at 0x7f05eba61790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:51.691028 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-505ef737-09f3-4551-b328-103195036fa3 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-131672488" status: 204 len: 0 microversion: 2.10 time: 0.043911 Jul 24 01:09:51.691835 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 190/399] 10.222.0.27 () {60 vars in 1321 bytes} [Sun Jul 24 01:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-131672488 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:09:51.701361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:51.702070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:51.709374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.710060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.710983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.711532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.784867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:51.793785 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ee46b763-06a5-4cb4-9255-f78faea2f1f4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.522926 Jul 24 01:09:51.794387 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 210/400] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:51 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:51.808362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f7e22ff-ef5e-4c59-9fc9-f4763e4d3096 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Calling method '.version_select at 0x7f05ebd0aaf0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:51.912910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f7e22ff-ef5e-4c59-9fc9-f4763e4d3096 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.913526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f7e22ff-ef5e-4c59-9fc9-f4763e4d3096 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.914595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f7e22ff-ef5e-4c59-9fc9-f4763e4d3096 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:51.916666 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f7e22ff-ef5e-4c59-9fc9-f4763e4d3096 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:51.944576 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f7e22ff-ef5e-4c59-9fc9-f4763e4d3096 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6/detail" status: 200 len: 916 microversion: 2.1 time: 0.141158 Jul 24 01:09:51.945960 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 211/401] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:09:51 2022] GET /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6/detail => generated 916 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:51.951204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e9ed4b5-fcbd-43af-b01c-5c04b15cc8d6 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Calling method '.version_select at 0x7f05ebbc21f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:51.963896 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:52.000220 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e9ed4b5-fcbd-43af-b01c-5c04b15cc8d6 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569825865?user_id=8ab14ea4975247678ed6149476a7a5e9" status: 204 len: 0 microversion: 2.10 time: 0.053070 Jul 24 01:09:52.006406 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 212/402] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569825865?user_id=8ab14ea4975247678ed6149476a7a5e9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:09:52.011020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:52.011779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:52.019759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.020205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.021171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.021522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.231387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:52.245961 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e11d11f5-f5cb-4a7d-8188-4fd6d9c2781a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1320 microversion: 2.1 time: 0.552127 Jul 24 01:09:52.247062 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 191/403] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:51 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1320 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:52.253119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d4b0e18-257c-48ad-ad5e-d81f61eafe24 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] Calling method '.version_select at 0x7f05eb931d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:52.283352 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d4b0e18-257c-48ad-ad5e-d81f61eafe24 tempest-KeyPairsV210TestJSON-40635433 tempest-KeyPairsV210TestJSON-40635433-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681683523?user_id=8ab14ea4975247678ed6149476a7a5e9" status: 204 len: 0 microversion: 2.10 time: 0.034442 Jul 24 01:09:52.284820 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 192/404] 10.222.0.27 () {60 vars in 1339 bytes} [Sun Jul 24 01:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681683523?user_id=8ab14ea4975247678ed6149476a7a5e9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:09:52.297264 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-436b30a5-5e74-4b91-8766-953051619fc1 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:52.298863 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-436b30a5-5e74-4b91-8766-953051619fc1 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:52.308272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-436b30a5-5e74-4b91-8766-953051619fc1 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.308980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-436b30a5-5e74-4b91-8766-953051619fc1 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.310037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-436b30a5-5e74-4b91-8766-953051619fc1 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.310753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-436b30a5-5e74-4b91-8766-953051619fc1 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.446126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:52.462081 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2c82648-65ac-47da-9146-484f961d1a80 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1319 microversion: 2.1 time: 0.459436 Jul 24 01:09:52.463803 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 213/405] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:52 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:52.471841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebd3c700>, body: {"quota_set": {"ram": "2048"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:52.685212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-436b30a5-5e74-4b91-8766-953051619fc1 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1613 microversion: 2.1 time: 0.398417 Jul 24 01:09:52.692711 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 193/406] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:52 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1613 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:52.702270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:52.703056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:52.718622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.719516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.720708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.721371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.753374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.754009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.754915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.755431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.834147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.834894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.841024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.843793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.971510 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ddd7cf51-5131-4144-8587-9c9282bef5cd tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6?user_id=5f77412d2e2f483580e8b8cc09ec3c27" status: 200 len: 328 microversion: 2.1 time: 0.505194 Jul 24 01:09:52.972618 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 214/407] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:09:52 2022] PUT /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6?user_id=5f77412d2e2f483580e8b8cc09ec3c27 => generated 328 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:52.984373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:52.985034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:52.993040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.993633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:52.994933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:52.995389 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:53.085984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:53.095890 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d50ef2c-dbf2-443b-a8f9-b95ca02c0d51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.400201 Jul 24 01:09:53.106022 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 194/408] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:52 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:53.111479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:53.112107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:53.132757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:53.134192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:53.135101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:53.139115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:53.736626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:53.737689 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] HTTP exception thrown: Cannot 'migrate' instance 218ba9eb-01c0-40ad-ba00-41c77f237321 while it is in vm_state suspended Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Request method failure captured: Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321/action HTTP/1.1 Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 15 Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Juq9B_C3QJZ8OTa33wBF31mUJiwBngMDFUMa3uCPZTObWmeLpeuLMzJeGlMpvWRsxDr5YHFbtmSIQvQpdXRjizvYp_7cgc9QonF9GFRsj-4syg3-NzMrh3pMxQQrZRSc16PE5Ltkrit_UbHL3aJgbGlKbB6SXCEekqKxoYvIXjpZVk Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:53.739500 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a09785ffe2da4839a184914bfacfebc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: a250ab409dd8445b910baf57f2e80b48 Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: {"migrate": {}} Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:53.740948 n-d-master-1 devstack@n-api.service[119561]: exception: Cannot 'migrate' instance 218ba9eb-01c0-40ad-ba00-41c77f237321 while it is in vm_state suspended Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '218ba9eb-01c0-40ad-ba00-41c77f237321', 'body': {'migrate': {}}} Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 218ba9eb-01c0-40ad-ba00-41c77f237321 in vm_state suspended. Cannot resize while the instance is in this state. Jul 24 01:09:53.747346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 218ba9eb-01c0-40ad-ba00-41c77f237321 while it is in vm_state suspended Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:53.748466 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 218ba9eb-01c0-40ad-ba00-41c77f237321 while it is in vm_state suspended Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Returning 409 to user: Cannot 'migrate' instance 218ba9eb-01c0-40ad-ba00-41c77f237321 while it is in vm_state suspended {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c6ae66b-202a-42a9-aae6-8ba426d863c6 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321/action" status: 409 len: 148 microversion: 2.1 time: 0.761126 Jul 24 01:09:53.749706 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 215/409] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:09:52 2022] POST /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321/action => generated 148 bytes in 769 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:53.751252 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a60b185-e159-47dd-bc54-931b93ebfa6d tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Calling method '.version_select at 0x7f05ebbf8af0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:53.761958 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5c025c16-b78d-4008-8f8e-54e3efa55320 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1504 microversion: 2.1 time: 0.654638 Jul 24 01:09:53.763787 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 195/410] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:53 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:53.777458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d65481be-3120-4b96-9adb-00cc52cd827b req-3b909068-8f97-43dc-83e9-5aaaf6deb142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80afddc-d9e6-4951-99ab-dabfae0ec911", "tag": "3a5dc077-80a5-48b5-be93-9084677b6222"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:53.813945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d65481be-3120-4b96-9adb-00cc52cd827b req-3b909068-8f97-43dc-83e9-5aaaf6deb142 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:53.816226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d65481be-3120-4b96-9adb-00cc52cd827b req-3b909068-8f97-43dc-83e9-5aaaf6deb142 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:53.837762 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d65481be-3120-4b96-9adb-00cc52cd827b req-3b909068-8f97-43dc-83e9-5aaaf6deb142 service nova] Creating event network-changed:3a5dc077-80a5-48b5-be93-9084677b6222 for instance b80afddc-d9e6-4951-99ab-dabfae0ec911 on n-h1-master-1 Jul 24 01:09:53.846056 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d65481be-3120-4b96-9adb-00cc52cd827b req-3b909068-8f97-43dc-83e9-5aaaf6deb142 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074569 Jul 24 01:09:53.848006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 196/411] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:53.859200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-03405ecd-ea65-468e-8ccd-26d493fb12d3 req-57e0a255-9628-4a8e-8240-7423ff4f3bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f09cbc-4e61-4153-9fae-de17316bae52", "name": "network-vif-plugged", "status": "completed", "tag": "53f21240-3ada-4187-82fd-9e3814713254"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:53.893048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-03405ecd-ea65-468e-8ccd-26d493fb12d3 req-57e0a255-9628-4a8e-8240-7423ff4f3bd9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:53.894252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-03405ecd-ea65-468e-8ccd-26d493fb12d3 req-57e0a255-9628-4a8e-8240-7423ff4f3bd9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:53.913755 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-03405ecd-ea65-468e-8ccd-26d493fb12d3 req-57e0a255-9628-4a8e-8240-7423ff4f3bd9 service nova] Creating event network-vif-plugged:53f21240-3ada-4187-82fd-9e3814713254 for instance d0f09cbc-4e61-4153-9fae-de17316bae52 on n-h2-master-1 Jul 24 01:09:53.923334 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-03405ecd-ea65-468e-8ccd-26d493fb12d3 req-57e0a255-9628-4a8e-8240-7423ff4f3bd9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072854 Jul 24 01:09:53.925158 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 197/412] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:53.936372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:53.937658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:53.946289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:53.947586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:53.949482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:53.950491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.369442 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a60b185-e159-47dd-bc54-931b93ebfa6d tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6?user_id=5f77412d2e2f483580e8b8cc09ec3c27" status: 200 len: 370 microversion: 2.1 time: 0.624807 Jul 24 01:09:54.372910 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 216/413] 10.222.0.27 () {58 vars in 1322 bytes} [Sun Jul 24 01:09:53 2022] GET /compute/v2.1/os-quota-sets/0de01a8806a449d38694beeb2b5a2ec6?user_id=5f77412d2e2f483580e8b8cc09ec3c27 => generated 370 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:54.385913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:54.387302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:54.394778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.395750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.396791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.397434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.436694 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:54.535473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:54.554454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59288fa3-4934-4b14-b5b8-75bae5df91b2 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1320 microversion: 2.1 time: 0.626735 Jul 24 01:09:54.557884 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 198/414] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:53 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1320 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:54.573946 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c535d20b-44b6-4046-aa41-567fa7fc4863 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c535d20b-44b6-4046-aa41-567fa7fc4863 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Request method failure captured: Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0/action HTTP/1.1 Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 39 Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Juq9B_C3QJZ8OTa33wBF31mUJiwBngMDFUMa3uCPZTObWmeLpeuLMzJeGlMpvWRsxDr5YHFbtmSIQvQpdXRjizvYp_7cgc9QonF9GFRsj-4syg3-NzMrh3pMxQQrZRSc16PE5Ltkrit_UbHL3aJgbGlKbB6SXCEekqKxoYvIXjpZVk Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:54.577365 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a09785ffe2da4839a184914bfacfebc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a250ab409dd8445b910baf57f2e80b48 Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: {"os-resetState": {"state": "invalid"}} Jul 24 01:09:54.578810 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd55b23bf-6ab5-4630-aa96-71a49a0200b0', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'invalid' Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:54.579462 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:09:54.580616 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 24 01:09:54.581613 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.583373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c535d20b-44b6-4046-aa41-567fa7fc4863 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:54.584565 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c535d20b-44b6-4046-aa41-567fa7fc4863 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0/action" status: 400 len: 144 microversion: 2.1 time: 0.014971 Jul 24 01:09:54.586539 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 199/415] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:09:54 2022] POST /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:09:54.596292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:54.597352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:54.607097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.607821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.608826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.609467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.798904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:54.810394 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40092250-6bff-47eb-9869-054b1b0b1fd4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1319 microversion: 2.1 time: 0.435399 Jul 24 01:09:54.816259 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 217/416] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:54 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:54.835408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4d1ff72d-17c3-4458-88f6-a609590dba66 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4d1ff72d-17c3-4458-88f6-a609590dba66 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Request method failure captured: Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0/action HTTP/1.1 Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 31 Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Juq9B_C3QJZ8OTa33wBF31mUJiwBngMDFUMa3uCPZTObWmeLpeuLMzJeGlMpvWRsxDr5YHFbtmSIQvQpdXRjizvYp_7cgc9QonF9GFRsj-4syg3-NzMrh3pMxQQrZRSc16PE5Ltkrit_UbHL3aJgbGlKbB6SXCEekqKxoYvIXjpZVk Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:09:54.838737 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a09785ffe2da4839a184914bfacfebc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: a250ab409dd8445b910baf57f2e80b48 Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: {"os-resetState": {"state": 1}} Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:54.839936 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'd55b23bf-6ab5-4630-aa96-71a49a0200b0', 'body': {'os-resetState': {'state': 1}}} Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 1 Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:54.840729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 24 01:09:54.842113 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.844066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4d1ff72d-17c3-4458-88f6-a609590dba66 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:54.845062 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4d1ff72d-17c3-4458-88f6-a609590dba66 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0/action" status: 400 len: 120 microversion: 2.1 time: 0.027304 Jul 24 01:09:54.846131 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 218/417] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:09:54 2022] POST /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0/action => generated 120 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:09:54.851392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:54.852275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:54.867435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:54.870525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.874767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.875944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.878975 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5ebf0186-8452-4076-af9a-cf315ef6c393 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.290155 Jul 24 01:09:54.879571 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 200/418] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:54 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:54.880426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.905082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-68e3017d-bd9d-42e3-8f91-5a9836f0d657 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:54.906492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-68e3017d-bd9d-42e3-8f91-5a9836f0d657 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Failed to fetch instance by id 999 {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 24 01:09:54.907082 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-68e3017d-bd9d-42e3-8f91-5a9836f0d657 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-68e3017d-bd9d-42e3-8f91-5a9836f0d657 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Request method failure captured: Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 37 Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Juq9B_C3QJZ8OTa33wBF31mUJiwBngMDFUMa3uCPZTObWmeLpeuLMzJeGlMpvWRsxDr5YHFbtmSIQvQpdXRjizvYp_7cgc9QonF9GFRsj-4syg3-NzMrh3pMxQQrZRSc16PE5Ltkrit_UbHL3aJgbGlKbB6SXCEekqKxoYvIXjpZVk Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:09:54.908843 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a09785ffe2da4839a184914bfacfebc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a09785ffe2da4839a184914bfacfebc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a09785ffe2da4839a184914bfacfebc3 Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1228797896 Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a250ab409dd8445b910baf57f2e80b48 Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1228797896-project-admin Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: {"os-resetState": {"state": "error"}} Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:09:54.910007 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 999 could not be found. Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:09:54.910684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-68e3017d-bd9d-42e3-8f91-5a9836f0d657 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:54.911796 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-68e3017d-bd9d-42e3-8f91-5a9836f0d657 tempest-ServersAdminNegativeTestJSON-1228797896 tempest-ServersAdminNegativeTestJSON-1228797896-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.028705 Jul 24 01:09:54.912636 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 201/419] 10.222.0.27 () {60 vars in 1178 bytes} [Sun Jul 24 01:09:54 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:09:54.925295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:54.925829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:54.934715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.935195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.936091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:54.936527 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:54.967349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:09:55.066143 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d3a8db1-55f1-4d4a-8ede-3be33dfd1324 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "DELETE /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 204 len: 0 microversion: 2.1 time: 0.144956 Jul 24 01:09:55.067023 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 202/420] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:09:54 2022] DELETE /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:09:55.074357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-20f0498d-0468-4f66-b7d9-a2b665cbeee7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Calling method '.version_select at 0x7f05eb9093a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:55.098775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:55.113170 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c419c9c-4107-433a-a8ce-9b52a7fb488d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1494 microversion: 2.1 time: 0.265669 Jul 24 01:09:55.126430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 219/421] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:54 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1494 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:55.134585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:55.135208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:55.142431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.142944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.143739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.144177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.353744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:55.365498 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-704cb864-7efb-45f5-bdfa-2e8934f19848 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1468 microversion: 2.1 time: 0.237472 Jul 24 01:09:55.379885 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 220/422] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:55 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1468 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:55.387181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-99866efd-a102-4d00-87e4-d0ab2ca0ce04 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '.version_select at 0x7f05ebbf8e50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:55.390135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99866efd-a102-4d00-87e4-d0ab2ca0ce04 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.390839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99866efd-a102-4d00-87e4-d0ab2ca0ce04 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.409342 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-99866efd-a102-4d00-87e4-d0ab2ca0ce04 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.026828 Jul 24 01:09:55.409998 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 221/423] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:09:55 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:55.423261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67180695-9b48-46c3-bca7-339f8052b736 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:55.424304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67180695-9b48-46c3-bca7-339f8052b736 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:55.433476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67180695-9b48-46c3-bca7-339f8052b736 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.434185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67180695-9b48-46c3-bca7-339f8052b736 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.435863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67180695-9b48-46c3-bca7-339f8052b736 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.436476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67180695-9b48-46c3-bca7-339f8052b736 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.485371 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-20f0498d-0468-4f66-b7d9-a2b665cbeee7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68/defaults" status: 200 len: 371 microversion: 2.1 time: 0.416509 Jul 24 01:09:55.485991 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 203/424] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:09:55 2022] GET /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68/defaults => generated 371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:55.497345 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11c8833c-6e0e-4961-8993-2b107e8e2484 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb8f60d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:55.688440 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67180695-9b48-46c3-bca7-339f8052b736 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1645 microversion: 2.1 time: 0.270254 Jul 24 01:09:55.689665 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 222/425] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:55 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1645 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:55.703012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:55.705239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:55.715250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.715761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.716597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.717292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.722105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11c8833c-6e0e-4961-8993-2b107e8e2484 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.723071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11c8833c-6e0e-4961-8993-2b107e8e2484 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.740157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11c8833c-6e0e-4961-8993-2b107e8e2484 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.743099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11c8833c-6e0e-4961-8993-2b107e8e2484 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.900332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:55.917085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20ebac84-febd-4691-ae0d-4f19f4fb2c24 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1320 microversion: 2.1 time: 0.221972 Jul 24 01:09:55.918573 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 223/426] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:55 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:55.926465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:55.927357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:55.942126 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.942873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:55.943681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:55.944141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.090108 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11c8833c-6e0e-4961-8993-2b107e8e2484 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68" status: 200 len: 329 microversion: 2.1 time: 0.597290 Jul 24 01:09:56.090931 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 204/427] 10.222.0.27 () {60 vars in 1262 bytes} [Sun Jul 24 01:09:55 2022] PUT /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68 => generated 329 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:09:56.096310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-215929007", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "0b0a25ed-fae4-4f81-a013-333d811349fa"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:56.150251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:56.164309 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4002ea73-8549-4c5e-ace8-f14d5777c18c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1319 microversion: 2.1 time: 0.243653 Jul 24 01:09:56.175403 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 224/428] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:55 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:56.175599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] validate_networks() for [('0b0a25ed-fae4-4f81-a013-333d811349fa', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:09:56.175697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:56.175697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:56.183757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.184212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.185108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.185775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.437698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:56.445256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6503135a-d28c-4c5b-8572-2fbbf0331a83 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.277671 Jul 24 01:09:56.445871 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 225/429] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:56 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:56.460240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5db803e5-ab31-45f4-a1ff-6a72124819f9 req-c9b4f413-daef-44e0-9bc7-449fe316b712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b", "name": "network-vif-plugged", "status": "completed", "tag": "66d9cb8a-e682-463f-8d7e-19a8fff0c76f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:56.469540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5db803e5-ab31-45f4-a1ff-6a72124819f9 req-c9b4f413-daef-44e0-9bc7-449fe316b712 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.470342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5db803e5-ab31-45f4-a1ff-6a72124819f9 req-c9b4f413-daef-44e0-9bc7-449fe316b712 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.486578 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5db803e5-ab31-45f4-a1ff-6a72124819f9 req-c9b4f413-daef-44e0-9bc7-449fe316b712 service nova] Creating event network-vif-plugged:66d9cb8a-e682-463f-8d7e-19a8fff0c76f for instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b on n-h1-master-1 Jul 24 01:09:56.489576 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5db803e5-ab31-45f4-a1ff-6a72124819f9 req-c9b4f413-daef-44e0-9bc7-449fe316b712 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032910 Jul 24 01:09:56.490065 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 226/430] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:56.496325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b16d10dd-561c-4aa2-be58-3773705df56a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebb93790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:56.697411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:09:56.697937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:09:56.698396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:09:56.698802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:09:56.699207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:09:56.708912 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.709354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.711939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.712423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.736159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:09:56.741126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for user 40b5fc3b4b6d43ab9342da568567140d and project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:09:56.743866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16d10dd-561c-4aa2-be58-3773705df56a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.744315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16d10dd-561c-4aa2-be58-3773705df56a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.745197 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16d10dd-561c-4aa2-be58-3773705df56a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.745629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16d10dd-561c-4aa2-be58-3773705df56a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.753586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:09:56.756350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:09:56.812165 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be78d8d9-1c76-45e1-bc9d-b7fdf54fda5f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719925 Jul 24 01:09:56.813038 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 205/431] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:09:56.821539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:56.823082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:56.830094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.830541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.831312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:56.831747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:56.835455 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:57.010334 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=11,nova_api:UPDATE=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:57.014272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:57.023294 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d26100e5-aab4-46ef-a02d-adea941aa251 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1468 microversion: 2.1 time: 0.208750 Jul 24 01:09:57.024516 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 206/432] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:56 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1468 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:57.030285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae868b7f-62ad-4651-a3d6-dca542674b20 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:57.031122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ae868b7f-62ad-4651-a3d6-dca542674b20 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:57.094176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ae868b7f-62ad-4651-a3d6-dca542674b20 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:57.104391 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ae868b7f-62ad-4651-a3d6-dca542674b20 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1210 microversion: 2.1 time: 0.077771 Jul 24 01:09:57.105287 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 207/433] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:57 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:57.120661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:57.121288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:57.130517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.131170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.132014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.132522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.157113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b16d10dd-561c-4aa2-be58-3773705df56a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68" status: 200 len: 329 microversion: 2.1 time: 0.665299 Jul 24 01:09:57.159185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 227/434] 10.222.0.27 () {60 vars in 1262 bytes} [Sun Jul 24 01:09:56 2022] PUT /compute/v2.1/os-quota-sets/5049e7661af04d2d930b150c2e04da68 => generated 329 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:57.183543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:57.184387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:57.195942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.196626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.197742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.198178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.417391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:57.429575 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28d47196-a76b-4345-85c5-bc53c0134a71 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1470 microversion: 2.1 time: 0.313095 Jul 24 01:09:57.431378 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 208/435] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:57 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:57.536089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:57.549275 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6963191-a21a-45ea-810c-814e95e63dad tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1319 microversion: 2.1 time: 0.370425 Jul 24 01:09:57.551960 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 228/436] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:57 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:57.708094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6236061d-c915-41e3-be57-822ec871973f tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] Calling method '.version_select at 0x7f05eb881ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:57.708981 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:57.708981 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:57.710992 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=17 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:57.738265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6236061d-c915-41e3-be57-822ec871973f tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.304003 Jul 24 01:09:57.739097 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 209/437] 10.222.0.27 () {58 vars in 1184 bytes} [Sun Jul 24 01:09:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:57.756003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:57.756630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:57.764101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.764835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.765886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.766515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.859274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:57.859949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:57.866224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.866761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.867603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:57.868114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:57.894770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:09:58.042072 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6af3da3e-2ac7-4b93-97d0-bef63f38b70e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 204 len: 0 microversion: 2.1 time: 0.487226 Jul 24 01:09:58.043117 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 229/438] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:09:57 2022] DELETE /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:09:58.048861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c358eab0-d837-43ce-8ad1-8800717f6df8 tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebaaae50>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:58.052333 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:58.052333 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:58.076847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:58.088444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4bcea2d7-3cde-4402-bf05-b3c68cc91353 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.348160 Jul 24 01:09:58.090022 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 210/439] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:57 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:58.103003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:58.104490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:58.113696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:58.114634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:58.116088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:58.117026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:58.206814 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=96,nova_cell0:UPDATE=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:58.369053 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c358eab0-d837-43ce-8ad1-8800717f6df8 tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.323945 Jul 24 01:09:58.369879 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 230/440] 10.222.0.27 () {60 vars in 1205 bytes} [Sun Jul 24 01:09:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:58.378996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:58.379803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:58.387104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:58.387601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:58.388446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:58.388874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:58.790669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:58.801232 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7af877e4-d305-4183-b398-5b35da950b85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 200 len: 1468 microversion: 2.1 time: 0.709037 Jul 24 01:09:58.805257 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 211/441] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:58 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 1468 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:58.820707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:58.822292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:58.834229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:58.838406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:58.839504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:58.840083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.001559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:59.010334 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c9f4275-f127-4d64-8e49-8457cbc054a2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1270 microversion: 2.1 time: 0.199192 Jul 24 01:09:59.011320 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 212/442] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:58 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:59.021330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-62b2f5eb-24c3-4d09-a9b4-1c6906312982 tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] Calling method '.version_select at 0x7f05eb8819d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:59.022418 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:59.022418 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:09:59.036668 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-62b2f5eb-24c3-4d09-a9b4-1c6906312982 tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023977 Jul 24 01:09:59.037255 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 213/443] 10.222.0.27 () {58 vars in 1184 bytes} [Sun Jul 24 01:09:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:59.043423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:59.044239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:59.050351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.051182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.052251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.052616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.064860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:59.074406 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-55bd01e6-478e-4bd4-890a-4328f645c4bb tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1476 microversion: 2.1 time: 0.703470 Jul 24 01:09:59.075287 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 231/444] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:58 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1476 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:59.081325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a7da05cc-a1e2-469e-b750-4433aaf29f85 req-d8849f30-95a6-49d5-8039-ccbdce35b76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218ba9eb-01c0-40ad-ba00-41c77f237321", "name": "network-vif-deleted", "tag": "c6fefab9-f9bd-4d28-be6d-43329982b608"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:59.090285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a7da05cc-a1e2-469e-b750-4433aaf29f85 req-d8849f30-95a6-49d5-8039-ccbdce35b76a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.090867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a7da05cc-a1e2-469e-b750-4433aaf29f85 req-d8849f30-95a6-49d5-8039-ccbdce35b76a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.104730 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a7da05cc-a1e2-469e-b750-4433aaf29f85 req-d8849f30-95a6-49d5-8039-ccbdce35b76a service nova] Creating event network-vif-deleted:c6fefab9-f9bd-4d28-be6d-43329982b608 for instance 218ba9eb-01c0-40ad-ba00-41c77f237321 on n-h1-master-1 Jul 24 01:09:59.109843 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a7da05cc-a1e2-469e-b750-4433aaf29f85 req-d8849f30-95a6-49d5-8039-ccbdce35b76a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Jul 24 01:09:59.111053 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 232/445] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:59.117471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-506c6666-c3d8-4bae-b7b7-7839bddcb066 tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] Action: 'update', calling method: .version_select at 0x7f05ebaf24c0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:09:59.120179 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:09:59.120179 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:09:59.203208 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=11,nova_api:UPDATE=26 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:59.217865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:59.229392 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-60705813-8797-465c-9734-3d754c2ac8ea tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1319 microversion: 2.1 time: 0.188015 Jul 24 01:09:59.239072 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 214/446] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:59 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:59.240818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:59.241449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:59.255370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.255912 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.256708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.257147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.268382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-506c6666-c3d8-4bae-b7b7-7839bddcb066 tempest-QuotaClassesAdminTestJSON-1586963623 tempest-QuotaClassesAdminTestJSON-1586963623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.155843 Jul 24 01:09:59.269266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 233/447] 10.222.0.27 () {60 vars in 1205 bytes} [Sun Jul 24 01:09:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:09:59.597333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:09:59.611834 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e12b2211-fb48-4acc-bf7e-cb6121664f44 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.376050 Jul 24 01:09:59.624195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 215/448] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:59 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:09:59.825091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:59.825825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: 218ba9eb-01c0-40ad-ba00-41c77f237321] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:59.833787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.834246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.835036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.835789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.857758 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] HTTP exception thrown: Instance 218ba9eb-01c0-40ad-ba00-41c77f237321 could not be found. Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Request method failure captured: Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 HTTP/1.1 Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JupqATuONkgNrAnTSRlw4ACsJtgbdbZpSq8OEmgt4BgevlgdE9efPlVyLOcV9GsOjJDtre6rOXv8j9GZQ-tyxl9zutjT7a-biapPH0T8hrrDkoWKOvRKp-mSw7vvggGy_jr2KRc8fOIzbDk0w5HLKMHhksR9WR8igYzRu5hYQtqEeM Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 3a66209b0c5f43928a52519ee8f5edbf Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-223595344 Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:09:59.859735 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a66209b0c5f43928a52519ee8f5edbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a66209b0c5f43928a52519ee8f5edbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a66209b0c5f43928a52519ee8f5edbf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a66209b0c5f43928a52519ee8f5edbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminNegativeTestJSON-223595344 Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 3a66209b0c5f43928a52519ee8f5edbf Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-223595344 Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminNegativeTestJSON-223595344-project Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d9d620962dcc40a8afaf6f97ae605eec Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminNegativeTestJSON-223595344-project Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 218ba9eb-01c0-40ad-ba00-41c77f237321 could not be found. Jul 24 01:09:59.860917 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '218ba9eb-01c0-40ad-ba00-41c77f237321'} Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218ba9eb-01c0-40ad-ba00-41c77f237321 could not be found. Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:09:59.861604 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218ba9eb-01c0-40ad-ba00-41c77f237321 could not be found. Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218ba9eb-01c0-40ad-ba00-41c77f237321 could not be found. Jul 24 01:09:59.863277 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:09:59.864271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Returning 404 to user: Instance 218ba9eb-01c0-40ad-ba00-41c77f237321 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:09:59.864271 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7569680b-4799-4738-aa3e-e7982148ebcf tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321" status: 404 len: 111 microversion: 2.1 time: 0.044504 Jul 24 01:09:59.864271 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 234/449] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:09:59 2022] GET /compute/v2.1/servers/218ba9eb-01c0-40ad-ba00-41c77f237321 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:09:59.872247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:09:59.873711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:09:59.889445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.890276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.891779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:09:59.892236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:09:59.954842 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:10:00.029375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:00.030402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:00.047048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.051794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.052907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.059835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.129560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d64fbc6-9630-4a74-a02c-86d1cd0af6b9 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 204 len: 0 microversion: 2.1 time: 0.260945 Jul 24 01:10:00.130520 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 216/450] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:09:59 2022] DELETE /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:10:00.148375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:00.148868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:00.158011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.158476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.159295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.159742 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.273168 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:00.282630 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf4e55c5-4ba1-4242-b647-0463b5ea927d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1268 microversion: 2.1 time: 0.258434 Jul 24 01:10:00.284650 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 235/451] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:00 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:10:00.297579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:00.298231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:00.316600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.317296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.318104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.318537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.627474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:00.641345 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-799d3f4c-d466-4024-8e41-f022f7fc7ab5 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 200 len: 1476 microversion: 2.1 time: 0.508332 Jul 24 01:10:00.642420 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 217/452] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:00 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 1476 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:00.659908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:00.661174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:00.666593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:00.676195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.676627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.677477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.677969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.682150 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab15c1ee-7125-47be-a451-84780020eeb6 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1478 microversion: 2.1 time: 0.394419 Jul 24 01:10:00.682741 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 236/453] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:00 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1478 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:00.687215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:00.687820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:00.703365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.703815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:00.704601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:00.705035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.140904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:01.153909 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9eb4e976-6b51-4a6f-b92e-d88f774200dc tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1468 microversion: 2.1 time: 0.509879 Jul 24 01:10:01.154961 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 218/454] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:00 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1468 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:01.155411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:01.160268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-71932a6f-737b-427c-b75f-72bd0f6f9c65 req-ed6a7183-95f3-4582-b6ce-15c6e603e6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f09cbc-4e61-4153-9fae-de17316bae52", "name": "network-vif-deleted", "tag": "53f21240-3ada-4187-82fd-9e3814713254"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:01.177443 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-28aeec57-56a5-4a53-98ea-877b0f53d421 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.492938 Jul 24 01:10:01.178102 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 237/455] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:00 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:01.179029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-71932a6f-737b-427c-b75f-72bd0f6f9c65 req-ed6a7183-95f3-4582-b6ce-15c6e603e6da service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.179476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-71932a6f-737b-427c-b75f-72bd0f6f9c65 req-ed6a7183-95f3-4582-b6ce-15c6e603e6da service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.212580 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-71932a6f-737b-427c-b75f-72bd0f6f9c65 req-ed6a7183-95f3-4582-b6ce-15c6e603e6da service nova] Creating event network-vif-deleted:53f21240-3ada-4187-82fd-9e3814713254 for instance d0f09cbc-4e61-4153-9fae-de17316bae52 on n-h2-master-1 Jul 24 01:10:01.223696 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-71932a6f-737b-427c-b75f-72bd0f6f9c65 req-ed6a7183-95f3-4582-b6ce-15c6e603e6da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064609 Jul 24 01:10:01.225215 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 219/456] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:01.306538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:01.306974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:01.319725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.320256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.322626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.323052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.548620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-512770461", "block_migration": true, "disk_over_commit": false}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:01.551845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:01.563030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.563557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.564464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.564995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.641770 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:01.662195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lazy-loading 'flavor' on Instance uuid 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:01.666266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:01.683792 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d384b74-f8c9-4e46-b258-c60fd9748718 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.384538 Jul 24 01:10:01.695938 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 220/457] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:01 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:01.701204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-026b0801-7452-4e14-8ee6-cc48e4a51b69 req-7e0261f3-e6c0-45bc-b9f2-4c773ccebbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80afddc-d9e6-4951-99ab-dabfae0ec911", "name": "network-vif-plugged", "status": "completed", "tag": "3a5dc077-80a5-48b5-be93-9084677b6222"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:01.710187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-026b0801-7452-4e14-8ee6-cc48e4a51b69 req-7e0261f3-e6c0-45bc-b9f2-4c773ccebbb2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.710677 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-026b0801-7452-4e14-8ee6-cc48e4a51b69 req-7e0261f3-e6c0-45bc-b9f2-4c773ccebbb2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.723127 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-026b0801-7452-4e14-8ee6-cc48e4a51b69 req-7e0261f3-e6c0-45bc-b9f2-4c773ccebbb2 service nova] Creating event network-vif-plugged:3a5dc077-80a5-48b5-be93-9084677b6222 for instance b80afddc-d9e6-4951-99ab-dabfae0ec911 on n-h1-master-1 Jul 24 01:10:01.731058 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-026b0801-7452-4e14-8ee6-cc48e4a51b69 req-7e0261f3-e6c0-45bc-b9f2-4c773ccebbb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033186 Jul 24 01:10:01.731665 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 221/458] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:01.738158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:01.740110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:01.747513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.748243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.749203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.749859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.769780 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] HTTP exception thrown: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Request method failure captured: Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 HTTP/1.1 Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvQ_n-XZDOZN7BDncXYj4fg3qs6M9LeNV8cYVy1HOwOaIQ5VN3O4GGsNTYZTQB3ug_iYRf8lXb1b-EqWmBkPZRn7VvdKbDM-yyh1-6oo5kRuFg-yYc7bFxfxs3zMLVoXo1fweO2snTuWIIrBGYxqW_haIZvNYKYcTM0YxOynqbMmOw Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:01.772787 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a228611da9b47f785568447a4caa0eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1070815bb60c44fcb6a586fd2d1f6e71 Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: exception: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:01.774336 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd0f09cbc-4e61-4153-9fae-de17316bae52'} Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:01.775568 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:01.776677 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.779721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Returning 404 to user: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:01.780667 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be554133-921c-4dc9-861c-387fc8272d6a tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 404 len: 111 microversion: 2.1 time: 0.047677 Jul 24 01:10:01.781458 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 222/459] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:01 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:01.799313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:01.800346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:01.806636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Going to try to live migrate instance to tempest-host-512770461 {{(pid=119561) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:10:01.812013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.813361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.814638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.815949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.826714 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] HTTP exception thrown: Compute host tempest-host-512770461 could not be found. Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Request method failure captured: Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b/action HTTP/1.1 Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 106 Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvV6efdZXBEFLSm9B1N8P1RMVkP4euV8PnWfD76IhZjQ0MCdJt5XhHJxbORD4MiAIUBhvbpYNVp3lCgBQE9wgQv_Go5JWmgNeBYDAKVOxI8yU2a_vHWYqQPcvjyxIu_BCg7m-wTuk2PIQ3TPjnpbrwd1aTX3ltq0WQWxRZqrvONXuE Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 724022d6e8d84abf8ed98950dc5f7df1 Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-LiveMigrationNegativeTest-1830862355 Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:10:01.831924 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/724022d6e8d84abf8ed98950dc5f7df1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/724022d6e8d84abf8ed98950dc5f7df1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_724022d6e8d84abf8ed98950dc5f7df1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/724022d6e8d84abf8ed98950dc5f7df1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-LiveMigrationNegativeTest-1830862355 Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 724022d6e8d84abf8ed98950dc5f7df1 Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1830862355 Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-LiveMigrationNegativeTest-1830862355-project-admin Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b8acf79566f9421a9235ec259d43e597 Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-LiveMigrationNegativeTest-1830862355-project-admin Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: {"os-migrateLive": {"host": "tempest-host-512770461", "block_migration": true, "disk_over_commit": false}} Jul 24 01:10:01.833126 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: exception: Compute host tempest-host-512770461 could not be found. Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b', 'body': {'os-migrateLive': {'host': 'tempest-host-512770461', 'block_migration': True, 'disk_over_commit': False}}} Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:10:01.833967 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-512770461 could not be found. Jul 24 01:10:01.835015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-512770461 could not be found. Jul 24 01:10:01.836049 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-512770461 could not be found. Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Returning 400 to user: Compute host tempest-host-512770461 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1d87d2d9-3962-4d06-a0dc-1478eb19d61c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b/action" status: 400 len: 99 microversion: 2.1 time: 0.654239 Jul 24 01:10:01.839192 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 238/460] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Jul 24 01:10:01 2022] POST /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b/action => generated 99 bytes in 656 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:01.857842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:01.860855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:01.875477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.876041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:01.876830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:01.877274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:02.574839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:02.590893 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab879b3e-1abb-4cc7-9771-17043fbbd25d tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1468 microversion: 2.1 time: 0.745173 Jul 24 01:10:02.591570 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 239/461] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:01 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1468 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:02.603869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-263860412", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:02.618250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:02.628426 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3b744e2-1c3e-4d3d-aaa4-27bf4ae54e85 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1478 microversion: 2.1 time: 0.835465 Jul 24 01:10:02.629534 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 223/462] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:01 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1478 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:02.634646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:02.635248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:02.646787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:02.647239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:02.648132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:02.648576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:02.686933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:03.123255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:03.131582 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb812981-24fc-40c1-bb27-cc6ca69d7978 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1313 microversion: 2.1 time: 0.500815 Jul 24 01:10:03.132176 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 224/463] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:02 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:03.137505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:03.138166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:03.168539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:03.170273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:03.171583 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:03.172623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:03.299177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:03.299762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:03.300428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:03.301125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:03.301762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:03.326300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:03.327187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:03.328292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:03.329121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:03.355459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Getting quotas for project 7a228611da9b47f785568447a4caa0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:03.360812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Getting quotas for user 1070815bb60c44fcb6a586fd2d1f6e71 and project 7a228611da9b47f785568447a4caa0eb. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:03.377384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:10:03.380643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:10:03.439936 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-19a1659b-3194-41ca-904d-5dd26eb308d3 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846623 Jul 24 01:10:03.441021 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 240/464] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:10:03.451202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-964742695", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:03.530332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:03.671351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:03.686543 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eb7a4758-8357-4a9f-a465-62c36445a9cd tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.553216 Jul 24 01:10:03.687157 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 225/465] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:03 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:03.693858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b1e8978-cad7-48ef-b61c-f96fe84f9718 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb935940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:03.801528 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b1e8978-cad7-48ef-b61c-f96fe84f9718 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/6508de2d-fd39-45c0-9991-4992d7d4b10f" status: 200 len: 661 microversion: 2.1 time: 0.103498 Jul 24 01:10:03.802714 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 226/466] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:03 2022] GET /compute/v2.1/images/6508de2d-fd39-45c0-9991-4992d7d4b10f => generated 661 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:03.822423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02b6ec6e-e6a1-4eb4-8a1c-24505dce2c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:03.828180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02b6ec6e-e6a1-4eb4-8a1c-24505dce2c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:04.197024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02b6ec6e-e6a1-4eb4-8a1c-24505dce2c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:04.205049 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=69 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:04.224907 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02b6ec6e-e6a1-4eb4-8a1c-24505dce2c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1219 microversion: 2.1 time: 0.414414 Jul 24 01:10:04.229375 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 227/467] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:03 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1219 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:04.235153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:04.235867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:04.246477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:04.247600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:04.251473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:04.253174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:04.332106 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:04.478898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d620962dcc40a8afaf6f97ae605eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a66209b0c5f43928a52519ee8f5edbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:04.498586 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e23a2453-e1ff-4583-8a84-7df1406d0d36 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 200 len: 1307 microversion: 2.1 time: 0.265918 Jul 24 01:10:04.502358 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 228/468] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:04 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 1307 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:04.524495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-425ec837-5413-469b-b555-e7347f6ec16b req-f77b0160-05c9-441c-a592-08903d8538c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5044972f-10c9-4250-87ea-7e65fdad75f5", "tag": "72a9224c-8d72-4822-b153-758b0b86416b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:04.545357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-425ec837-5413-469b-b555-e7347f6ec16b req-f77b0160-05c9-441c-a592-08903d8538c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:04.546249 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-425ec837-5413-469b-b555-e7347f6ec16b req-f77b0160-05c9-441c-a592-08903d8538c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:04.564321 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-425ec837-5413-469b-b555-e7347f6ec16b req-f77b0160-05c9-441c-a592-08903d8538c0 service nova] Creating event network-changed:72a9224c-8d72-4822-b153-758b0b86416b for instance 5044972f-10c9-4250-87ea-7e65fdad75f5 on n-h2-master-1 Jul 24 01:10:04.575549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-425ec837-5413-469b-b555-e7347f6ec16b req-f77b0160-05c9-441c-a592-08903d8538c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070796 Jul 24 01:10:04.578208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 229/469] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:04.595150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa8ef9d6-b94a-4036-ab6e-0ab70cd01276 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb881e50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:04.666144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa8ef9d6-b94a-4036-ab6e-0ab70cd01276 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/6508de2d-fd39-45c0-9991-4992d7d4b10f" status: 200 len: 661 microversion: 2.1 time: 0.084854 Jul 24 01:10:04.667463 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 230/470] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:04 2022] GET /compute/v2.1/images/6508de2d-fd39-45c0-9991-4992d7d4b10f => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:04.672822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:04.686856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:04.701801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:04.702670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:04.704412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:04.705940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:04.950164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:04.952217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:04.953760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:04.958275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:04.960087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:04.979917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:04.980762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:04.982194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:04.983315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.022075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Getting quotas for project aa9af5838d3645b2acad12161d65b6bc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:05.037230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Getting quotas for user 7fe15455304f4fe4a990a1d32e0d1c28 and project aa9af5838d3645b2acad12161d65b6bc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:05.073775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:10:05.079837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:10:05.167112 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9db07f1a-25a6-480c-b15a-d76fd061e53a tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723489 Jul 24 01:10:05.168144 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 241/471] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:10:05.176913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:05.177927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:05.187937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.188762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.189761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.190350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.242528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:05.259469 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-723aafb2-3e87-43b4-83d0-0e83784a7e2f tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1463 microversion: 2.1 time: 0.588206 Jul 24 01:10:05.275378 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 231/472] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:04 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1463 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:05.552633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5adcffa0-0966-45ef-afec-5a4feb748811 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Calling method '.version_select at 0x7f05eb9313a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:05.592814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:05.606279 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a27dead-61b8-4e4f-8513-6f4515d95b0f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.436551 Jul 24 01:10:05.606935 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 242/473] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:05 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:05.612630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f8554b4-1ff0-4a7f-a458-f00eff6dbaf9 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:05.613239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f8554b4-1ff0-4a7f-a458-f00eff6dbaf9 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:05.666477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5adcffa0-0966-45ef-afec-5a4feb748811 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 371 microversion: 2.1 time: 0.387829 Jul 24 01:10:05.670173 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 232/474] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:10:05 2022] GET /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:05.683471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:05.684443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:05.692369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.693099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.694105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.695412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.715509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f8554b4-1ff0-4a7f-a458-f00eff6dbaf9 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:05.724995 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f8554b4-1ff0-4a7f-a458-f00eff6dbaf9 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1218 microversion: 2.1 time: 0.116947 Jul 24 01:10:05.729208 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 243/475] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:05 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:05.836497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:05.849168 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa94ffdb-0b76-4a77-8a16-ad414a54f5fe tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1277 microversion: 2.1 time: 0.176377 Jul 24 01:10:05.852702 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 233/476] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:05 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:05.878024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:05.879843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] [instance: d55b23bf-6ab5-4630-aa96-71a49a0200b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:05.889393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.890609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.893064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.894996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.918826 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] HTTP exception thrown: Instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 could not be found. Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Request method failure captured: Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 HTTP/1.1 Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JupqATuONkgNrAnTSRlw4ACsJtgbdbZpSq8OEmgt4BgevlgdE9efPlVyLOcV9GsOjJDtre6rOXv8j9GZQ-tyxl9zutjT7a-biapPH0T8hrrDkoWKOvRKp-mSw7vvggGy_jr2KRc8fOIzbDk0w5HLKMHhksR9WR8igYzRu5hYQtqEeM Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 3a66209b0c5f43928a52519ee8f5edbf Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-223595344 Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:05.921366 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a66209b0c5f43928a52519ee8f5edbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a66209b0c5f43928a52519ee8f5edbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a66209b0c5f43928a52519ee8f5edbf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a66209b0c5f43928a52519ee8f5edbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-223595344 Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 3a66209b0c5f43928a52519ee8f5edbf Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-223595344 Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersAdminNegativeTestJSON-223595344-project Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: d9d620962dcc40a8afaf6f97ae605eec Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-223595344-project Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: exception: Instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 could not be found. Jul 24 01:10:05.922980 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd55b23bf-6ab5-4630-aa96-71a49a0200b0'} Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 could not be found. Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:05.923879 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 could not be found. Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 could not be found. Jul 24 01:10:05.925356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:05.928573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] Returning 404 to user: Instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:05.930995 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47cc8efd-1410-41ff-ba66-bb2dbc9f5cb3 tempest-ServersAdminNegativeTestJSON-223595344 tempest-ServersAdminNegativeTestJSON-223595344-project] 10.222.0.27 "GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0" status: 404 len: 111 microversion: 2.1 time: 0.076956 Jul 24 01:10:05.932175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 234/477] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:05 2022] GET /compute/v2.1/servers/d55b23bf-6ab5-4630-aa96-71a49a0200b0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:05.942100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38f1c774-ecc2-4830-b8c0-9b5cf49e32c3 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb881670>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:05.952832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6fb1b658-2d90-4505-8b50-8fc55afaeb6b tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:05.961305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6fb1b658-2d90-4505-8b50-8fc55afaeb6b tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Searching by: {'deleted': False, 'project_id': '8a01e29df907490aaa30e9b7f77ee406'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:05.984359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6fb1b658-2d90-4505-8b50-8fc55afaeb6b tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.985085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6fb1b658-2d90-4505-8b50-8fc55afaeb6b tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:05.986355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6fb1b658-2d90-4505-8b50-8fc55afaeb6b tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:05.987557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6fb1b658-2d90-4505-8b50-8fc55afaeb6b tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.143920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6fb1b658-2d90-4505-8b50-8fc55afaeb6b tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.413534 Jul 24 01:10:06.144675 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 244/478] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:10:05 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:10:06.166949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:06.183813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Searching by: {'deleted': False} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:06.197080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:06.198073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.199042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:06.199584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.351232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:10:06.511568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:06.512025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.615672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38f1c774-ecc2-4830-b8c0-9b5cf49e32c3 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:06.616108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38f1c774-ecc2-4830-b8c0-9b5cf49e32c3 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.616927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38f1c774-ecc2-4830-b8c0-9b5cf49e32c3 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:06.617638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38f1c774-ecc2-4830-b8c0-9b5cf49e32c3 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.626252 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=9 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:06.671642 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38f1c774-ecc2-4830-b8c0-9b5cf49e32c3 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 328 microversion: 2.1 time: 0.736894 Jul 24 01:10:06.684546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 235/479] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:10:05 2022] PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 328 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:06.684546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:06.684546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:06.684546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:06.685119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.686063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:06.686574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:06.880481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:06.890517 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e105360c-9d9b-48ec-9925-99cc086cd824 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.217198 Jul 24 01:10:06.902836 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 236/480] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:06 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:06.908433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-12c2fa13-9137-467c-9d8b-f31b7822964b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb819700>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.008730 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-12c2fa13-9137-467c-9d8b-f31b7822964b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/4eb3a96c-7b48-4551-9594-d0bad5d281d2" status: 200 len: 661 microversion: 2.1 time: 0.098047 Jul 24 01:10:07.011247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 237/481] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:06 2022] GET /compute/v2.1/images/4eb3a96c-7b48-4551-9594-d0bad5d281d2 => generated 661 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:07.018881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-cd394833-b51d-46b9-b1e7-631477dc6192 req-321ee1db-64b6-41e9-9b8d-cf56e658deb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55b23bf-6ab5-4630-aa96-71a49a0200b0", "name": "network-vif-deleted", "tag": "25ee93de-d0c7-486f-a871-8077bc634061"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:07.025182 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d3048099-9a91-48bf-8875-56447d166b0e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14169 microversion: 2.1 time: 0.862554 Jul 24 01:10:07.026093 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 245/482] 10.222.0.27 () {58 vars in 1170 bytes} [Sun Jul 24 01:10:06 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14169 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:10:07.036234 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-cd394833-b51d-46b9-b1e7-631477dc6192 req-321ee1db-64b6-41e9-9b8d-cf56e658deb2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.036609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.036826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-cd394833-b51d-46b9-b1e7-631477dc6192 req-321ee1db-64b6-41e9-9b8d-cf56e658deb2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.039158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:07.050074 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-cd394833-b51d-46b9-b1e7-631477dc6192 req-321ee1db-64b6-41e9-9b8d-cf56e658deb2 service nova] Creating event network-vif-deleted:25ee93de-d0c7-486f-a871-8077bc634061 for instance d55b23bf-6ab5-4630-aa96-71a49a0200b0 on n-h1-master-1 Jul 24 01:10:07.056414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.058339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-cd394833-b51d-46b9-b1e7-631477dc6192 req-321ee1db-64b6-41e9-9b8d-cf56e658deb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044033 Jul 24 01:10:07.059128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.059302 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 238/483] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:07.060287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.062857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.154377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:07.163779 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8964dcfc-b1e5-4492-a21e-f6a6f68cca33 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1222 microversion: 2.1 time: 0.135868 Jul 24 01:10:07.164639 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 246/484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:07.169935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.170880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:07.177975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.178941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.180030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.181390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.343680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:07.351502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-931155768", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:07.364917 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b408979e-dec0-4110-a7c6-adb0b33fa014 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.198923 Jul 24 01:10:07.365909 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 247/485] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:07.377626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa9a1c06-fe36-4844-b9a9-e62524914535 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb8f65e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.427099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:07.428620 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa9a1c06-fe36-4844-b9a9-e62524914535 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/4eb3a96c-7b48-4551-9594-d0bad5d281d2" status: 200 len: 661 microversion: 2.1 time: 0.061156 Jul 24 01:10:07.433804 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 248/486] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/images/4eb3a96c-7b48-4551-9594-d0bad5d281d2 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:07.438896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c30fa5be-919c-4252-b4d8-cc2d41aa8429 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.442806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c30fa5be-919c-4252-b4d8-cc2d41aa8429 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Searching by: {'deleted': False, 'project_id': '8a01e29df907490aaa30e9b7f77ee406'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:07.448649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30fa5be-919c-4252-b4d8-cc2d41aa8429 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.449107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30fa5be-919c-4252-b4d8-cc2d41aa8429 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.450118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30fa5be-919c-4252-b4d8-cc2d41aa8429 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.450550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30fa5be-919c-4252-b4d8-cc2d41aa8429 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.457441 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=24 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:07.486140 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c30fa5be-919c-4252-b4d8-cc2d41aa8429 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=c028787727e34a489f5a99f937538b6f" status: 200 len: 15 microversion: 2.1 time: 0.055301 Jul 24 01:10:07.487174 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 249/487] 10.222.0.27 () {58 vars in 1230 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/servers/detail?tenant_id=c028787727e34a489f5a99f937538b6f => generated 15 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:10:07.503520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.510470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Searching by: {'tenant_id': 'c028787727e34a489f5a99f937538b6f', 'deleted': False} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:07.520900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.521354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.522191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.522649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.553901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:10:07.630514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.630957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.731529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:07.732034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:07.732419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:07.732960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:07.733370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:07.742512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.743104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.743905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.744335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.770789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Getting quotas for project c6fbf893f8a5440bb48e571eadee05ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:07.780105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Getting quotas for user 931f77e76e1041e096a7051ce0beae4c and project c6fbf893f8a5440bb48e571eadee05ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:07.795663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.utils [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] cores quota exceeded for c6fbf893f8a5440bb48e571eadee05ab, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119562) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 24 01:10:07.796504 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 24 01:10:07.809845 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3fbcf67d-f3e5-40be-ab70-3b0cdc381c96 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c028787727e34a489f5a99f937538b6f" status: 200 len: 4826 microversion: 2.1 time: 0.309664 Jul 24 01:10:07.810559 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 250/488] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c028787727e34a489f5a99f937538b6f => generated 4826 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Request method failure captured: Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 144 Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvrS4FfUqsWs6khJfzIBMU8qvwW59BiPQ14w-rIOXMWw1lcAxErCHbrWo-Z4QBCpz6PekPJu-4UyXGM-g3LZT44XMZBMT4SxiTYnJfcniHEg8RtKsKuiMG41grAns--hSJNFxEbLTbNEhbu6w6aCttG7SIjNb_QCtM1UN15z8a9NvM Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:07.826614 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6fbf893f8a5440bb48e571eadee05ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 931f77e76e1041e096a7051ce0beae4c Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-931155768", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} Jul 24 01:10:07.828062 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-931155768', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452'}}} Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 24 01:10:07.828743 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:07.830314 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:07.831840 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09e303ee-c0b9-400f-98bd-031ccbd2fb03 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.767964 Jul 24 01:10:07.833450 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 239/489] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:07 2022] POST /compute/v2.1/servers => generated 111 bytes in 769 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:07.834280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-96eb5487-d595-47f9-a56e-7779e66e42f4 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.834491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-96eb5487-d595-47f9-a56e-7779e66e42f4 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Searching by: {'tenant_id': '8a01e29df907490aaa30e9b7f77ee406', 'deleted': False} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:07.839613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1a19df0-d652-4577-8b33-7525cd8c8dae tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb822e50>, body: {"quota_set": {"cores": 20}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:07.840816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96eb5487-d595-47f9-a56e-7779e66e42f4 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.841262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96eb5487-d595-47f9-a56e-7779e66e42f4 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.842088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96eb5487-d595-47f9-a56e-7779e66e42f4 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.842524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96eb5487-d595-47f9-a56e-7779e66e42f4 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.879301 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-96eb5487-d595-47f9-a56e-7779e66e42f4 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8a01e29df907490aaa30e9b7f77ee406" status: 200 len: 15 microversion: 2.1 time: 0.054296 Jul 24 01:10:07.880119 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 251/490] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8a01e29df907490aaa30e9b7f77ee406 => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:10:07.896443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-008551f0-164d-435c-86ff-474c718b7d38 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.901195 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-008551f0-164d-435c-86ff-474c718b7d38 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008356 Jul 24 01:10:07.901923 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 252/491] 10.222.0.27 () {58 vars in 1188 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:10:07.912956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:07.913990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:07.920853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.921318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:07.922122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:07.922585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.208139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:08.225346 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6300d47-16ee-45fa-b79f-d19302382548 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.317993 Jul 24 01:10:08.230878 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 253/492] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:07 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:10:08.243885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7723bf3b-76fb-4fc7-b109-fe7cef4cfb39 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:08.245999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7723bf3b-76fb-4fc7-b109-fe7cef4cfb39 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:08.257914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7723bf3b-76fb-4fc7-b109-fe7cef4cfb39 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.259457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7723bf3b-76fb-4fc7-b109-fe7cef4cfb39 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.262507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7723bf3b-76fb-4fc7-b109-fe7cef4cfb39 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.263021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7723bf3b-76fb-4fc7-b109-fe7cef4cfb39 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.333928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1a19df0-d652-4577-8b33-7525cd8c8dae tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.335276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1a19df0-d652-4577-8b33-7525cd8c8dae tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.338376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1a19df0-d652-4577-8b33-7525cd8c8dae tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.339587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1a19df0-d652-4577-8b33-7525cd8c8dae tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.392880 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:08.416267 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7723bf3b-76fb-4fc7-b109-fe7cef4cfb39 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action" status: 202 len: 0 microversion: 2.1 time: 0.181274 Jul 24 01:10:08.417078 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 254/493] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:08 2022] POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:08.431085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:08.433574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:08.445453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.446675 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.455138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.455913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.467348 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1a19df0-d652-4577-8b33-7525cd8c8dae tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 329 microversion: 2.1 time: 0.632219 Jul 24 01:10:08.468204 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 240/494] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:10:07 2022] PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 329 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:08.482597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:08.483977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:08.493730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.494375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.496316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.496932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.568717 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:08.579655 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab980c2e-9626-41b6-b927-f8f871359d3e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1270 microversion: 2.1 time: 0.160136 Jul 24 01:10:08.589838 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 255/495] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:08 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:08.594548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:08.598138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:08.598870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c028787727e34a489f5a99f937538b6f'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:08.614660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.630197 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.631191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:08.634140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:08.861526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:10:08.990081 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45d4f6f1-492f-45c3-ae96-ba5feaa8e3b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.408193 Jul 24 01:10:08.991371 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 256/496] 10.222.0.27 () {58 vars in 1149 bytes} [Sun Jul 24 01:10:08 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:09.005158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-74a34792-a31e-4011-87ea-466f9c0f1d22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Calling method '.version_select at 0x7f05eba570d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:09.201405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:09.213026 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58a8fbc3-e6d4-45d5-94fe-adba98c5839c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.738061 Jul 24 01:10:09.213940 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 241/497] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:08 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:09.223022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3e56e41-a9b6-4385-b1ee-78d0c9da57da tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:09.226760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c3e56e41-a9b6-4385-b1ee-78d0c9da57da tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:09.237245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3e56e41-a9b6-4385-b1ee-78d0c9da57da tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.238116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3e56e41-a9b6-4385-b1ee-78d0c9da57da tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.239147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3e56e41-a9b6-4385-b1ee-78d0c9da57da tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.239806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3e56e41-a9b6-4385-b1ee-78d0c9da57da tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.417993 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3e56e41-a9b6-4385-b1ee-78d0c9da57da tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action" status: 202 len: 0 microversion: 2.1 time: 0.198591 Jul 24 01:10:09.418989 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 242/498] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:09 2022] POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:09.426438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:09.427310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:09.438151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.438775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.439928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.440505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.665395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:09.684051 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c6ac4ef-3387-4718-a16e-3fff414b83f1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.263644 Jul 24 01:10:09.694925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 243/499] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:09 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:09.701311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a714f8a9-dc9f-4714-9f67-e9ca6321b578 req-46cfac77-f822-4ea5-801b-0aa9f0413b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea0fc22-3bb5-4042-bfb5-a5947beae6e7", "tag": "f8c3089f-0c86-42b2-b368-e6053f86d503"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:09.714539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a714f8a9-dc9f-4714-9f67-e9ca6321b578 req-46cfac77-f822-4ea5-801b-0aa9f0413b19 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.716048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a714f8a9-dc9f-4714-9f67-e9ca6321b578 req-46cfac77-f822-4ea5-801b-0aa9f0413b19 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.735079 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a714f8a9-dc9f-4714-9f67-e9ca6321b578 req-46cfac77-f822-4ea5-801b-0aa9f0413b19 service nova] Creating event network-changed:f8c3089f-0c86-42b2-b368-e6053f86d503 for instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 on n-h2-master-1 Jul 24 01:10:09.742279 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a714f8a9-dc9f-4714-9f67-e9ca6321b578 req-46cfac77-f822-4ea5-801b-0aa9f0413b19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044490 Jul 24 01:10:09.747181 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 244/500] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:09.758708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-852985e4-b529-4006-9201-9b9aa420e5ae tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:09.759819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-852985e4-b529-4006-9201-9b9aa420e5ae tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:09.781788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-852985e4-b529-4006-9201-9b9aa420e5ae tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.782260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-852985e4-b529-4006-9201-9b9aa420e5ae tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.783440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-852985e4-b529-4006-9201-9b9aa420e5ae tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.783961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-852985e4-b529-4006-9201-9b9aa420e5ae tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.947677 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-74a34792-a31e-4011-87ea-466f9c0f1d22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 371 microversion: 2.1 time: 0.954807 Jul 24 01:10:09.953447 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 257/501] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:10:08 2022] GET /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 371 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:09.966020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:09.966650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:09.969422 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-852985e4-b529-4006-9201-9b9aa420e5ae tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1614 microversion: 2.1 time: 0.216139 Jul 24 01:10:09.973879 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 245/502] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:09 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1614 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:09.984430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7673ba2e-3610-43c4-8529-cc133214443d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb84db80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:09.990316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.991174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:09.994141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:09.994854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.049727 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7673ba2e-3610-43c4-8529-cc133214443d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/e83db104-723f-42e2-8685-9280d5c44acd" status: 200 len: 662 microversion: 2.1 time: 0.077248 Jul 24 01:10:10.050411 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 246/503] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:09 2022] GET /compute/v2.1/images/e83db104-723f-42e2-8685-9280d5c44acd => generated 662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:10.061698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0a92547-f4fb-4d87-b547-8a76ef624cd6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb832c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:10.127304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:10.157258 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71f7c252-5015-409b-a86d-bb3993a076b4 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1276 microversion: 2.1 time: 0.206153 Jul 24 01:10:10.158594 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 258/504] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:09 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:10.163583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-022f9a99-5c7b-4fe9-a8c6-162dd1789ffd tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:10.164230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-022f9a99-5c7b-4fe9-a8c6-162dd1789ffd tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:10.175602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-022f9a99-5c7b-4fe9-a8c6-162dd1789ffd tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.176051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-022f9a99-5c7b-4fe9-a8c6-162dd1789ffd tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.176992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-022f9a99-5c7b-4fe9-a8c6-162dd1789ffd tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.177552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-022f9a99-5c7b-4fe9-a8c6-162dd1789ffd tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.182197 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:10.366684 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-022f9a99-5c7b-4fe9-a8c6-162dd1789ffd tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1614 microversion: 2.1 time: 0.206970 Jul 24 01:10:10.368592 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 259/505] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:10 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1614 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:10.375832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a75c345-f1f1-469f-b725-32943889d3f6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb69e0d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:10.441210 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a75c345-f1f1-469f-b725-32943889d3f6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/e83db104-723f-42e2-8685-9280d5c44acd" status: 200 len: 662 microversion: 2.1 time: 0.070578 Jul 24 01:10:10.442118 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 260/506] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:10 2022] GET /compute/v2.1/images/e83db104-723f-42e2-8685-9280d5c44acd => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:10.463843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:10.465544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:10.467949 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:10.476712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.478209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.479233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.479867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.485767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0a92547-f4fb-4d87-b547-8a76ef624cd6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.489748 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0a92547-f4fb-4d87-b547-8a76ef624cd6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.491563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0a92547-f4fb-4d87-b547-8a76ef624cd6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.497061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0a92547-f4fb-4d87-b547-8a76ef624cd6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.614497 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e0a92547-f4fb-4d87-b547-8a76ef624cd6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 328 microversion: 2.1 time: 0.562936 Jul 24 01:10:10.615406 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 247/507] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:10:10 2022] PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:10.624928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:10.636446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:10.650145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.650522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.651356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:10.651798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:10.698069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:10.706961 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b37b3b9b-b203-4f55-a05c-c6a3609a06de tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.255023 Jul 24 01:10:10.707785 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 261/508] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:10 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:10.763135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:10:10.772392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-587666927", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:10.826602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:10.871089 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9ac142e-ae39-4a27-a5ab-57263ddf4e69 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 1318 microversion: 2.1 time: 0.254358 Jul 24 01:10:10.872319 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 248/509] 10.222.0.27 () {58 vars in 1189 bytes} [Sun Jul 24 01:10:10 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:10.877173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-823866109", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:10.937036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:11.150898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:11.151411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:11.151769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:11.152171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:11.152602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:11.161798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.162313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.163186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.163797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.182661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Getting quotas for project 04e5954e848b49e7986b9f72eb5ea64c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:11.187889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Getting quotas for user 4f864a97463e4afb960a6c136e65b829 and project 04e5954e848b49e7986b9f72eb5ea64c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:11.200437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:10:11.202635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:10:11.215322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:11.215742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:11.216263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:11.216667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:11.217072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:11.226735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.227732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.228776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.229215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.247433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Getting quotas for project 221902b3cf044d719cc7dc1fcf7ba33b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:11.247641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79475466-8d0e-4906-9cb6-b203997d55c9 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530142 Jul 24 01:10:11.252953 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 262/510] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:10:11.257467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Getting quotas for user b96d7edf06d147bb94869c925933a78e and project 221902b3cf044d719cc7dc1fcf7ba33b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:11.261103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:11.261954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:11.268858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.270115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.271163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.271826 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.273805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:10:11.276909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:10:11.335960 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d6d04878-4c14-4476-be4b-fea8fc964026 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.462621 Jul 24 01:10:11.337177 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 249/511] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:10:11.343666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1090501515", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:11.422894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:11.516386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:11.529293 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13e390fb-25b4-41f7-ace7-b8c589924264 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.274832 Jul 24 01:10:11.539039 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 263/512] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:11 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:11.549716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d783740d-d58a-4554-8ee0-cae7938237e1 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:11.556627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d783740d-d58a-4554-8ee0-cae7938237e1 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:10:11.592563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d783740d-d58a-4554-8ee0-cae7938237e1 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.593480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d783740d-d58a-4554-8ee0-cae7938237e1 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.594542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d783740d-d58a-4554-8ee0-cae7938237e1 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.595106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d783740d-d58a-4554-8ee0-cae7938237e1 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.723756 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d783740d-d58a-4554-8ee0-cae7938237e1 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.182843 Jul 24 01:10:11.725084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 264/513] 10.222.0.27 () {58 vars in 1195 bytes} [Sun Jul 24 01:10:11 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:10:11.732876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:11.734586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:11.742480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:11.743555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:11.744138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:11.744836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:11.745500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:11.745883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.746357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.747872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.748324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.758238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.758838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.759784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.760241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.780725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Getting quotas for project c6fbf893f8a5440bb48e571eadee05ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:11.787418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Getting quotas for user 931f77e76e1041e096a7051ce0beae4c and project c6fbf893f8a5440bb48e571eadee05ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:11.808524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.utils [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] instances quota exceeded for c6fbf893f8a5440bb48e571eadee05ab, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119562) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 24 01:10:11.809067 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Request method failure captured: Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 145 Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvrS4FfUqsWs6khJfzIBMU8qvwW59BiPQ14w-rIOXMWw1lcAxErCHbrWo-Z4QBCpz6PekPJu-4UyXGM-g3LZT44XMZBMT4SxiTYnJfcniHEg8RtKsKuiMG41grAns--hSJNFxEbLTbNEhbu6w6aCttG7SIjNb_QCtM1UN15z8a9NvM Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:11.811235 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6fbf893f8a5440bb48e571eadee05ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 931f77e76e1041e096a7051ce0beae4c Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1090501515", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} Jul 24 01:10:11.813242 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1090501515', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452'}}} Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 24 01:10:11.814315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:11.816565 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:11.819793 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d87a4a68-47d3-4fad-9f98-38391137821c tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.473807 Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 250/514] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:11 2022] POST /compute/v2.1/servers => generated 119 bytes in 476 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:11.823078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2fa963f4-bff4-4c75-aa99-873123bb2480 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:11.824865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2fa963f4-bff4-4c75-aa99-873123bb2480 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:11.921826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2fa963f4-bff4-4c75-aa99-873123bb2480 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:11.931475 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2fa963f4-bff4-4c75-aa99-873123bb2480 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1213 microversion: 2.1 time: 0.116233 Jul 24 01:10:11.941960 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 251/515] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:11 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:11.948145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-127579727", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:11.951400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:11.960803 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae7e83b7-4986-4458-8b5b-718764db8788 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.233848 Jul 24 01:10:11.962364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 265/516] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:11 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:11.978088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:11.978639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:11.985088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.985593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:11.986486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:11.986872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.016015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:12.246966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:12.254801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30592445-fd65-4d0c-bfda-ca220a6e190f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.281756 Jul 24 01:10:12.255392 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 266/517] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:11 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:12.262891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c410ceb7-d354-4204-be77-92f9736788d8 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:12.264363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c410ceb7-d354-4204-be77-92f9736788d8 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:12.271285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c410ceb7-d354-4204-be77-92f9736788d8 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.271760 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c410ceb7-d354-4204-be77-92f9736788d8 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.272515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c410ceb7-d354-4204-be77-92f9736788d8 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.272951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c410ceb7-d354-4204-be77-92f9736788d8 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.325453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:12.325909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:12.326547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:12.327023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:12.327441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:12.338228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.338895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.340362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.340873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.361543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Getting quotas for project 221902b3cf044d719cc7dc1fcf7ba33b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:12.367322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Getting quotas for user b96d7edf06d147bb94869c925933a78e and project 221902b3cf044d719cc7dc1fcf7ba33b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:12.372715 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c410ceb7-d354-4204-be77-92f9736788d8 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action" status: 202 len: 0 microversion: 2.1 time: 0.115872 Jul 24 01:10:12.376680 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 267/518] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:12 2022] POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:12.379614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-684513ef-d1a4-4f85-ac21-1e958cda87fc tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb72bee0>, body: {"quota_set": {"instances": 10}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:12.386722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:10:12.389316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:10:12.436520 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-71561bf2-b1ad-4a34-9998-f1f657999a6a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493141 Jul 24 01:10:12.437521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 252/519] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:10:12.442681 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:12.444146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:12.449285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-684513ef-d1a4-4f85-ac21-1e958cda87fc tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.449831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-684513ef-d1a4-4f85-ac21-1e958cda87fc tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.450678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-684513ef-d1a4-4f85-ac21-1e958cda87fc tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.451148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-684513ef-d1a4-4f85-ac21-1e958cda87fc tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.452558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.453020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.454040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.454493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.521716 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-684513ef-d1a4-4f85-ac21-1e958cda87fc tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 329 microversion: 2.1 time: 0.147069 Jul 24 01:10:12.522618 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 268/520] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:10:12 2022] PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 329 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:12.543378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a887bc2-c08c-4e21-b3aa-11bd8e5d0e3f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:12.544312 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a887bc2-c08c-4e21-b3aa-11bd8e5d0e3f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:12.559707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:12.560245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:12.560729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:12.561147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:12.561560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:12.619981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a887bc2-c08c-4e21-b3aa-11bd8e5d0e3f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:12.627413 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a887bc2-c08c-4e21-b3aa-11bd8e5d0e3f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1217 microversion: 2.1 time: 0.103610 Jul 24 01:10:12.628484 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 269/521] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:12 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:12.639432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b65bb2dd-4ac5-4928-aae4-84fa5ab8e8e6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Calling method '.version_select at 0x7f05eb69eee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:12.642417 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:12.659898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:12.668770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.669269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.670239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.670683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.709699 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90cc9170-0a0a-4ba9-9bc0-fb52fcce2ee5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action" status: 202 len: 1067 microversion: 2.1 time: 0.270760 Jul 24 01:10:12.713746 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 253/522] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:12 2022] POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action => generated 1067 bytes in 272 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 24 01:10:12.715713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:12.716327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:12.723090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.723546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.724066 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b65bb2dd-4ac5-4928-aae4-84fa5ab8e8e6 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 371 microversion: 2.1 time: 0.094214 Jul 24 01:10:12.724326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.724766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.731318 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 270/523] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:10:12 2022] GET /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:12.736371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:12.736984 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:12.745882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.746246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:12.747181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:12.747616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.322275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:13.340637 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3aa5f939-c500-4ad3-a616-ac74fc7c9dca tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.628843 Jul 24 01:10:13.354018 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 254/524] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:12 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:13.359067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ebcc8e9-faf3-48fb-8e14-c0e094fb9920 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb822ee0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:13.406395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:13.420371 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-01c5bc6a-1e5a-47b2-9f54-fcb5c2fd9464 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.687784 Jul 24 01:10:13.421656 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 271/525] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:12 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:13.432416 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:13.433309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:13.445012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.445349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.446723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.447156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.468552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ebcc8e9-faf3-48fb-8e14-c0e094fb9920 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.473171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ebcc8e9-faf3-48fb-8e14-c0e094fb9920 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.474217 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ebcc8e9-faf3-48fb-8e14-c0e094fb9920 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.474606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ebcc8e9-faf3-48fb-8e14-c0e094fb9920 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.527156 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:13.545883 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ebcc8e9-faf3-48fb-8e14-c0e094fb9920 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 325 microversion: 2.1 time: 0.189636 Jul 24 01:10:13.547084 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 255/526] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:10:13 2022] PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:13.553453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:13.555513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:13.564225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.565225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.566203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.566906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.778504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:13.790920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-720a4435-116f-4f91-9cd6-9f350c49dcb1 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1271 microversion: 2.1 time: 0.366512 Jul 24 01:10:13.791813 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 272/527] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:13 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1271 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:13.807248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-06aac92f-0fba-4f68-9ade-2d43802b1b29 req-80ecb566-f85e-41fd-980a-bf40ce5e918b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5044972f-10c9-4250-87ea-7e65fdad75f5", "name": "network-vif-plugged", "status": "completed", "tag": "72a9224c-8d72-4822-b153-758b0b86416b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:13.817827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-06aac92f-0fba-4f68-9ade-2d43802b1b29 req-80ecb566-f85e-41fd-980a-bf40ce5e918b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.820340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-06aac92f-0fba-4f68-9ade-2d43802b1b29 req-80ecb566-f85e-41fd-980a-bf40ce5e918b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.838694 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-06aac92f-0fba-4f68-9ade-2d43802b1b29 req-80ecb566-f85e-41fd-980a-bf40ce5e918b service nova] Creating event network-vif-plugged:72a9224c-8d72-4822-b153-758b0b86416b for instance 5044972f-10c9-4250-87ea-7e65fdad75f5 on n-h2-master-1 Jul 24 01:10:13.847913 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-06aac92f-0fba-4f68-9ade-2d43802b1b29 req-80ecb566-f85e-41fd-980a-bf40ce5e918b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053348 Jul 24 01:10:13.852649 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 273/528] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:13.859201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:13.859958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:13.870778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.871869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:13.873226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:13.873837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:14.349178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:14.360398 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43a2d32c-c88c-41af-b998-fcb26126be78 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.812106 Jul 24 01:10:14.361628 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 256/529] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:13 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:14.366708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:14.368518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:14.376437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:14.377384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:14.378550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:14.379816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:14.498392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:14.507586 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-64d31bc4-81f4-4642-b55d-b43d5443565d tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1275 microversion: 2.1 time: 0.144362 Jul 24 01:10:14.519113 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 257/530] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:14 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:14.526006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1652251102", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:14.584426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:14.586027 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:14.606472 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46e6ae6e-2935-46bc-bb8a-7852c8c11491 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.751970 Jul 24 01:10:14.607458 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 274/531] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:13 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:14.614344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-44c68773-ea6f-4b25-8c85-8344f0d46b2a req-69b6ec8f-d79c-4c47-b4e1-9c36be8e7c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f", "tag": "03963919-2fd2-481c-af6e-bcc7698f3b88"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:14.626529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-44c68773-ea6f-4b25-8c85-8344f0d46b2a req-69b6ec8f-d79c-4c47-b4e1-9c36be8e7c48 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:14.627199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-44c68773-ea6f-4b25-8c85-8344f0d46b2a req-69b6ec8f-d79c-4c47-b4e1-9c36be8e7c48 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:14.641694 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-44c68773-ea6f-4b25-8c85-8344f0d46b2a req-69b6ec8f-d79c-4c47-b4e1-9c36be8e7c48 service nova] Creating event network-changed:03963919-2fd2-481c-af6e-bcc7698f3b88 for instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f on n-h2-master-1 Jul 24 01:10:14.646755 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-44c68773-ea6f-4b25-8c85-8344f0d46b2a req-69b6ec8f-d79c-4c47-b4e1-9c36be8e7c48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037879 Jul 24 01:10:14.647361 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 275/532] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:14.653409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:14.654160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:14.660707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:14.661160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:14.662061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:14.662497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.204155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:15.223891 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3caf9a7c-9ea2-4d9d-813e-d869d2aa40a6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1310 microversion: 2.1 time: 0.574857 Jul 24 01:10:15.235364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 276/533] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:14 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1310 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:15.240969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:15.241718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:15.249076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.249832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.250677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.251177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.269033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:15.269458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:15.270913 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:15.272319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:15.273121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:15.285157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.286006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.287634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.288187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.316724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Getting quotas for project c6fbf893f8a5440bb48e571eadee05ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:15.323556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Getting quotas for user 931f77e76e1041e096a7051ce0beae4c and project c6fbf893f8a5440bb48e571eadee05ab. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:15.340413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.utils [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] ram quota exceeded for c6fbf893f8a5440bb48e571eadee05ab, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119562) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 24 01:10:15.341075 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Request method failure captured: Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 145 Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvrS4FfUqsWs6khJfzIBMU8qvwW59BiPQ14w-rIOXMWw1lcAxErCHbrWo-Z4QBCpz6PekPJu-4UyXGM-g3LZT44XMZBMT4SxiTYnJfcniHEg8RtKsKuiMG41grAns--hSJNFxEbLTbNEhbu6w6aCttG7SIjNb_QCtM1UN15z8a9NvM Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:15.343278 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6fbf893f8a5440bb48e571eadee05ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 931f77e76e1041e096a7051ce0beae4c Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1652251102", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} Jul 24 01:10:15.344932 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1652251102', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452'}}} Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 24 01:10:15.345715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:15.346789 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:15.347902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f174cb2-6447-466b-a819-c38ead6439fe tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.824487 Jul 24 01:10:15.349102 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 258/534] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:14 2022] POST /compute/v2.1/servers => generated 110 bytes in 827 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:15.353579 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:15.353810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:15.362263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.362721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.363539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.363970 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.451636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:15.459314 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aeb57fdc-ba55-4f14-9424-2931bf27b536 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1271 microversion: 2.1 time: 0.111809 Jul 24 01:10:15.459871 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 259/535] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:15 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:15.469175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-14b83a75-e93c-41ae-84a3-407b03d678f2 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb791670>, body: {"quota_set": {"ram": 51200}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:15.528894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:15.540171 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-944659f7-dd1e-4111-822b-a21a70493913 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.302536 Jul 24 01:10:15.549600 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 277/536] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:15 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:15.549844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14b83a75-e93c-41ae-84a3-407b03d678f2 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.549844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14b83a75-e93c-41ae-84a3-407b03d678f2 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.550308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14b83a75-e93c-41ae-84a3-407b03d678f2 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.550721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14b83a75-e93c-41ae-84a3-407b03d678f2 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.557910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:15.558594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:15.570219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.570709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.571662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.572107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.640581 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-14b83a75-e93c-41ae-84a3-407b03d678f2 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 200 len: 329 microversion: 2.1 time: 0.179544 Jul 24 01:10:15.641476 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 260/537] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:10:15 2022] PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 329 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:15.652116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:15.652730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:15.660333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.660785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.662051 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.662913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.833790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:15.842119 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed9fd45c-188f-40d0-81e3-1440d65d70b1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1275 microversion: 2.1 time: 0.199502 Jul 24 01:10:15.843819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 261/538] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:15 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1275 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:15.848771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:15.848900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:15.856943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.856943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:15.857726 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:15.858388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:16.089106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:16.103246 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5239c73-cc78-4753-b30c-90726d192a68 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.560288 Jul 24 01:10:16.104321 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 278/539] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:15 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:16.112649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69184a65-0167-49db-812f-8060ef67c290 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Action: 'update', calling method: .version_select at 0x7f05ebbf8b80>, body: {"quota_set": {"ram": 0}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:16.117429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69184a65-0167-49db-812f-8060ef67c290 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '931f77e76e1041e096a7051ce0beae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fbf893f8a5440bb48e571eadee05ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69184a65-0167-49db-812f-8060ef67c290 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Request method failure captured: Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab HTTP/1.1 Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 25 Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvrS4FfUqsWs6khJfzIBMU8qvwW59BiPQ14w-rIOXMWw1lcAxErCHbrWo-Z4QBCpz6PekPJu-4UyXGM-g3LZT44XMZBMT4SxiTYnJfcniHEg8RtKsKuiMG41grAns--hSJNFxEbLTbNEhbu6w6aCttG7SIjNb_QCtM1UN15z8a9NvM Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:10:16.120632 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6fbf893f8a5440bb48e571eadee05ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6fbf893f8a5440bb48e571eadee05ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: c6fbf893f8a5440bb48e571eadee05ab Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-868825433 Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 931f77e76e1041e096a7051ce0beae4c Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-QuotasAdminNegativeTest-868825433-project Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: {"quota_set": {"ram": 0}} Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 24 01:10:16.122857 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c6fbf893f8a5440bb48e571eadee05ab', 'body': {'quota_set': {'ram': 0}}} Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:16.140310 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:16.142510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69184a65-0167-49db-812f-8060ef67c290 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69184a65-0167-49db-812f-8060ef67c290 tempest-QuotasAdminNegativeTest-868825433 tempest-QuotasAdminNegativeTest-868825433-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab" status: 403 len: 116 microversion: 2.1 time: 0.016517 Jul 24 01:10:16.148195 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 279/540] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:10:16 2022] PUT /compute/v2.1/os-quota-sets/c6fbf893f8a5440bb48e571eadee05ab => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:16.244094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:16.244337 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:16.256332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:16.258096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:16.259444 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:16.260449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:16.296161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:16.314626 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1dd2c1e-5cbf-4e31-9b9c-43d33c452038 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.469753 Jul 24 01:10:16.321746 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 262/541] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:15 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:16.480247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:16.481700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:16.487988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:16.488445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:16.489438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:16.489945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:16.888879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:16.905268 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c84f851-7df5-41c7-b673-b71ff977763b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1493 microversion: 2.1 time: 0.665762 Jul 24 01:10:16.917117 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 280/542] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:16 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1493 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:10:16.917824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:16.919733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:16.933377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:16.934520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:16.936741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:16.954815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:16.967504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:16.980252 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0d99b80c-4f0d-4eee-a70e-3469457d2f22 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1313 microversion: 2.1 time: 0.507070 Jul 24 01:10:16.980846 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 263/543] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:16 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:16.993754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:16.994869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:17.012492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.013181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.013485 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:17.016957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.019187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.197898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:17.216118 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a47d23c9-6a13-46e8-8093-830b9bcd95f1 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1275 microversion: 2.1 time: 0.233161 Jul 24 01:10:17.217149 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 264/544] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:16 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:17.222272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8232815f-1419-4e6f-a759-ea04106c1b57 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:17.223221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8232815f-1419-4e6f-a759-ea04106c1b57 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:17.231218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8232815f-1419-4e6f-a759-ea04106c1b57 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.231822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8232815f-1419-4e6f-a759-ea04106c1b57 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.232739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8232815f-1419-4e6f-a759-ea04106c1b57 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.234040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8232815f-1419-4e6f-a759-ea04106c1b57 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.613845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:17.626129 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-446beb99-eccb-4563-ac60-9e24781ac157 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.718180 Jul 24 01:10:17.626725 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 281/545] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:16 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:17.631367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:17.631975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:17.656790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.658082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.658938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.660437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.828901 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8232815f-1419-4e6f-a759-ea04106c1b57 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1644 microversion: 2.1 time: 0.610430 Jul 24 01:10:17.829699 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 265/546] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:17 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1644 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:17.846010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b2e68de9-f3f7-4eae-98aa-f46fb991cf80 req-f3c4b3f6-a3d9-4e12-b786-e08640653ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea0fc22-3bb5-4042-bfb5-a5947beae6e7", "name": "network-vif-plugged", "status": "completed", "tag": "f8c3089f-0c86-42b2-b368-e6053f86d503"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:17.855806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b2e68de9-f3f7-4eae-98aa-f46fb991cf80 req-f3c4b3f6-a3d9-4e12-b786-e08640653ea0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.856636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b2e68de9-f3f7-4eae-98aa-f46fb991cf80 req-f3c4b3f6-a3d9-4e12-b786-e08640653ea0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.870528 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b2e68de9-f3f7-4eae-98aa-f46fb991cf80 req-f3c4b3f6-a3d9-4e12-b786-e08640653ea0 service nova] Creating event network-vif-plugged:f8c3089f-0c86-42b2-b368-e6053f86d503 for instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 on n-h2-master-1 Jul 24 01:10:17.876128 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b2e68de9-f3f7-4eae-98aa-f46fb991cf80 req-f3c4b3f6-a3d9-4e12-b786-e08640653ea0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033669 Jul 24 01:10:17.877259 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 266/547] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:17.882667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:17.883451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:17.892141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.892719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:17.893723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:17.894167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:18.218920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:18.242660 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ad6a72a-4b81-444b-98a0-b9397c223090 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.614649 Jul 24 01:10:18.244237 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 282/548] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:17 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:18.270394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3f0f9c3-1fd4-42b1-8565-728e7b838ca9 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:18.272189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d3f0f9c3-1fd4-42b1-8565-728e7b838ca9 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:18.294692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f0f9c3-1fd4-42b1-8565-728e7b838ca9 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:18.295183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f0f9c3-1fd4-42b1-8565-728e7b838ca9 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:18.297238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f0f9c3-1fd4-42b1-8565-728e7b838ca9 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:18.298449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f0f9c3-1fd4-42b1-8565-728e7b838ca9 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:18.332322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:18.346482 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dcdc2737-a5b6-4ff6-849c-16e350064938 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.467194 Jul 24 01:10:18.347832 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 267/549] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:17 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:18.360425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:18.364423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:18.372125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:18.372711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:18.373614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:18.374186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:18.841140 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d3f0f9c3-1fd4-42b1-8565-728e7b838ca9 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1644 microversion: 2.1 time: 0.594815 Jul 24 01:10:18.843916 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 283/550] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:18 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1644 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:18.856587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:18.860076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:18.876696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:18.877310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:18.879396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:18.881696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:18.955639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:18.973462 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-200b31d2-530c-49a9-a9b2-6bd2032cd1cd tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1313 microversion: 2.1 time: 0.622715 Jul 24 01:10:18.974391 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 268/551] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:18 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:18.992205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:18.994347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:19.003461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.004243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.005301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.006885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.692743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:19.705045 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1be2b709-1170-4931-af42-84872295fbd4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1317 microversion: 2.1 time: 0.856946 Jul 24 01:10:19.717036 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 284/552] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:18 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:19.724487 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c116c644-362f-4a65-a688-5c74fbf7d1a8 req-1fe418dc-b1e7-43ae-9955-bfa00aae2c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79996ebc-6792-4dd1-bcf3-4791a78150bd", "tag": "02fe99c7-b8f9-4087-a49f-3b21c8d08aee"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:19.747055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c116c644-362f-4a65-a688-5c74fbf7d1a8 req-1fe418dc-b1e7-43ae-9955-bfa00aae2c87 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.747682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c116c644-362f-4a65-a688-5c74fbf7d1a8 req-1fe418dc-b1e7-43ae-9955-bfa00aae2c87 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.765833 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c116c644-362f-4a65-a688-5c74fbf7d1a8 req-1fe418dc-b1e7-43ae-9955-bfa00aae2c87 service nova] Creating event network-changed:02fe99c7-b8f9-4087-a49f-3b21c8d08aee for instance 79996ebc-6792-4dd1-bcf3-4791a78150bd on n-h1-master-1 Jul 24 01:10:19.778991 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c116c644-362f-4a65-a688-5c74fbf7d1a8 req-1fe418dc-b1e7-43ae-9955-bfa00aae2c87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059874 Jul 24 01:10:19.780831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 285/553] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:19.794426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2620f624-278b-483a-925a-eba60ab05ade tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:19.795985 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:19.795985 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:19.798087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2620f624-278b-483a-925a-eba60ab05ade tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.798689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2620f624-278b-483a-925a-eba60ab05ade tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.800559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2620f624-278b-483a-925a-eba60ab05ade tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.801574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2620f624-278b-483a-925a-eba60ab05ade tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.842099 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2620f624-278b-483a-925a-eba60ab05ade tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059554 Jul 24 01:10:19.846973 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 286/554] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:10:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:19.861622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:19.864950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:19.869568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:19.882660 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ca39267-0d1e-4c92-b716-1ec79754fef0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.886423 Jul 24 01:10:19.883914 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 269/555] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:18 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:19.889666 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.892690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.893337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:19.894341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:19.897467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.897989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.913707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.919951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:19.920931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:19.925420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.438291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:20.451781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:20.463973 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7bec381-2801-4e95-90a5-cc7178ffd17b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.615752 Jul 24 01:10:20.464523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 287/556] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:19 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:20.465142 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-716608f2-ab70-4191-9fad-d203e0f6d96c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1319 microversion: 2.1 time: 0.576910 Jul 24 01:10:20.466085 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 270/557] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:19 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:20.470959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15393432-e77f-4fb3-a335-1a851ce8f6a5 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:20.476219 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:20.477809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15393432-e77f-4fb3-a335-1a851ce8f6a5 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:20.482529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:20.497802 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15393432-e77f-4fb3-a335-1a851ce8f6a5 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.499551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.500440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.501175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15393432-e77f-4fb3-a335-1a851ce8f6a5 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.502238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.503276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15393432-e77f-4fb3-a335-1a851ce8f6a5 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.505302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15393432-e77f-4fb3-a335-1a851ce8f6a5 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.505640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.593914 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:20.624061 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15393432-e77f-4fb3-a335-1a851ce8f6a5 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5/action" status: 202 len: 0 microversion: 2.1 time: 0.156479 Jul 24 01:10:20.626661 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 271/558] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:20 2022] POST /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:20.636167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-3e152fa9-b133-46d8-ab70-f2f533581490 req-4a35f38e-cd36-48b8-9829-c14d6a9e03d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aac0c96-8aae-4ed3-bdd5-485b94e89ec1", "tag": "03895dd8-dd4b-4e93-9101-5db60f3eb869"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:20.647713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3e152fa9-b133-46d8-ab70-f2f533581490 req-4a35f38e-cd36-48b8-9829-c14d6a9e03d4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.649084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3e152fa9-b133-46d8-ab70-f2f533581490 req-4a35f38e-cd36-48b8-9829-c14d6a9e03d4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.662504 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-3e152fa9-b133-46d8-ab70-f2f533581490 req-4a35f38e-cd36-48b8-9829-c14d6a9e03d4 service nova] Creating event network-changed:03895dd8-dd4b-4e93-9101-5db60f3eb869 for instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 on n-h2-master-1 Jul 24 01:10:20.669993 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-3e152fa9-b133-46d8-ab70-f2f533581490 req-4a35f38e-cd36-48b8-9829-c14d6a9e03d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040032 Jul 24 01:10:20.671500 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 272/559] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:20.683899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-30fa5bed-418a-4563-bee3-05b3e361373c tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:20.684755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-30fa5bed-418a-4563-bee3-05b3e361373c tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:20.691728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30fa5bed-418a-4563-bee3-05b3e361373c tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.692587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30fa5bed-418a-4563-bee3-05b3e361373c tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.693858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30fa5bed-418a-4563-bee3-05b3e361373c tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.694576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30fa5bed-418a-4563-bee3-05b3e361373c tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.827300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:20.838885 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-118401c9-8054-4ce7-85af-1a6a5ece998d tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1313 microversion: 2.1 time: 0.366516 Jul 24 01:10:20.839479 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 288/560] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:20 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:20.844865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:20.845911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:20.869611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.870128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:20.870953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:20.871392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:21.048745 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-30fa5bed-418a-4563-bee3-05b3e361373c tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1649 microversion: 2.1 time: 0.375096 Jul 24 01:10:21.049767 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 273/561] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:20 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1649 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:21.055001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:21.063700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:21.084891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:21.091659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:21.092909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:21.093583 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:21.381134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:21.442573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3bdd1e40-a04f-4926-bf08-4d824f088f2c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1317 microversion: 2.1 time: 0.601960 Jul 24 01:10:21.443780 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 289/562] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:20 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:21.477560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:21.483623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:21.484493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:21.497314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:21.498080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:21.500641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:21.501285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:21.501837 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9778154e-1fa4-43ec-bd6c-90be7557a693 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.449795 Jul 24 01:10:21.503243 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 274/563] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:21 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:21.513812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:21.516234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:21.534931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:21.537298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:21.539414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:21.540466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.157534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:22.163476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:22.169812 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4e9c25c8-9aaa-4990-a9b6-8bc414249c52 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1468 microversion: 2.1 time: 0.689560 Jul 24 01:10:22.179502 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42107469-768e-473a-9252-cfa50a6c3c6f tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.668113 Jul 24 01:10:22.179502 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 275/564] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:21 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:22.182666 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 290/565] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:21 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1468 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:10:22.190967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-875e2ca5-515f-4bf2-b9cb-d8e995e0cfe2 req-65b39c8b-3a96-43f4-9b6c-222748dcd87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117685ac-31fb-41e6-94dc-4efdd3fc0262", "tag": "f50c3fdd-6dde-4107-af40-6e69ffd16a5f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:22.195960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:22.196868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:22.203536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-875e2ca5-515f-4bf2-b9cb-d8e995e0cfe2 req-65b39c8b-3a96-43f4-9b6c-222748dcd87f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.204144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-875e2ca5-515f-4bf2-b9cb-d8e995e0cfe2 req-65b39c8b-3a96-43f4-9b6c-222748dcd87f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.204554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.205004 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.205840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.206275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.218686 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-875e2ca5-515f-4bf2-b9cb-d8e995e0cfe2 req-65b39c8b-3a96-43f4-9b6c-222748dcd87f service nova] Creating event network-changed:f50c3fdd-6dde-4107-af40-6e69ffd16a5f for instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 on n-h1-master-1 Jul 24 01:10:22.236625 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-875e2ca5-515f-4bf2-b9cb-d8e995e0cfe2 req-65b39c8b-3a96-43f4-9b6c-222748dcd87f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060389 Jul 24 01:10:22.238302 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 276/566] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:22.249296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a06aa36-d7eb-462b-aa5f-7bd887744284 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:22.250640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4a06aa36-d7eb-462b-aa5f-7bd887744284 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:22.265283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06aa36-d7eb-462b-aa5f-7bd887744284 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.266164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06aa36-d7eb-462b-aa5f-7bd887744284 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.267606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06aa36-d7eb-462b-aa5f-7bd887744284 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.268461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06aa36-d7eb-462b-aa5f-7bd887744284 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.521138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:22.529999 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d8ac14e-bb8c-4d55-ae7f-7d9b5fbbfe3e tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1313 microversion: 2.1 time: 0.344682 Jul 24 01:10:22.540748 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 291/567] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:22 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:22.545818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29cdf31e-0117-4f99-9416-e71615d3818e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:22.546935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-29cdf31e-0117-4f99-9416-e71615d3818e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:22.553321 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29cdf31e-0117-4f99-9416-e71615d3818e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.553919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29cdf31e-0117-4f99-9416-e71615d3818e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.554809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29cdf31e-0117-4f99-9416-e71615d3818e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.555779 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29cdf31e-0117-4f99-9416-e71615d3818e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.564637 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4a06aa36-d7eb-462b-aa5f-7bd887744284 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1629 microversion: 2.1 time: 0.324069 Jul 24 01:10:22.578885 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 277/568] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:22 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1629 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:22.585838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:22.587472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:22.603391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.604546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.606484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.607673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.666149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29cdf31e-0117-4f99-9416-e71615d3818e tempest-DeleteServersAdminTestJSON-2033309836 tempest-DeleteServersAdminTestJSON-2033309836-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7/action" status: 202 len: 0 microversion: 2.1 time: 0.123906 Jul 24 01:10:22.667742 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 292/569] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:22 2022] POST /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:22.672888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:22.673841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:22.682803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.682803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.683608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:22.684087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:22.710149 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=51,nova_cell0:UPDATE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:23.175150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:23.185176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:23.190306 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56fe35f4-86a4-4787-9fea-d1b961ba0a6f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1317 microversion: 2.1 time: 0.609344 Jul 24 01:10:23.191257 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 278/570] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:22 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:23.200385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:23.201821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:23.207385 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f64f48bb-836d-481f-900a-4857a8f59b9a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.538290 Jul 24 01:10:23.210542 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:23.212588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:23.212740 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 293/571] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:22 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:23.213887 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:23.214721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:23.230025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:23.231622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:23.244879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:23.245349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:23.252203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:23.254247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:23.271791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lazy-loading 'flavor' on Instance uuid 5044972f-10c9-4250-87ea-7e65fdad75f5 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:23.301858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Going to try to live migrate instance to n-h1-master-1 {{(pid=119562) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:10:23.320100 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:23.323001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:23.323779 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:23.324513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lazy-loading 'fault' on Instance uuid dea0fc22-3bb5-4042-bfb5-a5947beae6e7 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:23.730874 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:23.746817 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-560bb314-9ae8-47aa-9cc0-c421c0c9a844 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1451 microversion: 2.1 time: 0.532466 Jul 24 01:10:23.747409 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 294/572] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:23 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1451 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:23.752172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:23.758682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:23.765063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:23.765810 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:23.766823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:23.767494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:24.290760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:24.309954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d3c89ea-ec93-4684-91f6-da7b7ca6fbb6 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.554987 Jul 24 01:10:24.309954 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 295/573] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:23 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:24.310685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:24.311523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:24.319903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:24.320677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:24.321492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:24.322000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:24.793649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:24.805480 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33a515c6-9f4f-4575-a79a-65550db306dc tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1313 microversion: 2.1 time: 0.499323 Jul 24 01:10:24.806367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 296/574] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:24 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:24.817831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:24.818340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:24.829847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:24.830304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:24.831097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:24.834677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:24.872903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:10:24.876132 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:25.017085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eec2091b-a426-4576-bd89-0ae33131f727 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 204 len: 0 microversion: 2.1 time: 0.202731 Jul 24 01:10:25.021866 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 297/575] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:10:24 2022] DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:10:25.032220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-84bec075-9487-4969-949c-e112fde43128 req-916742c4-c833-4c60-8a59-8cf6a8ba5edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f", "name": "network-vif-plugged", "status": "completed", "tag": "03963919-2fd2-481c-af6e-bcc7698f3b88"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:25.043594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-84bec075-9487-4969-949c-e112fde43128 req-916742c4-c833-4c60-8a59-8cf6a8ba5edf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:25.045346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-84bec075-9487-4969-949c-e112fde43128 req-916742c4-c833-4c60-8a59-8cf6a8ba5edf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:25.248773 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-84bec075-9487-4969-949c-e112fde43128 req-916742c4-c833-4c60-8a59-8cf6a8ba5edf service nova] Creating event network-vif-plugged:03963919-2fd2-481c-af6e-bcc7698f3b88 for instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f on n-h2-master-1 Jul 24 01:10:25.253654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-84bec075-9487-4969-949c-e112fde43128 req-916742c4-c833-4c60-8a59-8cf6a8ba5edf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229866 Jul 24 01:10:25.254715 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 298/576] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:25.261759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:25.261759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:25.271850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:25.272368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:25.273082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:25.274406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:25.312297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:10:25.409190 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a4e4c2a-0572-4d82-8231-12c155f4aa8f tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 204 len: 0 microversion: 2.1 time: 0.152217 Jul 24 01:10:25.410675 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 299/577] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:10:25 2022] DELETE /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:10:25.419545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:25.420635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:25.429324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:25.430969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:25.431998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:25.432633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:25.562697 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=21 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:25.629508 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=75 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:25.665225 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-65550b03-cb78-4897-b973-855ef7c77f74 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5/action" status: 202 len: 0 microversion: 2.1 time: 2.471725 Jul 24 01:10:25.666510 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 279/578] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:23 2022] POST /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5/action => generated 0 bytes in 2475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:25.677295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:25.679445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:25.691258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:25.692632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:25.693907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:25.694988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:25.706399 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:25.717937 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-906f8da8-3ed6-44d2-8cf5-b324aaa54e0f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1317 microversion: 2.1 time: 0.305692 Jul 24 01:10:25.730107 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 300/579] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:25 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:25.737363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-145898743", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "1384251660", "adminPass": "***", "networks": [{"uuid": "231851c3-f058-45c6-859c-c923dfade6c4"}], "security_groups": [{"name": "tempest-securitygroup--2032468166"}], "key_name": "tempest-keypair-238947261", "user_data": "}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:25.987624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:25.990996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] validate_networks() for [('231851c3-f058-45c6-859c-c923dfade6c4', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:10:25.997658 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a8f18c63-ff72-4ae0-a273-a7e4a3071007 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.328844 Jul 24 01:10:25.998893 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 280/580] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:25 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:26.011752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:26.012365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:26.019252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.019698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.020476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.020909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.348183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:26.360227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-39e824e0-d48c-4450-bf0d-610b6e8a4f90 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.359996 Jul 24 01:10:26.360956 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 281/581] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:25 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:26.374198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:26.375439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:26.385892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.386715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.388392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.389203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.446262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.446765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.447221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lazy-loading 'fault' on Instance uuid dea0fc22-3bb5-4042-bfb5-a5947beae6e7 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:26.718301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:26.731552 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-508779b2-5729-4be8-81d1-f285cf937142 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1457 microversion: 2.1 time: 0.363954 Jul 24 01:10:26.748706 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 282/582] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:26 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1457 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:26.753890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:26.754532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:26.765500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.766300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.767355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.768026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.865984 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:26.866502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:26.868119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:26.868880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:26.869632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:26.892799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.892799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.893198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:26.893514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:26.923946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Getting quotas for project 913058bc11904339a05f4784fee6f1a1. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:26.930619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Getting quotas for user b3861659794d4aa699ca3e984999a1fe and project 913058bc11904339a05f4784fee6f1a1. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:26.959457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:10:26.964654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:10:27.011262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:27.020861 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43e40307-1545-463e-a0a8-3ba3bc6c4c27 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.270910 Jul 24 01:10:27.033920 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 283/583] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:26 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:27.039676 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3bead797-6f23-4f54-bf8e-a8e8a3e8ad28 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.307780 Jul 24 01:10:27.040236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:27.045831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 301/584] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:10:27.046839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:27.047252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:27.047469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:27.054197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.055295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.056763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.057233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.057745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.058063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.058510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.058656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.700775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:27.710717 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c871e92c-835a-4b44-aab6-80e28013c7cd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1317 microversion: 2.1 time: 0.668555 Jul 24 01:10:27.712583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:27.717552 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 302/585] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:27 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:27.723367 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8df0bf54-6eeb-4466-aee4-77a263d17616 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1313 microversion: 2.1 time: 0.687877 Jul 24 01:10:27.724135 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 284/586] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:27 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:27.730649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:27.731530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:27.732046 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4b74091-db54-4a55-ab81-1ca49e380471 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:27.733480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d4b74091-db54-4a55-ab81-1ca49e380471 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:27.768189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.769747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.772888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.776910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.875769 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d4b74091-db54-4a55-ab81-1ca49e380471 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:27.891279 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d4b74091-db54-4a55-ab81-1ca49e380471 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1263 microversion: 2.1 time: 0.164080 Jul 24 01:10:27.897605 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 285/587] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:27 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:27.919066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f95604c2-3b5c-4ae0-b6a0-d604637bfa31 req-41d98c06-f932-40eb-ab5b-b79d8f3bc937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79996ebc-6792-4dd1-bcf3-4791a78150bd", "name": "network-vif-plugged", "status": "completed", "tag": "02fe99c7-b8f9-4087-a49f-3b21c8d08aee"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:27.935046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f95604c2-3b5c-4ae0-b6a0-d604637bfa31 req-41d98c06-f932-40eb-ab5b-b79d8f3bc937 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.936559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f95604c2-3b5c-4ae0-b6a0-d604637bfa31 req-41d98c06-f932-40eb-ab5b-b79d8f3bc937 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.961617 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f95604c2-3b5c-4ae0-b6a0-d604637bfa31 req-41d98c06-f932-40eb-ab5b-b79d8f3bc937 service nova] Creating event network-vif-plugged:02fe99c7-b8f9-4087-a49f-3b21c8d08aee for instance 79996ebc-6792-4dd1-bcf3-4791a78150bd on n-h1-master-1 Jul 24 01:10:27.967495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f95604c2-3b5c-4ae0-b6a0-d604637bfa31 req-41d98c06-f932-40eb-ab5b-b79d8f3bc937 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067807 Jul 24 01:10:27.968913 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 286/588] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:27.977216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:27.978748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:27.985902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.986929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:27.988013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:27.988986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:28.565186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:28.586306 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b1eb5d6-7419-4b41-b4b2-e9ec0242755c tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.604717 Jul 24 01:10:28.587173 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 287/589] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:27 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:28.607059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:28.609340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:28.620655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:28.626722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:28.627233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:28.628116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:28.629229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:28.663493 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d295844-dc23-4fb3-b195-3fe9e3589eaa tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.942242 Jul 24 01:10:28.663493 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 303/590] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:27 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:28.673083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:28.673710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:28.687778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:28.688099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:28.689139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:28.689845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:28.698712 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:28.703436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:28.706086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:28.706944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lazy-loading 'fault' on Instance uuid dea0fc22-3bb5-4042-bfb5-a5947beae6e7 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:28.715959 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:29.265569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:29.276519 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1edc76f-ecda-462a-81ad-748e0831c368 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1457 microversion: 2.1 time: 0.685870 Jul 24 01:10:29.291321 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 288/591] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:28 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1457 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:29.300787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:29.306286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:29.311361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:29.318918 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-878fcc66-8056-426d-a968-93c353f593e4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.655413 Jul 24 01:10:29.322337 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 304/592] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:28 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:29.335473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.336719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:29.337594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:29.338423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.341323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.342328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.354391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.355208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.356511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.360623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.755819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:29.764698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:29.765004 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79d6095b-42ad-44fc-8583-78fa42b95b30 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1313 microversion: 2.1 time: 0.441299 Jul 24 01:10:29.766284 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 305/593] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:29 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:29.771562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:29.772528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:29.772962 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bcf16ade-b9eb-44d4-951f-ebc4a6b35aa5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1317 microversion: 2.1 time: 0.480249 Jul 24 01:10:29.776076 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 289/594] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:29 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:29.780880 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.781890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.782952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.783633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.784638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:29.785274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:29.802426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.802890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.803715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.804159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.956784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:29.969858 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bdb16eaf-83de-4589-bc33-1f6859b7377f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1321 microversion: 2.1 time: 0.201542 Jul 24 01:10:29.970619 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 306/595] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:29 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:29.978803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:29.979710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:29.986813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.987383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:29.988263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:29.988775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.056374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:30.073215 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-459c146b-fbc6-49f3-96c9-acd329171764 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1318 microversion: 2.1 time: 0.295614 Jul 24 01:10:30.074986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 290/596] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:29 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:30.083148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-65055586-f2b4-441a-9a16-c9dbc914c229 req-edcff251-0990-4686-9803-d51e0bafa44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac0c96-8aae-4ed3-bdd5-485b94e89ec1", "name": "network-vif-plugged", "status": "completed", "tag": "03895dd8-dd4b-4e93-9101-5db60f3eb869"}, {"server_uuid": "117685ac-31fb-41e6-94dc-4efdd3fc0262", "name": "network-vif-plugged", "status": "completed", "tag": "f50c3fdd-6dde-4107-af40-6e69ffd16a5f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:30.100050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-65055586-f2b4-441a-9a16-c9dbc914c229 req-edcff251-0990-4686-9803-d51e0bafa44d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.102135 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-65055586-f2b4-441a-9a16-c9dbc914c229 req-edcff251-0990-4686-9803-d51e0bafa44d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.130338 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-65055586-f2b4-441a-9a16-c9dbc914c229 req-edcff251-0990-4686-9803-d51e0bafa44d service nova] Creating event network-vif-plugged:03895dd8-dd4b-4e93-9101-5db60f3eb869 for instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 on n-h2-master-1 Jul 24 01:10:30.131695 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-65055586-f2b4-441a-9a16-c9dbc914c229 req-edcff251-0990-4686-9803-d51e0bafa44d service nova] Creating event network-vif-plugged:f50c3fdd-6dde-4107-af40-6e69ffd16a5f for instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 on n-h1-master-1 Jul 24 01:10:30.147901 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-65055586-f2b4-441a-9a16-c9dbc914c229 req-edcff251-0990-4686-9803-d51e0bafa44d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070519 Jul 24 01:10:30.150036 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 291/597] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:30.311265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:30.314019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:30.341462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.343011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.344144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.344668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.408864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.409335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.410008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lazy-loading 'fault' on Instance uuid dea0fc22-3bb5-4042-bfb5-a5947beae6e7 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:30.501920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:30.516469 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-440bd0af-6766-480c-8657-87f6efe724e9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1471 microversion: 2.1 time: 0.544528 Jul 24 01:10:30.517430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 307/598] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:29 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:30.522372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:30.523704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:30.531050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.531889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.533087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.535993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.570267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:30.586884 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa5c077b-6633-4798-a2ab-7c1c45676c8d tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1415 microversion: 2.1 time: 0.291030 Jul 24 01:10:30.588191 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 292/599] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:30 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1415 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:30.727885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-86b42fc7-c053-4b6a-b65a-8d5fc1040c8e req-9f3e79df-4c9c-46ee-95dc-18934f81b365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea0fc22-3bb5-4042-bfb5-a5947beae6e7", "name": "network-vif-deleted", "tag": "f8c3089f-0c86-42b2-b368-e6053f86d503"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:30.770491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-86b42fc7-c053-4b6a-b65a-8d5fc1040c8e req-9f3e79df-4c9c-46ee-95dc-18934f81b365 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.776716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-86b42fc7-c053-4b6a-b65a-8d5fc1040c8e req-9f3e79df-4c9c-46ee-95dc-18934f81b365 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.797477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-86b42fc7-c053-4b6a-b65a-8d5fc1040c8e req-9f3e79df-4c9c-46ee-95dc-18934f81b365 service nova] Creating event network-vif-deleted:f8c3089f-0c86-42b2-b368-e6053f86d503 for instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 on n-h2-master-1 Jul 24 01:10:30.816586 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-86b42fc7-c053-4b6a-b65a-8d5fc1040c8e req-9f3e79df-4c9c-46ee-95dc-18934f81b365 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092900 Jul 24 01:10:30.818425 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 293/600] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:10:30.829879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:30.831027 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:30.849479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.850388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:30.852859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:30.855859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:31.312041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:31.338726 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c0876666-3b23-46bb-9953-25c847154fc3 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.819396 Jul 24 01:10:31.338726 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 308/601] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:30 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:31.347405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:31.348314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:31.378243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:31.381161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:31.384182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:31.388216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:31.399155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:31.454653 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-226ed85c-b83a-4e51-b795-fdcc26a0a836 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1462 microversion: 2.1 time: 0.630145 Jul 24 01:10:31.471782 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 294/602] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:30 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1462 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:31.498056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:31.499098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:31.514912 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:31.516872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:31.519252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:31.522569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:31.698158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:31.716444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1562b01-a6fb-498f-b5e3-5a8a1ea26acc tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1321 microversion: 2.1 time: 0.237570 Jul 24 01:10:31.717138 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 295/603] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:31 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:31.730690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:31.737589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:31.747007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:31.752129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:31.754443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:31.759009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:31.782801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:31.797928 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68453465-3e04-41e6-992c-9042379514bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1317 microversion: 2.1 time: 0.454316 Jul 24 01:10:31.800981 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 309/604] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:31 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:32.045240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:32.057239 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79751899-5c2d-4e1a-a6a1-ed9b2f74d516 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1467 microversion: 2.1 time: 0.338630 Jul 24 01:10:32.057734 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 296/605] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:31 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1467 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:32.074155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:32.076511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:32.100006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.100635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.103101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.105834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.391119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4fedf60c-53f6-448b-a347-8dfcb64296fe tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Calling method '.version_select at 0x7f05ebbf8280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:32.408147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fedf60c-53f6-448b-a347-8dfcb64296fe tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.416370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fedf60c-53f6-448b-a347-8dfcb64296fe tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.453564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fedf60c-53f6-448b-a347-8dfcb64296fe tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.455058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fedf60c-53f6-448b-a347-8dfcb64296fe tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.494281 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4fedf60c-53f6-448b-a347-8dfcb64296fe tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/04e5954e848b49e7986b9f72eb5ea64c?start=2022-07-23T01%3A10%3A31.480613&end=2022-07-25T01%3A10%3A31.480613" status: 200 len: 690 microversion: 2.1 time: 0.691586 Jul 24 01:10:32.505243 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 310/606] 10.222.0.27 () {58 vars in 1411 bytes} [Sun Jul 24 01:10:31 2022] GET /compute/v2.1/os-simple-tenant-usage/04e5954e848b49e7986b9f72eb5ea64c?start=2022-07-23T01%3A10%3A31.480613&end=2022-07-25T01%3A10%3A31.480613 => generated 690 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:32.511117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:32.518871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:32.533907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.536226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.537629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.540960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.616103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.616813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.618224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lazy-loading 'fault' on Instance uuid dea0fc22-3bb5-4042-bfb5-a5947beae6e7 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:32.813092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1070815bb60c44fcb6a586fd2d1f6e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a228611da9b47f785568447a4caa0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:32.822548 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-37e016e9-076d-4bc9-ac7b-1987f6903e27 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 200 len: 1309 microversion: 2.1 time: 0.314675 Jul 24 01:10:32.829798 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 311/607] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:32 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:32.836166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:32.836763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:32.843632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.844336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.845091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:32.845856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:32.879453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lazy-loading 'flavor' on Instance uuid 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:32.895798 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:33.003793 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-561712d9-ea49-4130-9742-f1eea23022f6 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f/action" status: 202 len: 0 microversion: 2.1 time: 0.178254 Jul 24 01:10:33.008206 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 312/608] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:32 2022] POST /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:33.022119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:33.025618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:33.027364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:33.043416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.044155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:33.046177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.047403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d19608c8-aae4-4a9e-934d-a42d676d41dc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1477 microversion: 2.1 time: 0.984225 Jul 24 01:10:33.048136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:33.052613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 297/609] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:32 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1477 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:33.067327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-65df3549-845b-4750-8c2d-176cb44851d5 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '.version_select at 0x7f05eb66a160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:33.094141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65df3549-845b-4750-8c2d-176cb44851d5 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.096246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65df3549-845b-4750-8c2d-176cb44851d5 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:33.147191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65df3549-845b-4750-8c2d-176cb44851d5 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.147891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65df3549-845b-4750-8c2d-176cb44851d5 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:33.198767 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-65df3549-845b-4750-8c2d-176cb44851d5 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/04e5954e848b49e7986b9f72eb5ea64c?start=2022-07-23T01%3A10%3A31.480613&end=2022-07-25T01%3A10%3A31.480613" status: 200 len: 694 microversion: 2.1 time: 0.144239 Jul 24 01:10:33.200015 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 298/610] 10.222.0.27 () {58 vars in 1411 bytes} [Sun Jul 24 01:10:33 2022] GET /compute/v2.1/os-simple-tenant-usage/04e5954e848b49e7986b9f72eb5ea64c?start=2022-07-23T01%3A10%3A31.480613&end=2022-07-25T01%3A10%3A31.480613 => generated 694 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:33.206498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:33.207461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:33.229171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.232499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:33.233588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.234861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:33.925923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:33.942751 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d892f0b-43a8-4645-b52b-fab141dd6d54 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.737158 Jul 24 01:10:33.954471 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 299/611] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:33 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:33.960587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:33.961258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:33.987834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.990413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:33.992118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:33.993925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:34.135050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:34.147571 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae0a686a-330a-40b0-809d-d3ce19e3e8ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 1.137455 Jul 24 01:10:34.152912 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 313/612] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:33 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:34.166294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-70c366c4-abbc-4494-9339-b35884e9ee60 req-d7d93b70-1f6c-4922-b57f-e6506946b823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7321071-81d5-42f4-b1ec-3e089a82ff19", "name": "network-vif-deleted", "tag": "f8164791-2c87-4117-8705-7b9e3a4c67cd"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:34.187470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-70c366c4-abbc-4494-9339-b35884e9ee60 req-d7d93b70-1f6c-4922-b57f-e6506946b823 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:34.194002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-70c366c4-abbc-4494-9339-b35884e9ee60 req-d7d93b70-1f6c-4922-b57f-e6506946b823 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:34.239750 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-70c366c4-abbc-4494-9339-b35884e9ee60 req-d7d93b70-1f6c-4922-b57f-e6506946b823 service nova] Creating event network-vif-deleted:f8164791-2c87-4117-8705-7b9e3a4c67cd for instance c7321071-81d5-42f4-b1ec-3e089a82ff19 on n-h2-master-1 Jul 24 01:10:34.253294 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-70c366c4-abbc-4494-9339-b35884e9ee60 req-d7d93b70-1f6c-4922-b57f-e6506946b823 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098989 Jul 24 01:10:34.256630 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 314/613] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:34.267397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:34.274763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:34.287346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:34.290657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:34.292520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:34.294592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:34.892212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:34.906043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:34.919641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aadb6f87-5592-42d3-b949-079174cf3e9b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1467 microversion: 2.1 time: 0.964736 Jul 24 01:10:34.921639 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 300/614] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:33 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1467 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:34.927234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63da4f36-ac1b-49e0-92bf-c3b31ea99184 tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Calling method '.version_select at 0x7f05eb66a310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:34.928545 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ec52435-98ff-48b4-81ac-ce7f7a6a65e7 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1458 microversion: 2.1 time: 0.666011 Jul 24 01:10:34.933517 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 315/615] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:34 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1458 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:34.956763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:34.958092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63da4f36-ac1b-49e0-92bf-c3b31ea99184 tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:34.958311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:34.958592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63da4f36-ac1b-49e0-92bf-c3b31ea99184 tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:34.968213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:34.969014 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:34.970093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:34.970691 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:34.993956 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] HTTP exception thrown: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Request method failure captured: Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 HTTP/1.1 Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvQ_n-XZDOZN7BDncXYj4fg3qs6M9LeNV8cYVy1HOwOaIQ5VN3O4GGsNTYZTQB3ug_iYRf8lXb1b-EqWmBkPZRn7VvdKbDM-yyh1-6oo5kRuFg-yYc7bFxfxs3zMLVoXo1fweO2snTuWIIrBGYxqW_haIZvNYKYcTM0YxOynqbMmOw Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:10:34.996594 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a228611da9b47f785568447a4caa0eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1070815bb60c44fcb6a586fd2d1f6e71 Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: exception: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:34.998302 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'dea0fc22-3bb5-4042-bfb5-a5947beae6e7'} Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:34.999159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:35.000830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:35.007457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Returning 404 to user: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:35.008518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3fd164d6-d7f9-401e-bd75-e113201dfb6c tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 404 len: 111 microversion: 2.1 time: 0.072517 Jul 24 01:10:35.009112 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 316/616] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:34 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:35.009642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63da4f36-ac1b-49e0-92bf-c3b31ea99184 tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.010299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63da4f36-ac1b-49e0-92bf-c3b31ea99184 tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.019875 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3fb8bc41-e973-49f7-b332-afaabd91d3a2 req-6311612b-a9bd-4413-9eb2-c395384c4765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47daf830-dbdf-42ca-ab4a-7fa63658b66a", "name": "network-vif-unplugged", "status": "completed", "tag": "d50c538b-1612-4fad-b54b-93a3c2ceaccb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:35.056851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fb8bc41-e973-49f7-b332-afaabd91d3a2 req-6311612b-a9bd-4413-9eb2-c395384c4765 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.057311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fb8bc41-e973-49f7-b332-afaabd91d3a2 req-6311612b-a9bd-4413-9eb2-c395384c4765 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.099248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3fb8bc41-e973-49f7-b332-afaabd91d3a2 req-6311612b-a9bd-4413-9eb2-c395384c4765 service nova] Creating event network-vif-unplugged:d50c538b-1612-4fad-b54b-93a3c2ceaccb for instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a on n-h1-master-1 Jul 24 01:10:35.110650 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63da4f36-ac1b-49e0-92bf-c3b31ea99184 tempest-TenantUsagesTestJSON-376815479 tempest-TenantUsagesTestJSON-376815479-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-23T01%3A10%3A31.480613&end=2022-07-25T01%3A10%3A31.480613&detailed=1" status: 200 len: 8705 microversion: 2.1 time: 0.187071 Jul 24 01:10:35.111377 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 301/617] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Jul 24 01:10:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-23T01%3A10%3A31.480613&end=2022-07-25T01%3A10%3A31.480613&detailed=1 => generated 8705 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:35.114573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3fb8bc41-e973-49f7-b332-afaabd91d3a2 req-6311612b-a9bd-4413-9eb2-c395384c4765 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097971 Jul 24 01:10:35.118891 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 317/618] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:35.131848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:35.136700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:35.145630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:35.149047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:35.155165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.155926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.157967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.158592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.166544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.167001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.167786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.176792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.834216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:35.847092 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cb8c676e-7603-4b4b-b71b-8acd262385ee tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1467 microversion: 2.1 time: 0.726715 Jul 24 01:10:35.849937 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 318/619] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:35 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1467 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:35.868676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-19b2479c-68d7-41d0-8f31-8f741c76814e tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:35.870046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-19b2479c-68d7-41d0-8f31-8f741c76814e tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:35.870676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:35.878815 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3f4ec27-4ba8-4432-ade0-283fb98fc381 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1477 microversion: 2.1 time: 0.754939 Jul 24 01:10:35.883053 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 302/620] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:35 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1477 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:35.894699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19b2479c-68d7-41d0-8f31-8f741c76814e tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.895159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19b2479c-68d7-41d0-8f31-8f741c76814e tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.895570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:35.895965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19b2479c-68d7-41d0-8f31-8f741c76814e tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.896408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19b2479c-68d7-41d0-8f31-8f741c76814e tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.896802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:35.914961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.916774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:35.917793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:35.918470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:36.674043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:36.685232 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf698a89-9b75-4797-9ce7-f62aafcab601 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.798566 Jul 24 01:10:36.697008 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 303/621] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:35 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:36.702639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:36.703497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:36.712441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:36.713155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:36.714335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:36.715113 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:36.754523 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] HTTP exception thrown: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Request method failure captured: Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 HTTP/1.1 Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvQ_n-XZDOZN7BDncXYj4fg3qs6M9LeNV8cYVy1HOwOaIQ5VN3O4GGsNTYZTQB3ug_iYRf8lXb1b-EqWmBkPZRn7VvdKbDM-yyh1-6oo5kRuFg-yYc7bFxfxs3zMLVoXo1fweO2snTuWIIrBGYxqW_haIZvNYKYcTM0YxOynqbMmOw Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:36.756473 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a228611da9b47f785568447a4caa0eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1070815bb60c44fcb6a586fd2d1f6e71 Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: exception: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:36.758022 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'dea0fc22-3bb5-4042-bfb5-a5947beae6e7'} Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:36.758930 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:36.760292 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:36.762015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Returning 404 to user: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:36.762015 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f0e9ace-e13b-4ce5-a1f4-2733db182cb7 tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 404 len: 111 microversion: 2.1 time: 0.060330 Jul 24 01:10:36.765384 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 304/622] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:10:36 2022] DELETE /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:36.772571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:36.773201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:36.780881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:36.781617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:36.782588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:36.783185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:36.825871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:10:36.946538 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:36.956415 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3090b795-5193-47c9-b7f4-f83aea9006a3 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 204 len: 0 microversion: 2.1 time: 0.188737 Jul 24 01:10:36.958381 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 305/623] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:10:36 2022] DELETE /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:10:36.979268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4e34ef54-61d8-4aeb-bbc1-39d0a6134095 req-b7c53fa3-ca3f-4a4e-a92b-00e9a24d6078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b68f333-31cf-4daf-8dad-2a4c759bddd8", "tag": "b8c94a54-3902-46c3-b698-8f8b474bdf76"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:36.987855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4e34ef54-61d8-4aeb-bbc1-39d0a6134095 req-b7c53fa3-ca3f-4a4e-a92b-00e9a24d6078 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:36.988694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4e34ef54-61d8-4aeb-bbc1-39d0a6134095 req-b7c53fa3-ca3f-4a4e-a92b-00e9a24d6078 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.002813 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4e34ef54-61d8-4aeb-bbc1-39d0a6134095 req-b7c53fa3-ca3f-4a4e-a92b-00e9a24d6078 service nova] Creating event network-changed:b8c94a54-3902-46c3-b698-8f8b474bdf76 for instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 on n-h2-master-1 Jul 24 01:10:37.009145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4e34ef54-61d8-4aeb-bbc1-39d0a6134095 req-b7c53fa3-ca3f-4a4e-a92b-00e9a24d6078 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048628 Jul 24 01:10:37.009989 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 306/624] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:37.018598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:37.019969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:37.050614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.051537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.052543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.053133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.059185 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:37.260715 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-19b2479c-68d7-41d0-8f31-8f741c76814e tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1609 microversion: 2.1 time: 1.406461 Jul 24 01:10:37.265633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 319/625] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:35 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1609 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:37.276747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-270b2c14-1884-43f9-ad0f-84931b834698 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-62099052"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:37.281931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-270b2c14-1884-43f9-ad0f-84931b834698 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:37.294447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-270b2c14-1884-43f9-ad0f-84931b834698 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.297097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-270b2c14-1884-43f9-ad0f-84931b834698 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.300569 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-270b2c14-1884-43f9-ad0f-84931b834698 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.301469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-270b2c14-1884-43f9-ad0f-84931b834698 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.353425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:37.363118 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0fad23d1-9849-40f4-ba81-50d685760582 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.351470 Jul 24 01:10:37.366376 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 307/626] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:37 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:37.379005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:37.379643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: dea0fc22-3bb5-4042-bfb5-a5947beae6e7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:37.392153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.392495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.393325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.393796 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.427702 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] HTTP exception thrown: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Request method failure captured: Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 HTTP/1.1 Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvQ_n-XZDOZN7BDncXYj4fg3qs6M9LeNV8cYVy1HOwOaIQ5VN3O4GGsNTYZTQB3ug_iYRf8lXb1b-EqWmBkPZRn7VvdKbDM-yyh1-6oo5kRuFg-yYc7bFxfxs3zMLVoXo1fweO2snTuWIIrBGYxqW_haIZvNYKYcTM0YxOynqbMmOw Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:37.429569 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a228611da9b47f785568447a4caa0eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1070815bb60c44fcb6a586fd2d1f6e71 Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: exception: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:37.431698 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'dea0fc22-3bb5-4042-bfb5-a5947beae6e7'} Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:37.432480 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. Jul 24 01:10:37.434944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.437366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Returning 404 to user: Instance dea0fc22-3bb5-4042-bfb5-a5947beae6e7 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:37.437366 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-760e8b34-79d5-46d2-8c68-38573803a97e tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7" status: 404 len: 111 microversion: 2.1 time: 0.062325 Jul 24 01:10:37.437366 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 308/627] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:37 2022] GET /compute/v2.1/servers/dea0fc22-3bb5-4042-bfb5-a5947beae6e7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:37.440834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:37.441463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:37.448894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.449339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.450168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.450601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.718639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:37.734403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-30e0b4ca-b24e-4849-a3eb-352d8e303424 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1477 microversion: 2.1 time: 0.296904 Jul 24 01:10:37.744838 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 309/628] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:37 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:37.746770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:37.752278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:37.764965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.767969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.769085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.771687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.837781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-270b2c14-1884-43f9-ad0f-84931b834698 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "POST /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262/action" status: 202 len: 0 microversion: 2.1 time: 0.569632 Jul 24 01:10:37.844385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 320/629] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:37 2022] POST /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:10:37.858167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-53a7bb66-c9ec-4395-9ba7-6f48d3a9dd3c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:37.861223 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:37.861223 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:37.862809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a7bb66-c9ec-4395-9ba7-6f48d3a9dd3c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.863396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a7bb66-c9ec-4395-9ba7-6f48d3a9dd3c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.864314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a7bb66-c9ec-4395-9ba7-6f48d3a9dd3c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.865475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a7bb66-c9ec-4395-9ba7-6f48d3a9dd3c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.876376 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=20 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:37.879920 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:37.909976 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-53a7bb66-c9ec-4395-9ba7-6f48d3a9dd3c tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063676 Jul 24 01:10:37.918175 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 321/630] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:10:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:37.926062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:37.927195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:37.934776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.935609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.936794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.937837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:37.965220 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] HTTP exception thrown: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Request method failure captured: Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 HTTP/1.1 Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvQ_n-XZDOZN7BDncXYj4fg3qs6M9LeNV8cYVy1HOwOaIQ5VN3O4GGsNTYZTQB3ug_iYRf8lXb1b-EqWmBkPZRn7VvdKbDM-yyh1-6oo5kRuFg-yYc7bFxfxs3zMLVoXo1fweO2snTuWIIrBGYxqW_haIZvNYKYcTM0YxOynqbMmOw Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:10:37.968560 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a228611da9b47f785568447a4caa0eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1070815bb60c44fcb6a586fd2d1f6e71 Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: exception: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:37.969882 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'd0f09cbc-4e61-4153-9fae-de17316bae52'} Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:37.970583 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:37.971685 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:37.977236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Returning 404 to user: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:37.978435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89ee4dea-f338-4f95-a60a-32f7df457b7b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 404 len: 111 microversion: 2.1 time: 0.058575 Jul 24 01:10:37.983234 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 322/631] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:10:37 2022] DELETE /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:37.989023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:37.990002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:37.998943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:37.999871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.001142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.001856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.106027 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:38.115575 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47a4faa2-5d27-4580-8c73-349e96d5e933 tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1468 microversion: 2.1 time: 0.378775 Jul 24 01:10:38.121326 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 310/632] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:37 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:38.135202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bd5ba26-52c3-4190-bd8b-bf4a5adf3abe tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb624700>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:38.259400 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3bd5ba26-52c3-4190-bd8b-bf4a5adf3abe tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 0.136014 Jul 24 01:10:38.260076 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 311/633] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:38 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:38.302557 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:38.309097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:38.324325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.325087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.329243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.330030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.390782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Lazy-loading 'flavor' on Instance uuid 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:38.422242 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f while it is in vm_state suspended Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Request method failure captured: Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f/action HTTP/1.1 Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 97 Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvV6efdZXBEFLSm9B1N8P1RMVkP4euV8PnWfD76IhZjQ0MCdJt5XhHJxbORD4MiAIUBhvbpYNVp3lCgBQE9wgQv_Go5JWmgNeBYDAKVOxI8yU2a_vHWYqQPcvjyxIu_BCg7m-wTuk2PIQ3TPjnpbrwd1aTX3ltq0WQWxRZqrvONXuE Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 724022d6e8d84abf8ed98950dc5f7df1 Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-LiveMigrationNegativeTest-1830862355 Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:10:38.429982 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/724022d6e8d84abf8ed98950dc5f7df1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/724022d6e8d84abf8ed98950dc5f7df1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_724022d6e8d84abf8ed98950dc5f7df1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/724022d6e8d84abf8ed98950dc5f7df1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-LiveMigrationNegativeTest-1830862355 Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 724022d6e8d84abf8ed98950dc5f7df1 Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1830862355 Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-LiveMigrationNegativeTest-1830862355-project-admin Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b8acf79566f9421a9235ec259d43e597 Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-LiveMigrationNegativeTest-1830862355-project-admin Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} Jul 24 01:10:38.431705 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'os-migrateLive' instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f while it is in vm_state suspended Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f', 'body': {'os-migrateLive': {'host': 'n-h1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 24 01:10:38.432549 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:38.434212 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f while it is in vm_state suspended Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f while it is in vm_state suspended Jul 24 01:10:38.435378 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.440520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f while it is in vm_state suspended {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:38.442977 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8cd81a82-f419-4e4a-baab-7505108f5760 tempest-LiveMigrationNegativeTest-1830862355 tempest-LiveMigrationNegativeTest-1830862355-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f/action" status: 409 len: 155 microversion: 2.1 time: 0.172332 Jul 24 01:10:38.448228 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 312/634] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:38 2022] POST /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f/action => generated 155 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:10:38.453421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:38.458556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] [instance: d0f09cbc-4e61-4153-9fae-de17316bae52] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:38.481019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.481208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:38.481377 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.484761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.487892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.491167 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e668eb8-0b4a-40a5-a64b-2e499d6ae1a8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.506422 Jul 24 01:10:38.499984 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 323/635] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:37 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:38.512226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7cf9008b-1b94-4c24-ae0c-377c1dac86b4 req-4653d84c-54e5-4cbc-aa99-ced08fb525f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47daf830-dbdf-42ca-ab4a-7fa63658b66a", "name": "network-vif-plugged", "status": "completed", "tag": "d50c538b-1612-4fad-b54b-93a3c2ceaccb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:38.533210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] HTTP exception thrown: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Request method failure captured: Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 HTTP/1.1 Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvQ_n-XZDOZN7BDncXYj4fg3qs6M9LeNV8cYVy1HOwOaIQ5VN3O4GGsNTYZTQB3ug_iYRf8lXb1b-EqWmBkPZRn7VvdKbDM-yyh1-6oo5kRuFg-yYc7bFxfxs3zMLVoXo1fweO2snTuWIIrBGYxqW_haIZvNYKYcTM0YxOynqbMmOw Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:38.534685 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a228611da9b47f785568447a4caa0eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a228611da9b47f785568447a4caa0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 7a228611da9b47f785568447a4caa0eb Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-479938772 Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1070815bb60c44fcb6a586fd2d1f6e71 Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersAdminTestJSON-479938772-project Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: exception: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:38.536275 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd0f09cbc-4e61-4153-9fae-de17316bae52'} Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:38.537128 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. Jul 24 01:10:38.539353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:38.547226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] Returning 404 to user: Instance d0f09cbc-4e61-4153-9fae-de17316bae52 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:38.551165 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c96fe7f-75c0-440f-a570-860e29f2b04b tempest-DeleteServersAdminTestJSON-479938772 tempest-DeleteServersAdminTestJSON-479938772-project] 10.222.0.27 "GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52" status: 404 len: 111 microversion: 2.1 time: 0.098662 Jul 24 01:10:38.558318 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 313/636] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:38 2022] GET /compute/v2.1/servers/d0f09cbc-4e61-4153-9fae-de17316bae52 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:38.563329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7cf9008b-1b94-4c24-ae0c-377c1dac86b4 req-4653d84c-54e5-4cbc-aa99-ced08fb525f4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.563781 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7cf9008b-1b94-4c24-ae0c-377c1dac86b4 req-4653d84c-54e5-4cbc-aa99-ced08fb525f4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.572122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:38.576207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:38.592908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.594413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.597404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.598073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.603741 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7cf9008b-1b94-4c24-ae0c-377c1dac86b4 req-4653d84c-54e5-4cbc-aa99-ced08fb525f4 service nova] Creating event network-vif-plugged:d50c538b-1612-4fad-b54b-93a3c2ceaccb for instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a on n-h1-master-1 Jul 24 01:10:38.616211 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7cf9008b-1b94-4c24-ae0c-377c1dac86b4 req-4653d84c-54e5-4cbc-aa99-ced08fb525f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114902 Jul 24 01:10:38.620694 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 324/637] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:38.629096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:38.636420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:38.656006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.656906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.658008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:38.660054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:38.758939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:10:39.053921 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:39.069273 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67244d19-b0ff-4f5c-907f-409238a69f65 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 204 len: 0 microversion: 2.1 time: 0.446018 Jul 24 01:10:39.070466 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 325/638] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:10:38 2022] DELETE /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:10:39.098034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:39.099344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:39.141580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:39.141580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:39.141580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:39.141580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:39.171334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:39.207096 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-167b6e46-9597-4d6b-9baa-4aa6f91f9156 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.646114 Jul 24 01:10:39.220172 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 314/639] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:38 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:39.227274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b3711efc-a73f-4e9c-87f3-8fefa05fcaa0 req-a95af685-b0d1-43ec-8d0a-91c7800917d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5044972f-10c9-4250-87ea-7e65fdad75f5", "name": "network-vif-unplugged", "status": "completed", "tag": "72a9224c-8d72-4822-b153-758b0b86416b"}, {"name": "network-changed", "server_uuid": "5044972f-10c9-4250-87ea-7e65fdad75f5", "tag": "72a9224c-8d72-4822-b153-758b0b86416b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:39.238058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3711efc-a73f-4e9c-87f3-8fefa05fcaa0 req-a95af685-b0d1-43ec-8d0a-91c7800917d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:39.238681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3711efc-a73f-4e9c-87f3-8fefa05fcaa0 req-a95af685-b0d1-43ec-8d0a-91c7800917d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:39.257724 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b3711efc-a73f-4e9c-87f3-8fefa05fcaa0 req-a95af685-b0d1-43ec-8d0a-91c7800917d7 service nova] Creating event network-vif-unplugged:72a9224c-8d72-4822-b153-758b0b86416b for instance 5044972f-10c9-4250-87ea-7e65fdad75f5 on n-h2-master-1 Jul 24 01:10:39.258192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b3711efc-a73f-4e9c-87f3-8fefa05fcaa0 req-a95af685-b0d1-43ec-8d0a-91c7800917d7 service nova] Creating event network-changed:72a9224c-8d72-4822-b153-758b0b86416b for instance 5044972f-10c9-4250-87ea-7e65fdad75f5 on n-h2-master-1 Jul 24 01:10:39.274058 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b3711efc-a73f-4e9c-87f3-8fefa05fcaa0 req-a95af685-b0d1-43ec-8d0a-91c7800917d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.052151 Jul 24 01:10:39.277113 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 315/640] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:39.291323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:39.293463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:39.310473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:39.311538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:39.312680 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:39.314205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:39.733291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:39.742231 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-451c4e77-7423-4fdf-82e3-885270f84880 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1464 microversion: 2.1 time: 0.460747 Jul 24 01:10:39.743110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 316/641] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:39 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1464 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:39.748198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:39.749230 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:39.756899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:39.758184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:39.759067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:39.759457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:39.836587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:39.859119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-17901133-932d-4bbc-b537-309865e6b667 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1477 microversion: 2.1 time: 0.787429 Jul 24 01:10:39.859947 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 326/642] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:39 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1477 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:39.880178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6408f47f-2e80-4e88-976a-3a4b935c9804 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb5f6940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:39.974323 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6408f47f-2e80-4e88-976a-3a4b935c9804 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 0.112124 Jul 24 01:10:39.981635 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 327/643] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:39 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:39.987970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:39.989604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:40.003519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.003990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:40.004822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.005269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:40.226331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:40.238149 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dbc03d3d-3338-4bc0-a408-bd15179b364b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1468 microversion: 2.1 time: 0.492423 Jul 24 01:10:40.238149 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 317/644] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:39 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1468 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:40.243571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:40.244389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:40.255851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.256733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:40.257842 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.258571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:40.570673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:40.610123 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6a5a07c-4e70-4c6b-b0f2-124971b2728d tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.614211 Jul 24 01:10:40.611311 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 328/645] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:39 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:40.666722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:40.674715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-198c68f4-c177-4663-a760-a56a33071194 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.435794 Jul 24 01:10:40.675880 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 318/646] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:40 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:40.807062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:40.812561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:40.829148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.829403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:40.831949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.832594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:40.890526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:40.891332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:40.903414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.906647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:40.910332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:40.922476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:41.703376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:41.716613 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:41.719524 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e0b2398d-5582-48be-857f-87ec511595f0 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1464 microversion: 2.1 time: 0.953616 Jul 24 01:10:41.720304 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 329/647] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:40 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1464 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:41.758917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2a39591-eb70-4aca-a773-f9201cff3f92 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb514a60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:41.791516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:41.800204 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7df020c2-a685-46a6-a8b5-5866335c209c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1477 microversion: 2.1 time: 0.920849 Jul 24 01:10:41.811231 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 319/648] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:40 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1477 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:41.817921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:41.819023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:41.834259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:41.835073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:41.836877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:41.840870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:41.853553 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2a39591-eb70-4aca-a773-f9201cff3f92 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 0.111851 Jul 24 01:10:41.854699 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 330/649] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:41 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:41.859583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ed1a8322-25eb-4405-b0b3-72395adeb151 req-1197196b-8f77-4a0a-9ceb-54365da9fe84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79996ebc-6792-4dd1-bcf3-4791a78150bd", "name": "network-vif-deleted", "tag": "02fe99c7-b8f9-4087-a49f-3b21c8d08aee"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:41.886646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ed1a8322-25eb-4405-b0b3-72395adeb151 req-1197196b-8f77-4a0a-9ceb-54365da9fe84 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:41.891132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ed1a8322-25eb-4405-b0b3-72395adeb151 req-1197196b-8f77-4a0a-9ceb-54365da9fe84 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:41.927128 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ed1a8322-25eb-4405-b0b3-72395adeb151 req-1197196b-8f77-4a0a-9ceb-54365da9fe84 service nova] Creating event network-vif-deleted:02fe99c7-b8f9-4087-a49f-3b21c8d08aee for instance 79996ebc-6792-4dd1-bcf3-4791a78150bd on n-h1-master-1 Jul 24 01:10:41.937096 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ed1a8322-25eb-4405-b0b3-72395adeb151 req-1197196b-8f77-4a0a-9ceb-54365da9fe84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080868 Jul 24 01:10:41.937666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:41.938457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:41.939153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lazy-loading 'fault' on Instance uuid 79996ebc-6792-4dd1-bcf3-4791a78150bd {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:41.949361 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 331/650] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:41.983145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:41.984354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:42.028563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.032300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:42.040616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.041574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:42.120771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f864a97463e4afb960a6c136e65b829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e5954e848b49e7986b9f72eb5ea64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:42.156708 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1623abfd-b56a-4a0c-b23e-d898a0f9255c tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 200 len: 1303 microversion: 2.1 time: 0.338582 Jul 24 01:10:42.159449 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 320/651] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:41 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 1303 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:42.185116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:42.188880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:42.219094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.222064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:42.223983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.225235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:42.553241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:42.564254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b7a15815-c1cc-40a2-bf6a-624fe0ab79ec tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.613150 Jul 24 01:10:42.584220 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 332/652] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:41 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:42.739288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:42.741198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:42.755337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.758417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:42.761232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.763680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:42.827156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:42.843478 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e6b659ae-80e8-4f99-aca5-0f1558ae2a7e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.681641 Jul 24 01:10:42.850358 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 321/653] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:42 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:42.858793 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:42.859334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:42.874554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.877017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:42.878066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:42.880684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:43.530436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:43.541430 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-974def21-e369-4760-bef7-d1b1b2ba1e0e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1464 microversion: 2.1 time: 0.806926 Jul 24 01:10:43.548784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 333/654] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:42 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1464 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:10:43.555409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:43.563633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-188d77d4-7a5a-462c-9f56-7b58c2d3f351 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1463 microversion: 2.1 time: 0.710122 Jul 24 01:10:43.567960 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 322/655] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:42 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1463 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:43.573551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:43.579461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7111a353-048c-48e7-82cd-0e0f1f6e8d2b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb6a81f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:43.589348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] [instance: 79996ebc-6792-4dd1-bcf3-4791a78150bd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:43.608010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:43.610910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:43.613210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:43.614866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:43.648464 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] HTTP exception thrown: Instance 79996ebc-6792-4dd1-bcf3-4791a78150bd could not be found. Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Request method failure captured: Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd HTTP/1.1 Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JvwKY7ohBfq6QaRcQn4hbAYa9ZoPHlyWWE4IqHqaDmh5jeG3kIKIV96rb4jQpHyfthhDNM1fQv9TJ_yIlnaPP_KOA0WyB6cD1Dh_AkIhTqYGCh2YfLZAynnjkxlyLWH_ZLRCP8n6X-2P6ggYDqphFSJisw_3pXz_2LKIOEc9Stc4X0 Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 04e5954e848b49e7986b9f72eb5ea64c Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TenantUsagesTestJSON-123055448 Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:10:43.652504 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04e5954e848b49e7986b9f72eb5ea64c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e5954e848b49e7986b9f72eb5ea64c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04e5954e848b49e7986b9f72eb5ea64c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e5954e848b49e7986b9f72eb5ea64c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TenantUsagesTestJSON-123055448 Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 04e5954e848b49e7986b9f72eb5ea64c Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TenantUsagesTestJSON-123055448 Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TenantUsagesTestJSON-123055448-project Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4f864a97463e4afb960a6c136e65b829 Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TenantUsagesTestJSON-123055448-project Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 79996ebc-6792-4dd1-bcf3-4791a78150bd could not be found. Jul 24 01:10:43.654000 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '79996ebc-6792-4dd1-bcf3-4791a78150bd'} Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79996ebc-6792-4dd1-bcf3-4791a78150bd could not be found. Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:43.654758 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79996ebc-6792-4dd1-bcf3-4791a78150bd could not be found. Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79996ebc-6792-4dd1-bcf3-4791a78150bd could not be found. Jul 24 01:10:43.655950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:10:43.662294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] Returning 404 to user: Instance 79996ebc-6792-4dd1-bcf3-4791a78150bd could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:43.666756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3303703c-e3d0-4df2-89f2-d21301948c5b tempest-TenantUsagesTestJSON-123055448 tempest-TenantUsagesTestJSON-123055448-project] 10.222.0.27 "GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd" status: 404 len: 111 microversion: 2.1 time: 0.097529 Jul 24 01:10:43.672912 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 323/656] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:43 2022] GET /compute/v2.1/servers/79996ebc-6792-4dd1-bcf3-4791a78150bd => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:43.684188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:43.699722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:43.735229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:43.739848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:43.743911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:43.746521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:44.880427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:44.899160 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4bf15764-1402-475e-9dad-06f0823bb8e6 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1463 microversion: 2.1 time: 1.217671 Jul 24 01:10:44.900707 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 324/657] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:43 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1463 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:44.910005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:44.911075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:44.938400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:44.939542 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:44.940744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:44.941758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:44.994487 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:45.310301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:45.324172 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d1af44b2-861c-4cd3-b36a-a190344ef0c9 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.418526 Jul 24 01:10:45.338104 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 325/658] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:44 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:45.344079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:45.345145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:45.364864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:45.366131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:45.369119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:45.369927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:45.945562 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7111a353-048c-48e7-82cd-0e0f1f6e8d2b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 2.386209 Jul 24 01:10:45.947626 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 334/659] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:43 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 2398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:45.954225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:45.955242 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:45.963398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:45.964105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:45.965080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:45.965701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:46.006970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:46.007786 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:46.008740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lazy-loading 'fault' on Instance uuid 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:46.379802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:46.396619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:46.398958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c1b5775e-f25a-484b-9f8c-43f563a4f294 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 200 len: 1308 microversion: 2.1 time: 0.447341 Jul 24 01:10:46.401847 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 335/660] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:45 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:46.416236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b0eff584-3c9a-4260-801c-c6f12f0a78ee tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 1.076456 Jul 24 01:10:46.417805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:46.423314 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 326/661] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:45 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:46.435172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:46.452137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b756c280-6f8b-47ad-95eb-b099ecc34ca8 req-51e09828-b5ef-400e-a064-099f3b51c411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f", "name": "network-vif-deleted", "tag": "03963919-2fd2-481c-af6e-bcc7698f3b88"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:46.462980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:46.464622 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:46.469242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:46.470576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:46.473489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b756c280-6f8b-47ad-95eb-b099ecc34ca8 req-51e09828-b5ef-400e-a064-099f3b51c411 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:46.480191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b756c280-6f8b-47ad-95eb-b099ecc34ca8 req-51e09828-b5ef-400e-a064-099f3b51c411 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:46.501603 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:46.544822 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b756c280-6f8b-47ad-95eb-b099ecc34ca8 req-51e09828-b5ef-400e-a064-099f3b51c411 service nova] Creating event network-vif-deleted:03963919-2fd2-481c-af6e-bcc7698f3b88 for instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f on n-h2-master-1 Jul 24 01:10:46.567330 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b756c280-6f8b-47ad-95eb-b099ecc34ca8 req-51e09828-b5ef-400e-a064-099f3b51c411 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142549 Jul 24 01:10:46.573466 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 327/662] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:46.595073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:46.596284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:46.624395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:46.627541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:46.631123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:46.636547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:46.794936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:10:46.795528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:10:46.798542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:10:46.801948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:10:46.802545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:10:47.221983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:47.240965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.241650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.243046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.244180 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.314063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4fa0c81c-b7be-4118-9d4a-e5993e144e80 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action" status: 202 len: 1067 microversion: 2.1 time: 0.908662 Jul 24 01:10:47.315920 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 336/663] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:10:46 2022] POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action => generated 1067 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 24 01:10:47.324495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7237f7a-b807-46ea-af76-4ebf1f173095 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb8d69d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:47.368395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:47.388816 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03c96a03-7c4c-4a99-8b4d-6cc689f63c82 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.813688 Jul 24 01:10:47.403447 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 328/664] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:46 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:47.418682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:47.421399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:47.443953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.447092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.450921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.458302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.497712 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7237f7a-b807-46ea-af76-4ebf1f173095 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 0.179929 Jul 24 01:10:47.504399 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 337/665] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:47 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:47.532190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:47.533235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:47.578456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.584756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.586724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.588617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.643451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] HTTP exception thrown: Instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f could not be found. Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Request method failure captured: Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f HTTP/1.1 Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvTRXmtdPEtn5jm5NTJ_xIFNkM47l7yis9WNT7sCeaEhdAJsO8uHCGbJDB4ulwrkzjVF6787iBEuC15VYjQzjQYhkLweDrMJ3SZafD1eR4NZ1P45nY9Qdc_qsb6p4kBUIGELCEuIASoC-Jt3aCSOnmdBU5_cs-4nr9_2zp1OKtPjy8 Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: aa9af5838d3645b2acad12161d65b6bc Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-LiveMigrationNegativeTest-1038257748 Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:10:47.663321 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa9af5838d3645b2acad12161d65b6bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa9af5838d3645b2acad12161d65b6bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa9af5838d3645b2acad12161d65b6bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa9af5838d3645b2acad12161d65b6bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-LiveMigrationNegativeTest-1038257748 Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: aa9af5838d3645b2acad12161d65b6bc Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1038257748 Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-LiveMigrationNegativeTest-1038257748-project Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 7fe15455304f4fe4a990a1d32e0d1c28 Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-LiveMigrationNegativeTest-1038257748-project Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f could not be found. Jul 24 01:10:47.665023 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f'} Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f could not be found. Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:47.667042 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f could not be found. Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f could not be found. Jul 24 01:10:47.668317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:47.669373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Returning 404 to user: Instance 97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:47.673817 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1ba959b1-ce2c-4fb0-9d81-1c77ae817d6e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f" status: 404 len: 111 microversion: 2.1 time: 0.164861 Jul 24 01:10:47.677515 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 338/666] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:47 2022] GET /compute/v2.1/servers/97a7f2f2-bca1-4d13-a4b2-6c8f4dbeb85f => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:47.705560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:47.724101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:47.752933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.754830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.755836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:47.756292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:47.914473 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:48.081568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:48.107923 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f7369c41-32e5-43b9-9b72-a8f3dfb5be84 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 0.703145 Jul 24 01:10:48.111119 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 329/667] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:47 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:48.123220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:48.124173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:48.152545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:48.153825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:48.154958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:48.155564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:48.230320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:10:48.429424 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-60d43efe-0761-486c-b0e0-7a302ca2327e tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 204 len: 0 microversion: 2.1 time: 0.316647 Jul 24 01:10:48.430778 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 330/668] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:10:48 2022] DELETE /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:10:48.500828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:48.520067 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-37442533-e8da-46e9-9205-431752dd994a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 0.838058 Jul 24 01:10:48.526971 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 339/669] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:47 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:48.545156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:48.548872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:48.566516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:48.569096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:48.572609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:48.573634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:48.906126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-99428c9f-e75a-4cae-81c9-614142ac08c8 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1715448137", "id": 390276043, "os-flavor-access:is_public": "False"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:48.907780 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:48.907780 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:10:48.923626 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:48.977717 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-99428c9f-e75a-4cae-81c9-614142ac08c8 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.539340 Jul 24 01:10:48.981022 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 331/670] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:48 2022] POST /compute/v2.1/flavors => generated 436 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:49.000312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:49.008047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:49.027899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:49.030925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:49.032000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:49.033888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:49.052334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:49.065438 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d0f31d5a-dd58-468f-8d30-3e3c7caa603e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.535950 Jul 24 01:10:49.074979 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 340/671] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:48 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:49.083392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9194feb3-2219-412b-86e7-050a2982260b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb5f6790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:49.172450 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9194feb3-2219-412b-86e7-050a2982260b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 0.102212 Jul 24 01:10:49.177762 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 341/672] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:49 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:49.193972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2568a309-8173-4e94-aa15-77a94f85e83b req-7d525f56-3dd3-47d0-b96b-9f2b0c0c5547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5044972f-10c9-4250-87ea-7e65fdad75f5", "name": "network-vif-unplugged", "status": "completed", "tag": "72a9224c-8d72-4822-b153-758b0b86416b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:49.284210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2568a309-8173-4e94-aa15-77a94f85e83b req-7d525f56-3dd3-47d0-b96b-9f2b0c0c5547 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:49.287127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2568a309-8173-4e94-aa15-77a94f85e83b req-7d525f56-3dd3-47d0-b96b-9f2b0c0c5547 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:49.337442 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2568a309-8173-4e94-aa15-77a94f85e83b req-7d525f56-3dd3-47d0-b96b-9f2b0c0c5547 service nova] Creating event network-vif-unplugged:72a9224c-8d72-4822-b153-758b0b86416b for instance 5044972f-10c9-4250-87ea-7e65fdad75f5 on n-h2-master-1 Jul 24 01:10:49.349930 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2568a309-8173-4e94-aa15-77a94f85e83b req-7d525f56-3dd3-47d0-b96b-9f2b0c0c5547 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173066 Jul 24 01:10:49.352350 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 342/673] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:49.364913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-965b5578-dba9-424d-8549-7efd52f008c4 req-eaaef8ed-a26c-4d4a-8501-f0186a1f6086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b68f333-31cf-4daf-8dad-2a4c759bddd8", "name": "network-vif-plugged", "status": "completed", "tag": "b8c94a54-3902-46c3-b698-8f8b474bdf76"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:49.377968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-965b5578-dba9-424d-8549-7efd52f008c4 req-eaaef8ed-a26c-4d4a-8501-f0186a1f6086 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:49.378524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-965b5578-dba9-424d-8549-7efd52f008c4 req-eaaef8ed-a26c-4d4a-8501-f0186a1f6086 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:49.391897 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-965b5578-dba9-424d-8549-7efd52f008c4 req-eaaef8ed-a26c-4d4a-8501-f0186a1f6086 service nova] Creating event network-vif-plugged:b8c94a54-3902-46c3-b698-8f8b474bdf76 for instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 on n-h2-master-1 Jul 24 01:10:49.403271 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-965b5578-dba9-424d-8549-7efd52f008c4 req-eaaef8ed-a26c-4d4a-8501-f0186a1f6086 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048554 Jul 24 01:10:49.408572 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 343/674] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:49.422623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5733198-bea4-4ecf-bf32-fdb92153e777 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:49.431084 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:49.431084 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:49.564722 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5733198-bea4-4ecf-bf32-fdb92153e777 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/390276043/action" status: 200 len: 96 microversion: 2.1 time: 0.153522 Jul 24 01:10:49.571562 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 344/675] 10.222.0.27 () {60 vars in 1196 bytes} [Sun Jul 24 01:10:49 2022] POST /compute/v2.1/flavors/390276043/action => generated 96 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:10:49.588609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:49.591362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:49.615220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:49.616196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:49.618133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:49.620032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:49.907253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:49.922110 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ac567dc-a34c-4c3e-bd92-e2b544408e41 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1474 microversion: 2.1 time: 0.937103 Jul 24 01:10:49.944710 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 332/676] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:48 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1474 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:49.959624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:49.960782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:50.025152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:50.025910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:50.027292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:50.028325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:50.850180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:50.862266 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4aa7ccd-d01c-4629-9fcc-357426eec0c5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 1.287094 Jul 24 01:10:50.875199 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 345/677] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:49 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:50.909555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c27abbbd-ea30-45fb-8a84-6e779b7c3158 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:50.914790 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:50.914790 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:51.091457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:51.103048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d70a9b5f-bcea-48e2-9d18-332867a99676 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1503 microversion: 2.1 time: 1.156774 Jul 24 01:10:51.106566 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 333/678] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:49 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1503 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:51.117836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:51.131539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:51.160000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:51.160755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:51.161907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:51.162540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:51.920480 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c27abbbd-ea30-45fb-8a84-6e779b7c3158 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 9bf45e2aa05f4f2aa444be7fd3195e7c combination. Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c27abbbd-ea30-45fb-8a84-6e779b7c3158 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Request method failure captured: Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/flavors/390276043/action HTTP/1.1 Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 67 Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JwWXvlmv7vl6SeeNXBg9KLuYTjfLnL6m98GEFQhprlzs8RBraDGMSQOMj-zGCTL0RYz5YqKRyeykm82gYwpkiY9FF03FIdhjeN8RYfa3tHQRcDafQbriQFQ6viPGskIlDncqj8JZUy76JdzpdmKW6to-DGHrGZsMeHfYAzosqLa5h4 Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 293506e56f5148a2a635e914a25e71d3 Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:10:51.946957 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_293506e56f5148a2a635e914a25e71d3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 293506e56f5148a2a635e914a25e71d3 Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4327bc6f292c43f780d905a55502ed4c Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: {"addTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} Jul 24 01:10:51.948798 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: exception: Flavor access already exists for flavor 32 and project 9bf45e2aa05f4f2aa444be7fd3195e7c combination. Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '390276043', 'body': {'addTenantAccess': {'tenant': '9bf45e2aa05f4f2aa444be7fd3195e7c'}}} Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result.read() Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:10:51.949753 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-9bf45e2aa05f4f2aa444be7fd3195e7c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi session.flush() Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 01:10:51.951045 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 01:10:51.952365 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:10:51.953591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result.read() Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-9bf45e2aa05f4f2aa444be7fd3195e7c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 24, 1, 10, 51, 911201), 'updated_at': None, 'flavor_id': 32, 'project_id': '9bf45e2aa05f4f2aa444be7fd3195e7c'}] Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:51.954843 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 9bf45e2aa05f4f2aa444be7fd3195e7c combination. Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:51.957142 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 9bf45e2aa05f4f2aa444be7fd3195e7c combination. Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:51.959907 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:51.962867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 9bf45e2aa05f4f2aa444be7fd3195e7c combination. Jul 24 01:10:51.962867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:51.962867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c27abbbd-ea30-45fb-8a84-6e779b7c3158 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 9bf45e2aa05f4f2aa444be7fd3195e7c combination. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:51.962867 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c27abbbd-ea30-45fb-8a84-6e779b7c3158 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/390276043/action" status: 409 len: 152 microversion: 2.1 time: 1.071881 Jul 24 01:10:51.962867 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 346/679] 10.222.0.27 () {60 vars in 1196 bytes} [Sun Jul 24 01:10:50 2022] POST /compute/v2.1/flavors/390276043/action => generated 152 bytes in 1077 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:10:51.962867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf3187e9-4346-43c2-a5fe-962943e584b9 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb334e50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:52.028510 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:52.037605 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-adf59eb4-9c91-46c6-8384-e496fa95841f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1389 microversion: 2.1 time: 0.929679 Jul 24 01:10:52.046142 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 334/680] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:51 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1389 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:52.057502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:52.066312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:52.084291 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf3187e9-4346-43c2-a5fe-962943e584b9 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 0.128835 Jul 24 01:10:52.088885 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 347/681] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:51 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:52.109097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:52.110247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:52.112130 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:52.112858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5efada49-d55b-42a7-9cc9-4c497814b108 req-3207d1cc-fe2b-4609-989f-eaff2d7a730d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117685ac-31fb-41e6-94dc-4efdd3fc0262", "name": "network-vif-plugged", "status": "completed", "tag": "f50c3fdd-6dde-4107-af40-6e69ffd16a5f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:52.117495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:52.143495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5efada49-d55b-42a7-9cc9-4c497814b108 req-3207d1cc-fe2b-4609-989f-eaff2d7a730d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:52.146744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5efada49-d55b-42a7-9cc9-4c497814b108 req-3207d1cc-fe2b-4609-989f-eaff2d7a730d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:52.182091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5efada49-d55b-42a7-9cc9-4c497814b108 req-3207d1cc-fe2b-4609-989f-eaff2d7a730d service nova] Creating event network-vif-plugged:f50c3fdd-6dde-4107-af40-6e69ffd16a5f for instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 on n-h1-master-1 Jul 24 01:10:52.196522 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5efada49-d55b-42a7-9cc9-4c497814b108 req-3207d1cc-fe2b-4609-989f-eaff2d7a730d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102823 Jul 24 01:10:52.199188 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 348/682] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:52.238858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:52.240536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:52.280065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:52.287736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:52.291387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:52.297992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:53.045051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:53.064347 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5fc667e6-0737-4d54-85a3-2052deb18845 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1474 microversion: 2.1 time: 1.010970 Jul 24 01:10:53.067905 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 335/683] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:52 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1474 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:53.093181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6beb50ba-c6b5-4935-89d2-286418383fe8 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:53.094642 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:53.094642 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:10:53.501808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:53.511908 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d875e7db-08bc-42b6-acc6-e8536fd2c966 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 1.311257 Jul 24 01:10:53.518734 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 349/684] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:52 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:53.530178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:53.531205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:53.559683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:53.564374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:53.580613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:53.582221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:53.762028 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6beb50ba-c6b5-4935-89d2-286418383fe8 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/390276043/action" status: 200 len: 21 microversion: 2.1 time: 0.690693 Jul 24 01:10:53.770725 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 336/685] 10.222.0.27 () {60 vars in 1196 bytes} [Sun Jul 24 01:10:53 2022] POST /compute/v2.1/flavors/390276043/action => generated 21 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:10:53.795351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:53.796465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:53.803708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:53.804646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:53.805723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:53.818558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:53.946277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:53.964849 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8fa7274-6b23-40fb-b14a-d111226ce6b4 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1478 microversion: 2.1 time: 0.442772 Jul 24 01:10:53.968611 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 350/686] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:53 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1478 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:54.000398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c5f8938-8a93-4a61-ba86-b6f496f2a373 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb5f6f70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:54.081115 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c5f8938-8a93-4a61-ba86-b6f496f2a373 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1453 microversion: 2.1 time: 0.111111 Jul 24 01:10:54.084591 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 351/687] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:53 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:54.096407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16694dc1-97da-4517-a48d-448600b1effd tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:54.097290 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:54.097290 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:54.144506 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16694dc1-97da-4517-a48d-448600b1effd tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/390276043" status: 202 len: 0 microversion: 2.1 time: 0.058093 Jul 24 01:10:54.152533 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 352/688] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:10:54 2022] DELETE /compute/v2.1/flavors/390276043 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:54.158014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-801ff73b-3dad-4e60-a1d0-cc4ccb19b6fe tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '.version_select at 0x7f05eb53dca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:54.165797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-801ff73b-3dad-4e60-a1d0-cc4ccb19b6fe tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:54.175598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-801ff73b-3dad-4e60-a1d0-cc4ccb19b6fe tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:54.197831 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-801ff73b-3dad-4e60-a1d0-cc4ccb19b6fe tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.042549 Jul 24 01:10:54.199920 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 353/689] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:10:54 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:54.221891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:54.222956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:54.231650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:54.232393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:54.233496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:54.234215 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:54.472510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:54.490316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-164227ad-d442-4123-b050-55929e366102 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1432 microversion: 2.1 time: 0.285557 Jul 24 01:10:54.491627 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 354/690] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:54 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1432 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:54.515906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2fe5a484-4a1a-4217-ac4f-720da2df773d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:54.583600 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2fe5a484-4a1a-4217-ac4f-720da2df773d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.087014 Jul 24 01:10:54.594379 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 355/691] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:10:54 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:54.634319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0ccce128-ead2-41f8-8756-0bf351ecb2e1 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:54.634594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0ccce128-ead2-41f8-8756-0bf351ecb2e1 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:54.643284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:54.652530 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c74d132-eec3-42f6-969f-e2f063b14151 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1588 microversion: 2.1 time: 0.880591 Jul 24 01:10:54.658155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 337/692] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:53 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1588 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:54.679705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ccce128-ead2-41f8-8756-0bf351ecb2e1 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:54.680500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ccce128-ead2-41f8-8756-0bf351ecb2e1 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:54.681610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ccce128-ead2-41f8-8756-0bf351ecb2e1 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:54.683320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ccce128-ead2-41f8-8756-0bf351ecb2e1 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:54.686609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:54.687507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:54.699653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:54.704510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:54.705588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:54.709926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:55.616804 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0ccce128-ead2-41f8-8756-0bf351ecb2e1 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1629 microversion: 2.1 time: 1.018953 Jul 24 01:10:55.631385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 356/693] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:54 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1629 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:55.631385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83e1d9d6-062f-4d53-a595-cc69cab5e5cd tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1344732050", "id": 1066275938, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:55.651814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:55.653880 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:55.653880 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:55.683961 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-213c479e-034e-4c1f-b769-a2647aad9cc3 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 1.020079 Jul 24 01:10:55.686683 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 338/694] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:54 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:55.698774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-24178061-d308-4685-9eba-50812f3e92e5 req-2c4c371a-7134-435f-9bf9-f94e01f769ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b", "name": "network-vif-deleted", "tag": "66d9cb8a-e682-463f-8d7e-19a8fff0c76f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:55.705489 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-83e1d9d6-062f-4d53-a595-cc69cab5e5cd tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.084406 Jul 24 01:10:55.711107 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 357/695] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:55 2022] POST /compute/v2.1/flavors => generated 438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:55.722973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-24178061-d308-4685-9eba-50812f3e92e5 req-2c4c371a-7134-435f-9bf9-f94e01f769ed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:55.724961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-24178061-d308-4685-9eba-50812f3e92e5 req-2c4c371a-7134-435f-9bf9-f94e01f769ed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:55.742707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e308e8ff-ddb2-439f-b321-bfac1da84746 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:55.745418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e308e8ff-ddb2-439f-b321-bfac1da84746 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:55.758362 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-24178061-d308-4685-9eba-50812f3e92e5 req-2c4c371a-7134-435f-9bf9-f94e01f769ed service nova] Creating event network-vif-deleted:66d9cb8a-e682-463f-8d7e-19a8fff0c76f for instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b on n-h1-master-1 Jul 24 01:10:55.761979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e308e8ff-ddb2-439f-b321-bfac1da84746 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:55.763960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e308e8ff-ddb2-439f-b321-bfac1da84746 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:55.767528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e308e8ff-ddb2-439f-b321-bfac1da84746 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:55.768342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e308e8ff-ddb2-439f-b321-bfac1da84746 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:55.770253 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-24178061-d308-4685-9eba-50812f3e92e5 req-2c4c371a-7134-435f-9bf9-f94e01f769ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079032 Jul 24 01:10:55.771383 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 339/696] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:55.787369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6994f938-1668-4e22-b0a3-2f240b835b59 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb562310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:55.998938 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e308e8ff-ddb2-439f-b321-bfac1da84746 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.286360 Jul 24 01:10:56.008498 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 358/697] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:10:55 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8/os-interface => generated 284 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:56.016107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:56.019229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:56.035541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.042204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.045191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.047853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.095989 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:56.155894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.156753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.158056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lazy-loading 'fault' on Instance uuid 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:10:56.313297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fe15455304f4fe4a990a1d32e0d1c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9af5838d3645b2acad12161d65b6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:56.325797 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-876e6d28-f6a0-4f5c-b38d-4ca222b78e75 tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 200 len: 1309 microversion: 2.1 time: 0.315213 Jul 24 01:10:56.330864 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 359/698] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:56 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:56.355735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-62ff438e-14c6-446d-8907-1a342be3a828 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Action: 'create', calling method: .version_select at 0x7f05ebb93a60>, body: {"keypair": {"name": "tempest-keypair-679968791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiI5YKL1x83Lp6f8b8F9bNZjthTfQoZjV+Dk06k5NEE1QIz4D0TGRIc7sTQ7NzINYukl/X6v5vB2UJtvQgbvS66JBE0sKIdXFzlDcNxmGYJvYOrA8AWV4AKf4lxWUqN0w=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:56.463530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-62ff438e-14c6-446d-8907-1a342be3a828 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:10:56.501839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-62ff438e-14c6-446d-8907-1a342be3a828 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for user 40b5fc3b4b6d43ab9342da568567140d and project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:10:56.613281 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-62ff438e-14c6-446d-8907-1a342be3a828 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.280742 Jul 24 01:10:56.630701 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 360/699] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:10:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:56.646908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-993a8eef-2759-4c04-97f7-5247cdbdecef tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:56.647914 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:56.647914 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:56.684274 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-993a8eef-2759-4c04-97f7-5247cdbdecef tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-993a8eef-2759-4c04-97f7-5247cdbdecef tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Request method failure captured: Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/flavors/1066275938/os-flavor-access HTTP/1.1 Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JwWXvlmv7vl6SeeNXBg9KLuYTjfLnL6m98GEFQhprlzs8RBraDGMSQOMj-zGCTL0RYz5YqKRyeykm82gYwpkiY9FF03FIdhjeN8RYfa3tHQRcDafQbriQFQ6viPGskIlDncqj8JZUy76JdzpdmKW6to-DGHrGZsMeHfYAzosqLa5h4 Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 293506e56f5148a2a635e914a25e71d3 Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:10:56.690102 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_293506e56f5148a2a635e914a25e71d3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 293506e56f5148a2a635e914a25e71d3 Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4327bc6f292c43f780d905a55502ed4c Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: exception: Access list not available for public flavors. Jul 24 01:10:56.692525 n-d-master-1 devstack@n-api.service[119561]: action_args: {'flavor_id': '1066275938'} Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 24 01:10:56.693814 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:56.696970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-993a8eef-2759-4c04-97f7-5247cdbdecef tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:56.704992 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-993a8eef-2759-4c04-97f7-5247cdbdecef tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1066275938/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.070018 Jul 24 01:10:56.708504 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 361/700] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:10:56 2022] GET /compute/v2.1/flavors/1066275938/os-flavor-access => generated 91 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:10:56.725476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:56.729191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:56.747826 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.751547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:56.754062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:56.755029 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:58.323327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:58.344789 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf82657e-0eed-4aa4-94ac-c1e44d1d6789 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 1.632636 Jul 24 01:10:58.347456 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 362/701] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:56 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:58.365775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5d5028bc-450a-462f-bfa3-3a40ca132481 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:58.367348 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:58.367348 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:58.393428 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5d5028bc-450a-462f-bfa3-3a40ca132481 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1066275938" status: 202 len: 0 microversion: 2.1 time: 0.044272 Jul 24 01:10:58.394737 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 363/702] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:10:58 2022] DELETE /compute/v2.1/flavors/1066275938 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:58.406985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:58.409334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] [instance: 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:58.423694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:58.430978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:58.432424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:58.434798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:58.482715 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] HTTP exception thrown: Instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b could not be found. Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Request method failure captured: Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b HTTP/1.1 Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JvTRXmtdPEtn5jm5NTJ_xIFNkM47l7yis9WNT7sCeaEhdAJsO8uHCGbJDB4ulwrkzjVF6787iBEuC15VYjQzjQYhkLweDrMJ3SZafD1eR4NZ1P45nY9Qdc_qsb6p4kBUIGELCEuIASoC-Jt3aCSOnmdBU5_cs-4nr9_2zp1OKtPjy8 Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: aa9af5838d3645b2acad12161d65b6bc Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-LiveMigrationNegativeTest-1038257748 Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:10:58.484667 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa9af5838d3645b2acad12161d65b6bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa9af5838d3645b2acad12161d65b6bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa9af5838d3645b2acad12161d65b6bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa9af5838d3645b2acad12161d65b6bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-LiveMigrationNegativeTest-1038257748 Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: aa9af5838d3645b2acad12161d65b6bc Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1038257748 Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-LiveMigrationNegativeTest-1038257748-project Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 7fe15455304f4fe4a990a1d32e0d1c28 Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-LiveMigrationNegativeTest-1038257748-project Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b could not be found. Jul 24 01:10:58.486255 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b'} Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b could not be found. Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:58.487100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b could not be found. Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b could not be found. Jul 24 01:10:58.491200 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:58.494557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] Returning 404 to user: Instance 2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:58.495628 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bd1b681-1e4e-4569-8209-3c0ebedde47b tempest-LiveMigrationNegativeTest-1038257748 tempest-LiveMigrationNegativeTest-1038257748-project] 10.222.0.27 "GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b" status: 404 len: 111 microversion: 2.1 time: 0.099720 Jul 24 01:10:58.496684 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 364/703] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:58 2022] GET /compute/v2.1/servers/2dcbd580-d18b-45ae-a7d7-4709dcfa4f9b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:58.516993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-238fe388-208a-4bb5-9c42-4a3c046a77aa tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:58.565114 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:58.602129 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-238fe388-208a-4bb5-9c42-4a3c046a77aa tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.100410 Jul 24 01:10:58.615298 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 365/704] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:10:58 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:58.632303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f6c9a11e-d7b8-43ad-81ca-9868eacb40c0 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1630703983", "id": 1193937283, "os-flavor-access:is_public": "False"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:58.633960 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:58.633960 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:58.701798 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f6c9a11e-d7b8-43ad-81ca-9868eacb40c0 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.076713 Jul 24 01:10:58.705773 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 366/705] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:58 2022] POST /compute/v2.1/flavors => generated 439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:58.994353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-44fdf216-259d-4566-8a8f-cfe56ac0acf7 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:58.996081 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:58.996081 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:58.998098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-44fdf216-259d-4566-8a8f-cfe56ac0acf7 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bc58047717b243ce9e59242f8275acff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf45e2aa05f4f2aa444be7fd3195e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-44fdf216-259d-4566-8a8f-cfe56ac0acf7 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Request method failure captured: Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/flavors/1193937283/action HTTP/1.1 Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 67 Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JwUlE-aCHZtIAxH68pvj2v0mX70R5X5ksiWywtCFafMsQ8CQyVTAkdZJOikTMa9gRrPXD71Op8B18FZLTMwSHaWXdvm8PdruhKlkJDaIGJ_Tad_uD2uEYfZ_oVZASbr9PX4v3KdHONsPUnXXU3MCskO8sllqYJaWgwfWDG_zLzFJrE Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9bf45e2aa05f4f2aa444be7fd3195e7c Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1571016673 Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:10:59.002356 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bf45e2aa05f4f2aa444be7fd3195e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bf45e2aa05f4f2aa444be7fd3195e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bf45e2aa05f4f2aa444be7fd3195e7c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bf45e2aa05f4f2aa444be7fd3195e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1571016673 Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9bf45e2aa05f4f2aa444be7fd3195e7c Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1571016673 Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsAccessNegativeTestJSON-1571016673-project Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bc58047717b243ce9e59242f8275acff Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1571016673-project Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: {"addTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} Jul 24 01:10:59.003617 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '1193937283', 'body': {'addTenantAccess': {'tenant': '9bf45e2aa05f4f2aa444be7fd3195e7c'}}} Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:10:59.004322 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 24 01:10:59.005871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:10:59.013102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-44fdf216-259d-4566-8a8f-cfe56ac0acf7 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:10:59.023834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-44fdf216-259d-4566-8a8f-cfe56ac0acf7 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] 10.222.0.27 "POST /compute/v2.1/flavors/1193937283/action" status: 403 len: 130 microversion: 2.1 time: 0.312601 Jul 24 01:10:59.028108 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 367/706] 10.222.0.27 () {60 vars in 1199 bytes} [Sun Jul 24 01:10:58 2022] POST /compute/v2.1/flavors/1193937283/action => generated 130 bytes in 317 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:59.033401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86c7b582-1679-4bf8-ac1a-9455732637f2 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:59.034394 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:10:59.034394 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:10:59.092386 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86c7b582-1679-4bf8-ac1a-9455732637f2 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1193937283" status: 202 len: 0 microversion: 2.1 time: 0.062243 Jul 24 01:10:59.093899 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 368/707] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:10:59 2022] DELETE /compute/v2.1/flavors/1193937283 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:10:59.127807 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0a6ca47a-244a-402e-bd56-ba784d925e5e tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:59.210871 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0a6ca47a-244a-402e-bd56-ba784d925e5e tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.096477 Jul 24 01:10:59.211825 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 369/708] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:10:59 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:10:59.235618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bee4b034-f18f-4727-9963-ab77c5c07276 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-363501396", "id": 49624664, "os-flavor-access:is_public": "False"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:59.281504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bee4b034-f18f-4727-9963-ab77c5c07276 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.049540 Jul 24 01:10:59.282962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 370/709] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:10:59 2022] POST /compute/v2.1/flavors => generated 432 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:10:59.297586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c85b75ba-f01a-4382-a543-5aafb9f1e326 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:10:59.712784 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c85b75ba-f01a-4382-a543-5aafb9f1e326 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/49624664/action" status: 200 len: 95 microversion: 2.1 time: 0.419943 Jul 24 01:10:59.719334 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 371/710] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:10:59 2022] POST /compute/v2.1/flavors/49624664/action => generated 95 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:10:59.747226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:10:59.749837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:10:59.771217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:59.772604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:10:59.778721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:10:59.779778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:01.219025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:01.231075 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fe465666-1b6f-4c67-8af7-eac7738aefed tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 1.510283 Jul 24 01:11:01.241519 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 372/711] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:10:59 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:01.248827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4cae6bac-7d69-4e46-81bc-bb0d8f4d86c0 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:01.250278 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:01.250278 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:01.263802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4cae6bac-7d69-4e46-81bc-bb0d8f4d86c0 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bc58047717b243ce9e59242f8275acff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf45e2aa05f4f2aa444be7fd3195e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4cae6bac-7d69-4e46-81bc-bb0d8f4d86c0 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Request method failure captured: Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/flavors/49624664/action HTTP/1.1 Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 70 Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JwUlE-aCHZtIAxH68pvj2v0mX70R5X5ksiWywtCFafMsQ8CQyVTAkdZJOikTMa9gRrPXD71Op8B18FZLTMwSHaWXdvm8PdruhKlkJDaIGJ_Tad_uD2uEYfZ_oVZASbr9PX4v3KdHONsPUnXXU3MCskO8sllqYJaWgwfWDG_zLzFJrE Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9bf45e2aa05f4f2aa444be7fd3195e7c Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1571016673 Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:11:01.265836 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bf45e2aa05f4f2aa444be7fd3195e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bf45e2aa05f4f2aa444be7fd3195e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bf45e2aa05f4f2aa444be7fd3195e7c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bf45e2aa05f4f2aa444be7fd3195e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1571016673 Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9bf45e2aa05f4f2aa444be7fd3195e7c Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1571016673 Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsAccessNegativeTestJSON-1571016673-project Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bc58047717b243ce9e59242f8275acff Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1571016673-project Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: {"removeTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} Jul 24 01:11:01.267086 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '49624664', 'body': {'removeTenantAccess': {'tenant': '9bf45e2aa05f4f2aa444be7fd3195e7c'}}} Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can( Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:11:01.267787 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 24 01:11:01.268914 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:01.270027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4cae6bac-7d69-4e46-81bc-bb0d8f4d86c0 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:01.270027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4cae6bac-7d69-4e46-81bc-bb0d8f4d86c0 tempest-FlavorsAccessNegativeTestJSON-1571016673 tempest-FlavorsAccessNegativeTestJSON-1571016673-project] 10.222.0.27 "POST /compute/v2.1/flavors/49624664/action" status: 403 len: 133 microversion: 2.1 time: 0.033242 Jul 24 01:11:01.288251 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 373/712] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:11:01 2022] POST /compute/v2.1/flavors/49624664/action => generated 133 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:01.300653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3dd0428e-86f4-4255-8388-17eb11ac88f4 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9bf45e2aa05f4f2aa444be7fd3195e7c"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:02.074112 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3dd0428e-86f4-4255-8388-17eb11ac88f4 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/49624664/action" status: 200 len: 21 microversion: 2.1 time: 0.781539 Jul 24 01:11:02.074814 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 374/713] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:11:01 2022] POST /compute/v2.1/flavors/49624664/action => generated 21 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:11:02.105037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:02.107181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:02.133074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:02.135524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:02.143522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:02.146530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:02.520824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:02.535584 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7907f6a0-3be2-4c0e-ad46-c29156714699 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1588 microversion: 2.1 time: 0.451774 Jul 24 01:11:02.538873 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 375/714] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:02 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1588 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:02.545001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-38dd9f0f-46d8-49ab-a907-3abaf49e98a2 req-945e2a56-8f8c-4874-86dc-80e0a3fd2d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b68f333-31cf-4daf-8dad-2a4c759bddd8", "tag": "b8c94a54-3902-46c3-b698-8f8b474bdf76"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:02.593366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-38dd9f0f-46d8-49ab-a907-3abaf49e98a2 req-945e2a56-8f8c-4874-86dc-80e0a3fd2d2d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:02.594041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-38dd9f0f-46d8-49ab-a907-3abaf49e98a2 req-945e2a56-8f8c-4874-86dc-80e0a3fd2d2d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:02.613200 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-38dd9f0f-46d8-49ab-a907-3abaf49e98a2 req-945e2a56-8f8c-4874-86dc-80e0a3fd2d2d service nova] Creating event network-changed:b8c94a54-3902-46c3-b698-8f8b474bdf76 for instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 on n-h2-master-1 Jul 24 01:11:02.638135 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-38dd9f0f-46d8-49ab-a907-3abaf49e98a2 req-945e2a56-8f8c-4874-86dc-80e0a3fd2d2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097591 Jul 24 01:11:02.657529 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 376/715] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:02.678125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e279974a-f90c-4d24-91bf-33e83b697682 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:02.685749 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:02.685749 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:02.733020 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e279974a-f90c-4d24-91bf-33e83b697682 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/49624664" status: 202 len: 0 microversion: 2.1 time: 0.073169 Jul 24 01:11:02.733726 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 377/716] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:11:02 2022] DELETE /compute/v2.1/flavors/49624664 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:02.749783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:02.751067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:02.768479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:02.769209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:02.772579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:02.780724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:03.218837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:03.234172 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0951441d-4306-4842-b197-4c84a276fb28 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 0.499093 Jul 24 01:11:03.240613 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 378/717] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:02 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:03.249797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b6c6e57-f271-4e9a-a8e2-9f6e35a0749d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:03.341646 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5b6c6e57-f271-4e9a-a8e2-9f6e35a0749d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.099262 Jul 24 01:11:03.345213 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 379/718] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:11:03 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:03.358013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-159029727", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "0b0a25ed-fae4-4f81-a013-333d811349fa"}], "security_groups": [{"name": "tempest-securitygroup--1276551576"}], "key_name": "tempest-keypair-679968791", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:05.715335 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:05.740257 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:06.545011 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:08.904714 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6994f938-1668-4e22-b0a3-2f240b835b59 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1462 microversion: 2.1 time: 13.128778 Jul 24 01:11:08.915469 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 340/719] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:55 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1462 bytes in 13143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:08.938454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25e00fdc-5323-40cd-a558-05c07ae81189 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-609402990", "id": 101098887, "os-flavor-access:is_public": "False"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:08.940399 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:08.940399 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:11:08.969360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-25e00fdc-5323-40cd-a558-05c07ae81189 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.052555 Jul 24 01:11:08.974955 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 341/720] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:08 2022] POST /compute/v2.1/flavors => generated 435 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:08.984565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:08.985608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:08.995536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:08.996746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:08.997937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:08.998562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:09.036302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] validate_networks() for [('0b0a25ed-fae4-4f81-a013-333d811349fa', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:11:09.529251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:09.544269 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-875fa5a9-14cc-4d88-b7f6-07221ff0fb7a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 0.566748 Jul 24 01:11:09.555478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 342/721] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:08 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:09.707806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f977b748-83f9-4a04-a864-8e0412b156a6 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb69cf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:09.812388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f977b748-83f9-4a04-a864-8e0412b156a6 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:09.812388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f977b748-83f9-4a04-a864-8e0412b156a6 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:09.813185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f977b748-83f9-4a04-a864-8e0412b156a6 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:09.813640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f977b748-83f9-4a04-a864-8e0412b156a6 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:09.872956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:11:09.873480 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:11:09.874146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:11:09.874648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:11:09.875075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:11:09.888643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:09.889342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:09.889556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f977b748-83f9-4a04-a864-8e0412b156a6 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90" status: 200 len: 240 microversion: 2.36 time: 0.332469 Jul 24 01:11:09.895005 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 343/722] 10.222.0.27 () {62 vars in 1302 bytes} [Sun Jul 24 01:11:09 2022] PUT /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90 => generated 240 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:09.896322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:09.897580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:09.919722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:09.928665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for user 40b5fc3b4b6d43ab9342da568567140d and project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:09.947764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:11:09.950844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:11:09.985299 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1509730376", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:10.030773 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8d8954c-473a-4611-baa3-0257d0381eb6 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 6.683629 Jul 24 01:11:10.031607 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 380/723] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 6686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:11:10.036837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-acea056f-29d1-41d6-ba18-ddaa9cc1cb05 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb53db80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:10.111792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] validate_networks() for [('1d90afb7-a614-4f6a-ab1f-4bbd8730a637', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:11:10.143830 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-acea056f-29d1-41d6-ba18-ddaa9cc1cb05 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 200 len: 1462 microversion: 2.1 time: 0.110650 Jul 24 01:11:10.145446 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 381/724] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:10 2022] GET /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:10.155432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4cd22358-0625-491f-ae30-a6e4f148a024 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8294ba72d7624d8baf9148c515f61005"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:10.157969 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:10.157969 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:10.396504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4cd22358-0625-491f-ae30-a6e4f148a024 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] HTTP exception thrown: Flavor access not found for 36 / 8294ba72d7624d8baf9148c515f61005 combination. Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4cd22358-0625-491f-ae30-a6e4f148a024 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Request method failure captured: Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/flavors/101098887/action HTTP/1.1 Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 70 Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JwWXvlmv7vl6SeeNXBg9KLuYTjfLnL6m98GEFQhprlzs8RBraDGMSQOMj-zGCTL0RYz5YqKRyeykm82gYwpkiY9FF03FIdhjeN8RYfa3tHQRcDafQbriQFQ6viPGskIlDncqj8JZUy76JdzpdmKW6to-DGHrGZsMeHfYAzosqLa5h4 Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 293506e56f5148a2a635e914a25e71d3 Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:11:10.399556 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_293506e56f5148a2a635e914a25e71d3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/293506e56f5148a2a635e914a25e71d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 293506e56f5148a2a635e914a25e71d3 Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-808867611 Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4327bc6f292c43f780d905a55502ed4c Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: {"removeTenantAccess": {"tenant": "8294ba72d7624d8baf9148c515f61005"}} Jul 24 01:11:10.400767 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: exception: Flavor access not found for 36 / 8294ba72d7624d8baf9148c515f61005 combination. Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '101098887', 'body': {'removeTenantAccess': {'tenant': '8294ba72d7624d8baf9148c515f61005'}}} Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 24 01:11:10.401465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 8294ba72d7624d8baf9148c515f61005 combination. Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 8294ba72d7624d8baf9148c515f61005 combination. Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:10.402505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 8294ba72d7624d8baf9148c515f61005 combination. Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4cd22358-0625-491f-ae30-a6e4f148a024 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Returning 404 to user: Flavor access not found for 36 / 8294ba72d7624d8baf9148c515f61005 combination. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:10.403711 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4cd22358-0625-491f-ae30-a6e4f148a024 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/101098887/action" status: 404 len: 124 microversion: 2.1 time: 0.253937 Jul 24 01:11:10.410255 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 382/725] 10.222.0.27 () {60 vars in 1196 bytes} [Sun Jul 24 01:11:10 2022] POST /compute/v2.1/flavors/101098887/action => generated 124 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:10.415679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-26d62eb8-60db-4002-8b81-09c47feca6ff tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Calling method '.version_select at 0x7f05eb5f6820>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:10.542318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26d62eb8-60db-4002-8b81-09c47feca6ff tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:10.546167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26d62eb8-60db-4002-8b81-09c47feca6ff tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:10.547370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26d62eb8-60db-4002-8b81-09c47feca6ff tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:10.550542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26d62eb8-60db-4002-8b81-09c47feca6ff tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:10.611751 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-26d62eb8-60db-4002-8b81-09c47feca6ff tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90/detail" status: 200 len: 672 microversion: 2.36 time: 0.197438 Jul 24 01:11:10.614239 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 383/726] 10.222.0.27 () {60 vars in 1303 bytes} [Sun Jul 24 01:11:10 2022] GET /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90/detail => generated 672 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:10.628204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-65e6078a-ebba-47aa-9aaf-f634adf47229 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:10.628888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-65e6078a-ebba-47aa-9aaf-f634adf47229 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:10.751080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-65e6078a-ebba-47aa-9aaf-f634adf47229 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:10.763016 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-65e6078a-ebba-47aa-9aaf-f634adf47229 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1233 microversion: 2.1 time: 0.143117 Jul 24 01:11:10.764336 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 384/727] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:10 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1233 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:10.772805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:10.777993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:10.785035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:10.785913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:10.787088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:10.788347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:10.958063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:11:10.960382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:11:10.961088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:11:10.961775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:11:10.963925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:11:10.977007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:10.977832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:10.978902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:10.979567 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.011984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Getting quotas for project aa4e8e174a104e60a0c40a83bd2235fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:11.018202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Getting quotas for user 23333c1ebbdf4ddab9d21d5b8b7139e6 and project aa4e8e174a104e60a0c40a83bd2235fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:11.051191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:11:11.068291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:11:11.082500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:11.145577 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ee1e3f11-0f6e-4575-8425-7e4e3f4d185c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1467 microversion: 2.1 time: 0.379842 Jul 24 01:11:11.166459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 385/728] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:10 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1467 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:11.182935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fe7adcea-1ff5-4524-a093-e93802cfae9c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:11.191450 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:11.191450 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:11.194698 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa17ca11-feac-4886-b714-ba3b6e827dd7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303068 Jul 24 01:11:11.200797 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 344/729] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:11:11.206329 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:11.207244 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:11.217747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.218789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.219825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.220650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.259398 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fe7adcea-1ff5-4524-a093-e93802cfae9c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/101098887" status: 202 len: 0 microversion: 2.1 time: 0.100350 Jul 24 01:11:11.264447 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 386/730] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:11:11 2022] DELETE /compute/v2.1/flavors/101098887 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:11.277977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb7499d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:11.400701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.401193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.402112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.402549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.502244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.502705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.503517 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.503960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.529962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:11.544531 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b20b0c44-68ae-4343-a5dc-c12a3ce52868 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 0.340299 Jul 24 01:11:11.546030 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 345/731] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:11 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:11.552486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd378c36-e7fd-4235-ab77-e43bbe4d74ba tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2069584188"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:11.555175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd378c36-e7fd-4235-ab77-e43bbe4d74ba tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:11.564460 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:11.567783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd378c36-e7fd-4235-ab77-e43bbe4d74ba tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.568951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd378c36-e7fd-4235-ab77-e43bbe4d74ba tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.570026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd378c36-e7fd-4235-ab77-e43bbe4d74ba tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:11.570541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd378c36-e7fd-4235-ab77-e43bbe4d74ba tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:11.742526 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-334bca52-f36e-48ed-a9ec-311dd5e37b66 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90?user_id=00df0c633f274fef9e555422ed3a8eb6" status: 200 len: 240 microversion: 2.36 time: 0.473954 Jul 24 01:11:11.744453 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 387/732] 10.222.0.27 () {62 vars in 1383 bytes} [Sun Jul 24 01:11:11 2022] PUT /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90?user_id=00df0c633f274fef9e555422ed3a8eb6 => generated 240 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:11.758591 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a39c30ce-f51d-42cd-841a-6c1bbdade35a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:11.759408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a39c30ce-f51d-42cd-841a-6c1bbdade35a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:11.947947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a39c30ce-f51d-42cd-841a-6c1bbdade35a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:11.957115 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a39c30ce-f51d-42cd-841a-6c1bbdade35a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1224 microversion: 2.1 time: 0.211672 Jul 24 01:11:11.962178 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 388/733] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:11 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1224 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:11.973422 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-73d99570-984a-459c-adb2-7ffd5b564cd3 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:12.043070 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-73d99570-984a-459c-adb2-7ffd5b564cd3 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.077982 Jul 24 01:11:12.045380 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 389/734] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:11:11 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:12.058568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-639a517f-dff8-4da4-8fc2-c98ee88bf988 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Calling method '.version_select at 0x7f05eb6a8670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:12.360525 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-639a517f-dff8-4da4-8fc2-c98ee88bf988 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90?user_id=00df0c633f274fef9e555422ed3a8eb6" status: 200 len: 282 microversion: 2.36 time: 0.308561 Jul 24 01:11:12.368959 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 390/735] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Jul 24 01:11:12 2022] GET /compute/v2.1/os-quota-sets/243b5970fb764475bae2ef144a49cf90?user_id=00df0c633f274fef9e555422ed3a8eb6 => generated 282 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:12.380469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:12.383791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:12.403510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:12.404023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:12.404849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:12.405285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:12.491874 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd378c36-e7fd-4235-ab77-e43bbe4d74ba tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "POST /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1/action" status: 202 len: 0 microversion: 2.1 time: 0.935791 Jul 24 01:11:12.496151 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 346/736] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:11:11 2022] POST /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:11:12.556889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-625fc18c-0d72-48a6-a3ed-ff16348e3de7 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb607940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:12.659052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:12.668186 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a1427e6c-bef0-454f-bb24-9cae7d11aa10 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1291 microversion: 2.1 time: 0.297914 Jul 24 01:11:12.674082 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 391/737] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:12 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1291 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:12.688285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:12.692197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:12.722495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:12.731306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:12.735009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:12.739451 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:12.794042 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-625fc18c-0d72-48a6-a3ed-ff16348e3de7 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.292970 Jul 24 01:11:12.799765 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 347/738] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:12 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:12.986936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:12.989690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:13.078428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:13.079436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:13.080480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:13.081099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:13.309592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:13.323939 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a06f187-8ba4-4479-a054-36deac21fc04 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 0.648023 Jul 24 01:11:13.342242 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 392/739] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:12 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:13.367883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:13.391334 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c4c0d8ce-6d26-494f-b9bf-b1d84fd8a931 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1276 microversion: 2.1 time: 0.416465 Jul 24 01:11:13.397602 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 348/740] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:12 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1276 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:13.696520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:13.697147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:13.712937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:13.715918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:13.718450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:13.725960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:13.809424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ddca2447-87e2-4ac3-a277-144abcd72d45 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb687040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:13.908506 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ddca2447-87e2-4ac3-a277-144abcd72d45 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.104284 Jul 24 01:11:13.909113 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 349/741] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:13 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:14.217589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:14.227241 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6bb5689b-5e27-44dc-ba2b-36147c8044e7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1291 microversion: 2.1 time: 0.544146 Jul 24 01:11:14.229866 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 393/742] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:13 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1291 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:14.264246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7f96e4ed-f23e-4076-ab77-c5fbc5bfcfb1 req-3b8f1c93-4f25-4848-9ccb-0c5d2fe53df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117685ac-31fb-41e6-94dc-4efdd3fc0262", "name": "network-vif-unplugged", "status": "completed", "tag": "f50c3fdd-6dde-4107-af40-6e69ffd16a5f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:14.300646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7f96e4ed-f23e-4076-ab77-c5fbc5bfcfb1 req-3b8f1c93-4f25-4848-9ccb-0c5d2fe53df7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:14.301163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7f96e4ed-f23e-4076-ab77-c5fbc5bfcfb1 req-3b8f1c93-4f25-4848-9ccb-0c5d2fe53df7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:14.324751 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7f96e4ed-f23e-4076-ab77-c5fbc5bfcfb1 req-3b8f1c93-4f25-4848-9ccb-0c5d2fe53df7 service nova] Creating event network-vif-unplugged:f50c3fdd-6dde-4107-af40-6e69ffd16a5f for instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 on n-h1-master-1 Jul 24 01:11:14.341886 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7f96e4ed-f23e-4076-ab77-c5fbc5bfcfb1 req-3b8f1c93-4f25-4848-9ccb-0c5d2fe53df7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079014 Jul 24 01:11:14.347743 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 350/743] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:14.357474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:14.363355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:14.392136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:14.392868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:14.393837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:14.394439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:14.436191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:14.437598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:14.456938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:14.457929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:14.459992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:14.464819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:14.697800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:14.732321 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a56447ec-cd35-4600-97b5-c694090edd06 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1282 microversion: 2.1 time: 0.315560 Jul 24 01:11:14.736844 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 351/744] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:14 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1282 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:14.855576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:14.873288 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-edd4e182-b6d8-4f3d-beef-695afdf56be5 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1472 microversion: 2.1 time: 0.526509 Jul 24 01:11:14.884817 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 394/745] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:14 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1472 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:14.927597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ccf96b7e-ec81-4c0a-b41b-9c3f52471849 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb7498b0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:14.989410 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ccf96b7e-ec81-4c0a-b41b-9c3f52471849 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.070777 Jul 24 01:11:14.990946 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 395/746] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:14 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:15.060420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b885d46c-37f9-46a9-a947-a8c68e74326b tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Action: 'create', calling method: .version_select at 0x7f05eb687550>, body: {"keypair": {"name": "tempest-keypair-1598550670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsWWaA7da96WmhqD1WrK+PBE1hLAY0ipUJPYBYukTmp2HJUMyKjUgFaFxkvrNFJT371q+Nt4I7v3K9Us/NKPSP4liPbk6ShwvsXeFcRjPnjM4ey7GyNJfXCcUJDEfgU3A=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:15.098202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b885d46c-37f9-46a9-a947-a8c68e74326b tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Getting quotas for project 6c9db762e4c14d538ea1c9de1b204c95. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:15.128486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b885d46c-37f9-46a9-a947-a8c68e74326b tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Getting quotas for user 01b0f82f73ea4c14a51c5481e78d4493 and project 6c9db762e4c14d538ea1c9de1b204c95. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:15.189545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b885d46c-37f9-46a9-a947-a8c68e74326b tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.450814 Jul 24 01:11:15.194414 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 352/747] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:11:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:15.248769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:15.249751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:15.257579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:15.258329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:15.259556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:15.260311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:15.612516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:15.627738 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32369d6a-0314-4f7d-bddf-39e51be6e942 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.384027 Jul 24 01:11:15.638808 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 396/748] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:15 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:15.752919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:15.753546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:15.768109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:15.770229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:15.772815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:15.774248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:15.891981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:15.893363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:15.900601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:15.901149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:15.902036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:15.902718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:16.127493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:16.142774 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cbfc1def-bef0-4b48-b53a-ef06d4dab653 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 0.394221 Jul 24 01:11:16.146029 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 353/749] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:15 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:16.154914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a5b5955-a9e1-47c1-b6a5-ee8b21978ba6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb633700>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:16.245726 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4a5b5955-a9e1-47c1-b6a5-ee8b21978ba6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.098412 Jul 24 01:11:16.256443 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 354/750] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:16 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:16.316346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:16.326915 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b5c505e-2680-4e08-82db-187a0111e305 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1478 microversion: 2.1 time: 0.439053 Jul 24 01:11:16.327748 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 397/751] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:15 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1478 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:16.645472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:16.646148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:16.661923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:16.665656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:16.666769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:16.667372 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:17.047683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:17.059708 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5cb071b4-e001-42ea-80af-a40dcf32e765 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.417958 Jul 24 01:11:17.061176 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 355/752] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:16 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:17.159455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:17.160259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:17.171886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:17.173609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:17.174605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:17.176508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:17.271092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1aebe5ff-d621-4b43-870c-18ef92b4ffbb tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb6338b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:17.359603 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1aebe5ff-d621-4b43-870c-18ef92b4ffbb tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.092824 Jul 24 01:11:17.360819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 356/753] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:17 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:17.369641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-75fd62ce-1f0c-4031-bb54-dd16d2f1d43b req-c8b64900-d864-4e70-96a4-bef354f7c8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5", "tag": "32fa2173-df2d-4d45-b2f8-9c6046b137ea"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:17.383713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-75fd62ce-1f0c-4031-bb54-dd16d2f1d43b req-c8b64900-d864-4e70-96a4-bef354f7c8fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:17.397434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-75fd62ce-1f0c-4031-bb54-dd16d2f1d43b req-c8b64900-d864-4e70-96a4-bef354f7c8fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:17.411537 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-75fd62ce-1f0c-4031-bb54-dd16d2f1d43b req-c8b64900-d864-4e70-96a4-bef354f7c8fb service nova] Creating event network-changed:32fa2173-df2d-4d45-b2f8-9c6046b137ea for instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 on n-h2-master-1 Jul 24 01:11:17.425022 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-75fd62ce-1f0c-4031-bb54-dd16d2f1d43b req-c8b64900-d864-4e70-96a4-bef354f7c8fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062772 Jul 24 01:11:17.426313 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 357/754] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:17.435853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:17.436982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:17.456460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:17.458491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:17.460930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:17.461627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:17.588228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:17.603991 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4e39978a-19fe-4355-9754-e33024ec75e5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 0.448332 Jul 24 01:11:17.605108 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 398/755] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:17 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:17.611049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-068d2c34-1030-458f-b103-1ea59942a272 req-c8706ccd-4696-4415-bfec-fd5693f13160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c4c870-8606-4888-81ee-c2a835a28957", "tag": "d4d5f9d8-92d8-4655-b5b7-0152abef78c0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:17.625921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-068d2c34-1030-458f-b103-1ea59942a272 req-c8706ccd-4696-4415-bfec-fd5693f13160 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:17.626887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-068d2c34-1030-458f-b103-1ea59942a272 req-c8706ccd-4696-4415-bfec-fd5693f13160 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:17.646203 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-068d2c34-1030-458f-b103-1ea59942a272 req-c8706ccd-4696-4415-bfec-fd5693f13160 service nova] Creating event network-changed:d4d5f9d8-92d8-4655-b5b7-0152abef78c0 for instance 38c4c870-8606-4888-81ee-c2a835a28957 on n-h2-master-1 Jul 24 01:11:17.681619 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-068d2c34-1030-458f-b103-1ea59942a272 req-c8706ccd-4696-4415-bfec-fd5693f13160 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073487 Jul 24 01:11:17.682503 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 399/756] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:17.817548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:17.829772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85ee3f75-879b-47f4-9df6-5e3e680e91f0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1478 microversion: 2.1 time: 0.401572 Jul 24 01:11:17.830615 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 358/757] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:17 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1478 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:18.085363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:18.086526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:18.094088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:18.094952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:18.096384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:18.097062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:18.373569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bd386bb-f132-4de8-bdcc-663e7ca04935 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb698430>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:18.470167 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3bd386bb-f132-4de8-bdcc-663e7ca04935 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.100236 Jul 24 01:11:18.470908 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 359/758] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:18 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:18.606258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:18.614710 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-821dbfb1-fcc1-4e0b-991f-052c949f0403 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.533775 Jul 24 01:11:18.625588 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 400/759] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:18 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:18.625707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:18.625707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:18.634688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:18.637490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:18.640034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:18.641348 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:18.647136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0ac432c1-130e-46cf-a0ec-a47198e5c25f req-8c5c2c0d-cd4d-4f1c-9563-0adda85821ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47daf830-dbdf-42ca-ab4a-7fa63658b66a", "name": "network-vif-unplugged", "status": "completed", "tag": "d50c538b-1612-4fad-b54b-93a3c2ceaccb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:18.657857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0ac432c1-130e-46cf-a0ec-a47198e5c25f req-8c5c2c0d-cd4d-4f1c-9563-0adda85821ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:18.658611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0ac432c1-130e-46cf-a0ec-a47198e5c25f req-8c5c2c0d-cd4d-4f1c-9563-0adda85821ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:18.665946 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:18.677178 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0ac432c1-130e-46cf-a0ec-a47198e5c25f req-8c5c2c0d-cd4d-4f1c-9563-0adda85821ad service nova] Creating event network-vif-unplugged:d50c538b-1612-4fad-b54b-93a3c2ceaccb for instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a on n-h1-master-1 Jul 24 01:11:18.684924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0ac432c1-130e-46cf-a0ec-a47198e5c25f req-8c5c2c0d-cd4d-4f1c-9563-0adda85821ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045337 Jul 24 01:11:18.685742 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 401/760] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:18.848326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:18.849303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:18.854824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:18.860314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:18.861283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:18.862934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:18.863600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:18.865303 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78a3366e-46ba-4839-8a00-17ad4574f9cc tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 0.245292 Jul 24 01:11:18.867105 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 360/761] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:18 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:19.094113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:19.110946 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6f28a84-e595-4e66-9e08-41bb5ef18e0c tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1478 microversion: 2.1 time: 0.267066 Jul 24 01:11:19.132618 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 402/762] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:18 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1478 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:19.484473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c501880-109e-4d78-9069-1e11ce35def4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb589280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:19.542560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c501880-109e-4d78-9069-1e11ce35def4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.060579 Jul 24 01:11:19.549928 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 361/763] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:19 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:19.632837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:19.633643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1608885603", "imageRef": "9a4644e2-4fa2-45b3-b376-66c09b6b671a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8e061be9-77d7-4807-96d0-03a806e87259"}], "security_groups": [{"name": "tempest-securitygroup--1955736685"}], "key_name": "tempest-keypair-1598550670", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:19.634435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:19.642267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:19.642936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:19.643954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:19.644833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:19.826247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:19.826998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] validate_networks() for [('8e061be9-77d7-4807-96d0-03a806e87259', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:11:19.838292 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4645df63-571b-4831-8587-f57bf5f58fa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.207703 Jul 24 01:11:19.838904 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 362/764] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:19 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:19.883277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:19.886146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:19.895734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:19.896985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:19.898187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:19.898710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.207418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:20.221179 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-616e7a3a-38c8-4520-86e9-f5e0796a1fb1 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 0.343057 Jul 24 01:11:20.222293 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 363/765] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:19 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:20.244022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:20.245096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:20.264535 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:20.265750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.272422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:20.277328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.651535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:20.659399 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ca5d91b6-d8ef-45f3-9c78-565123b147a4 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1478 microversion: 2.1 time: 0.435802 Jul 24 01:11:20.659983 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 364/766] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:20 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1478 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:20.669582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-483cf636-ffe5-497b-8634-dff4efb71893 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb562940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:20.721777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:11:20.723060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:11:20.723985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:11:20.725532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:11:20.726747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:11:20.738111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:20.738938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.739740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:20.740231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.745357 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-483cf636-ffe5-497b-8634-dff4efb71893 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.080271 Jul 24 01:11:20.746448 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 365/767] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:20 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:20.760141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-41038e86-092f-4856-99f5-e43577482925 req-9e4d8009-85d4-48c5-923a-c2b579ac2bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47daf830-dbdf-42ca-ab4a-7fa63658b66a", "name": "network-vif-plugged", "status": "completed", "tag": "d50c538b-1612-4fad-b54b-93a3c2ceaccb"}, {"server_uuid": "4aac0c96-8aae-4ed3-bdd5-485b94e89ec1", "name": "network-vif-plugged", "status": "completed", "tag": "03895dd8-dd4b-4e93-9101-5db60f3eb869"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:20.772761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-41038e86-092f-4856-99f5-e43577482925 req-9e4d8009-85d4-48c5-923a-c2b579ac2bb1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:20.773600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-41038e86-092f-4856-99f5-e43577482925 req-9e4d8009-85d4-48c5-923a-c2b579ac2bb1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.791402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-41038e86-092f-4856-99f5-e43577482925 req-9e4d8009-85d4-48c5-923a-c2b579ac2bb1 service nova] Creating event network-vif-plugged:d50c538b-1612-4fad-b54b-93a3c2ceaccb for instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a on n-h1-master-1 Jul 24 01:11:20.792190 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-41038e86-092f-4856-99f5-e43577482925 req-9e4d8009-85d4-48c5-923a-c2b579ac2bb1 service nova] Creating event network-vif-plugged:03895dd8-dd4b-4e93-9101-5db60f3eb869 for instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 on n-h2-master-1 Jul 24 01:11:20.802054 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-41038e86-092f-4856-99f5-e43577482925 req-9e4d8009-85d4-48c5-923a-c2b579ac2bb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053877 Jul 24 01:11:20.803967 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 366/768] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:20.812215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Getting quotas for project 6c9db762e4c14d538ea1c9de1b204c95. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:20.831643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Getting quotas for user 01b0f82f73ea4c14a51c5481e78d4493 and project 6c9db762e4c14d538ea1c9de1b204c95. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:20.857326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:11:20.857609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:20.858476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:20.861701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a4644e2-4fa2-45b3-b376-66c09b6b671a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:11:20.869716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:20.871941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.872887 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:20.875220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:20.966151 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-afa28146-f47d-4099-83c5-386d951c2b59 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.338693 Jul 24 01:11:20.976978 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 403/769] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:11:20.991838 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:21.004695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9ed6799-e3cf-4795-a3d5-b0f084975840 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:21.007253 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9ed6799-e3cf-4795-a3d5-b0f084975840 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:21.163245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9ed6799-e3cf-4795-a3d5-b0f084975840 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:21.178083 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9ed6799-e3cf-4795-a3d5-b0f084975840 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1246 microversion: 2.1 time: 0.187290 Jul 24 01:11:21.181795 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 404/770] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:20 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1246 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:21.257484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:21.274212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a11e31f6-9479-4f65-afb2-6bebccadf4ce tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.421634 Jul 24 01:11:21.274810 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 367/771] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:20 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:21.282001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:21.282621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:21.297013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:21.297893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:21.299672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:21.300313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:21.343992 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:21.527291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:21.528793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d492698f-b172-45f2-8245-557576e78af2 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1981953006", "id": 801122641, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:21.530869 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:21.530869 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:21.537528 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d91f5c0-1b3b-4414-a5ed-b037401f46e7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 0.261302 Jul 24 01:11:21.538579 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 368/772] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:21 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:21.559499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d492698f-b172-45f2-8245-557576e78af2 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.376154 Jul 24 01:11:21.560418 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 405/773] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:11:21 2022] POST /compute/v2.1/flavors => generated 446 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:21.624451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-566a66af-111e-4b2b-94b9-ed751c87c613 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb59f040>, body: {"quota_set": {"ram": "5120"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:21.704698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-566a66af-111e-4b2b-94b9-ed751c87c613 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:21.705318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-566a66af-111e-4b2b-94b9-ed751c87c613 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:21.706158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-566a66af-111e-4b2b-94b9-ed751c87c613 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:21.706663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-566a66af-111e-4b2b-94b9-ed751c87c613 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:21.753414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43bcd7ae-267e-4721-b600-412fcf27f893 tempest-FlavorsV255TestJSON-1985736297 tempest-FlavorsV255TestJSON-1985736297-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:21.762356 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43bcd7ae-267e-4721-b600-412fcf27f893 tempest-FlavorsV255TestJSON-1985736297 tempest-FlavorsV255TestJSON-1985736297-project] 10.222.0.27 "GET /compute/v2.1/flavors/801122641" status: 200 len: 446 microversion: 2.55 time: 0.194477 Jul 24 01:11:21.763010 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 406/774] 10.222.0.27 () {60 vars in 1195 bytes} [Sun Jul 24 01:11:21 2022] GET /compute/v2.1/flavors/801122641 => generated 446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:11:21.767842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:21.768454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:21.771288 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-566a66af-111e-4b2b-94b9-ed751c87c613 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853" status: 200 len: 148 microversion: 2.57 time: 0.231265 Jul 24 01:11:21.771912 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 369/775] 10.222.0.27 () {62 vars in 1302 bytes} [Sun Jul 24 01:11:21 2022] PUT /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853 => generated 148 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:21.775078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:21.775723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:21.776929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:21.777074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e4767885-e572-4ad3-8b93-c95a2444bb6e tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb59f820>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:21.777376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:21.830937 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e4767885-e572-4ad3-8b93-c95a2444bb6e tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.057426 Jul 24 01:11:21.831886 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 370/776] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:21 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:21.842555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-55cf60f7-2dab-4e88-a08b-54cfaffbce85 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] Action: 'update', calling method: .version_select at 0x7f05fa02e3a0>, body: {"flavor": {"description": "new"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:21.853930 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:21.853930 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:11:21.879205 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:21.935590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:21.944425 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f6bcdfc-aac9-4796-b34c-611f831d1f0a tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1478 microversion: 2.1 time: 0.180159 Jul 24 01:11:21.945709 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 407/777] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:21 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1478 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:21.950677 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-724d6ce6-58da-4b22-9c27-ea5ef31312ae tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Calling method '.version_select at 0x7f05eb5f60d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.026201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724d6ce6-58da-4b22-9c27-ea5ef31312ae tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.027194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724d6ce6-58da-4b22-9c27-ea5ef31312ae tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.031298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724d6ce6-58da-4b22-9c27-ea5ef31312ae tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.031298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724d6ce6-58da-4b22-9c27-ea5ef31312ae tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.059555 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-724d6ce6-58da-4b22-9c27-ea5ef31312ae tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853/detail" status: 200 len: 463 microversion: 2.57 time: 0.112534 Jul 24 01:11:22.060192 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 408/778] 10.222.0.27 () {60 vars in 1303 bytes} [Sun Jul 24 01:11:21 2022] GET /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853/detail => generated 463 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:22.060755 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-55cf60f7-2dab-4e88-a08b-54cfaffbce85 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/801122641" status: 200 len: 447 microversion: 2.55 time: 0.222547 Jul 24 01:11:22.061432 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 371/779] 10.222.0.27 () {62 vars in 1215 bytes} [Sun Jul 24 01:11:21 2022] PUT /compute/v2.1/flavors/801122641 => generated 447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:22.073602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fa9e68b-f003-446d-8a39-2fe5b7bc7e7b tempest-FlavorsV255TestJSON-1985736297 tempest-FlavorsV255TestJSON-1985736297-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.099479 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3fa9e68b-f003-446d-8a39-2fe5b7bc7e7b tempest-FlavorsV255TestJSON-1985736297 tempest-FlavorsV255TestJSON-1985736297-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.029895 Jul 24 01:11:22.111129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 409/780] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:11:22.121590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4bba36ed-c454-45e3-94fb-41d1a221e2e7 tempest-FlavorsV255TestJSON-1985736297 tempest-FlavorsV255TestJSON-1985736297-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.157942 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4bba36ed-c454-45e3-94fb-41d1a221e2e7 tempest-FlavorsV255TestJSON-1985736297 tempest-FlavorsV255TestJSON-1985736297-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.042910 Jul 24 01:11:22.158835 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 372/781] 10.222.0.27 () {60 vars in 1165 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:11:22.174690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3259fd65-1bff-4125-9985-046ab3c83de3 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.175775 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:22.175775 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:22.198391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.199405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:22.204716 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3259fd65-1bff-4125-9985-046ab3c83de3 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/801122641" status: 202 len: 0 microversion: 2.55 time: 0.034193 Jul 24 01:11:22.207106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.207783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.209394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.209621 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 410/782] 10.222.0.27 () {60 vars in 1198 bytes} [Sun Jul 24 01:11:22 2022] DELETE /compute/v2.1/flavors/801122641 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:11:22.210587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.218440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e4ef698-38f7-4eec-bcd8-3a1ebfe53e63 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.256330 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e4ef698-38f7-4eec-bcd8-3a1ebfe53e63 tempest-FlavorsV255TestJSON-1301662902 tempest-FlavorsV255TestJSON-1301662902-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.045130 Jul 24 01:11:22.256922 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 411/783] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:11:22.264293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb72b940>, body: {"quota_set": {"ram": "2048"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:22.286055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:22.294791 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f54782a-af88-4cb9-9b2d-3443fdfd54fa tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1242 microversion: 2.1 time: 0.103646 Jul 24 01:11:22.306604 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 373/784] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:22.320427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.321070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:22.330790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.331247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.332099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.332712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.411397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.412731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.413853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.414578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.471343 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:22.520621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.521403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.522766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.523496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.600161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:22.609907 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fe8996f-e364-4a04-ab13-6389d905da4e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.301250 Jul 24 01:11:22.618268 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 374/785] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:22.628104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.629242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:22.637454 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aea0bd99-9cfd-47e4-a992-f4b5253de17e tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853?user_id=7e0bd6160f4b4b4a8b8d4cbb304effbe" status: 200 len: 148 microversion: 2.57 time: 0.376233 Jul 24 01:11:22.639045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.639803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.641076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:22.641619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:22.645464 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 412/786] 10.222.0.27 () {62 vars in 1383 bytes} [Sun Jul 24 01:11:22 2022] PUT /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853?user_id=7e0bd6160f4b4b4a8b8d4cbb304effbe => generated 148 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:22.653779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-28f10ae6-666f-47df-9c4f-7fb925ebf9bf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Calling method '.version_select at 0x7f05eb5c9310>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:22.918417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:22.934059 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03a48643-e7df-48a3-9216-1fe94c1248df tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 0.313148 Jul 24 01:11:22.935759 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 375/787] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:22.954266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f7a65d3e-0b33-4807-a0bf-75a67034e550 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb545940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:23.017964 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f7a65d3e-0b33-4807-a0bf-75a67034e550 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.079314 Jul 24 01:11:23.027917 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 376/788] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:23.034212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:23.035214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:23.043103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.043972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.044876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.045558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.143412 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-28f10ae6-666f-47df-9c4f-7fb925ebf9bf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853?user_id=7e0bd6160f4b4b4a8b8d4cbb304effbe" status: 200 len: 190 microversion: 2.57 time: 0.496143 Jul 24 01:11:23.150152 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 413/789] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Jul 24 01:11:22 2022] GET /compute/v2.1/os-quota-sets/0555e26bdd4c43baba80de66453e6853?user_id=7e0bd6160f4b4b4a8b8d4cbb304effbe => generated 190 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:11:23.314982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:23.316092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:23.327585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.332142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.334745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.337480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.610449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:23.620663 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d32e129f-8401-4114-95a5-68f9038b94a2 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1304 microversion: 2.1 time: 0.311107 Jul 24 01:11:23.625614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 414/790] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:23 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1304 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:23.631183 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:23.632022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:23.652032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.652236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.658275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.663634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.741521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:23.754325 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ba46220-ff93-4c90-8d2e-de0a218b4d57 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1463 microversion: 2.1 time: 0.724734 Jul 24 01:11:23.754915 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 377/791] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:23 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1463 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:23.776104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-094d5dc4-b392-4b25-9b20-532a14a3057e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:23.777435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-094d5dc4-b392-4b25-9b20-532a14a3057e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:23.786160 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-094d5dc4-b392-4b25-9b20-532a14a3057e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.786932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-094d5dc4-b392-4b25-9b20-532a14a3057e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.788360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-094d5dc4-b392-4b25-9b20-532a14a3057e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.789014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-094d5dc4-b392-4b25-9b20-532a14a3057e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.911589 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-094d5dc4-b392-4b25-9b20-532a14a3057e tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action" status: 202 len: 0 microversion: 2.1 time: 0.139960 Jul 24 01:11:23.917584 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 378/792] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:11:23 2022] POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:23.932681 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:23.934447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:23.946354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.947406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.948560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.949285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.997377 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:23.998402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:23.999324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lazy-loading 'fault' on Instance uuid 47daf830-dbdf-42ca-ab4a-7fa63658b66a {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:11:24.442073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:24.455467 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36f44a00-5b0f-47d0-9d3d-fb1a38015cd7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.828319 Jul 24 01:11:24.461487 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 415/793] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:23 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:24.475881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:24.484907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:24.497281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:24.504550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:24.513073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:24.514414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:24.982852 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c91ab0a7-8672-4fc5-ab4c-0e9fc29d4b71 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1597 microversion: 2.1 time: 1.059439 Jul 24 01:11:24.987422 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 379/794] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:23 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1597 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:25.019166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-546042fb-9604-40b8-a72d-43e0e1200a40 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb6078b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:25.158234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-546042fb-9604-40b8-a72d-43e0e1200a40 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.169151 Jul 24 01:11:25.158880 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 380/795] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:24 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:25.167488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:25.172115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:25.188236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:25.191158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:25.192395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:25.197186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:25.856419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:25.866507 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ecb65f61-f564-4956-971f-7083af2c8f4b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 1.402091 Jul 24 01:11:25.869833 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 416/796] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:24 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:25.887155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c9b91430-620d-4174-af6a-ad52bd065097 req-80d106e7-ccbe-4e0e-b92f-b16d024b3f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5", "name": "network-vif-plugged", "status": "completed", "tag": "32fa2173-df2d-4d45-b2f8-9c6046b137ea"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:25.902234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c9b91430-620d-4174-af6a-ad52bd065097 req-80d106e7-ccbe-4e0e-b92f-b16d024b3f73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:25.907654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c9b91430-620d-4174-af6a-ad52bd065097 req-80d106e7-ccbe-4e0e-b92f-b16d024b3f73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:25.944705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c9b91430-620d-4174-af6a-ad52bd065097 req-80d106e7-ccbe-4e0e-b92f-b16d024b3f73 service nova] Creating event network-vif-plugged:32fa2173-df2d-4d45-b2f8-9c6046b137ea for instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 on n-h2-master-1 Jul 24 01:11:25.961560 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c9b91430-620d-4174-af6a-ad52bd065097 req-80d106e7-ccbe-4e0e-b92f-b16d024b3f73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089558 Jul 24 01:11:25.970410 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 417/797] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:25.985559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5250a08-c391-4dc5-8e61-8011f6a8263f tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:25.990324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5250a08-c391-4dc5-8e61-8011f6a8263f tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:26.007025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5250a08-c391-4dc5-8e61-8011f6a8263f tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:26.008235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5250a08-c391-4dc5-8e61-8011f6a8263f tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:26.012621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5250a08-c391-4dc5-8e61-8011f6a8263f tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:26.013434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5250a08-c391-4dc5-8e61-8011f6a8263f tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:26.249422 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5250a08-c391-4dc5-8e61-8011f6a8263f tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action" status: 202 len: 0 microversion: 2.1 time: 0.262934 Jul 24 01:11:26.249422 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 418/798] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:11:25 2022] POST /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:26.272196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:26.274997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:26.288032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:26.299151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:26.302325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:26.306176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:26.336558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:26.364670 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5966dc4a-9051-458e-a339-2128ceb7c810 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 1.197286 Jul 24 01:11:26.365556 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 381/799] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:25 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:26.380223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa011f5a-9243-44f1-bd97-635c603dad8e tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05ebd01550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:27.598418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:27.608150 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d3b57979-10ee-4632-86de-4d60148dcb9b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 1.361343 Jul 24 01:11:27.624762 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 419/800] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:26 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:27.633408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4addb401-2135-4e37-9964-dc0c4449d655 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:27.660520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4addb401-2135-4e37-9964-dc0c4449d655 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:27.673049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4addb401-2135-4e37-9964-dc0c4449d655 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:27.690724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4addb401-2135-4e37-9964-dc0c4449d655 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:27.693440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4addb401-2135-4e37-9964-dc0c4449d655 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:27.697650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4addb401-2135-4e37-9964-dc0c4449d655 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:28.144785 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4addb401-2135-4e37-9964-dc0c4449d655 tempest-ServersAdminTestJSON-985086041 tempest-ServersAdminTestJSON-985086041-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1614 microversion: 2.1 time: 0.516097 Jul 24 01:11:28.163612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 420/801] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:27 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1614 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:28.169547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:28.172803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:28.195767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:28.200457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:28.215953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:28.219667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:28.665513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:28.673464 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f3fc5a3-fb0b-4f4e-9ebc-8dcd541645a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1324 microversion: 2.1 time: 0.508516 Jul 24 01:11:28.681095 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 421/802] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:28 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:28.695425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:28.698507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:28.711376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:28.713619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:28.716246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:28.716833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:29.248841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:29.271878 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-48d29385-2064-45d6-83b9-794abaa2bed4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 0.579810 Jul 24 01:11:29.285592 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 422/803] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:28 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:29.291803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:29.292753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:29.314864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:29.315378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:29.316182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:29.316620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:29.364136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:11:29.534344 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a6d6a22-14b8-45b3-a488-e958a21d74c7 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 204 len: 0 microversion: 2.1 time: 0.247286 Jul 24 01:11:29.535131 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 423/804] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:11:29 2022] DELETE /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:11:29.545609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:29.546438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:29.563189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:29.563665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:29.564445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:29.564905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:29.610467 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:30.006457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:30.022719 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c3be41ff-47c6-4e68-a5d1-4a634cd15cea tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1359 microversion: 2.1 time: 0.480296 Jul 24 01:11:30.035670 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 424/805] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:29 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1359 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:30.047780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8dcf8346-d13f-42a1-98e8-d9beb0a951d7 req-f5d84b96-b922-43dc-ae0d-53dbb4a422df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f91e88b1-cc02-4d11-8b50-36eaa04b5dba", "tag": "d72066e3-ef54-493b-9c00-76e56950686e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:30.069194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8dcf8346-d13f-42a1-98e8-d9beb0a951d7 req-f5d84b96-b922-43dc-ae0d-53dbb4a422df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.070073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8dcf8346-d13f-42a1-98e8-d9beb0a951d7 req-f5d84b96-b922-43dc-ae0d-53dbb4a422df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:30.098673 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8dcf8346-d13f-42a1-98e8-d9beb0a951d7 req-f5d84b96-b922-43dc-ae0d-53dbb4a422df service nova] Creating event network-changed:d72066e3-ef54-493b-9c00-76e56950686e for instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba on n-h1-master-1 Jul 24 01:11:30.109176 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8dcf8346-d13f-42a1-98e8-d9beb0a951d7 req-f5d84b96-b922-43dc-ae0d-53dbb4a422df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071454 Jul 24 01:11:30.114466 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 425/806] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:30.519117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05eb53da60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:30.519994 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:30.519994 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:30.521919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.522457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:30.561165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.562978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:30.581340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.581837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:30.592888 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a53e529e-713f-47c7-91cc-9d3389aa4e35 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.476544 Jul 24 01:11:30.593496 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 426/807] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:11:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:30.600032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:30.601031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:30.608684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.609142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:30.610122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.610725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:30.839441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:30.861010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-379efbde-92f7-4aec-afc9-f6162dd49784 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 200 len: 1469 microversion: 2.1 time: 0.266249 Jul 24 01:11:30.872534 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 427/808] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:30 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:30.875758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:30.876585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:30.891908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.892371 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:30.893547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:30.894112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:31.159205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:31.170788 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1916d3eb-7afd-460d-8054-3c913610c2c0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1520 microversion: 2.1 time: 0.306070 Jul 24 01:11:31.183472 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 428/809] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:30 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:31.197278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:31.197933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:31.213712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:31.218488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:31.219366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:31.219765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:31.720786 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:31.745329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:31.756912 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c35100db-448d-4f1f-a335-fa50bfd9424f tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 0.569170 Jul 24 01:11:31.764193 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=26 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:31.770040 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 429/810] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:31 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:31.775531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05f9a63e50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:31.776164 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:31.776164 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:31.777348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:31.777837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:31.815974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:31.816432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:31.839070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:31.839500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:31.845962 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e9b69486-5724-402f-ae3a-4d05799b1e86 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.074749 Jul 24 01:11:31.846987 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 430/811] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:11:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:31.853717 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c5a41b04-b456-4e36-b6a2-d0f65125d064 req-2d6c4ce4-6c00-4447-bc16-30dee0d35044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c4c870-8606-4888-81ee-c2a835a28957", "name": "network-vif-plugged", "status": "completed", "tag": "d4d5f9d8-92d8-4655-b5b7-0152abef78c0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:31.861629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c5a41b04-b456-4e36-b6a2-d0f65125d064 req-2d6c4ce4-6c00-4447-bc16-30dee0d35044 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:31.862105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c5a41b04-b456-4e36-b6a2-d0f65125d064 req-2d6c4ce4-6c00-4447-bc16-30dee0d35044 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:31.875587 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c5a41b04-b456-4e36-b6a2-d0f65125d064 req-2d6c4ce4-6c00-4447-bc16-30dee0d35044 service nova] Creating event network-vif-plugged:d4d5f9d8-92d8-4655-b5b7-0152abef78c0 for instance 38c4c870-8606-4888-81ee-c2a835a28957 on n-h2-master-1 Jul 24 01:11:31.881880 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c5a41b04-b456-4e36-b6a2-d0f65125d064 req-2d6c4ce4-6c00-4447-bc16-30dee0d35044 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 Jul 24 01:11:31.882847 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 431/812] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:32.219776 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1064348753", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:32.550560 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=18 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:33.134622 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=54 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:35.190067 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=19 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:36.371493 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:36.825966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:11:36.830998 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa011f5a-9243-44f1-bd97-635c603dad8e tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 10.463316 Jul 24 01:11:36.831825 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 382/813] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:26 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 10465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:36.851980 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:36.852906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:36.862622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:36.863454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:36.865045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:36.865745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.137598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:37.148118 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ea8dc64-8d71-41e8-bf9b-a9e031a145cc tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1543 microversion: 2.1 time: 0.314819 Jul 24 01:11:37.162084 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 383/814] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:36 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1543 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:37.169929 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf4a108f-a193-4f35-9455-1a37aa8e7376 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'create', calling method: .version_select at 0x7f05ebd01af0>, body: {"pool": null} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:37.214557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:11:37.214984 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:11:37.215464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:11:37.215875 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:11:37.216294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:11:37.238013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.240923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.250192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.251172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.287981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Getting quotas for project 398c03dd81d44131b50d466f22c4001c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:37.302873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Getting quotas for user 1303cf4bd9f84cb1802e4d3b6ccbafa2 and project 398c03dd81d44131b50d466f22c4001c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:37.334115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:11:37.341906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:11:37.409806 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0b05918d-6d9b-4f9b-a80e-63c589db6691 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.525687 Jul 24 01:11:37.412913 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 432/815] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 5530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:11:37.424725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05ebbf8280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:37.426977 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:37.426977 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:37.429040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.429564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.446708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.447840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.466122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.466122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.474919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d8af269-a1eb-4b23-a401-cc8348a32208 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053533 Jul 24 01:11:37.476539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 433/816] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:11:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:37.485160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:37.485898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: b80afddc-d9e6-4951-99ab-dabfae0ec911] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:37.494151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.494687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.496528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.496528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.513845 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] HTTP exception thrown: Instance b80afddc-d9e6-4951-99ab-dabfae0ec911 could not be found. Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Request method failure captured: Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 HTTP/1.1 Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Ju3eqLJsdND51Y4XKDVjCctAg1SPqXgFHlz02lqBPBt237UVHhfAov0TwW7H9aw0X45zt-qeWBPeuNiFKZKE1CibV1J5mFJhsCHy8QK-RLk6kTVc__dClK7i0xXWVL9kcIelz0KFrBAyh8dvEGKOXPI2OwicUx1BUVYtk74V5hsDZQ Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: c028787727e34a489f5a99f937538b6f Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:11:37.518685 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c028787727e34a489f5a99f937538b6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c028787727e34a489f5a99f937538b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c028787727e34a489f5a99f937538b6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c028787727e34a489f5a99f937538b6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: c028787727e34a489f5a99f937538b6f Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminTestJSON-1889275173-project Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bfd5b02713f54950b7a5fae18bf4d485 Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminTestJSON-1889275173-project Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b80afddc-d9e6-4951-99ab-dabfae0ec911 could not be found. Jul 24 01:11:37.520092 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b80afddc-d9e6-4951-99ab-dabfae0ec911'} Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80afddc-d9e6-4951-99ab-dabfae0ec911 could not be found. Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:37.521434 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80afddc-d9e6-4951-99ab-dabfae0ec911 could not be found. Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80afddc-d9e6-4951-99ab-dabfae0ec911 could not be found. Jul 24 01:11:37.523321 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:37.524383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Returning 404 to user: Instance b80afddc-d9e6-4951-99ab-dabfae0ec911 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:37.524383 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5b468c7d-1742-43a4-b45f-6e2ae3eb47b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911" status: 404 len: 111 microversion: 2.1 time: 0.042459 Jul 24 01:11:37.524383 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 434/817] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:37 2022] GET /compute/v2.1/servers/b80afddc-d9e6-4951-99ab-dabfae0ec911 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:37.532933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c8bf088c-15d6-4e6f-957b-350e9305a12a req-717e312c-2eed-43da-9b36-9a77f2de27d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80afddc-d9e6-4951-99ab-dabfae0ec911", "name": "network-vif-deleted", "tag": "3a5dc077-80a5-48b5-be93-9084677b6222"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:37.542816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c8bf088c-15d6-4e6f-957b-350e9305a12a req-717e312c-2eed-43da-9b36-9a77f2de27d9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.543454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c8bf088c-15d6-4e6f-957b-350e9305a12a req-717e312c-2eed-43da-9b36-9a77f2de27d9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.563985 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c8bf088c-15d6-4e6f-957b-350e9305a12a req-717e312c-2eed-43da-9b36-9a77f2de27d9 service nova] Creating event network-vif-deleted:3a5dc077-80a5-48b5-be93-9084677b6222 for instance b80afddc-d9e6-4951-99ab-dabfae0ec911 on n-h1-master-1 Jul 24 01:11:37.576187 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c8bf088c-15d6-4e6f-957b-350e9305a12a req-717e312c-2eed-43da-9b36-9a77f2de27d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049057 Jul 24 01:11:37.576805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 435/818] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:37.585139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:37.586390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:37.595365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.596194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:37.597017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:37.597492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.108361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:38.118583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c881cfec-fec2-4140-9fc3-71b0d7542a65 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 0.540574 Jul 24 01:11:38.132173 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 436/819] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:37 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:38.137454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a097f834-c6f7-408e-b550-207a9bb579e2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:38.138271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a097f834-c6f7-408e-b550-207a9bb579e2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:38.144869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a097f834-c6f7-408e-b550-207a9bb579e2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.145766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a097f834-c6f7-408e-b550-207a9bb579e2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.146834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a097f834-c6f7-408e-b550-207a9bb579e2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.147481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a097f834-c6f7-408e-b550-207a9bb579e2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.289792 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a097f834-c6f7-408e-b550-207a9bb579e2 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155759 Jul 24 01:11:38.304247 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 437/820] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:11:38 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:38.321714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:38.324284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:38.341754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.342261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.344085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.344539 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.470611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:38.524702 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af62c4a5-9efa-413e-9f37-7916aa0d0e3c tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1275 microversion: 2.1 time: 0.218129 Jul 24 01:11:38.525848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 438/821] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:38 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:38.534567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be95dd9c-a381-4d9f-b4f4-eb74dbc8840b tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05eb5c9310>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:38.537570 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:38.537570 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:38.542373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be95dd9c-a381-4d9f-b4f4-eb74dbc8840b tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.542832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be95dd9c-a381-4d9f-b4f4-eb74dbc8840b tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.560867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be95dd9c-a381-4d9f-b4f4-eb74dbc8840b tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.561552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be95dd9c-a381-4d9f-b4f4-eb74dbc8840b tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.573757 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be95dd9c-a381-4d9f-b4f4-eb74dbc8840b tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.046574 Jul 24 01:11:38.577727 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 439/822] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:11:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:38.587933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:38.588603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:38.596331 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.598207 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.598777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.601017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:38.601462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:38.669385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:11:38.888828 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f8bc53e-62dd-4ed3-98c0-3a678d195920 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 204 len: 0 microversion: 2.1 time: 0.312729 Jul 24 01:11:38.889842 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 440/823] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:11:38 2022] DELETE /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:11:38.905523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9d2e69b9-ea81-4cbc-8989-ba53101579d5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb8d65e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.057880 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9d2e69b9-ea81-4cbc-8989-ba53101579d5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1455 microversion: 2.1 time: 0.164196 Jul 24 01:11:39.066072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 441/824] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:38 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:39.073653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9c16878-0146-4da1-a1af-b9c8eab249cb tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05eb4f1dc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.074609 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:39.074609 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:11:39.076085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9c16878-0146-4da1-a1af-b9c8eab249cb tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.077177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9c16878-0146-4da1-a1af-b9c8eab249cb tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.100452 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9c16878-0146-4da1-a1af-b9c8eab249cb tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.033120 Jul 24 01:11:39.110437 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 442/825] 10.222.0.27 () {58 vars in 1178 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:39.141663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.142778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:39.162748 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.163226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.164874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.165369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.519580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:39.527854 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf4a108f-a193-4f35-9455-1a37aa8e7376 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.364217 Jul 24 01:11:39.528904 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a7a46140-13d4-4fe6-8c23-89682059c680 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1470 microversion: 2.1 time: 0.417107 Jul 24 01:11:39.529314 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 384/826] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:11:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:39.529896 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 443/827] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1470 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:39.534106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05eb5451f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.535123 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:39.535123 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:11:39.539646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.540645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.545998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.547313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:39.556738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.557308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.559472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.560256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.562270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.563191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.580581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.580968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.590095 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-00ca7eb2-4c51-4ff3-8c69-67ace8663c4f tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059627 Jul 24 01:11:39.590975 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 385/828] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:39.596437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.598367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:39.607919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.608603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.609577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.610507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.710064 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:39.717923 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-620000e1-3f5e-458b-9cdb-ec1f0731c871 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1283 microversion: 2.1 time: 0.125581 Jul 24 01:11:39.718915 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 386/829] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1283 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:39.724254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08eafa81-40b6-45b7-8b6b-e9611943fd01 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05eb545d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.725278 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:39.725278 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:11:39.726772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08eafa81-40b6-45b7-8b6b-e9611943fd01 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.727221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08eafa81-40b6-45b7-8b6b-e9611943fd01 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.741351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08eafa81-40b6-45b7-8b6b-e9611943fd01 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.741834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08eafa81-40b6-45b7-8b6b-e9611943fd01 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.745043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:39.749870 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08eafa81-40b6-45b7-8b6b-e9611943fd01 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.029624 Jul 24 01:11:39.757898 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 387/830] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:39.758094 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a53e90c-d523-41dd-bc85-85e59dea25d3 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 0.211369 Jul 24 01:11:39.758094 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 444/831] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:39.761908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6de6877f-1001-47d7-baf2-0935cd5fb614 req-1a826850-0ffc-4411-9c69-facf0746a5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c4c870-8606-4888-81ee-c2a835a28957", "tag": "d4d5f9d8-92d8-4655-b5b7-0152abef78c0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:39.766596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-37857109", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:39.771679 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6de6877f-1001-47d7-baf2-0935cd5fb614 req-1a826850-0ffc-4411-9c69-facf0746a5ac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.772132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6de6877f-1001-47d7-baf2-0935cd5fb614 req-1a826850-0ffc-4411-9c69-facf0746a5ac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.783896 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6de6877f-1001-47d7-baf2-0935cd5fb614 req-1a826850-0ffc-4411-9c69-facf0746a5ac service nova] Creating event network-changed:d4d5f9d8-92d8-4655-b5b7-0152abef78c0 for instance 38c4c870-8606-4888-81ee-c2a835a28957 on n-h2-master-1 Jul 24 01:11:39.790271 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6de6877f-1001-47d7-baf2-0935cd5fb614 req-1a826850-0ffc-4411-9c69-facf0746a5ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037889 Jul 24 01:11:39.790928 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 388/832] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:39.795792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01adc111-662d-483a-bb6e-3d1df575f20a tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05eb66a1f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.796649 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:39.796649 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:11:39.797854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01adc111-662d-483a-bb6e-3d1df575f20a tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.798299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01adc111-662d-483a-bb6e-3d1df575f20a tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.819889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01adc111-662d-483a-bb6e-3d1df575f20a tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.820344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01adc111-662d-483a-bb6e-3d1df575f20a tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.826003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] validate_networks() for [('1d90afb7-a614-4f6a-ab1f-4bbd8730a637', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:11:39.826969 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01adc111-662d-483a-bb6e-3d1df575f20a tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.034922 Jul 24 01:11:39.827703 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 389/833] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:39.839940 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Calling method '.version_select at 0x7f05eb66a790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:39.840733 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:39.840733 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:11:39.841952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.842405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.857308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.857813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.870255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:39.870706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:39.897444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d3e5034-574c-40e0-8d32-d9c8388e44e4 tempest-HypervisorAdminTestJSON-1783482801 tempest-HypervisorAdminTestJSON-1783482801-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.060384 Jul 24 01:11:39.898341 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 390/834] 10.222.0.27 () {58 vars in 1172 bytes} [Sun Jul 24 01:11:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:11:40.073389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e7aeed1-03ca-496e-b5ff-1f04f5906dac tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb589ca0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:40.166510 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e7aeed1-03ca-496e-b5ff-1f04f5906dac tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1464 microversion: 2.1 time: 0.097271 Jul 24 01:11:40.168825 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 391/835] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:40 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:40.210381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b876e6a-b658-43e5-9525-155df51afe60 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb698160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:40.305995 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b876e6a-b658-43e5-9525-155df51afe60 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 200 len: 1464 microversion: 2.1 time: 0.115555 Jul 24 01:11:40.312636 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 392/836] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:40 2022] GET /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 1464 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:40.321730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:40.322773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:40.330779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.331492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:40.332301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.332746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:40.433137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:11:40.433639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:11:40.434052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:11:40.434462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:11:40.435726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:11:40.451656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.452317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:40.453395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.454371 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:40.471141 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:40.505206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Getting quotas for project aa4e8e174a104e60a0c40a83bd2235fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:11:40.519656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Getting quotas for user 23333c1ebbdf4ddab9d21d5b8b7139e6 and project aa4e8e174a104e60a0c40a83bd2235fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:11:40.548224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:11:40.550838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:11:40.569145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:40.580235 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a7c22422-998a-4cb3-85f8-016e6978acff tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1480 microversion: 2.1 time: 0.262099 Jul 24 01:11:40.581870 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 393/837] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:40 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1480 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:40.589960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:40.599212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:40.618763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.619489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:40.620685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.621289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:40.643563 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5fb6c57b-ef6d-496d-a88a-f4e3a36c258d tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889045 Jul 24 01:11:40.644523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 445/838] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:11:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:11:40.657712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a634da25-37bc-44d7-b3cb-36065d6390ea tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:40.658620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a634da25-37bc-44d7-b3cb-36065d6390ea tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:40.797650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a634da25-37bc-44d7-b3cb-36065d6390ea tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:40.814704 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a634da25-37bc-44d7-b3cb-36065d6390ea tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1222 microversion: 2.1 time: 0.162128 Jul 24 01:11:40.815418 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 446/839] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:40 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:40.839307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:40.840070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:40.851141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.851759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:40.852653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:40.853347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:41.000501 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:41.014094 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-884c7331-cefa-4a6c-a354-01c9abcfe780 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1281 microversion: 2.1 time: 0.193049 Jul 24 01:11:41.015498 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 447/840] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:40 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:41.022418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:41.023502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:41.033413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:41.035679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:41.038825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:41.039483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:41.094266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:41.106069 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-886f9784-274e-4735-b6f1-71b7d8aa8b51 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1470 microversion: 2.1 time: 0.522869 Jul 24 01:11:41.117209 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 394/841] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:40 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1470 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:41.417060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:41.445044 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a1bd8d15-f729-4a41-b87f-c5a4ed17b9fc tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 0.427968 Jul 24 01:11:41.446593 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 448/842] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:41 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:41.598303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:41.600416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:41.607985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:41.608803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:41.609958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:41.611049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:41.832554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:41.833976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:41.851095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:41.851552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:41.852694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:41.853133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:41.974981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:41.984787 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fa727148-34fd-491c-b66d-a38367b3fde0 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1274 microversion: 2.1 time: 0.156648 Jul 24 01:11:41.985971 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 449/843] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:41 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:42.021386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:42.033554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:42.034476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:42.044443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.045159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.046154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.046757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.056481 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be4c9cb0-e7fb-41dc-9719-654900986c97 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1467 microversion: 2.1 time: 0.463304 Jul 24 01:11:42.059625 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 395/844] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:41 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1467 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:42.075967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-62ec64fc-679a-4d6c-911a-a1e2daaff63c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-851822169"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:42.077917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-62ec64fc-679a-4d6c-911a-a1e2daaff63c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:42.087017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62ec64fc-679a-4d6c-911a-a1e2daaff63c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.087840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62ec64fc-679a-4d6c-911a-a1e2daaff63c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.089109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62ec64fc-679a-4d6c-911a-a1e2daaff63c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.089835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62ec64fc-679a-4d6c-911a-a1e2daaff63c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.234485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:42.248071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8c0c5cc3-fa3c-4fdc-a378-fa100dfefa4a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1281 microversion: 2.1 time: 0.219131 Jul 24 01:11:42.249315 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 450/845] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:42 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:42.257946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:42.258941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:42.267038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.268592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.269863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.271107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.587001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:42.615049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df3d11ad-019a-4688-ad7b-e5d85aee6e89 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 200 len: 1428 microversion: 2.1 time: 0.364095 Jul 24 01:11:42.615667 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 451/846] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:42 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 1428 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:42.633774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3cafa69a-3632-43ee-b9cc-c222cc515447 req-eee8b7ca-0570-40ed-9e2f-f714009bc01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8a845b-e3fb-48d2-8b69-183a831b96e3", "name": "network-vif-deleted", "tag": "7ba985c1-2254-4edb-adf4-2e9d68bd70a9"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:42.669835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3cafa69a-3632-43ee-b9cc-c222cc515447 req-eee8b7ca-0570-40ed-9e2f-f714009bc01c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.672831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3cafa69a-3632-43ee-b9cc-c222cc515447 req-eee8b7ca-0570-40ed-9e2f-f714009bc01c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.702003 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3cafa69a-3632-43ee-b9cc-c222cc515447 req-eee8b7ca-0570-40ed-9e2f-f714009bc01c service nova] Creating event network-vif-deleted:7ba985c1-2254-4edb-adf4-2e9d68bd70a9 for instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 on n-h2-master-1 Jul 24 01:11:42.722892 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3cafa69a-3632-43ee-b9cc-c222cc515447 req-eee8b7ca-0570-40ed-9e2f-f714009bc01c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098319 Jul 24 01:11:42.725370 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 452/847] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:42.750443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:42.751325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:42.766816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.770450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.773315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.773961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.779781 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-62ec64fc-679a-4d6c-911a-a1e2daaff63c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "POST /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262/action" status: 202 len: 0 microversion: 2.1 time: 0.705722 Jul 24 01:11:42.786986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 396/848] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:11:42 2022] POST /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:11:42.801394 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-daf79124-501f-48cb-b790-94f6d7e2dff9 req-a4ad65f8-6579-42ee-b594-5eb4976d1d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91e88b1-cc02-4d11-8b50-36eaa04b5dba", "name": "network-vif-plugged", "status": "completed", "tag": "d72066e3-ef54-493b-9c00-76e56950686e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:42.821657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-daf79124-501f-48cb-b790-94f6d7e2dff9 req-a4ad65f8-6579-42ee-b594-5eb4976d1d9d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:42.827018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-daf79124-501f-48cb-b790-94f6d7e2dff9 req-a4ad65f8-6579-42ee-b594-5eb4976d1d9d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:42.858918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-daf79124-501f-48cb-b790-94f6d7e2dff9 req-a4ad65f8-6579-42ee-b594-5eb4976d1d9d service nova] Creating event network-vif-plugged:d72066e3-ef54-493b-9c00-76e56950686e for instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba on n-h1-master-1 Jul 24 01:11:42.872118 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-daf79124-501f-48cb-b790-94f6d7e2dff9 req-a4ad65f8-6579-42ee-b594-5eb4976d1d9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081805 Jul 24 01:11:42.873012 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 397/849] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:42.879291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad2acc8f-dce2-44c9-95f2-480e306bfeb7 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb607ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:42.942535 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad2acc8f-dce2-44c9-95f2-480e306bfeb7 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.067852 Jul 24 01:11:42.943254 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 398/850] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:42 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:43.005881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.007372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:43.016365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.017186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.019040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.020995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.171162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:43.187909 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-14fcf8b3-f26a-475d-93ac-a2193c0fe21a tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1280 microversion: 2.1 time: 0.187712 Jul 24 01:11:43.189863 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 399/851] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:42 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:43.272973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.273467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:43.279354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:43.280164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.280913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.281730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.282502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.288993 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f0c2c745-0c1a-439d-ab79-d89851b1e1e4 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 0.561921 Jul 24 01:11:43.289779 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 453/852] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:42 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:43.638328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.641088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:43.644517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 9b8a845b-e3fb-48d2-8b69-183a831b96e3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:43.660348 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a5a4303-aaad-4a27-a2dc-7e1f17c5aa20 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.390639 Jul 24 01:11:43.662799 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 400/853] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:43.671842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.672602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.674108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.674685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.695760 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] HTTP exception thrown: Instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 could not be found. Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Request method failure captured: Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 HTTP/1.1 Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Ju3eqLJsdND51Y4XKDVjCctAg1SPqXgFHlz02lqBPBt237UVHhfAov0TwW7H9aw0X45zt-qeWBPeuNiFKZKE1CibV1J5mFJhsCHy8QK-RLk6kTVc__dClK7i0xXWVL9kcIelz0KFrBAyh8dvEGKOXPI2OwicUx1BUVYtk74V5hsDZQ Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: c028787727e34a489f5a99f937538b6f Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:11:43.698816 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c028787727e34a489f5a99f937538b6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c028787727e34a489f5a99f937538b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c028787727e34a489f5a99f937538b6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c028787727e34a489f5a99f937538b6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: c028787727e34a489f5a99f937538b6f Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminTestJSON-1889275173-project Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bfd5b02713f54950b7a5fae18bf4d485 Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminTestJSON-1889275173-project Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 could not be found. Jul 24 01:11:43.700373 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '9b8a845b-e3fb-48d2-8b69-183a831b96e3'} Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 could not be found. Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:43.701317 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 could not be found. Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 could not be found. Jul 24 01:11:43.702835 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:43.704066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Returning 404 to user: Instance 9b8a845b-e3fb-48d2-8b69-183a831b96e3 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:43.704266 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a586075-b991-4057-9934-f75a58a6b9bc tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3" status: 404 len: 111 microversion: 2.1 time: 0.075370 Jul 24 01:11:43.705437 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 454/854] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/servers/9b8a845b-e3fb-48d2-8b69-183a831b96e3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:43.716083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.718081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:43.726116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.726980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.727929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.728480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.758457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:11:43.856756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8e4101ee-dc22-4bda-b7a4-ce31ece88c0d tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 204 len: 0 microversion: 2.1 time: 0.144173 Jul 24 01:11:43.857607 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 401/855] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:11:43 2022] DELETE /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:11:43.867793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:43.868738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:43.878111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.880814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.881837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:43.882432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:43.962570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f0d59f3e-106b-47b3-89d4-fbe56765d7c6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb687310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:44.019815 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f0d59f3e-106b-47b3-89d4-fbe56765d7c6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.064668 Jul 24 01:11:44.021416 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 402/856] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:44.216779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:44.217567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:44.226168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:44.226619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:44.227417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:44.227849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:44.260162 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:44.492923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:44.502627 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-645d9f5e-80d4-4a4a-86a1-9a248ad28de0 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1469 microversion: 2.1 time: 0.639807 Jul 24 01:11:44.506550 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 455/857] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:43 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1469 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:44.518792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:44.519427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:44.528719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:44.529423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:44.531571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:44.532186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:44.722631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:44.735234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c73a7d23-cdb0-4db9-b62a-90c54e964661 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.522995 Jul 24 01:11:44.736491 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 403/858] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:44 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:44.857095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:44.869051 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ba3a4e2-d7a6-4fb5-ab61-726edd56694c tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1372 microversion: 2.1 time: 0.359362 Jul 24 01:11:44.869653 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 456/859] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:44 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1372 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:44.874185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:44.875084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:44.884039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:44.884643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:44.885609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:44.886122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:45.008738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-209dc1ee-7db4-4704-aa58-fd8f5a79dbcb tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] Action: 'create', calling method: .version_select at 0x7f05eb607700>, body: {"security_group": {"name": "tempest-securitygroup-1674169615", "description": "tempest-description-847583149"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:45.321083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:45.329324 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-04ddbe49-5a97-4d84-a522-943a533823f8 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.458603 Jul 24 01:11:45.330023 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 457/860] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:44 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:45.336464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cd39e8bb-cd2d-4975-8e5c-5642ec87d68f req-b5026424-7513-4c45-8591-f936156d47aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac0c96-8aae-4ed3-bdd5-485b94e89ec1", "name": "network-vif-unplugged", "status": "completed", "tag": "03895dd8-dd4b-4e93-9101-5db60f3eb869"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:45.347570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cd39e8bb-cd2d-4975-8e5c-5642ec87d68f req-b5026424-7513-4c45-8591-f936156d47aa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:45.348294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cd39e8bb-cd2d-4975-8e5c-5642ec87d68f req-b5026424-7513-4c45-8591-f936156d47aa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:45.362748 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cd39e8bb-cd2d-4975-8e5c-5642ec87d68f req-b5026424-7513-4c45-8591-f936156d47aa service nova] Creating event network-vif-unplugged:03895dd8-dd4b-4e93-9101-5db60f3eb869 for instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 on n-h2-master-1 Jul 24 01:11:45.368544 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cd39e8bb-cd2d-4975-8e5c-5642ec87d68f req-b5026424-7513-4c45-8591-f936156d47aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036830 Jul 24 01:11:45.369202 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 458/861] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:45.374341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88e97203-4026-4067-bf75-7b0b60191db4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb72b8b0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:45.423304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88e97203-4026-4067-bf75-7b0b60191db4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.052820 Jul 24 01:11:45.428880 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 459/862] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:45 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:45.428880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6930a4ad-58e9-49be-8d80-47635f68566c req-7ea54888-c187-43c0-8cec-c80f86f0a618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a3af3f-a328-4fd1-bde3-60e2bd931971", "tag": "0214e03d-9856-453d-bbf6-369c337000f0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:45.437242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6930a4ad-58e9-49be-8d80-47635f68566c req-7ea54888-c187-43c0-8cec-c80f86f0a618 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:45.437621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6930a4ad-58e9-49be-8d80-47635f68566c req-7ea54888-c187-43c0-8cec-c80f86f0a618 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:45.449114 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6930a4ad-58e9-49be-8d80-47635f68566c req-7ea54888-c187-43c0-8cec-c80f86f0a618 service nova] Creating event network-changed:0214e03d-9856-453d-bbf6-369c337000f0 for instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 on n-h2-master-1 Jul 24 01:11:45.453887 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6930a4ad-58e9-49be-8d80-47635f68566c req-7ea54888-c187-43c0-8cec-c80f86f0a618 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028517 Jul 24 01:11:45.454669 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 460/863] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:45.524450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:45.525175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:45.531719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:45.532170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:45.532951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:45.533395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:46.058259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:46.065873 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d4164d95-3a16-46d1-9e02-57623e464aea tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1469 microversion: 2.1 time: 0.546234 Jul 24 01:11:46.066443 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 461/864] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:45 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1469 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:46.079660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.080402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:46.086991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:46.087438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:46.088220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:46.088661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:46.204035 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-209dc1ee-7db4-4704-aa58-fd8f5a79dbcb tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.465579 Jul 24 01:11:46.205600 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 404/865] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:11:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:46.212914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.213918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:46.222199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:46.222664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:46.223674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:46.224282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:46.603940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:46.612877 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4715cb56-20a7-4588-9067-9d60da313d51 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.545307 Jul 24 01:11:46.613446 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 462/866] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:46.627348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d899d1ba-c88a-407b-b111-364883166e01 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] Action: 'create', calling method: .version_select at 0x7f05eb334d30>, body: {"security_group": {"name": "tempest-securitygroup-415298084", "description": "tempest-description-1347141538"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:46.702248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:46.710964 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-55e31681-5a53-46f1-98a2-714b6ab7c02d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1558 microversion: 2.1 time: 0.503764 Jul 24 01:11:46.711773 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 405/867] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1558 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:46.716516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:46.717339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:46.724322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:46.725003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:46.726527 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:46.727135 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.350198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:47.360421 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b0dc511f-ceb4-4f68-9702-04c097a4d09a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.647365 Jul 24 01:11:47.361133 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 406/868] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:46 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:47.372501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b404409d-4c6e-4221-9a90-dd9a53feb775 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb642430>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.404796 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d899d1ba-c88a-407b-b111-364883166e01 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.781859 Jul 24 01:11:47.406108 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 463/869] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:11:46 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:47.415217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-50a77eda-ce3a-4c8f-846a-d19eeae93000 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.417690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-50a77eda-ce3a-4c8f-846a-d19eeae93000 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:47.428398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a77eda-ce3a-4c8f-846a-d19eeae93000 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:47.428571 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b404409d-4c6e-4221-9a90-dd9a53feb775 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.064872 Jul 24 01:11:47.429047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a77eda-ce3a-4c8f-846a-d19eeae93000 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.429794 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 407/870] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:47.435605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.436091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a77eda-ce3a-4c8f-846a-d19eeae93000 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:47.436702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a77eda-ce3a-4c8f-846a-d19eeae93000 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.437016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:47.446708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:47.447732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.448790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:47.449447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.604841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd5b02713f54950b7a5fae18bf4d485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c028787727e34a489f5a99f937538b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:47.614151 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e21ea787-38b6-4719-8f2c-b85753e782b9 tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 200 len: 1427 microversion: 2.1 time: 0.182891 Jul 24 01:11:47.615664 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 408/871] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 1427 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:47.656354 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-50a77eda-ce3a-4c8f-846a-d19eeae93000 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248834 Jul 24 01:11:47.657430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 464/872] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:47.662881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6d52eba3-c024-4c88-b320-0c82d3a39e8b req-06bdc5bd-e66b-41fc-9686-c4ffad30bc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c", "tag": "e368dfa6-9f73-459f-b85b-937469b46092"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:47.690305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6d52eba3-c024-4c88-b320-0c82d3a39e8b req-06bdc5bd-e66b-41fc-9686-c4ffad30bc71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:47.693775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6d52eba3-c024-4c88-b320-0c82d3a39e8b req-06bdc5bd-e66b-41fc-9686-c4ffad30bc71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.715017 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6d52eba3-c024-4c88-b320-0c82d3a39e8b req-06bdc5bd-e66b-41fc-9686-c4ffad30bc71 service nova] Creating event network-changed:e368dfa6-9f73-459f-b85b-937469b46092 for instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c on n-h1-master-1 Jul 24 01:11:47.728703 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6d52eba3-c024-4c88-b320-0c82d3a39e8b req-06bdc5bd-e66b-41fc-9686-c4ffad30bc71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069880 Jul 24 01:11:47.729469 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 465/873] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:47.735452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:47.736298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:47.745208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:47.746057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.747056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:47.747821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:47.759041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13886c63-8358-4905-9ecd-a35377b5910f tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Action: 'create', calling method: .version_select at 0x7f05eb589430>, body: {"security_group": {"name": "tempest-securitygroup-1765360446", "description": "tempest-description-72616010"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:47.948037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:47.957041 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2fc77d3-35b1-4b6b-b54c-b35dcf63eeb5 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.225562 Jul 24 01:11:47.968222 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 466/874] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:47 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:48.382635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:48.383672 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:48.393931 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13886c63-8358-4905-9ecd-a35377b5910f tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.776818 Jul 24 01:11:48.394568 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 409/875] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:11:47 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:48.405844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ea7a4cd-4120-4433-b3a3-159db5ec01fb tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Action: 'create', calling method: .version_select at 0x7f05eb6079d0>, body: {"security_group": {"name": "tempest-securitygroup-170197796", "description": "tempest-description-1429691787"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:48.408659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:48.409207 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:48.410295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:48.412057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:48.641642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:48.652606 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e965b011-cf81-4e9e-8e4e-8045272d3f9a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.276702 Jul 24 01:11:48.654969 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 467/876] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:48 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:48.660146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4795f1ac-24df-4f2f-8d3a-e3aa030ae974 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb8d6af0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:48.716025 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4795f1ac-24df-4f2f-8d3a-e3aa030ae974 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.059811 Jul 24 01:11:48.722825 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 468/877] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:48 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:48.733864 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ea7a4cd-4120-4433-b3a3-159db5ec01fb tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.331725 Jul 24 01:11:48.741372 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 410/878] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:11:48 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:11:48.741372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:48.741372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] [instance: 47daf830-dbdf-42ca-ab4a-7fa63658b66a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:48.749999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c2126a04-652a-41f2-a2c9-468c4a452b18 req-620d7e82-c423-497a-8e68-519b1b2235e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117685ac-31fb-41e6-94dc-4efdd3fc0262", "name": "network-vif-plugged", "status": "completed", "tag": "f50c3fdd-6dde-4107-af40-6e69ffd16a5f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:48.751167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:48.751627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:48.752408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:48.752840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:48.766292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c2126a04-652a-41f2-a2c9-468c4a452b18 req-620d7e82-c423-497a-8e68-519b1b2235e3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:48.766873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c2126a04-652a-41f2-a2c9-468c4a452b18 req-620d7e82-c423-497a-8e68-519b1b2235e3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:48.771757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] HTTP exception thrown: Instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a could not be found. Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Request method failure captured: Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a HTTP/1.1 Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Ju3eqLJsdND51Y4XKDVjCctAg1SPqXgFHlz02lqBPBt237UVHhfAov0TwW7H9aw0X45zt-qeWBPeuNiFKZKE1CibV1J5mFJhsCHy8QK-RLk6kTVc__dClK7i0xXWVL9kcIelz0KFrBAyh8dvEGKOXPI2OwicUx1BUVYtk74V5hsDZQ Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: c028787727e34a489f5a99f937538b6f Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:11:48.773641 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c028787727e34a489f5a99f937538b6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c028787727e34a489f5a99f937538b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c028787727e34a489f5a99f937538b6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c028787727e34a489f5a99f937538b6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: c028787727e34a489f5a99f937538b6f Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersAdminTestJSON-1889275173 Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersAdminTestJSON-1889275173-project Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: bfd5b02713f54950b7a5fae18bf4d485 Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersAdminTestJSON-1889275173-project Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a could not be found. Jul 24 01:11:48.774959 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '47daf830-dbdf-42ca-ab4a-7fa63658b66a'} Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a could not be found. Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:48.775647 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a could not be found. Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a could not be found. Jul 24 01:11:48.776764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:11:48.778891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] Returning 404 to user: Instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:48.778891 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cc52e41f-2cb1-46d1-897c-2e02e72a6a1b tempest-ServersAdminTestJSON-1889275173 tempest-ServersAdminTestJSON-1889275173-project] 10.222.0.27 "GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a" status: 404 len: 111 microversion: 2.1 time: 0.039047 Jul 24 01:11:48.778891 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 411/879] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:48 2022] GET /compute/v2.1/servers/47daf830-dbdf-42ca-ab4a-7fa63658b66a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:48.781970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Calling method '.version_select at 0x7f05eb698700>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:48.806651 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c2126a04-652a-41f2-a2c9-468c4a452b18 req-620d7e82-c423-497a-8e68-519b1b2235e3 service nova] Creating event network-vif-plugged:f50c3fdd-6dde-4107-af40-6e69ffd16a5f for instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 on n-h1-master-1 Jul 24 01:11:48.821355 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c2126a04-652a-41f2-a2c9-468c4a452b18 req-620d7e82-c423-497a-8e68-519b1b2235e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096267 Jul 24 01:11:48.824636 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 469/880] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:48.976229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:48.977981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:48.987926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:48.991294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:48.992527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:48.993378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:49.415917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:49.425469 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:49.438872 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb0ec92f-0463-4002-9de8-83a29bc4ac10 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.466971 Jul 24 01:11:49.439656 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 470/881] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:48 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:49.454744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-91c5ad44-794b-4599-91e2-552c23e7df99 req-9751b9b8-2a60-480d-990a-5890dd21eb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f91e88b1-cc02-4d11-8b50-36eaa04b5dba", "tag": "d72066e3-ef54-493b-9c00-76e56950686e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:49.475442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-91c5ad44-794b-4599-91e2-552c23e7df99 req-9751b9b8-2a60-480d-990a-5890dd21eb2b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:49.486489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-91c5ad44-794b-4599-91e2-552c23e7df99 req-9751b9b8-2a60-480d-990a-5890dd21eb2b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:49.506046 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-91c5ad44-794b-4599-91e2-552c23e7df99 req-9751b9b8-2a60-480d-990a-5890dd21eb2b service nova] Creating event network-changed:d72066e3-ef54-493b-9c00-76e56950686e for instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba on n-h1-master-1 Jul 24 01:11:49.535822 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-91c5ad44-794b-4599-91e2-552c23e7df99 req-9751b9b8-2a60-480d-990a-5890dd21eb2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085604 Jul 24 01:11:49.538877 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 471/882] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:49.670743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:49.671721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:49.686945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:49.687401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:49.688183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:49.688794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:50.405700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:50.427736 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ba8c29b-9b1b-42be-ba01-68be8ef57640 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.761047 Jul 24 01:11:50.431738 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 472/883] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:49 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:50.458257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bda1e0d1-21fa-4418-8368-fdba53379862 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb4f1310>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:50.479552 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:50.567664 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bda1e0d1-21fa-4418-8368-fdba53379862 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.134607 Jul 24 01:11:50.568354 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 473/884] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:50 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:50.577966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-781c732f-37f1-4cc0-aea9-5f03ca5dcb9d req-b971c850-c7fa-4d7a-bb87-ea74a70c4f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47daf830-dbdf-42ca-ab4a-7fa63658b66a", "name": "network-vif-deleted", "tag": "d50c538b-1612-4fad-b54b-93a3c2ceaccb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:50.595062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-781c732f-37f1-4cc0-aea9-5f03ca5dcb9d req-b971c850-c7fa-4d7a-bb87-ea74a70c4f96 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:50.598207 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-781c732f-37f1-4cc0-aea9-5f03ca5dcb9d req-b971c850-c7fa-4d7a-bb87-ea74a70c4f96 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:50.618467 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-781c732f-37f1-4cc0-aea9-5f03ca5dcb9d req-b971c850-c7fa-4d7a-bb87-ea74a70c4f96 service nova] Creating event network-vif-deleted:d50c538b-1612-4fad-b54b-93a3c2ceaccb for instance 47daf830-dbdf-42ca-ab4a-7fa63658b66a on n-h1-master-1 Jul 24 01:11:50.631399 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-781c732f-37f1-4cc0-aea9-5f03ca5dcb9d req-b971c850-c7fa-4d7a-bb87-ea74a70c4f96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061560 Jul 24 01:11:50.632390 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 474/885] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:50.639961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:50.640935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:50.650294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:50.651202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:50.652573 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:50.653183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:50.805276 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:51.764823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:51.785844 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d79d68e-0abb-4c6f-a36d-653a6f4a5d29 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 1.151680 Jul 24 01:11:51.796297 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 475/886] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:50 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:51.804681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:51.805551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:51.847346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:51.851765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:51.852660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:51.853092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:52.259385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:52.268759 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0332eef6-3288-4d22-9bf1-660dba73cc19 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.479571 Jul 24 01:11:52.273514 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 476/887] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:51 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:52.279309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2132af11-c6e1-4c85-9b04-f65f8386edd7 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb53dc10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:52.344305 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2132af11-c6e1-4c85-9b04-f65f8386edd7 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.069245 Jul 24 01:11:52.348050 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 477/888] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:52 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:52.368235 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3c9987fd-543a-4357-828d-8dccd1b1e92c does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:11:52.368846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Neutron security group 3c9987fd-543a-4357-828d-8dccd1b1e92c not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:11:52.369301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.security_groups [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Security Group ID 3c9987fd-543a-4357-828d-8dccd1b1e92c does not exist {{(pid=119562) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 24 01:11:52.390434 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3c9987fd-543a-4357-828d-8dccd1b1e92c does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:11:52.391022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Neutron security group 3c9987fd-543a-4357-828d-8dccd1b1e92c not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:11:52.391668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.security_groups [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Security Group ID 3c9987fd-543a-4357-828d-8dccd1b1e92c does not exist {{(pid=119562) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 24 01:11:52.563760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32f013c4-68af-4ef0-96ae-e3ec429ae333 tempest-ListImageFiltersNegativeTestJSON-339619589 tempest-ListImageFiltersNegativeTestJSON-339619589-project] Calling method '.version_select at 0x7f05eb4f1550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:52.587316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-32f013c4-68af-4ef0-96ae-e3ec429ae333 tempest-ListImageFiltersNegativeTestJSON-339619589 tempest-ListImageFiltersNegativeTestJSON-339619589-project] HTTP exception thrown: Image not found. Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32f013c4-68af-4ef0-96ae-e3ec429ae333 tempest-ListImageFiltersNegativeTestJSON-339619589 tempest-ListImageFiltersNegativeTestJSON-339619589-project] Request method failure captured: Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/images/52885940-384d-410c-9888-e5bac3b42ca5 HTTP/1.1 Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JxXTwBoqwLKM79QcH9DIF4wF_LcFCmBYwmQZQEbFWXqlkru26NWGlvhCrdeoUrlWfvmDAuXW0JPByJFPsIyWZTW9GN3StNY22-qbtcBb7qiKgof4710mWdRx6X67SUg2sBRbKYdqQ3X6RPmeJDfz3xxEV5-GarfSnELvJ-qiNqwI7Q Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e67380ef5ad54bc9b978142f9f9eaa8e Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-339619589 Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:11:52.646939 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e67380ef5ad54bc9b978142f9f9eaa8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e67380ef5ad54bc9b978142f9f9eaa8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e67380ef5ad54bc9b978142f9f9eaa8e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e67380ef5ad54bc9b978142f9f9eaa8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-339619589 Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e67380ef5ad54bc9b978142f9f9eaa8e Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-339619589 Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListImageFiltersNegativeTestJSON-339619589-project Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: e053b08200e941c09cbfceca57fcf7f2 Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-339619589-project Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '52885940-384d-410c-9888-e5bac3b42ca5'} Jul 24 01:11:52.648344 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:11:52.649103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 52885940-384d-410c-9888-e5bac3b42ca5 Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:11:52.650217 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 52885940-384d-410c-9888-e5bac3b42ca5 could not be found. Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:11:52.651665 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:11:52.653696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:52.655544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32f013c4-68af-4ef0-96ae-e3ec429ae333 tempest-ListImageFiltersNegativeTestJSON-339619589 tempest-ListImageFiltersNegativeTestJSON-339619589-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:52.656535 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32f013c4-68af-4ef0-96ae-e3ec429ae333 tempest-ListImageFiltersNegativeTestJSON-339619589 tempest-ListImageFiltersNegativeTestJSON-339619589-project] 10.222.0.27 "GET /compute/v2.1/images/52885940-384d-410c-9888-e5bac3b42ca5" status: 404 len: 62 microversion: 2.1 time: 0.304169 Jul 24 01:11:52.657223 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 478/889] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:52 2022] GET /compute/v2.1/images/52885940-384d-410c-9888-e5bac3b42ca5 => generated 62 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:11:52.805931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:52.807490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:52.817033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:52.820316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:52.824851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:52.825542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:52.863217 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89461757-63d7-40d0-bffd-87882aedea90 does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:11:52.863891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Neutron security group 89461757-63d7-40d0-bffd-87882aedea90 not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:11:52.865352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.security_groups [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Security Group ID 89461757-63d7-40d0-bffd-87882aedea90 does not exist {{(pid=119562) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 24 01:11:52.887981 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89461757-63d7-40d0-bffd-87882aedea90 does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:11:52.888592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Neutron security group 89461757-63d7-40d0-bffd-87882aedea90 not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:11:52.889042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.security_groups [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Security Group ID 89461757-63d7-40d0-bffd-87882aedea90 does not exist {{(pid=119562) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 24 01:11:53.134367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:53.145002 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c0ca7fe7-dfb3-459e-8a8a-887832bc440c tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.344762 Jul 24 01:11:53.150895 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 479/890] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:52 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:53.293655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:53.294294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:53.304388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:53.304849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:53.305646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:53.306094 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:53.697392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:53.717922 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1ae1641-0552-4f51-b559-cc549a5f9ded tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.429306 Jul 24 01:11:53.745411 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 480/891] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:53 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:53.758876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4769d904-d8e0-4170-8100-7cd640022441 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb287b80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:53.922772 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4769d904-d8e0-4170-8100-7cd640022441 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.170699 Jul 24 01:11:53.927778 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 481/892] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:53 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:53.951746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cc39c0cc-71ce-4ae0-b0a5-2fefde508778 req-de5d7b56-e0ef-48f7-ae2e-798986f7a6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a3af3f-a328-4fd1-bde3-60e2bd931971", "name": "network-vif-plugged", "status": "completed", "tag": "0214e03d-9856-453d-bbf6-369c337000f0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:53.962745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc39c0cc-71ce-4ae0-b0a5-2fefde508778 req-de5d7b56-e0ef-48f7-ae2e-798986f7a6f5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:53.969401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc39c0cc-71ce-4ae0-b0a5-2fefde508778 req-de5d7b56-e0ef-48f7-ae2e-798986f7a6f5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:53.982997 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc39c0cc-71ce-4ae0-b0a5-2fefde508778 req-de5d7b56-e0ef-48f7-ae2e-798986f7a6f5 service nova] Creating event network-vif-plugged:0214e03d-9856-453d-bbf6-369c337000f0 for instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 on n-h2-master-1 Jul 24 01:11:53.993354 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cc39c0cc-71ce-4ae0-b0a5-2fefde508778 req-de5d7b56-e0ef-48f7-ae2e-798986f7a6f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058486 Jul 24 01:11:53.994944 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 482/893] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:54.196041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:54.197759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:54.226874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:54.228167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:54.229914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:54.231743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:54.542928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:54.555769 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9f2e0b3-2092-4712-bf3e-782a1a30d8f8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.378153 Jul 24 01:11:54.557416 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 483/894] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:54 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:54.597979 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb874dcd-6c26-48ac-87dc-0cc310d1ab9a tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12637 microversion: 2.1 time: 5.820829 Jul 24 01:11:54.598748 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 412/895] 10.222.0.27 () {58 vars in 1190 bytes} [Sun Jul 24 01:11:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12637 bytes in 5822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:11:54.622582 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ad2e282-9862-4f92-8c6e-5357a71175e1 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] Calling method '.version_select at 0x7f05eb4f1550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:54.736666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:54.737354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:54.744987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:54.745834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:54.746628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:54.747669 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:54.969594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:54.987402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-26041702-c35c-487c-af14-03dea73fdf43 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.255282 Jul 24 01:11:54.988286 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 413/896] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:54 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:54.995912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3d513ad-e6a5-40c9-80ab-50f788f68781 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb801550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:55.026687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ad2e282-9862-4f92-8c6e-5357a71175e1 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.408461 Jul 24 01:11:55.028260 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 484/897] 10.222.0.27 () {58 vars in 1190 bytes} [Sun Jul 24 01:11:54 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:55.042408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f27fc32c-365c-4461-8c90-a242bb87bd3d tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Calling method '.version_select at 0x7f05eb287280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:55.076360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3d513ad-e6a5-40c9-80ab-50f788f68781 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.085311 Jul 24 01:11:55.077595 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 414/898] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:54 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:55.331621 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f27fc32c-365c-4461-8c90-a242bb87bd3d tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7a7d5846-a0e0-4a41-85a1-561fbdb5cb0f" status: 202 len: 0 microversion: 2.1 time: 0.292707 Jul 24 01:11:55.333928 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 485/899] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:11:55 2022] DELETE /compute/v2.1/os-security-groups/7a7d5846-a0e0-4a41-85a1-561fbdb5cb0f => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:55.345734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fc014a14-a447-40e1-8841-8b173148e787 tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] Calling method '.version_select at 0x7f05eb59fee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:55.574732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:55.576543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:55.611039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:55.612539 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:55.618619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:55.619809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:55.666844 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fc014a14-a447-40e1-8841-8b173148e787 tempest-SecurityGroupsTestAdminJSON-1044162318 tempest-SecurityGroupsTestAdminJSON-1044162318-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b9ba85e2-59f4-4c36-aa5c-6831d3b788c3" status: 202 len: 0 microversion: 2.1 time: 0.327475 Jul 24 01:11:55.668213 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 415/900] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:11:55 2022] DELETE /compute/v2.1/os-security-groups/b9ba85e2-59f4-4c36-aa5c-6831d3b788c3 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:55.691121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d3e7486d-d019-49ff-8e06-3997b568a1c2 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] Calling method '.version_select at 0x7f05eb698af0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:55.918419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:55.927889 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8575d77c-88b6-44c9-a270-ac280fd40cfe tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.358263 Jul 24 01:11:55.944416 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 486/901] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:55 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:56.007844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:56.008708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:56.018464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:56.026829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:56.028567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:56.029251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:56.044595 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d3e7486d-d019-49ff-8e06-3997b568a1c2 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/becb3942-687e-44f5-8670-206f87bc7f08" status: 202 len: 0 microversion: 2.1 time: 0.367893 Jul 24 01:11:56.049569 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 416/902] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:11:55 2022] DELETE /compute/v2.1/os-security-groups/becb3942-687e-44f5-8670-206f87bc7f08 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:56.055463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a786da37-bafe-444f-bc91-af92ae938342 req-afb7e471-18e0-4225-8780-468741a2ef0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c", "name": "network-vif-plugged", "status": "completed", "tag": "e368dfa6-9f73-459f-b85b-937469b46092"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:56.098797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a786da37-bafe-444f-bc91-af92ae938342 req-afb7e471-18e0-4225-8780-468741a2ef0a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:56.102440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a786da37-bafe-444f-bc91-af92ae938342 req-afb7e471-18e0-4225-8780-468741a2ef0a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:56.119730 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a786da37-bafe-444f-bc91-af92ae938342 req-afb7e471-18e0-4225-8780-468741a2ef0a service nova] Creating event network-vif-plugged:e368dfa6-9f73-459f-b85b-937469b46092 for instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c on n-h1-master-1 Jul 24 01:11:56.142315 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a786da37-bafe-444f-bc91-af92ae938342 req-afb7e471-18e0-4225-8780-468741a2ef0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087407 Jul 24 01:11:56.143051 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 417/903] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:11:56.149735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f21e6d59-9e2e-488b-8c0d-37f6dfa6a2e9 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] Calling method '.version_select at 0x7f05eb698040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:56.523344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:56.534391 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f953266c-7a97-4c27-b372-c8e94cb01c53 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1323 microversion: 2.1 time: 0.532614 Jul 24 01:11:56.541863 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 487/904] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:56 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1323 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:56.560846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b4a67ea-8fd3-4c99-9caa-c48384a8e7e6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb2873a0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:56.643649 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b4a67ea-8fd3-4c99-9caa-c48384a8e7e6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.100250 Jul 24 01:11:56.645743 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 488/905] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:56 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:56.731276 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f21e6d59-9e2e-488b-8c0d-37f6dfa6a2e9 tempest-SecurityGroupsTestAdminJSON-2106041172 tempest-SecurityGroupsTestAdminJSON-2106041172-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/406a5342-dd26-4466-a137-726013b52f04" status: 202 len: 0 microversion: 2.1 time: 0.586602 Jul 24 01:11:56.743362 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 418/906] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:11:56 2022] DELETE /compute/v2.1/os-security-groups/406a5342-dd26-4466-a137-726013b52f04 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:11:56.961768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:56.962704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:56.975122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:56.977586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:56.978586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:56.980048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:57.219222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:57.229379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e1f2ccd-d267-44f6-bc25-97303f19c10e tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1322 microversion: 2.1 time: 0.272736 Jul 24 01:11:57.232580 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 489/907] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:56 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:57.558598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:57.559425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:57.576925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:57.584290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:57.585173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:57.590028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:57.658961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae17a155-c1af-420c-8572-da3537fe9a08 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb2871f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:57.753863 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae17a155-c1af-420c-8572-da3537fe9a08 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.098921 Jul 24 01:11:57.759616 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 490/908] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:57 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:57.995964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:58.007680 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03fc3e74-a678-4a40-a100-99179f2609fa tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1472 microversion: 2.1 time: 0.454678 Jul 24 01:11:58.010593 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 419/909] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:57 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:58.029156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:58.030782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:58.046673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.049374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.050607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.054807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.135274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Request method failure captured: Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971/diagnostics HTTP/1.1 Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JxBN3BquKu4vTXmuftSp0GbCLk9EKMzQ6xLZIf18SoVLzjHAjU8uRhtNDM2uLv9u_Ks8AYtQXg3V-TsmoN3Q_1wAHMRp-U6gu4Sp0iqhpiHx1_0mykCtrngpc5tr1FHthgGEoHLUWmPNo_Eejn4JDFUYi4yNJvYO7pCnDXWDmI-xu8 Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 398c03dd81d44131b50d466f22c4001c Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-163728883 Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:11:58.147477 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/398c03dd81d44131b50d466f22c4001c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c03dd81d44131b50d466f22c4001c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_398c03dd81d44131b50d466f22c4001c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c03dd81d44131b50d466f22c4001c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-163728883 Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 398c03dd81d44131b50d466f22c4001c Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-163728883 Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerDiagnosticsNegativeTest-163728883-project Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1303cf4bd9f84cb1802e4d3b6ccbafa2 Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-163728883-project Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:11:58.148910 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': 'c6a3af3f-a328-4fd1-bde3-60e2bd931971'} Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:11:58.149600 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 24 01:11:58.150830 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:11:58.153452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:11:58.154752 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bdf9467b-1cb3-4168-adbf-4dca22dc8095 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.130341 Jul 24 01:11:58.155564 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 491/910] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:11:58 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971/diagnostics => generated 117 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:11:58.167980 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:58.168555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:58.182344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.182925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.184495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.185021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.232452 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:11:58.251041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:58.252343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:58.255927 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:58.270206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.271082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.274400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.277026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.418838 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c06a15f8-8702-40be-a8b0-5090e2f2e5c1 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 204 len: 0 microversion: 2.1 time: 0.256362 Jul 24 01:11:58.422867 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 420/911] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:11:58 2022] DELETE /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:11:58.438136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:58.440953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:58.460575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.463683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.464861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.466165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.767958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:58.784419 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e59aae60-0601-43c9-ad1b-b16d86e182d6 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 200 len: 1517 microversion: 2.1 time: 0.535334 Jul 24 01:11:58.786552 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 492/912] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:58 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:11:58.795955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4604db38-cd6e-4cf4-b937-9f80c3159f18 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb72b940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:11:58.883037 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4604db38-cd6e-4cf4-b937-9f80c3159f18 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.095191 Jul 24 01:11:58.884113 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 493/913] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:58 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:58.897622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'action', calling method: .version_select at 0x7f05f9e83040>, body: {"addFloatingIp": {"address": "172.35.1.101"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:11:58.906081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:11:58.934081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.948340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:58.950962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:11:58.951633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:11:59.058023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:11:59.091564 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2db84f0f-8c8f-4eb6-911b-1fe908411083 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1478 microversion: 2.1 time: 0.663648 Jul 24 01:11:59.103077 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 421/914] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:11:58 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1478 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:11:59.199164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Acquired lock "refresh_cache-f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:11:59.900248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f827d5f3-0f45-4195-a511-7902202d0482 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb84d280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:00.012709 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f827d5f3-0f45-4195-a511-7902202d0482 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.117628 Jul 24 01:12:00.013453 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 422/915] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:59 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:00.135441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:00.136141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:00.154025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:00.154508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:00.157453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:00.164758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:01.077754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:01.087823 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7fae2d9a-7d65-4c4f-8036-1f86deeea056 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1478 microversion: 2.1 time: 0.972632 Jul 24 01:12:01.096313 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 423/916] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:00 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1478 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:01.121343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3ff15e9c-b3f9-4fe6-b24e-1de336bc9133 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb84d3a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:01.227833 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3ff15e9c-b3f9-4fe6-b24e-1de336bc9133 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.130019 Jul 24 01:12:01.230630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 424/917] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:01 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:02.126012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:02.126935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:02.166029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:02.171185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:02.181359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:02.182173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:02.445494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1303cf4bd9f84cb1802e4d3b6ccbafa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c03dd81d44131b50d466f22c4001c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:02.455423 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-783bd724-c729-4586-8297-2cb227b6e79a tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 200 len: 1308 microversion: 2.1 time: 0.348426 Jul 24 01:12:02.463089 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 425/918] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:02 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:02.474812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d811ea76-a619-4e15-84a7-04f0ec11248a req-ba2a9b72-efd1-4e0e-bf13-fa59097914c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a3af3f-a328-4fd1-bde3-60e2bd931971", "name": "network-vif-deleted", "tag": "0214e03d-9856-453d-bbf6-369c337000f0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:02.507220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d811ea76-a619-4e15-84a7-04f0ec11248a req-ba2a9b72-efd1-4e0e-bf13-fa59097914c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:02.508829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d811ea76-a619-4e15-84a7-04f0ec11248a req-ba2a9b72-efd1-4e0e-bf13-fa59097914c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:02.542326 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d811ea76-a619-4e15-84a7-04f0ec11248a req-ba2a9b72-efd1-4e0e-bf13-fa59097914c0 service nova] Creating event network-vif-deleted:0214e03d-9856-453d-bbf6-369c337000f0 for instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 on n-h2-master-1 Jul 24 01:12:02.554365 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d811ea76-a619-4e15-84a7-04f0ec11248a req-ba2a9b72-efd1-4e0e-bf13-fa59097914c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089751 Jul 24 01:12:02.555279 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 426/919] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:02.561020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d25ba552-1d99-465d-a2fe-fe3c185fe264 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb9359d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:02.642819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d25ba552-1d99-465d-a2fe-fe3c185fe264 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.086149 Jul 24 01:12:02.643705 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 427/920] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:02 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:03.274811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Building network info cache for instance {{(pid=119561) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:12:03.778197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-516999be-d427-4cc1-9a38-f4e9efca80cd tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Calling method '.version_select at 0x7f05eb84d8b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:03.995740 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-516999be-d427-4cc1-9a38-f4e9efca80cd tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:12:03.996680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-516999be-d427-4cc1-9a38-f4e9efca80cd tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Neutron security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:12:03.997401 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-516999be-d427-4cc1-9a38-f4e9efca80cd tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] HTTP exception thrown: Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist Jul 24 01:12:03.997401 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-47e3dd06-13eb-4d44-a511-b8f3cddf78ee'] Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-516999be-d427-4cc1-9a38-f4e9efca80cd tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Request method failure captured: Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-security-groups/9bd9224c-261e-40a6-9c1c-f9ea47c3c499 HTTP/1.1 Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jxj3AEAibLwZPwy6l0L9BARJLW06sTgLJxVRzmW5Xel4hTAnyK9aVg1kmoy09zuwbd6AklRd-Pulq6szasaotxYeTIJsB1znTPsoTtgWHCX_biLfM8miuIbsucaQrdwgB1DSigGym35p39tcMfwkAb2bKZ50FJCX5XIxLKOaN_uPtY Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:04.056948 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a6fa94d0cab4efea6cd924459d20656", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f0c7356c8a6b4618b7f8acc88eefc6b1 Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: exception: Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-47e3dd06-13eb-4d44-a511-b8f3cddf78ee'] Jul 24 01:12:04.058641 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9bd9224c-261e-40a6-9c1c-f9ea47c3c499'} Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:04.059489 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e3dd06-13eb-4d44-a511-b8f3cddf78ee'] Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:12:04.060779 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e3dd06-13eb-4d44-a511-b8f3cddf78ee'] Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e3dd06-13eb-4d44-a511-b8f3cddf78ee'] Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.061870 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:04.063147 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:04.063147 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:04.063147 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:04.063147 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:04.063147 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist Jul 24 01:12:04.063147 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e3dd06-13eb-4d44-a511-b8f3cddf78ee'] Jul 24 01:12:04.063147 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.066655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-516999be-d427-4cc1-9a38-f4e9efca80cd tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Returning 404 to user: Security group 9bd9224c-261e-40a6-9c1c-f9ea47c3c499 does not exist Jul 24 01:12:04.066655 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-47e3dd06-13eb-4d44-a511-b8f3cddf78ee'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:04.068058 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-516999be-d427-4cc1-9a38-f4e9efca80cd tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9bd9224c-261e-40a6-9c1c-f9ea47c3c499" status: 404 len: 194 microversion: 2.1 time: 0.758868 Jul 24 01:12:04.069143 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 428/921] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:12:03 2022] DELETE /compute/v2.1/os-security-groups/9bd9224c-261e-40a6-9c1c-f9ea47c3c499 => generated 194 bytes in 760 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:12:04.077928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:04.080579 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] [instance: c6a3af3f-a328-4fd1-bde3-60e2bd931971] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:04.108282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.114158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.115083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.115547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.148237 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] HTTP exception thrown: Instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 could not be found. Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Request method failure captured: Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 HTTP/1.1 Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JxBN3BquKu4vTXmuftSp0GbCLk9EKMzQ6xLZIf18SoVLzjHAjU8uRhtNDM2uLv9u_Ks8AYtQXg3V-TsmoN3Q_1wAHMRp-U6gu4Sp0iqhpiHx1_0mykCtrngpc5tr1FHthgGEoHLUWmPNo_Eejn4JDFUYi4yNJvYO7pCnDXWDmI-xu8 Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 398c03dd81d44131b50d466f22c4001c Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-163728883 Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:04.150656 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/398c03dd81d44131b50d466f22c4001c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c03dd81d44131b50d466f22c4001c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_398c03dd81d44131b50d466f22c4001c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c03dd81d44131b50d466f22c4001c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-163728883 Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 398c03dd81d44131b50d466f22c4001c Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-163728883 Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerDiagnosticsNegativeTest-163728883-project Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1303cf4bd9f84cb1802e4d3b6ccbafa2 Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-163728883-project Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 could not be found. Jul 24 01:12:04.151974 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c6a3af3f-a328-4fd1-bde3-60e2bd931971'} Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 could not be found. Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:04.152723 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 could not be found. Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 could not be found. Jul 24 01:12:04.153968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:04.155035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] Returning 404 to user: Instance c6a3af3f-a328-4fd1-bde3-60e2bd931971 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:04.155035 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ce6c5de0-9cd9-4f6e-8dfa-f2cbe2166f55 tempest-ServerDiagnosticsNegativeTest-163728883 tempest-ServerDiagnosticsNegativeTest-163728883-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971" status: 404 len: 111 microversion: 2.1 time: 0.081785 Jul 24 01:12:04.163098 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 429/922] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:04 2022] GET /compute/v2.1/servers/c6a3af3f-a328-4fd1-bde3-60e2bd931971 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:04.173883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3386ef6-b9d2-4cab-a366-7aceb51eb28f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb801ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:04.287381 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3386ef6-b9d2-4cab-a366-7aceb51eb28f tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.123097 Jul 24 01:12:04.287990 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 430/923] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:04 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:04.446502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-241884285", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": "none"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:04.562774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:04.563204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:04.563869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:04.564457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:04.565320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:04.584537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.585840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.587255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.588043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.644849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Getting quotas for project 6dc5a0a6cd7f48bc8c41a790c3f82cc6. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:04.664296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Getting quotas for user 3c39d06504644aa29428fc9b130e73ea and project 6dc5a0a6cd7f48bc8c41a790c3f82cc6. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:04.732143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:12:04.749620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:04.782979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Updating instance_info_cache with network_info: [{"id": "32fa2173-df2d-4d45-b2f8-9c6046b137ea", "address": "fa:16:3e:f5:02:33", "network": {"id": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-799036886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa4e8e174a104e60a0c40a83bd2235fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32fa2173-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119561) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:12:04.811740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Releasing lock "refresh_cache-f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:12:04.813143 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36f5da0b-9f66-4133-8a02-62639deb1b02 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action" status: 202 len: 0 microversion: 2.1 time: 5.925832 Jul 24 01:12:04.814367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 494/924] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:11:58 2022] POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action => generated 0 bytes in 5929 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:12:04.824272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a3c4082-e156-4c60-a915-6a76c31e3bc7 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008489 Jul 24 01:12:04.827665 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 495/925] 10.222.0.27 () {58 vars in 1163 bytes} [Sun Jul 24 01:12:04 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 24 01:12:04.841375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7b7086a1-b33f-4feb-af49-0f1ba0aaa913 req-12000d49-620e-4712-8f84-2e781b972807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5", "tag": "32fa2173-df2d-4d45-b2f8-9c6046b137ea"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:04.870408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7b7086a1-b33f-4feb-af49-0f1ba0aaa913 req-12000d49-620e-4712-8f84-2e781b972807 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.876138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7b7086a1-b33f-4feb-af49-0f1ba0aaa913 req-12000d49-620e-4712-8f84-2e781b972807 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.883202 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-220ea514-9713-4f44-bf5a-2f64069940c2 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.587764 Jul 24 01:12:04.885050 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 431/926] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:12:04.897454 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7b7086a1-b33f-4feb-af49-0f1ba0aaa913 req-12000d49-620e-4712-8f84-2e781b972807 service nova] Creating event network-changed:32fa2173-df2d-4d45-b2f8-9c6046b137ea for instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 on n-h2-master-1 Jul 24 01:12:04.901233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'action', calling method: .version_select at 0x7f05f9ea4c10>, body: {"addFloatingIp": {"address": "172.35.1.101"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:04.902779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:04.927839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7b7086a1-b33f-4feb-af49-0f1ba0aaa913 req-12000d49-620e-4712-8f84-2e781b972807 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097071 Jul 24 01:12:04.930310 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 496/927] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:04.943216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebca157f-acfc-4528-bedb-630de28c7860 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Calling method '.version_select at 0x7f05eb201940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:04.946462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.947226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:04.948338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:04.949073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:05.199923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Acquired lock "refresh_cache-a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:12:06.204682 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ebca157f-acfc-4528-bedb-630de28c7860 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.273047 Jul 24 01:12:06.210335 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 497/928] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:12:04 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:06.218723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:06.222243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:06.249610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:06.253185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:06.255516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:06.256166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:06.746492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:06.756365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:06.766829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:06.796338 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9debc855-ceb8-4568-8b39-65530daa7c3c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "PUT /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1410 microversion: 2.75 time: 0.584262 Jul 24 01:12:06.817149 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 498/929] 10.222.0.27 () {62 vars in 1296 bytes} [Sun Jul 24 01:12:06 2022] PUT /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1410 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:06.830727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68e067ce-2e65-43a6-86b2-1b4f0e604fa9 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb2019d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:06.919704 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68e067ce-2e65-43a6-86b2-1b4f0e604fa9 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.100565 Jul 24 01:12:06.920777 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 499/930] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:06 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:06.933415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-616b3df2-768e-4d5f-ab7b-6e5a7624007c tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Calling method '.version_select at 0x7f05eb236670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:07.728319 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-616b3df2-768e-4d5f-ab7b-6e5a7624007c tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:12:07.729017 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-616b3df2-768e-4d5f-ab7b-6e5a7624007c tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 24 01:12:07.729017 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-35256d0c-92fd-4fba-9b0a-ee43f8506e86'] Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-616b3df2-768e-4d5f-ab7b-6e5a7624007c tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Request method failure captured: Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-groups/4bf5b37d-16cf-4094-8e50-c3e3ae26f749 HTTP/1.1 Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jxj3AEAibLwZPwy6l0L9BARJLW06sTgLJxVRzmW5Xel4hTAnyK9aVg1kmoy09zuwbd6AklRd-Pulq6szasaotxYeTIJsB1znTPsoTtgWHCX_biLfM8miuIbsucaQrdwgB1DSigGym35p39tcMfwkAb2bKZ50FJCX5XIxLKOaN_uPtY Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:07.734719 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a6fa94d0cab4efea6cd924459d20656", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f0c7356c8a6b4618b7f8acc88eefc6b1 Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: exception: Insufficient rights for removing default security group. Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-35256d0c-92fd-4fba-9b0a-ee43f8506e86'] Jul 24 01:12:07.736405 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '4bf5b37d-16cf-4094-8e50-c3e3ae26f749'} Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:07.737513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35256d0c-92fd-4fba-9b0a-ee43f8506e86'] Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 24 01:12:07.739156 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35256d0c-92fd-4fba-9b0a-ee43f8506e86'] Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35256d0c-92fd-4fba-9b0a-ee43f8506e86'] Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:07.740570 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:07.742218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:07.742218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:07.742218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:07.742218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 24 01:12:07.742218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35256d0c-92fd-4fba-9b0a-ee43f8506e86'] Jul 24 01:12:07.742218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:07.744372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-616b3df2-768e-4d5f-ab7b-6e5a7624007c tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 24 01:12:07.744372 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-35256d0c-92fd-4fba-9b0a-ee43f8506e86'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:07.745520 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-616b3df2-768e-4d5f-ab7b-6e5a7624007c tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4bf5b37d-16cf-4094-8e50-c3e3ae26f749" status: 400 len: 182 microversion: 2.1 time: 0.821506 Jul 24 01:12:07.750101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 500/931] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:12:06 2022] DELETE /compute/v2.1/os-security-groups/4bf5b37d-16cf-4094-8e50-c3e3ae26f749 => generated 182 bytes in 826 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:12:07.768884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:07.778755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:07.799593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.800454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.801884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:07.802435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:07.995199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:08.008180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:08.011032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:08.019009 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e436b8c-ee05-4cfa-ae54-8a791f092b4f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1416 microversion: 2.75 time: 0.267375 Jul 24 01:12:08.020348 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 501/932] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:07 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1416 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:08.053363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f480fab-708c-47ed-9b52-f0c084aee668 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Calling method '.version_select at 0x7f05eb4f1a60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:08.115228 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-2f480fab-708c-47ed-9b52-f0c084aee668 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group da45e977-a667-4d7c-9335-7240971db03f does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:12:08.116302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-2f480fab-708c-47ed-9b52-f0c084aee668 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Neutron security group da45e977-a667-4d7c-9335-7240971db03f not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:12:08.117062 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-2f480fab-708c-47ed-9b52-f0c084aee668 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] HTTP exception thrown: Security group da45e977-a667-4d7c-9335-7240971db03f does not exist Jul 24 01:12:08.117062 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-252f67c0-df67-4261-956a-c4f90a73bd20'] Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f480fab-708c-47ed-9b52-f0c084aee668 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Request method failure captured: Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-security-groups/da45e977-a667-4d7c-9335-7240971db03f HTTP/1.1 Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jxj3AEAibLwZPwy6l0L9BARJLW06sTgLJxVRzmW5Xel4hTAnyK9aVg1kmoy09zuwbd6AklRd-Pulq6szasaotxYeTIJsB1znTPsoTtgWHCX_biLfM8miuIbsucaQrdwgB1DSigGym35p39tcMfwkAb2bKZ50FJCX5XIxLKOaN_uPtY Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:08.119454 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a6fa94d0cab4efea6cd924459d20656", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f0c7356c8a6b4618b7f8acc88eefc6b1 Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: exception: Security group da45e977-a667-4d7c-9335-7240971db03f does not exist Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-252f67c0-df67-4261-956a-c4f90a73bd20'] Jul 24 01:12:08.120704 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'da45e977-a667-4d7c-9335-7240971db03f'} Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.121441 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group da45e977-a667-4d7c-9335-7240971db03f does not exist Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-252f67c0-df67-4261-956a-c4f90a73bd20'] Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:12:08.122533 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group da45e977-a667-4d7c-9335-7240971db03f does not exist Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-252f67c0-df67-4261-956a-c4f90a73bd20'] Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group da45e977-a667-4d7c-9335-7240971db03f does not exist Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-252f67c0-df67-4261-956a-c4f90a73bd20'] Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.123760 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.125215 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:08.125215 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:08.125215 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:08.125215 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:08.125215 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group da45e977-a667-4d7c-9335-7240971db03f does not exist Jul 24 01:12:08.125215 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-252f67c0-df67-4261-956a-c4f90a73bd20'] Jul 24 01:12:08.125215 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.142245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f480fab-708c-47ed-9b52-f0c084aee668 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Returning 404 to user: Security group da45e977-a667-4d7c-9335-7240971db03f does not exist Jul 24 01:12:08.142245 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-252f67c0-df67-4261-956a-c4f90a73bd20'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:08.143581 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f480fab-708c-47ed-9b52-f0c084aee668 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/da45e977-a667-4d7c-9335-7240971db03f" status: 404 len: 194 microversion: 2.1 time: 0.097805 Jul 24 01:12:08.144739 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 502/933] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:12:08 2022] GET /compute/v2.1/os-security-groups/da45e977-a667-4d7c-9335-7240971db03f => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:08.157254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a8d0131-f800-4e45-a154-a4ef25ede012 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb287c10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:08.250387 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a8d0131-f800-4e45-a154-a4ef25ede012 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1454 microversion: 2.1 time: 0.103678 Jul 24 01:12:08.252049 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 503/934] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:08 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:08.258780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a93770a-c61b-49ba-a0d2-7c612bfd06c5 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Action: 'update', calling method: .version_select at 0x7f05eb4f1790>, body: {"security_group": {"name": "tempest-sg-1627637402", "description": "tempest-description-1823200615"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:08.381150 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-2a93770a-c61b-49ba-a0d2-7c612bfd06c5 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:12:08.384681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-2a93770a-c61b-49ba-a0d2-7c612bfd06c5 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Neutron security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:12:08.385267 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-2a93770a-c61b-49ba-a0d2-7c612bfd06c5 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] HTTP exception thrown: Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist Jul 24 01:12:08.385267 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f87513ae-3436-4231-92e8-a9f266b00bee'] Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a93770a-c61b-49ba-a0d2-7c612bfd06c5 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Request method failure captured: Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/os-security-groups/0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe HTTP/1.1 Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 102 Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jxj3AEAibLwZPwy6l0L9BARJLW06sTgLJxVRzmW5Xel4hTAnyK9aVg1kmoy09zuwbd6AklRd-Pulq6szasaotxYeTIJsB1znTPsoTtgWHCX_biLfM8miuIbsucaQrdwgB1DSigGym35p39tcMfwkAb2bKZ50FJCX5XIxLKOaN_uPtY Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:08.387566 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a6fa94d0cab4efea6cd924459d20656", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a6fa94d0cab4efea6cd924459d20656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9a6fa94d0cab4efea6cd924459d20656 Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589 Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f0c7356c8a6b4618b7f8acc88eefc6b1 Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1918715589-project Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: {"security_group": {"name": "tempest-sg-1627637402", "description": "tempest-description-1823200615"}} Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:12:08.388795 n-d-master-1 devstack@n-api.service[119561]: exception: Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f87513ae-3436-4231-92e8-a9f266b00bee'] Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe', 'body': {'security_group': {'name': 'tempest-sg-1627637402', 'description': 'tempest-description-1823200615'}}} Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:12:08.389545 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f87513ae-3436-4231-92e8-a9f266b00bee'] Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:12:08.390616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f87513ae-3436-4231-92e8-a9f266b00bee'] Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f87513ae-3436-4231-92e8-a9f266b00bee'] Jul 24 01:12:08.391682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f87513ae-3436-4231-92e8-a9f266b00bee'] Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a93770a-c61b-49ba-a0d2-7c612bfd06c5 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] Returning 404 to user: Security group 0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe does not exist Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f87513ae-3436-4231-92e8-a9f266b00bee'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:08.392865 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a93770a-c61b-49ba-a0d2-7c612bfd06c5 tempest-SecurityGroupsNegativeTestJSON-1918715589 tempest-SecurityGroupsNegativeTestJSON-1918715589-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe" status: 404 len: 194 microversion: 2.1 time: 0.135486 Jul 24 01:12:08.406727 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 504/935] 10.222.0.27 () {60 vars in 1289 bytes} [Sun Jul 24 01:12:08 2022] PUT /compute/v2.1/os-security-groups/0d52cb6e-3ee8-47fe-90e1-6fdf3a6402fe => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:09.047811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:09.048561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:09.058339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.062355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.063701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.065915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.242969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:09.250309 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:09.261106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:09.263079 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:09.278598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a488c56e-6abc-47be-a9e9-ea73a2bea607 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1416 microversion: 2.75 time: 0.234880 Jul 24 01:12:09.292656 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 505/936] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:09 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1416 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:09.302725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1830bc51-2e17-4700-8262-8317d4faf6df tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb53db80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:09.390607 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1830bc51-2e17-4700-8262-8317d4faf6df tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1463 microversion: 2.1 time: 0.096215 Jul 24 01:12:09.391131 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 506/937] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:09 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1463 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:09.403119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57d5cc16-e477-4517-ae52-a7a166dc3beb tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb236790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:09.473017 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-57d5cc16-e477-4517-ae52-a7a166dc3beb tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 200 len: 1463 microversion: 2.1 time: 0.073128 Jul 24 01:12:09.476728 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 507/938] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:09 2022] GET /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 1463 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:09.489973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:09.490956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:09.502849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.504950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:09.507682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:09.508388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.136619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:10.144728 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f27764b-e454-4479-b368-c0b180136f25 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1480 microversion: 2.1 time: 0.658722 Jul 24 01:12:10.148141 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 508/939] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:09 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1480 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:10.172597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3c282d48-0ee9-4b88-bb56-8d81f0408fdf req-2f40718b-f7c3-482b-8dfb-8c637330a1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5", "tag": "32fa2173-df2d-4d45-b2f8-9c6046b137ea"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:10.189284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3c282d48-0ee9-4b88-bb56-8d81f0408fdf req-2f40718b-f7c3-482b-8dfb-8c637330a1ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.190418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3c282d48-0ee9-4b88-bb56-8d81f0408fdf req-2f40718b-f7c3-482b-8dfb-8c637330a1ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.221632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3c282d48-0ee9-4b88-bb56-8d81f0408fdf req-2f40718b-f7c3-482b-8dfb-8c637330a1ad service nova] Creating event network-changed:32fa2173-df2d-4d45-b2f8-9c6046b137ea for instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 on n-h2-master-1 Jul 24 01:12:10.228927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3c282d48-0ee9-4b88-bb56-8d81f0408fdf req-2f40718b-f7c3-482b-8dfb-8c637330a1ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060519 Jul 24 01:12:10.230397 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 509/940] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:10.304974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:10.305693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:10.320769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.321237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.322060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.322496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.399971 n-d-master-1 devstack@n-api.service[119562]: INFO nova.network.neutron [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] re-assign floating IP 172.35.1.101 from instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 Jul 24 01:12:10.505626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Building network info cache for instance {{(pid=119562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:12:10.512897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:10.524719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:10.526479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:10.533389 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-41a7e991-2d7e-429f-a843-edbec4b216f8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1437 microversion: 2.75 time: 0.236563 Jul 24 01:12:10.534902 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 510/941] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:10 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1437 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:12:10.793201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-191358f6-4859-4d58-aec2-205573b2a3a8 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:10.794995 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:10.794995 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:10.804899 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-191358f6-4859-4d58-aec2-205573b2a3a8 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.806394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-191358f6-4859-4d58-aec2-205573b2a3a8 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.808032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-191358f6-4859-4d58-aec2-205573b2a3a8 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.808984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-191358f6-4859-4d58-aec2-205573b2a3a8 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.848845 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-191358f6-4859-4d58-aec2-205573b2a3a8 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.312775 Jul 24 01:12:10.850956 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 511/942] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:10.856623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:10.858441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:10.869987 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.870746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:10.875503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:10.875975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.007554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:11.008216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:11.009150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:11.010702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:11.011627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:11.210932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:11.228276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.229277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.233972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.234882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.441985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:11.454116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:11.455903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:11.478056 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-42a958cc-3148-408f-92bb-7f217dd6fba8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "POST /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8/action" status: 202 len: 1494 microversion: 2.75 time: 0.625432 Jul 24 01:12:11.498581 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 512/943] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:12:10 2022] POST /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8/action => generated 1494 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 24 01:12:11.510060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5da64bfb-9650-48a2-92ca-d8c8f4169bf9 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:11.511471 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:11.511471 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:11.513324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da64bfb-9650-48a2-92ca-d8c8f4169bf9 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.514104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da64bfb-9650-48a2-92ca-d8c8f4169bf9 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.515672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da64bfb-9650-48a2-92ca-d8c8f4169bf9 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.516563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da64bfb-9650-48a2-92ca-d8c8f4169bf9 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.568002 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5da64bfb-9650-48a2-92ca-d8c8f4169bf9 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.065849 Jul 24 01:12:11.572701 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 513/944] 10.222.0.27 () {58 vars in 1169 bytes} [Sun Jul 24 01:12:11 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:11.595940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:11.596975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:11.619861 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.620579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.621628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.622366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.918084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:11.931620 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c796981-c9ce-4d23-a1f2-fb88ea1d5d12 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1467 microversion: 2.1 time: 0.345282 Jul 24 01:12:11.933498 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 514/945] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:11 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1467 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:11.943388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:11.944333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:11.966087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.966964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:11.968326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:11.969047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.041956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Updating instance_info_cache with network_info: [{"id": "32fa2173-df2d-4d45-b2f8-9c6046b137ea", "address": "fa:16:3e:f5:02:33", "network": {"id": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-799036886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa4e8e174a104e60a0c40a83bd2235fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32fa2173-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:12:12.055014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Building network info cache for instance {{(pid=119562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:12:12.105787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:12.118329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:12.120082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:12.139324 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-82e05628-35f5-42fc-af4d-86148932a6c8 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.203804 Jul 24 01:12:12.141742 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 515/946] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:11 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:12.149320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2fc45a87-f919-4fd7-9462-219a591f6746 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.154730 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:12.154730 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:12.156499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fc45a87-f919-4fd7-9462-219a591f6746 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.157455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fc45a87-f919-4fd7-9462-219a591f6746 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.157952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fc45a87-f919-4fd7-9462-219a591f6746 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.158458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fc45a87-f919-4fd7-9462-219a591f6746 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.209301 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2fc45a87-f919-4fd7-9462-219a591f6746 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.066283 Jul 24 01:12:12.221183 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 516/947] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:12.237493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8322af00-77d1-4f69-9127-86e9aee3f272 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb08daf0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.390784 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8322af00-77d1-4f69-9127-86e9aee3f272 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-07-24T01%3A10%3A07Z" status: 200 len: 2799 microversion: 2.1 time: 0.165722 Jul 24 01:12:12.391998 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 517/948] 10.222.0.27 () {58 vars in 1198 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/images?changes-since=2022-07-24T01%3A10%3A07Z => generated 2799 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:12.397997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fee4fbb-defe-43c9-aee3-0d4116c939dd tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.399709 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:12.399709 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:12.401250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fee4fbb-defe-43c9-aee3-0d4116c939dd tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.402103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fee4fbb-defe-43c9-aee3-0d4116c939dd tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.403128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fee4fbb-defe-43c9-aee3-0d4116c939dd tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.405151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fee4fbb-defe-43c9-aee3-0d4116c939dd tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.434011 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3fee4fbb-defe-43c9-aee3-0d4116c939dd tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.040664 Jul 24 01:12:12.443049 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 518/949] 10.222.0.27 () {58 vars in 1193 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:12.447412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2bfd5fb4-f957-4ee7-b23b-0f91eac8c491 req-dbedfa92-2e7b-4dbe-950f-3c772601aa0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c", "tag": "e368dfa6-9f73-459f-b85b-937469b46092"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:12.459547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2bfd5fb4-f957-4ee7-b23b-0f91eac8c491 req-dbedfa92-2e7b-4dbe-950f-3c772601aa0d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.460006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2bfd5fb4-f957-4ee7-b23b-0f91eac8c491 req-dbedfa92-2e7b-4dbe-950f-3c772601aa0d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.475869 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2bfd5fb4-f957-4ee7-b23b-0f91eac8c491 req-dbedfa92-2e7b-4dbe-950f-3c772601aa0d service nova] Creating event network-changed:e368dfa6-9f73-459f-b85b-937469b46092 for instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c on n-h1-master-1 Jul 24 01:12:12.483467 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2bfd5fb4-f957-4ee7-b23b-0f91eac8c491 req-dbedfa92-2e7b-4dbe-950f-3c772601aa0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039112 Jul 24 01:12:12.484396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 519/950] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:12.494027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a7d62f3-bbbf-49b9-ab35-b8ada56c3863 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb08d550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.609234 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a7d62f3-bbbf-49b9-ab35-b8ada56c3863 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-963614707" status: 200 len: 484 microversion: 2.1 time: 0.123282 Jul 24 01:12:12.610544 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 520/951] 10.222.0.27 () {58 vars in 1228 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-963614707 => generated 484 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:12.632920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cfd15bcd-0860-4ee8-97ac-f471ba7c5122 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.636440 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:12.636440 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:12.638810 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfd15bcd-0860-4ee8-97ac-f471ba7c5122 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.639515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfd15bcd-0860-4ee8-97ac-f471ba7c5122 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.640566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfd15bcd-0860-4ee8-97ac-f471ba7c5122 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.641215 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfd15bcd-0860-4ee8-97ac-f471ba7c5122 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.680148 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cfd15bcd-0860-4ee8-97ac-f471ba7c5122 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.066068 Jul 24 01:12:12.686083 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 521/952] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:12.696195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f022f84f-2fff-4a82-9945-a3693c7088d4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb53daf0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.865925 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f022f84f-2fff-4a82-9945-a3693c7088d4 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?server=117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 955 microversion: 2.1 time: 0.177698 Jul 24 01:12:12.867292 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 522/953] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/images?server=117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 955 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:12.872789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fe00907a-e8f9-47fb-9166-9f83a4f15be0 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:12.874366 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:12.874366 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:12.876404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe00907a-e8f9-47fb-9166-9f83a4f15be0 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.876745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe00907a-e8f9-47fb-9166-9f83a4f15be0 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.877921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe00907a-e8f9-47fb-9166-9f83a4f15be0 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:12.878469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe00907a-e8f9-47fb-9166-9f83a4f15be0 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:12.916456 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fe00907a-e8f9-47fb-9166-9f83a4f15be0 tempest-ServicesAdminNegativeTestJSON-2055394564 tempest-ServicesAdminNegativeTestJSON-2055394564-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.047977 Jul 24 01:12:12.918017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 523/954] 10.222.0.27 () {58 vars in 1197 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:12.928997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-55386b2f-3c92-45dd-a614-27eb33f1014a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb53dc10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.032700 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-55386b2f-3c92-45dd-a614-27eb33f1014a tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 485 microversion: 2.1 time: 0.113686 Jul 24 01:12:13.041987 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 524/955] 10.222.0.27 () {58 vars in 1316 bytes} [Sun Jul 24 01:12:12 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 485 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:13.299858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5047d604-58c2-4fd1-af7d-402b67b5bcfd tempest-ServicesAdminNegativeTestJSON-366419390 tempest-ServicesAdminNegativeTestJSON-366419390-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.301599 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:13.301599 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:13.302823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5047d604-58c2-4fd1-af7d-402b67b5bcfd tempest-ServicesAdminNegativeTestJSON-366419390 tempest-ServicesAdminNegativeTestJSON-366419390-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a2915eb3357b41549733e3574f38bdd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e20f1d7a14a8280e2d1f115f3b674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5047d604-58c2-4fd1-af7d-402b67b5bcfd tempest-ServicesAdminNegativeTestJSON-366419390 tempest-ServicesAdminNegativeTestJSON-366419390-project] Request method failure captured: Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JxpxfJLWAhQtuYWMQg3Whhesprkb_qWKMJI2vdYkOKT6vIXSethM_qFKdDfe1lQqA1AMn_JFmqzTqLwkzJ1yiG5FwrLq55fNK2fox8OgPOVFunGpgwkqcAx6e68Lpd9-I4ld0uELrn51e-Y76FZAtVXR9EHXXjYZ1w-MtGBBJFoz5I Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 6b4e20f1d7a14a8280e2d1f115f3b674 Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-366419390 Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:13.305894 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b4e20f1d7a14a8280e2d1f115f3b674"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b4e20f1d7a14a8280e2d1f115f3b674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b4e20f1d7a14a8280e2d1f115f3b674", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b4e20f1d7a14a8280e2d1f115f3b674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-366419390 Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 6b4e20f1d7a14a8280e2d1f115f3b674 Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-366419390 Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServicesAdminNegativeTestJSON-366419390-project Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: a2915eb3357b41549733e3574f38bdd2 Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-366419390-project Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 24 01:12:13.308019 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:12:13.309975 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 24 01:12:13.313564 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:13.315431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5047d604-58c2-4fd1-af7d-402b67b5bcfd tempest-ServicesAdminNegativeTestJSON-366419390 tempest-ServicesAdminNegativeTestJSON-366419390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:13.315431 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5047d604-58c2-4fd1-af7d-402b67b5bcfd tempest-ServicesAdminNegativeTestJSON-366419390 tempest-ServicesAdminNegativeTestJSON-366419390-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.253197 Jul 24 01:12:13.315431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 525/956] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/os-services => generated 112 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:13.315431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1db59787-327c-413c-a7bc-9a1e938818dd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb2365e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.389638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1db59787-327c-413c-a7bc-9a1e938818dd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 485 microversion: 2.1 time: 0.080128 Jul 24 01:12:13.390687 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 526/957] 10.222.0.27 () {58 vars in 1302 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 485 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:13.406177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.407158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:13.415051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:13.415513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:13.416314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:13.416766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:13.608157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:13.621257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:13.627468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:13.639852 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f20aabc-6ad9-4518-8e83-1f262deb8323 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.247823 Jul 24 01:12:13.643107 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 527/958] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:13.649042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89e7a9f2-a25a-42a2-9d08-e1360f2491bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb0dbc10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.655804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Updating instance_info_cache with network_info: [{"id": "e368dfa6-9f73-459f-b85b-937469b46092", "address": "fa:16:3e:1a:ae:3b", "network": {"id": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-799036886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa4e8e174a104e60a0c40a83bd2235fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape368dfa6-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:12:13.683334 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Releasing lock "refresh_cache-a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:12:13.684498 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f351d25-9398-4ba8-aced-29b00504a790 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c/action" status: 202 len: 0 microversion: 2.1 time: 8.792855 Jul 24 01:12:13.688365 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 432/959] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:12:04 2022] POST /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c/action => generated 0 bytes in 8798 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:12:13.700096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'action', calling method: .version_select at 0x7f05fa0281f0>, body: {"removeFloatingIp": {"address": "172.35.1.101"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:13.839239 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89e7a9f2-a25a-42a2-9d08-e1360f2491bd tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3704 microversion: 2.1 time: 0.194699 Jul 24 01:12:13.840168 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 528/960] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3704 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:13.853062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c7a90a2-6644-40df-be44-b278a65e6722 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb236b80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:13.952567 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c7a90a2-6644-40df-be44-b278a65e6722 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.103017 Jul 24 01:12:13.954187 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 529/961] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:13.971057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3d1d979-825e-418e-8b14-b6b1a5ef0977 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb0dbf70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:14.090701 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3d1d979-825e-418e-8b14-b6b1a5ef0977 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.127819 Jul 24 01:12:14.100099 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 530/962] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:13 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:14.107682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30b1282c-1399-49d0-ab25-cd8e7a468091 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb08d9d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:14.241228 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30b1282c-1399-49d0-ab25-cd8e7a468091 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-07-24T01%3A10%3A01Z" status: 200 len: 7019 microversion: 2.1 time: 0.138718 Jul 24 01:12:14.242394 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 531/963] 10.222.0.27 () {58 vars in 1219 bytes} [Sun Jul 24 01:12:14 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-24T01%3A10%3A01Z => generated 7019 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:14.269861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29eb6f66-b1ec-41ee-8f63-1bdb8af95517 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb2363a0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:14.373036 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29eb6f66-b1ec-41ee-8f63-1bdb8af95517 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-963614707" status: 200 len: 664 microversion: 2.1 time: 0.107001 Jul 24 01:12:14.373607 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 532/964] 10.222.0.27 () {58 vars in 1249 bytes} [Sun Jul 24 01:12:14 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-963614707 => generated 664 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:14.393664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c4f2d79-4e17-45d0-a617-d4b50f842acf tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb236430>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:14.526136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:14.527527 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c4f2d79-4e17-45d0-a617-d4b50f842acf tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1467 microversion: 2.1 time: 0.137250 Jul 24 01:12:14.536509 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 533/965] 10.222.0.27 () {58 vars in 1337 bytes} [Sun Jul 24 01:12:14 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1467 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:14.543931 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:14.548399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:14.549146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:14.551269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:14.553156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f926da75-df10-4f88-b8dc-a5c1cc2baae9 req-1037529f-7596-4d45-8aef-40c8ef2a81fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117685ac-31fb-41e6-94dc-4efdd3fc0262", "name": "network-vif-unplugged", "status": "completed", "tag": "f50c3fdd-6dde-4107-af40-6e69ffd16a5f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:14.553990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:14.563140 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:14.573162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f926da75-df10-4f88-b8dc-a5c1cc2baae9 req-1037529f-7596-4d45-8aef-40c8ef2a81fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:14.574510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f926da75-df10-4f88-b8dc-a5c1cc2baae9 req-1037529f-7596-4d45-8aef-40c8ef2a81fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:14.600263 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f926da75-df10-4f88-b8dc-a5c1cc2baae9 req-1037529f-7596-4d45-8aef-40c8ef2a81fc service nova] Creating event network-vif-unplugged:f50c3fdd-6dde-4107-af40-6e69ffd16a5f for instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 on n-h1-master-1 Jul 24 01:12:14.609147 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f926da75-df10-4f88-b8dc-a5c1cc2baae9 req-1037529f-7596-4d45-8aef-40c8ef2a81fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070848 Jul 24 01:12:14.610568 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 534/966] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:14.618304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b90b3094-d09f-4b57-8fdf-5d4322768f7c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb0dbee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:14.622697 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:14.713332 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b90b3094-d09f-4b57-8fdf-5d4322768f7c tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1467 microversion: 2.1 time: 0.101230 Jul 24 01:12:14.714768 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:14.723266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 535/967] 10.222.0.27 () {58 vars in 1323 bytes} [Sun Jul 24 01:12:14 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1467 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:14.731035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:14.732685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:14.744907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:14.745972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:14.747219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:14.748853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:14.978668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:14.992144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:14.992144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:14.997964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5350e746-2e37-4a40-a7fc-5e2ce7fb14c1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.272222 Jul 24 01:12:15.009701 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 536/968] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:14 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:15.009701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29638a7f-bfa9-4f8c-af9c-b12bcd9b5b42 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb0db430>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:15.086206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] HTTP exception thrown: Floating IP 172.35.1.101 is not associated with instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5. Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Request method failure captured: Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action HTTP/1.1 Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 49 Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jwrix_eI-nk0aOv-4lAGKEo7cWH7SymYgL4o9LEhkheu6Rk94jWXJGIjeIoT132wjcA_-MRJ7uwgf8doAqgaSvzlUJiDhXarBdsRq0WsijJAnbU23jQrKNF8t9cRhusLwsBgDR7lRRBwA35NDp6LDPkI3Xkrsw3H0vCEGpBec2LKFY Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:15.091998 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa4e8e174a104e60a0c40a83bd2235fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 23333c1ebbdf4ddab9d21d5b8b7139e6 Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: {"removeFloatingIp": {"address": "172.35.1.101"}} Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:12:15.093872 n-d-master-1 devstack@n-api.service[119562]: exception: Floating IP 172.35.1.101 is not associated with instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5. Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5', 'body': {'removeFloatingIp': {'address': '172.35.1.101'}}} Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.1.101 is not associated with instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5. Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:15.094854 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:15.096611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:15.096611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:15.096611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:15.096611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:15.096611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.1.101 is not associated with instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5. Jul 24 01:12:15.096611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:15.099989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Returning 409 to user: Floating IP 172.35.1.101 is not associated with instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:15.101549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-19e2afeb-cf03-41a8-b865-cf55db7789a9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action" status: 409 len: 146 microversion: 2.1 time: 1.407597 Jul 24 01:12:15.103023 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 433/969] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:12:13 2022] POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action => generated 146 bytes in 1410 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:12:15.115648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.101"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:15.166112 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29638a7f-bfa9-4f8c-af9c-b12bcd9b5b42 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7794 microversion: 2.1 time: 0.165889 Jul 24 01:12:15.166936 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 537/970] 10.222.0.27 () {58 vars in 1169 bytes} [Sun Jul 24 01:12:14 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7794 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:15.188086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e746bce0-5afc-4d6b-9301-82d3c4f0fcc6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb236ca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:15.291729 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e746bce0-5afc-4d6b-9301-82d3c4f0fcc6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.108878 Jul 24 01:12:15.302261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 538/971] 10.222.0.27 () {58 vars in 1169 bytes} [Sun Jul 24 01:12:15 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:15.308080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-725234d8-8a92-4554-b8d7-50fd1221512b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb4ea040>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:15.372943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:15.375372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-725234d8-8a92-4554-b8d7-50fd1221512b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/9fcc346b-5e09-42b6-9557-a6eb28d96f08" status: 200 len: 784 microversion: 2.1 time: 0.071430 Jul 24 01:12:15.384385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 539/972] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:15 2022] GET /compute/v2.1/images/9fcc346b-5e09-42b6-9557-a6eb28d96f08 => generated 784 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:15.388832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:15.390264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:15.391209 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2f7cc46-4fd1-4548-bf4f-09ba981ba2fc tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb0dbd30>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:15.392760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:15.393911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:15.448269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2f7cc46-4fd1-4548-bf4f-09ba981ba2fc tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.062311 Jul 24 01:12:15.448870 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 540/973] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:12:15 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:15.464138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-21ffc41c-2d2d-4ac4-9e5e-a20f97a17730 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb2360d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:15.664859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Acquired lock "refresh_cache-a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:12:16.515448 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-21ffc41c-2d2d-4ac4-9e5e-a20f97a17730 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d" status: 204 len: 0 microversion: 2.1 time: 1.057473 Jul 24 01:12:16.519430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 541/974] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:15 2022] DELETE /compute/v2.1/images/94e39283-780e-493e-82b9-3506e034fd0d => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:16.525157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:16.525806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:16.534011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:16.534475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:16.535402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:16.535885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:16.576805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Building network info cache for instance {{(pid=119562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:12:16.679059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:16.687524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:16.689547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:16.697547 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-26bbbd05-07a0-4f15-95b5-2f6d051ba140 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.176774 Jul 24 01:12:16.698450 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 542/975] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:16 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:16.703792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4b52f20d-f5e4-4078-902c-8cc2d9d4f4aa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb0db820>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:17.495517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Updating instance_info_cache with network_info: [{"id": "e368dfa6-9f73-459f-b85b-937469b46092", "address": "fa:16:3e:1a:ae:3b", "network": {"id": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-799036886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa4e8e174a104e60a0c40a83bd2235fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape368dfa6-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:12:17.511374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Releasing lock "refresh_cache-a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:12:17.513540 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2460936f-21b8-477a-b309-19c86018b00b tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c/action" status: 202 len: 0 microversion: 2.1 time: 2.404612 Jul 24 01:12:17.514797 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 434/976] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:12:15 2022] POST /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c/action => generated 0 bytes in 2407 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:12:17.521095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-fff4678c-a35c-40dd-97d6-9d3d5fb18acb req-e081ec1e-1041-4b46-9766-63cdbf0b3d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c", "tag": "e368dfa6-9f73-459f-b85b-937469b46092"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:17.533998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fff4678c-a35c-40dd-97d6-9d3d5fb18acb req-e081ec1e-1041-4b46-9766-63cdbf0b3d82 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:17.535933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fff4678c-a35c-40dd-97d6-9d3d5fb18acb req-e081ec1e-1041-4b46-9766-63cdbf0b3d82 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.551132 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-fff4678c-a35c-40dd-97d6-9d3d5fb18acb req-e081ec1e-1041-4b46-9766-63cdbf0b3d82 service nova] Creating event network-changed:e368dfa6-9f73-459f-b85b-937469b46092 for instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c on n-h1-master-1 Jul 24 01:12:17.558352 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-fff4678c-a35c-40dd-97d6-9d3d5fb18acb req-e081ec1e-1041-4b46-9766-63cdbf0b3d82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041737 Jul 24 01:12:17.559576 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 435/977] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:17.573005 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4b52f20d-f5e4-4078-902c-8cc2d9d4f4aa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d" status: 204 len: 0 microversion: 2.1 time: 0.873035 Jul 24 01:12:17.575932 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 543/978] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:16 2022] DELETE /compute/v2.1/images/08cc471a-5b85-474f-82d7-94ca8482855d => generated 0 bytes in 874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:17.578341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:17.578953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:17.588805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:17.590161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.591597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:17.592687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.627371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:12:17.774671 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9fa4361a-1795-4abc-86a0-f1ea28e6e1f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 204 len: 0 microversion: 2.1 time: 0.210304 Jul 24 01:12:17.781140 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 436/979] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:17 2022] DELETE /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:17.793894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:17.794625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:17.805013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25e17be7-5c48-422b-a994-1db150c5b888 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:17.807649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:17.808277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.809433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:17.815608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:17.823063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25e17be7-5c48-422b-a994-1db150c5b888 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.247565 Jul 24 01:12:17.833462 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 544/980] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:17.838563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-10580696-3959-4bff-bc34-82219f006e55 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb08d310>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:17.879722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:12:18.026471 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9e4a7fa-2881-4b14-9fd1-36ba8eb2f6f7 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 204 len: 0 microversion: 2.1 time: 0.242248 Jul 24 01:12:18.027473 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 437/981] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:17 2022] DELETE /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:18.041320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:18.042483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:18.049775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.050636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.052057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.052816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.293623 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:18.311159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:18.313177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:18.323368 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-546fae41-3c4c-4d50-b83e-6e02136a1894 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.294285 Jul 24 01:12:18.324984 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 438/982] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:18 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:18.330948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:18.332014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:18.340808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.340808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.341121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.341776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.562924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:18.574775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5eef0ffd-1883-4acc-925c-c34358655c0c tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1712 microversion: 2.1 time: 0.248326 Jul 24 01:12:18.578293 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 439/983] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:18 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1712 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:18.584904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-704a9882-24f3-4fb1-99c0-27bc9b4446a4 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:18.610234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-704a9882-24f3-4fb1-99c0-27bc9b4446a4 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3080 microversion: 2.1 time: 0.030555 Jul 24 01:12:18.611478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 440/984] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:12:18 2022] GET /compute/v2.1/flavors => generated 3080 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:18.616937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.101"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:18.618054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:18.624446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.625129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.625952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.626674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.659764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Acquired lock "refresh_cache-f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:12:18.760312 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-10580696-3959-4bff-bc34-82219f006e55 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99" status: 204 len: 0 microversion: 2.1 time: 0.925463 Jul 24 01:12:18.760899 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 545/985] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:17 2022] DELETE /compute/v2.1/images/cb5bd013-992a-4a35-87ea-f6e7f0999b99 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:18.766029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b82b4230-0f6d-4bc6-a38f-1fc7ccbb943b tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:18.775733 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b82b4230-0f6d-4bc6-a38f-1fc7ccbb943b tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013764 Jul 24 01:12:18.776321 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 546/986] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:18.788019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:18.792391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:18.800925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.801932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.803834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:18.804447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:18.844020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:12:18.960196 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d771b4c5-6714-4102-9bea-ecd11aa929b6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 204 len: 0 microversion: 2.1 time: 0.178644 Jul 24 01:12:18.961315 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 547/987] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:18 2022] DELETE /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:18.971321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8e0885bb-dcb6-4b00-b585-9665d42be012 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.005227 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8e0885bb-dcb6-4b00-b585-9665d42be012 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040869 Jul 24 01:12:19.007764 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 548/988] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:19.017140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.017932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:19.024639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.025334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.026924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.027620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.048986 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:19.430562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:19.439372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6841922-1c90-41e7-957b-8c280c172eda tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1473 microversion: 2.1 time: 0.430473 Jul 24 01:12:19.444927 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 549/989] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:19 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1473 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:19.458342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c9188a1-19d8-41c9-9261-5ca0988e7ccb tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.485432 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c9188a1-19d8-41c9-9261-5ca0988e7ccb tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.038105 Jul 24 01:12:19.486768 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 550/990] 10.222.0.27 () {58 vars in 1164 bytes} [Sun Jul 24 01:12:19 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:19.503136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.504642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:19.515305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.515772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.516813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.517435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.657611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:19.668793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:19.670326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:19.675956 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:19.681855 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-293dd4e2-34b6-4587-adb9-3346ec44657e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.192269 Jul 24 01:12:19.694838 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 551/991] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:19 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:19.699977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef4a858b-ab66-4d5f-9bc7-85d6caa02351 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.710018 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef4a858b-ab66-4d5f-9bc7-85d6caa02351 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013738 Jul 24 01:12:19.710610 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 552/992] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:19.715360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:19.716509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:19.723592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.724077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:19.725081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:19.726087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.409026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:20.422458 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7dbacbc-03d3-4684-874b-18b7d2ed41c0 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1712 microversion: 2.1 time: 0.710597 Jul 24 01:12:20.424343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 553/993] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:19 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1712 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:20.430801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-946eab9a-8a35-443a-b937-77af9ef3a7d6 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:20.488464 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-946eab9a-8a35-443a-b937-77af9ef3a7d6 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.060818 Jul 24 01:12:20.489896 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 554/994] 10.222.0.27 () {58 vars in 1168 bytes} [Sun Jul 24 01:12:20 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:20.495708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:20.496995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:20.510258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.511348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:20.512517 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:20.513854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:21.527816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:21.545134 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2de427a-846f-434f-b5f7-990fdd53b2b2 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1473 microversion: 2.1 time: 1.052372 Jul 24 01:12:21.546414 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 555/995] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:20 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1473 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:21.563584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-937e8309-bbbb-4a6b-9a81-5894b341ccbb tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:21.601759 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-937e8309-bbbb-4a6b-9a81-5894b341ccbb tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.049702 Jul 24 01:12:21.604039 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 556/996] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:12:21 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:21.623375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:21.624004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:21.657059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:21.657880 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:21.660756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:21.661737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.025730 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.049063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.052316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.058834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ea5dc50-99f5-4850-800f-c51cc19745eb tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.450730 Jul 24 01:12:22.060003 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 557/997] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:21 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:22.069646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:22.070305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:22.079209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.079672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.080469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.080905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.249952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Building network info cache for instance {{(pid=119562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:12:22.432892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.458625 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fa6d3b95-41a7-430d-a937-3e5e3add179e tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1712 microversion: 2.1 time: 0.397624 Jul 24 01:12:22.459473 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 558/998] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:22 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1712 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:22.468051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3a13cde-a601-46ef-9e21-2397f173d955 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:22.488886 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3a13cde-a601-46ef-9e21-2397f173d955 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025377 Jul 24 01:12:22.493706 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 559/999] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:22.518178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5ce91fbb-9016-4194-8205-9cef46c63c47 req-050d2560-3f19-43c5-a798-8bbd91c81e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c", "name": "network-vif-deleted", "tag": "e368dfa6-9f73-459f-b85b-937469b46092"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:22.552712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5ce91fbb-9016-4194-8205-9cef46c63c47 req-050d2560-3f19-43c5-a798-8bbd91c81e2d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.555428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5ce91fbb-9016-4194-8205-9cef46c63c47 req-050d2560-3f19-43c5-a798-8bbd91c81e2d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.575445 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5ce91fbb-9016-4194-8205-9cef46c63c47 req-050d2560-3f19-43c5-a798-8bbd91c81e2d service nova] Creating event network-vif-deleted:e368dfa6-9f73-459f-b85b-937469b46092 for instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c on n-h1-master-1 Jul 24 01:12:22.583568 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5ce91fbb-9016-4194-8205-9cef46c63c47 req-050d2560-3f19-43c5-a798-8bbd91c81e2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074625 Jul 24 01:12:22.584692 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 560/1000] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:22.590040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c32f2b13-7b46-4b56-8fe8-668bfc8c437b tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:22.695689 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c32f2b13-7b46-4b56-8fe8-668bfc8c437b tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.109661 Jul 24 01:12:22.696822 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 561/1001] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:12:22 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:22.709421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:22.710313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:22.729099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.729562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.730393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:22.730830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:22.891878 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:22.924666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:22.947158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-db25c96e-d8d2-4edf-8e07-8d90f4a33559 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 200 len: 1431 microversion: 2.1 time: 0.249391 Jul 24 01:12:22.947967 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 562/1002] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:22 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 1431 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:22.952809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bbd0f230-4901-4864-8860-c1ddd5faca63 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:22.964930 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bbd0f230-4901-4864-8860-c1ddd5faca63 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015529 Jul 24 01:12:22.965881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 563/1003] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:22.971164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-adbf7b0a-2672-42fe-8927-694d738d1504 req-2712759d-3fff-407a-b6c9-58a78bfe7205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac0c96-8aae-4ed3-bdd5-485b94e89ec1", "name": "network-vif-deleted", "tag": "03895dd8-dd4b-4e93-9101-5db60f3eb869"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:23.004999 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-adbf7b0a-2672-42fe-8927-694d738d1504 req-2712759d-3fff-407a-b6c9-58a78bfe7205 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.005765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-adbf7b0a-2672-42fe-8927-694d738d1504 req-2712759d-3fff-407a-b6c9-58a78bfe7205 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.032612 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-adbf7b0a-2672-42fe-8927-694d738d1504 req-2712759d-3fff-407a-b6c9-58a78bfe7205 service nova] Creating event network-vif-deleted:03895dd8-dd4b-4e93-9101-5db60f3eb869 for instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 on n-h2-master-1 Jul 24 01:12:23.058868 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-adbf7b0a-2672-42fe-8927-694d738d1504 req-2712759d-3fff-407a-b6c9-58a78bfe7205 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090879 Jul 24 01:12:23.062006 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 564/1004] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:23.072557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58a9a09e-c196-4e7f-946f-f59d469cac6c tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.092669 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58a9a09e-c196-4e7f-946f-f59d469cac6c tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.028941 Jul 24 01:12:23.102300 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 565/1005] 10.222.0.27 () {58 vars in 1143 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:23.107702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.108574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:23.120333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.126014 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.127213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.127888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.389610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:23.411608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:23.418296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:23.439855 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa03c251-c0cb-4c89-a582-e974fe25dd51 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.336107 Jul 24 01:12:23.442016 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 566/1006] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:23.447820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-52b1cd94-38a7-40b7-acab-a193a9fd0f69 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.474382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-52b1cd94-38a7-40b7-acab-a193a9fd0f69 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030427 Jul 24 01:12:23.475973 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 567/1007] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:23.498004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:23.498912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:23.511428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.512051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:23.514474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:23.517875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.012847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:24.023068 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f37d104c-49b2-4161-b322-e9dbf05bf283 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1712 microversion: 2.1 time: 0.544578 Jul 24 01:12:24.023998 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 568/1008] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:23 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1712 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:24.028918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61a5e498-f8c5-48e0-b13b-52e5e88e18aa tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.048043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-61a5e498-f8c5-48e0-b13b-52e5e88e18aa tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.022771 Jul 24 01:12:24.049031 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 569/1009] 10.222.0.27 () {58 vars in 1147 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:24.062150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.063114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:24.069661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.070286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.071340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.071894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.101581 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] HTTP exception thrown: Instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 could not be found. Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Request method failure captured: Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 HTTP/1.1 Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jvo8Of94n-q16J-WkqhtYIl_iym_4jzPTxl0Uz1UjeGZ30iEvxpk1NNmbQRv4TG9-FZ6Vi5k6mrpcDqiM66RYJuMvt24vgdpmZ5SzU2dCRz7eajNzUMxwNq1VBZFL15s4NKAHi28wLkVLr1oEGub4A-KeXndKLH91RbUQxDUqEZXeg Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 221902b3cf044d719cc7dc1fcf7ba33b Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListImageFiltersTestJSON-1103488121 Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:24.107490 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/221902b3cf044d719cc7dc1fcf7ba33b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/221902b3cf044d719cc7dc1fcf7ba33b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_221902b3cf044d719cc7dc1fcf7ba33b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/221902b3cf044d719cc7dc1fcf7ba33b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListImageFiltersTestJSON-1103488121 Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 221902b3cf044d719cc7dc1fcf7ba33b Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1103488121 Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListImageFiltersTestJSON-1103488121-project Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b96d7edf06d147bb94869c925933a78e Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListImageFiltersTestJSON-1103488121-project Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 could not be found. Jul 24 01:12:24.108927 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '4aac0c96-8aae-4ed3-bdd5-485b94e89ec1'} Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 could not be found. Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:24.109657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 could not be found. Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 could not be found. Jul 24 01:12:24.110876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:24.117397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Returning 404 to user: Instance 4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:24.118646 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-83740fdc-4629-4be5-b402-0dd6cf85ec7b tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1" status: 404 len: 111 microversion: 2.1 time: 0.067940 Jul 24 01:12:24.123994 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 570/1010] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/servers/4aac0c96-8aae-4ed3-bdd5-485b94e89ec1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:24.152583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed181f01-da04-417e-b22d-8eb172445d3d tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.174331 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed181f01-da04-417e-b22d-8eb172445d3d tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.048745 Jul 24 01:12:24.176569 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 571/1011] 10.222.0.27 () {58 vars in 1139 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:24.193975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.194495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:24.232078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.232965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.234324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.240046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.272195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Updating instance_info_cache with network_info: [{"id": "32fa2173-df2d-4d45-b2f8-9c6046b137ea", "address": "fa:16:3e:f5:02:33", "network": {"id": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-799036886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa4e8e174a104e60a0c40a83bd2235fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32fa2173-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:12:24.292338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Releasing lock "refresh_cache-f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:12:24.295106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:12:24.295304 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eba89794-cd68-4963-8e30-25ef57704b22 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action" status: 202 len: 0 microversion: 2.1 time: 5.680971 Jul 24 01:12:24.296673 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 441/1012] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:12:18 2022] POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action => generated 0 bytes in 5684 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:12:24.311042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73ee6e59-54c9-4680-af07-69f77c8e5538 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.335333 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73ee6e59-54c9-4680-af07-69f77c8e5538 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036347 Jul 24 01:12:24.336564 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 442/1013] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:24.355669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d59cccbc-b210-460d-ae83-f71806a24c0f tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '.version_select at 0x7f05ebec29d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.450775 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67c53bcb-1f65-4296-998a-1b437570bdaa tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 204 len: 0 microversion: 2.1 time: 0.271511 Jul 24 01:12:24.454421 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 572/1014] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:24 2022] DELETE /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:24.462782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c241df8-992a-431e-8b92-b745ed10bdd0 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.503889 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c241df8-992a-431e-8b92-b745ed10bdd0 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.047212 Jul 24 01:12:24.506088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 573/1015] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:24.512933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:24.514058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:24.522965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.523787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:24.524886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:24.525554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.224723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.240642 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e45fb4d-22b0-4d34-be10-10afe6cd1c74 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1473 microversion: 2.1 time: 0.732949 Jul 24 01:12:25.242158 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 574/1016] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1473 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:25.262239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:25.262865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:25.280032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.280489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.292837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.293584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.315443 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d59cccbc-b210-460d-ae83-f71806a24c0f tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/d1bab47f-7538-4c7d-b938-1dabbfba13e7" status: 200 len: 185 microversion: 2.1 time: 0.976600 Jul 24 01:12:25.316520 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 443/1017] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:12:24 2022] GET /compute/v2.1/os-floating-ips/d1bab47f-7538-4c7d-b938-1dabbfba13e7 => generated 185 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:25.326432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ad97be0-2f63-4a5c-b0f1-da3e02c7d1e4 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:25.369945 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ad97be0-2f63-4a5c-b0f1-da3e02c7d1e4 tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.050940 Jul 24 01:12:25.372470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 444/1018] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:12:25 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:25.379637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9f20574f-8ccd-4ac1-9a71-bc25f658f8e1 req-177cce45-098e-491e-aaac-a49f2030a1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5", "tag": "32fa2173-df2d-4d45-b2f8-9c6046b137ea"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:25.403165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9f20574f-8ccd-4ac1-9a71-bc25f658f8e1 req-177cce45-098e-491e-aaac-a49f2030a1c4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.404018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9f20574f-8ccd-4ac1-9a71-bc25f658f8e1 req-177cce45-098e-491e-aaac-a49f2030a1c4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.421039 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9f20574f-8ccd-4ac1-9a71-bc25f658f8e1 req-177cce45-098e-491e-aaac-a49f2030a1c4 service nova] Creating event network-changed:32fa2173-df2d-4d45-b2f8-9c6046b137ea for instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 on n-h2-master-1 Jul 24 01:12:25.427021 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9f20574f-8ccd-4ac1-9a71-bc25f658f8e1 req-177cce45-098e-491e-aaac-a49f2030a1c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052516 Jul 24 01:12:25.429624 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 445/1019] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:25.438434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:25.439520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:25.448949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.449645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.450931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.451746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.477410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.489583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.492476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.493966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.494437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.494898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lazy-loading 'fault' on Instance uuid 8b68f333-31cf-4daf-8dad-2a4c759bddd8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:25.499632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-11e5f263-35ca-452b-b650-bd6468e27d17 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.254935 Jul 24 01:12:25.513480 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 575/1020] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:25 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:25.520020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Action: 'action', calling method: .version_select at 0x7f05f9e830d0>, body: {"removeFloatingIp": {"address": "172.35.1.101"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:25.603909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3861659794d4aa699ca3e984999a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913058bc11904339a05f4784fee6f1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:25.614837 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d1991e1-3e78-4885-b726-2ee2fe338e24 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 200 len: 1353 microversion: 2.1 time: 0.182943 Jul 24 01:12:25.636402 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 446/1021] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:25 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 1353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:25.641893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b12ce191-1065-4f34-9213-97c384cdcb1b tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:25.657277 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b12ce191-1065-4f34-9213-97c384cdcb1b tempest-FlavorsV2TestJSON-1826462850 tempest-FlavorsV2TestJSON-1826462850-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019226 Jul 24 01:12:25.658558 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 447/1022] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:25.887380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:25.898452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.898729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:25.900203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:25.900820 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.260090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:26.260712 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:26.279536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.279980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.280790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:26.281223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:26.658298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Acquired lock "refresh_cache-f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:12:27.567019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:27.579090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2f564cb0-aa95-4ebc-a86a-444f26deaef6 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1473 microversion: 2.1 time: 1.322784 Jul 24 01:12:27.582548 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 448/1023] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:26 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1473 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:27.600826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:27.602102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:27.621636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.622101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.633847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:27.633847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:27.967340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:28.006945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:28.010988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:28.031136 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23a62d11-95c9-4cb3-bff2-91c3388b03ad tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.443564 Jul 24 01:12:28.032062 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 449/1024] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:27 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:28.038526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:28.039379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:28.048426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.049258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.059431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.060385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.078923 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] HTTP exception thrown: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Request method failure captured: Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 HTTP/1.1 Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt_mvt74LCA01lzVhWUSo6dBRkYrhfjzgGyx1tlCSz8tmdmfaa1x7bwAhpRAsNe1X1aC3dC99KdHqOUpKFj-bkWBhHkR7YLwn95xWL8lTYA1kWdcIf91rfyuCRo7gCXRG_zk6nALVrZ5Qmgfto6Ba55NX6YrQVSVkqa6iY_6rqrt1s Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:28.086887 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_913058bc11904339a05f4784fee6f1a1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b3861659794d4aa699ca3e984999a1fe Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:28.088248 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8b68f333-31cf-4daf-8dad-2a4c759bddd8'} Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:28.089108 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:28.090323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.093522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Returning 404 to user: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:28.094611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-69b6e768-2f0a-4e56-a9a6-058f87e39303 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 404 len: 111 microversion: 2.1 time: 0.061377 Jul 24 01:12:28.098312 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 450/1025] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:28 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:28.105055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7d51a4c1-5583-4fbe-8652-2d257362ca88 req-1cd2d7df-aedc-441f-aba3-8a9145d7b084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b68f333-31cf-4daf-8dad-2a4c759bddd8", "name": "network-vif-deleted", "tag": "b8c94a54-3902-46c3-b698-8f8b474bdf76"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:28.154729 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7d51a4c1-5583-4fbe-8652-2d257362ca88 req-1cd2d7df-aedc-441f-aba3-8a9145d7b084 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.155091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7d51a4c1-5583-4fbe-8652-2d257362ca88 req-1cd2d7df-aedc-441f-aba3-8a9145d7b084 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.191014 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7d51a4c1-5583-4fbe-8652-2d257362ca88 req-1cd2d7df-aedc-441f-aba3-8a9145d7b084 service nova] Creating event network-vif-deleted:b8c94a54-3902-46c3-b698-8f8b474bdf76 for instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 on n-h2-master-1 Jul 24 01:12:28.216196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7d51a4c1-5583-4fbe-8652-2d257362ca88 req-1cd2d7df-aedc-441f-aba3-8a9145d7b084 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112808 Jul 24 01:12:28.217517 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 451/1026] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:28.232671 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:28.237248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:28.259087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.265646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.267568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.268433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.310578 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] HTTP exception thrown: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Request method failure captured: Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 HTTP/1.1 Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt_mvt74LCA01lzVhWUSo6dBRkYrhfjzgGyx1tlCSz8tmdmfaa1x7bwAhpRAsNe1X1aC3dC99KdHqOUpKFj-bkWBhHkR7YLwn95xWL8lTYA1kWdcIf91rfyuCRo7gCXRG_zk6nALVrZ5Qmgfto6Ba55NX6YrQVSVkqa6iY_6rqrt1s Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:28.312719 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_913058bc11904339a05f4784fee6f1a1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b3861659794d4aa699ca3e984999a1fe Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.314299 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c7321071-81d5-42f4-b1ec-3e089a82ff19'} Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:28.315174 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.316423 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.319533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Returning 404 to user: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:28.320597 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3ef634a-98ff-4e5a-aedc-1bdd3d831ac8 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 404 len: 111 microversion: 2.1 time: 0.101494 Jul 24 01:12:28.322030 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 452/1027] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:28 2022] DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:28.330159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:28.331113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:28.338603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.339579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.340651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.344690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.351762 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:28.375157 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] HTTP exception thrown: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Request method failure captured: Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 HTTP/1.1 Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jt_mvt74LCA01lzVhWUSo6dBRkYrhfjzgGyx1tlCSz8tmdmfaa1x7bwAhpRAsNe1X1aC3dC99KdHqOUpKFj-bkWBhHkR7YLwn95xWL8lTYA1kWdcIf91rfyuCRo7gCXRG_zk6nALVrZ5Qmgfto6Ba55NX6YrQVSVkqa6iY_6rqrt1s Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:28.377183 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_913058bc11904339a05f4784fee6f1a1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b3861659794d4aa699ca3e984999a1fe Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.379264 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c7321071-81d5-42f4-b1ec-3e089a82ff19'} Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:28.380110 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:28.381523 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:28.384256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Returning 404 to user: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:28.385390 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cee85458-b63a-48b4-931f-c48238ede8f7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 404 len: 111 microversion: 2.1 time: 0.059494 Jul 24 01:12:28.386674 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 453/1028] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:28 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:28.395693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6b600b19-fc4e-4b61-9130-19f6cd4eb8a4 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '.version_select at 0x7f05eb46edc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:28.425331 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6b600b19-fc4e-4b61-9130-19f6cd4eb8a4 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238947261" status: 202 len: 0 microversion: 2.1 time: 0.034205 Jul 24 01:12:28.434408 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 454/1029] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:12:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238947261 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:12:28.623577 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:28.647127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:28.681187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.682340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:28.684401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:28.687017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.626398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:29.637380 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-438f02c4-f671-491f-9120-72e704d04cc5 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1473 microversion: 2.1 time: 1.041204 Jul 24 01:12:29.638382 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 455/1030] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:28 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1473 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:29.851535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28ba0b71-cee8-436a-ad7e-5e363ce0dbd0 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:29.868566 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28ba0b71-cee8-436a-ad7e-5e363ce0dbd0 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.227988 Jul 24 01:12:29.870078 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 456/1031] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:12:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:29.875599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:29.876451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:29.914083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.915053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:29.918413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:29.919121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.565058 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.576315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.578963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.590901 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38c66d2b-d1f1-40db-8a8d-959bcc77b63b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.719605 Jul 24 01:12:30.595939 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 457/1032] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:29 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:30.654739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:30.658656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:30.681813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.687667 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.694505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.695006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.927340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b96d7edf06d147bb94869c925933a78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221902b3cf044d719cc7dc1fcf7ba33b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:30.944606 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-876cf9a1-a414-4514-9faf-03999c9a6b07 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 200 len: 1431 microversion: 2.1 time: 0.289863 Jul 24 01:12:30.946619 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 458/1033] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:30 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 1431 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:12:30.966746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a404c014-14bc-40af-b4c9-2e676cc66ee7 req-fa79417e-248d-4865-8304-144627e8908d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117685ac-31fb-41e6-94dc-4efdd3fc0262", "name": "network-vif-deleted", "tag": "f50c3fdd-6dde-4107-af40-6e69ffd16a5f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:30.981734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a404c014-14bc-40af-b4c9-2e676cc66ee7 req-fa79417e-248d-4865-8304-144627e8908d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:30.982277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a404c014-14bc-40af-b4c9-2e676cc66ee7 req-fa79417e-248d-4865-8304-144627e8908d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:30.996566 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a404c014-14bc-40af-b4c9-2e676cc66ee7 req-fa79417e-248d-4865-8304-144627e8908d service nova] Creating event network-vif-deleted:f50c3fdd-6dde-4107-af40-6e69ffd16a5f for instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 on n-h1-master-1 Jul 24 01:12:30.996803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Building network info cache for instance {{(pid=119561) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:12:31.005772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a404c014-14bc-40af-b4c9-2e676cc66ee7 req-fa79417e-248d-4865-8304-144627e8908d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057195 Jul 24 01:12:31.007076 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 459/1034] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:31.013016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7467a5f-b3b5-41ee-b5aa-99879f429668 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-50822921", "imageRef": "63e7a081-b561-4765-85a3-af5166fecff8", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:31.080079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-c7467a5f-b3b5-41ee-b5aa-99879f429668 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:12:31.787405 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c7467a5f-b3b5-41ee-b5aa-99879f429668 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7467a5f-b3b5-41ee-b5aa-99879f429668 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] Request method failure captured: Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 141 Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jx8db_c_bE6ggqTiAUVLnSZrM1fUQHuCsmXjPUm345JURFYtw0armSQjLjBpq20NkGGeyANGrOSWyb0hOhgLxOdG9LLY1KSuH1gVabwpImaM5YPWG-Yfzxjso6YHI5u5P2sckXlDqTiUBdBg8A5E9QBB_SQdIt11bWGKYw4c-8b-iA Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d4b56de6c48e44de9e938460ffc1805c Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FlavorsV2NegativeTest-58750123 Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:31.790446 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4b56de6c48e44de9e938460ffc1805c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4b56de6c48e44de9e938460ffc1805c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4b56de6c48e44de9e938460ffc1805c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4b56de6c48e44de9e938460ffc1805c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FlavorsV2NegativeTest-58750123 Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d4b56de6c48e44de9e938460ffc1805c Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-58750123 Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FlavorsV2NegativeTest-58750123-project Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: d56b7263985743839941e421b52bcc04 Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FlavorsV2NegativeTest-58750123-project Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-50822921", "imageRef": "63e7a081-b561-4765-85a3-af5166fecff8", "flavorRef": "452"}} Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:12:31.792094 n-d-master-1 devstack@n-api.service[119562]: exception: Flavor's memory is too small for requested image. Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-50822921', 'imageRef': '63e7a081-b561-4765-85a3-af5166fecff8', 'flavorRef': '452'}}} Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:31.793061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:31.794524 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7467a5f-b3b5-41ee-b5aa-99879f429668 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:31.795916 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c7467a5f-b3b5-41ee-b5aa-99879f429668 tempest-FlavorsV2NegativeTest-58750123 tempest-FlavorsV2NegativeTest-58750123-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.785517 Jul 24 01:12:31.798389 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 460/1035] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:12:31 2022] POST /compute/v2.1/servers => generated 93 bytes in 789 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:31.808128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-86da1c6a-2ef5-410f-a68d-d8b004721005 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:31.812892 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:31.812892 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:12:31.851772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-86da1c6a-2ef5-410f-a68d-d8b004721005 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2025549651" status: 202 len: 0 microversion: 2.1 time: 0.052655 Jul 24 01:12:31.853388 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 461/1036] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:12:31 2022] DELETE /compute/v2.1/flavors/2025549651 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:12:31.863538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ba1932c-d9fa-4a48-bede-4e47580187f8 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d55e9edf-9cfb-40ca-b90d-1a628555c2ec"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:31.865583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ba1932c-d9fa-4a48-bede-4e47580187f8 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:31.900544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1932c-d9fa-4a48-bede-4e47580187f8 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.901145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1932c-d9fa-4a48-bede-4e47580187f8 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:31.902024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1932c-d9fa-4a48-bede-4e47580187f8 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:31.910184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1932c-d9fa-4a48-bede-4e47580187f8 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.134421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Updating instance_info_cache with network_info: [{"id": "32fa2173-df2d-4d45-b2f8-9c6046b137ea", "address": "fa:16:3e:f5:02:33", "network": {"id": "1d90afb7-a614-4f6a-ab1f-4bbd8730a637", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-799036886-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aa4e8e174a104e60a0c40a83bd2235fa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32fa2173-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119561) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:12:32.153433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Releasing lock "refresh_cache-f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:12:32.154758 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b837eac5-d66c-4052-b48c-bc3937e324fa tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action" status: 202 len: 0 microversion: 2.1 time: 6.639731 Jul 24 01:12:32.162356 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 576/1037] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:12:25 2022] POST /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5/action => generated 0 bytes in 6648 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:12:32.171542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.173380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:32.180706 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.181396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.182641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.183237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.206362 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:32.320651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:32.335514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:32.338260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:32.354065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0ee9d354-027c-4db2-a0b7-4e98f3abe04b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.190459 Jul 24 01:12:32.358094 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 577/1038] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:32 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:32.364145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-315bc744-066d-4ec7-a35e-e431b362c88b tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.431542 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-315bc744-066d-4ec7-a35e-e431b362c88b tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.066498 Jul 24 01:12:32.432754 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 578/1039] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:12:32 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:32.445380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.447532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] [instance: 117685ac-31fb-41e6-94dc-4efdd3fc0262] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:32.461272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.461906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.462740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.463155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.501616 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] HTTP exception thrown: Instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 could not be found. Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Request method failure captured: Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 HTTP/1.1 Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jvo8Of94n-q16J-WkqhtYIl_iym_4jzPTxl0Uz1UjeGZ30iEvxpk1NNmbQRv4TG9-FZ6Vi5k6mrpcDqiM66RYJuMvt24vgdpmZ5SzU2dCRz7eajNzUMxwNq1VBZFL15s4NKAHi28wLkVLr1oEGub4A-KeXndKLH91RbUQxDUqEZXeg Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 221902b3cf044d719cc7dc1fcf7ba33b Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListImageFiltersTestJSON-1103488121 Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:32.504828 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/221902b3cf044d719cc7dc1fcf7ba33b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/221902b3cf044d719cc7dc1fcf7ba33b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_221902b3cf044d719cc7dc1fcf7ba33b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/221902b3cf044d719cc7dc1fcf7ba33b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListImageFiltersTestJSON-1103488121 Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 221902b3cf044d719cc7dc1fcf7ba33b Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1103488121 Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListImageFiltersTestJSON-1103488121-project Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b96d7edf06d147bb94869c925933a78e Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListImageFiltersTestJSON-1103488121-project Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 could not be found. Jul 24 01:12:32.507032 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '117685ac-31fb-41e6-94dc-4efdd3fc0262'} Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 could not be found. Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:32.508096 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 could not be found. Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 could not be found. Jul 24 01:12:32.509721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.513686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Returning 404 to user: Instance 117685ac-31fb-41e6-94dc-4efdd3fc0262 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:32.514764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98c4024c-a6e2-4b6a-b366-2fc680348aae tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262" status: 404 len: 111 microversion: 2.1 time: 0.080088 Jul 24 01:12:32.518805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 579/1040] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:32 2022] GET /compute/v2.1/servers/117685ac-31fb-41e6-94dc-4efdd3fc0262 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:32.536755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.537654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:32.557379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.559178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.560396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.560968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.567165 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ba1932c-d9fa-4a48-bede-4e47580187f8 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "POST /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706329 Jul 24 01:12:32.572238 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 462/1041] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:12:31 2022] POST /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:32.594948 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] HTTP exception thrown: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Request method failure captured: Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c HTTP/1.1 Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jwrix_eI-nk0aOv-4lAGKEo7cWH7SymYgL4o9LEhkheu6Rk94jWXJGIjeIoT132wjcA_-MRJ7uwgf8doAqgaSvzlUJiDhXarBdsRq0WsijJAnbU23jQrKNF8t9cRhusLwsBgDR7lRRBwA35NDp6LDPkI3Xkrsw3H0vCEGpBec2LKFY Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:32.599925 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa4e8e174a104e60a0c40a83bd2235fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 23333c1ebbdf4ddab9d21d5b8b7139e6 Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: exception: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.602213 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c'} Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:32.603168 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.604551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.606632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Returning 404 to user: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:32.606632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a098e7c-22eb-48af-a03b-cebc4f112646 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 404 len: 111 microversion: 2.1 time: 0.080734 Jul 24 01:12:32.606632 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 580/1042] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:32 2022] DELETE /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:32.611872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00bd20ef-c513-47c0-bcb8-1496ce266068 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb041280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.625195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7dd68561-d44c-4440-82d7-a540259d0368 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.626884 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:32.626884 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:12:32.678171 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7dd68561-d44c-4440-82d7-a540259d0368 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1384251660" status: 202 len: 0 microversion: 2.1 time: 0.106605 Jul 24 01:12:32.681406 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 463/1043] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:12:32 2022] DELETE /compute/v2.1/flavors/1384251660 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:12:32.690477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.691697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:32.704566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.708136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.710300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:32.712058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:32.773310 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] HTTP exception thrown: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Request method failure captured: Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c HTTP/1.1 Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jwrix_eI-nk0aOv-4lAGKEo7cWH7SymYgL4o9LEhkheu6Rk94jWXJGIjeIoT132wjcA_-MRJ7uwgf8doAqgaSvzlUJiDhXarBdsRq0WsijJAnbU23jQrKNF8t9cRhusLwsBgDR7lRRBwA35NDp6LDPkI3Xkrsw3H0vCEGpBec2LKFY Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:12:32.775378 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa4e8e174a104e60a0c40a83bd2235fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 23333c1ebbdf4ddab9d21d5b8b7139e6 Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: exception: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.776672 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c'} Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:32.777387 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. Jul 24 01:12:32.779199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:12:32.781986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Returning 404 to user: Instance a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:32.781986 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa6d21d3-6876-4a6c-8c2e-228f57caf2e8 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c" status: 404 len: 111 microversion: 2.1 time: 0.094130 Jul 24 01:12:32.781986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 464/1044] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:32 2022] GET /compute/v2.1/servers/a2bfa4fa-2ce2-46c3-ace2-471f3acd7f9c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:32.826649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9271c69-40d5-4133-a6db-5136a7fafdc5 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:32.904876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9271c69-40d5-4133-a6db-5136a7fafdc5 tempest-ServersWithSpecificFlavorTestJSON-1719945850 tempest-ServersWithSpecificFlavorTestJSON-1719945850-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.126352 Jul 24 01:12:32.906456 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 465/1045] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:12:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:32.913455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f2834953-42b8-4fba-91ce-08ac4bce9452 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '.version_select at 0x7f05eb562790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:33.433119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00bd20ef-c513-47c0-bcb8-1496ce266068 tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/images/e83db104-723f-42e2-8685-9280d5c44acd" status: 204 len: 0 microversion: 2.1 time: 0.829650 Jul 24 01:12:33.434552 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 581/1046] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:32 2022] DELETE /compute/v2.1/images/e83db104-723f-42e2-8685-9280d5c44acd => generated 0 bytes in 831 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:33.444140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:33.444801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:33.459502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.464851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.465861 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.466386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.496823 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] HTTP exception thrown: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Request method failure captured: Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 HTTP/1.1 Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt_mvt74LCA01lzVhWUSo6dBRkYrhfjzgGyx1tlCSz8tmdmfaa1x7bwAhpRAsNe1X1aC3dC99KdHqOUpKFj-bkWBhHkR7YLwn95xWL8lTYA1kWdcIf91rfyuCRo7gCXRG_zk6nALVrZ5Qmgfto6Ba55NX6YrQVSVkqa6iY_6rqrt1s Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:33.502274 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_913058bc11904339a05f4784fee6f1a1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b3861659794d4aa699ca3e984999a1fe Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:33.504009 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8b68f333-31cf-4daf-8dad-2a4c759bddd8'} Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:33.504721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:33.505929 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:33.507096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Returning 404 to user: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:33.507096 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e9c71689-735e-4ee7-bc29-05cef7d8512f tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 404 len: 111 microversion: 2.1 time: 0.068527 Jul 24 01:12:33.512818 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 582/1047] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:33 2022] DELETE /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:33.525529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-64c1fcb7-d757-4963-a77e-9cf7b3a84b4f req-75f50b82-c7aa-4f46-954a-b34c9f10c376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5", "tag": "32fa2173-df2d-4d45-b2f8-9c6046b137ea"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:33.543393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-64c1fcb7-d757-4963-a77e-9cf7b3a84b4f req-75f50b82-c7aa-4f46-954a-b34c9f10c376 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.546334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-64c1fcb7-d757-4963-a77e-9cf7b3a84b4f req-75f50b82-c7aa-4f46-954a-b34c9f10c376 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.592831 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-64c1fcb7-d757-4963-a77e-9cf7b3a84b4f req-75f50b82-c7aa-4f46-954a-b34c9f10c376 service nova] Creating event network-changed:32fa2173-df2d-4d45-b2f8-9c6046b137ea for instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 on n-h2-master-1 Jul 24 01:12:33.601313 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-64c1fcb7-d757-4963-a77e-9cf7b3a84b4f req-75f50b82-c7aa-4f46-954a-b34c9f10c376 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086581 Jul 24 01:12:33.604523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 583/1048] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:33.613287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:33.615561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:33.625693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.626361 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.628620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:33.629318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:33.876688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:33.894410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:33.897925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:33.915666 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46214538-ee5d-4dd7-a188-d23a76fa760c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.307040 Jul 24 01:12:33.918021 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 584/1049] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:33 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:33.930058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c6ecc59-ef19-4e10-a655-434e1b5b21ef tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb236af0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.361335 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c6ecc59-ef19-4e10-a655-434e1b5b21ef tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/images/4eb3a96c-7b48-4551-9594-d0bad5d281d2" status: 204 len: 0 microversion: 2.1 time: 0.441907 Jul 24 01:12:34.362831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 585/1050] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:33 2022] DELETE /compute/v2.1/images/4eb3a96c-7b48-4551-9594-d0bad5d281d2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:34.372775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.373796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: 8b68f333-31cf-4daf-8dad-2a4c759bddd8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:34.383387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.384370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.385402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.386095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.412658 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] HTTP exception thrown: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Request method failure captured: Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 HTTP/1.1 Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt_mvt74LCA01lzVhWUSo6dBRkYrhfjzgGyx1tlCSz8tmdmfaa1x7bwAhpRAsNe1X1aC3dC99KdHqOUpKFj-bkWBhHkR7YLwn95xWL8lTYA1kWdcIf91rfyuCRo7gCXRG_zk6nALVrZ5Qmgfto6Ba55NX6YrQVSVkqa6iY_6rqrt1s Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:34.420111 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_913058bc11904339a05f4784fee6f1a1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b3861659794d4aa699ca3e984999a1fe Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:34.421591 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8b68f333-31cf-4daf-8dad-2a4c759bddd8'} Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:34.422603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. Jul 24 01:12:34.423780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:34.427409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Returning 404 to user: Instance 8b68f333-31cf-4daf-8dad-2a4c759bddd8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:34.429181 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e0ade392-15f7-4266-a79f-c470311167b7 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8" status: 404 len: 111 microversion: 2.1 time: 0.064800 Jul 24 01:12:34.432333 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 586/1051] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:34 2022] GET /compute/v2.1/servers/8b68f333-31cf-4daf-8dad-2a4c759bddd8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:34.449786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b142ee70-5ddd-4e98-ba7c-55a679319f4e tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] Calling method '.version_select at 0x7f05eb041f70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.932355 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b142ee70-5ddd-4e98-ba7c-55a679319f4e tempest-ListImageFiltersTestJSON-1103488121 tempest-ListImageFiltersTestJSON-1103488121-project] 10.222.0.27 "DELETE /compute/v2.1/images/6508de2d-fd39-45c0-9991-4992d7d4b10f" status: 204 len: 0 microversion: 2.1 time: 0.498636 Jul 24 01:12:34.933202 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 587/1052] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:34 2022] DELETE /compute/v2.1/images/6508de2d-fd39-45c0-9991-4992d7d4b10f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:34.939409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:34.939928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:34.961572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.962063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:34.963107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:34.963713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.011494 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] HTTP exception thrown: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Request method failure captured: Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 HTTP/1.1 Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt_mvt74LCA01lzVhWUSo6dBRkYrhfjzgGyx1tlCSz8tmdmfaa1x7bwAhpRAsNe1X1aC3dC99KdHqOUpKFj-bkWBhHkR7YLwn95xWL8lTYA1kWdcIf91rfyuCRo7gCXRG_zk6nALVrZ5Qmgfto6Ba55NX6YrQVSVkqa6iY_6rqrt1s Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:35.013088 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_913058bc11904339a05f4784fee6f1a1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b3861659794d4aa699ca3e984999a1fe Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: exception: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.014709 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c7321071-81d5-42f4-b1ec-3e089a82ff19'} Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:35.015559 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.016954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.029269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Returning 404 to user: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:35.031399 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23842b33-41a1-4c36-bde6-f42055b0af93 tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 404 len: 111 microversion: 2.1 time: 0.097058 Jul 24 01:12:35.036440 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 588/1053] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:34 2022] DELETE /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:35.043751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:35.050581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:35.057350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.058240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.059326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.059889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.256651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:35.265213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:35.275336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:35.280964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-828dd00c-26b7-4247-ba80-4d05af1abb10 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.243072 Jul 24 01:12:35.281585 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 589/1054] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:35 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:35.293655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:35.306602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] [instance: c7321071-81d5-42f4-b1ec-3e089a82ff19] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:35.315049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.316574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.317714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.318350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.349973 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] HTTP exception thrown: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Request method failure captured: Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 HTTP/1.1 Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jt_mvt74LCA01lzVhWUSo6dBRkYrhfjzgGyx1tlCSz8tmdmfaa1x7bwAhpRAsNe1X1aC3dC99KdHqOUpKFj-bkWBhHkR7YLwn95xWL8lTYA1kWdcIf91rfyuCRo7gCXRG_zk6nALVrZ5Qmgfto6Ba55NX6YrQVSVkqa6iY_6rqrt1s Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:35.360239 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_913058bc11904339a05f4784fee6f1a1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/913058bc11904339a05f4784fee6f1a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 913058bc11904339a05f4784fee6f1a1 Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449 Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b3861659794d4aa699ca3e984999a1fe Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-627309449-project Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: exception: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.361618 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c7321071-81d5-42f4-b1ec-3e089a82ff19'} Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:35.362987 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. Jul 24 01:12:35.364566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:35.367007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] Returning 404 to user: Instance c7321071-81d5-42f4-b1ec-3e089a82ff19 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:35.368131 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2796ac3f-4cf3-4e14-a711-8f0a831dcace tempest-ServersWithSpecificFlavorTestJSON-627309449 tempest-ServersWithSpecificFlavorTestJSON-627309449-project] 10.222.0.27 "GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19" status: 404 len: 111 microversion: 2.1 time: 0.082098 Jul 24 01:12:35.369233 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 590/1055] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:35 2022] GET /compute/v2.1/servers/c7321071-81d5-42f4-b1ec-3e089a82ff19 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:35.697359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f2834953-42b8-4fba-91ce-08ac4bce9452 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d1bab47f-7538-4c7d-b938-1dabbfba13e7" status: 202 len: 0 microversion: 2.1 time: 2.789037 Jul 24 01:12:35.698478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 466/1056] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:12:32 2022] DELETE /compute/v2.1/os-floating-ips/d1bab47f-7538-4c7d-b938-1dabbfba13e7 => generated 0 bytes in 2791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:12:35.706892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:35.708153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:35.718798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.719255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.720045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:35.720486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:35.809497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:12:36.058571 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.067168 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-287e4ead-3f42-49a6-85d7-2706600b1378 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 204 len: 0 microversion: 2.1 time: 0.364513 Jul 24 01:12:36.072042 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 591/1057] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:12:35 2022] DELETE /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:36.076899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:36.077533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:36.104091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.104997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.107598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.109143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.308538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:36.309556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:36.325468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.326000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.326784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:36.327217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:36.413634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:36.425407 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5046a7ba-b2c9-4286-8cce-234669e4e0e9 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1526 microversion: 2.1 time: 0.351347 Jul 24 01:12:36.438470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 467/1058] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:36 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1526 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:36.469532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:36.482263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:36.485515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:36.495683 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-522ebdd9-29a5-4149-97c1-968ee9b471c0 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.193315 Jul 24 01:12:36.506725 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 592/1059] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:36 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:37.443951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:37.445051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:37.463751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.464696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.474808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.475998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.520272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:37.521540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:37.556558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.557741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.561788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:37.561973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:37.920080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:37.945212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:37.954235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:38.006239 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-781b03f3-8b0a-4afa-ab82-398618e1647b tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.469494 Jul 24 01:12:38.027271 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 593/1060] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:37 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:12:38.303973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:38.317842 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-82ece38e-76f5-4398-aa6c-865cdb0b15d4 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1526 microversion: 2.1 time: 0.879064 Jul 24 01:12:38.318981 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 468/1061] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:37 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1526 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:38.810538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2959103-a260-4711-8e9f-8cdbc66752f9 tempest-AbsoluteLimitsTestJSON-431421063 tempest-AbsoluteLimitsTestJSON-431421063-project] Calling method '.version_select at 0x7f05eb236820>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:38.843117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2959103-a260-4711-8e9f-8cdbc66752f9 tempest-AbsoluteLimitsTestJSON-431421063 tempest-AbsoluteLimitsTestJSON-431421063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.850181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2959103-a260-4711-8e9f-8cdbc66752f9 tempest-AbsoluteLimitsTestJSON-431421063 tempest-AbsoluteLimitsTestJSON-431421063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.859002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2959103-a260-4711-8e9f-8cdbc66752f9 tempest-AbsoluteLimitsTestJSON-431421063 tempest-AbsoluteLimitsTestJSON-431421063-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:38.862870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2959103-a260-4711-8e9f-8cdbc66752f9 tempest-AbsoluteLimitsTestJSON-431421063 tempest-AbsoluteLimitsTestJSON-431421063-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:38.932026 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2959103-a260-4711-8e9f-8cdbc66752f9 tempest-AbsoluteLimitsTestJSON-431421063 tempest-AbsoluteLimitsTestJSON-431421063-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.403773 Jul 24 01:12:38.933336 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 594/1062] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:38 2022] GET /compute/v2.1/limits => generated 511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:39.035202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:39.035648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:39.040256 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:39.061906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.062857 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.063834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.064426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.274182 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.289084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.291149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.314419 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d912cd5d-0bc3-4d85-bc74-c3a0992ffd22 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.283812 Jul 24 01:12:39.315102 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 469/1063] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:39 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:39.339585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:39.340548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:39.359977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.362564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.366949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.367923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.369117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0e8f7223-8c6a-44b9-80fe-0e4122ed2c5c req-0bdbf371-ae9d-4811-9c65-f1429a8ee332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5", "name": "network-vif-deleted", "tag": "32fa2173-df2d-4d45-b2f8-9c6046b137ea"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:39.386537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0e8f7223-8c6a-44b9-80fe-0e4122ed2c5c req-0bdbf371-ae9d-4811-9c65-f1429a8ee332 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:39.386983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0e8f7223-8c6a-44b9-80fe-0e4122ed2c5c req-0bdbf371-ae9d-4811-9c65-f1429a8ee332 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:39.417166 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0e8f7223-8c6a-44b9-80fe-0e4122ed2c5c req-0bdbf371-ae9d-4811-9c65-f1429a8ee332 service nova] Creating event network-vif-deleted:32fa2173-df2d-4d45-b2f8-9c6046b137ea for instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 on n-h2-master-1 Jul 24 01:12:39.431194 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0e8f7223-8c6a-44b9-80fe-0e4122ed2c5c req-0bdbf371-ae9d-4811-9c65-f1429a8ee332 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065893 Jul 24 01:12:39.441558 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 470/1064] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:39.555365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23333c1ebbdf4ddab9d21d5b8b7139e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4e8e174a104e60a0c40a83bd2235fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:39.575201 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a33fe97-c3dd-46ee-932d-5435ac332e27 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 200 len: 1484 microversion: 2.1 time: 0.237927 Jul 24 01:12:39.579112 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 595/1065] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:39 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 1484 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:40.342930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:40.344460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:40.355021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.356512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.357659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.358423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.579930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:40.604216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:40.605568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] [instance: f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:40.616749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:40.628890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:40.630790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.635309 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.644529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:40.646632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:40.664292 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72739501-c4e8-4338-8a84-26ceaa028f3e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.327384 Jul 24 01:12:40.673791 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 471/1066] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:40 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:40.700316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] HTTP exception thrown: Instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 could not be found. Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Request method failure captured: Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 HTTP/1.1 Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jwrix_eI-nk0aOv-4lAGKEo7cWH7SymYgL4o9LEhkheu6Rk94jWXJGIjeIoT132wjcA_-MRJ7uwgf8doAqgaSvzlUJiDhXarBdsRq0WsijJAnbU23jQrKNF8t9cRhusLwsBgDR7lRRBwA35NDp6LDPkI3Xkrsw3H0vCEGpBec2LKFY Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:12:40.714829 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aa4e8e174a104e60a0c40a83bd2235fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aa4e8e174a104e60a0c40a83bd2235fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: aa4e8e174a104e60a0c40a83bd2235fa Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-798457998 Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 23333c1ebbdf4ddab9d21d5b8b7139e6 Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-798457998-project Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 could not be found. Jul 24 01:12:40.716323 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5'} Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 could not be found. Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:12:40.717342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 could not be found. Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 could not be found. Jul 24 01:12:40.719295 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:12:40.724804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] Returning 404 to user: Instance f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:12:40.728230 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1aa53da2-3a72-4abe-ac60-ce861dced525 tempest-FloatingIPsAssociationTestJSON-798457998 tempest-FloatingIPsAssociationTestJSON-798457998-project] 10.222.0.27 "GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5" status: 404 len: 111 microversion: 2.1 time: 0.126150 Jul 24 01:12:40.730486 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 596/1067] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:40 2022] GET /compute/v2.1/servers/f1e5146f-2eb2-4ce3-b98e-875c8b6e79c5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:12:41.688600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:41.689215 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:41.698535 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:41.700220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:41.701132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:41.701573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:42.016328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:42.028881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:42.030984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:42.039158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-438c2a30-b621-48f0-b08c-8840c4016c6e tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.353811 Jul 24 01:12:42.040061 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 472/1068] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:41 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:43.060904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:43.062428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:43.080657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:43.082891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:43.088993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:43.092083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:43.229824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:43.248372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:43.251936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:43.272169 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-931a59c6-6ee3-4938-899b-be8796f10397 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1446 microversion: 2.75 time: 0.215252 Jul 24 01:12:43.292087 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 597/1069] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:43 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1446 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:44.313317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:44.314164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:44.328449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.329152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.355217 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:44.355861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:44.802656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:44.814210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:44.826816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:44.838755 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9e22635-f859-4be8-a8a7-a60f90a6cf44 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1452 microversion: 2.75 time: 0.530059 Jul 24 01:12:44.839600 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 473/1070] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:44 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1452 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:45.860581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:45.861307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:45.872052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.874466 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:45.875840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:45.877658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:46.516456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:46.532642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:46.534403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:46.571840 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ecfe5ee3-e6b3-4e71-ab30-97fb99bc3a2c tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1452 microversion: 2.75 time: 0.711080 Jul 24 01:12:46.574861 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 598/1071] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:45 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1452 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:47.594529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:47.595148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:47.614060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.614821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.615917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:47.616548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:47.811058 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.830553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.837125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:47.855964 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e688f93-5585-425c-8f70-cc2f5a59ca0f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1437 microversion: 2.75 time: 0.263178 Jul 24 01:12:47.857372 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 474/1072] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:47 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1437 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:48.303843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:48.308559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:48.328933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.332476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.333566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.343608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.498189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:48.499454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:48.500291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:48.500996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:48.501845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:48.649540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:48.665309 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.666227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.668595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:48.669368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:48.833512 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:48.896295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:49.039942 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:49.041222 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:49.055784 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ec97f53-c625-487f-b7ed-c7764dcddbe0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8/action" status: 202 len: 1940 microversion: 2.75 time: 1.182730 Jul 24 01:12:49.057977 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 599/1073] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:12:47 2022] POST /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8/action => generated 1940 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 24 01:12:49.076798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:49.080902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:49.094960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.095848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.098210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:49.098909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:49.675378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:49.829291 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d94f353-66af-44a1-8940-2a692e302676 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.756895 Jul 24 01:12:49.833033 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 475/1074] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:49 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:50.853404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:50.854074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:50.886161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.890076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:50.891821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:50.892492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:51.059901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:51.177041 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7510fb4b-13bd-458b-8275-b76731137e42 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.327945 Jul 24 01:12:51.179098 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 600/1075] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:50 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:52.073542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-545ba5c8-c7bf-4656-ad5a-ae7fc9a009b9 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:52.074750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-545ba5c8-c7bf-4656-ad5a-ae7fc9a009b9 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:52.089791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545ba5c8-c7bf-4656-ad5a-ae7fc9a009b9 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.091659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545ba5c8-c7bf-4656-ad5a-ae7fc9a009b9 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.093217 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545ba5c8-c7bf-4656-ad5a-ae7fc9a009b9 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.093736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545ba5c8-c7bf-4656-ad5a-ae7fc9a009b9 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.204692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:52.205797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:52.209093 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-545ba5c8-c7bf-4656-ad5a-ae7fc9a009b9 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140316 Jul 24 01:12:52.215140 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 476/1076] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:12:52 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:52.217161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.220418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:52.222934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:52.223118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.224175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.224628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.231633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.232359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.233401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:52.234110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:52.391630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:52.455439 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89b9d7ba-3b21-4423-b60c-62b5ee0cb2f9 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.252560 Jul 24 01:12:52.466419 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 601/1077] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:52 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:12:52.649891 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:52.662378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lazy-loading 'services' on Instance uuid f91e88b1-cc02-4d11-8b50-36eaa04b5dba {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:52.921827 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-150934cd-edda-417a-863e-4a6ad05c9ab7 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments/d55e9edf-9cfb-40ca-b90d-1a628555c2ec" status: 202 len: 0 microversion: 2.1 time: 0.705106 Jul 24 01:12:52.922437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 477/1078] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:12:52 2022] DELETE /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments/d55e9edf-9cfb-40ca-b90d-1a628555c2ec => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:12:53.478598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:53.479517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:53.513828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.516828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:53.519606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:53.520379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:53.645010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:53.661171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd229fe8-966a-4a6c-8bd2-4bc71c16c138 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eb3f1dc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:53.683521 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60eedb34-602c-41e3-9c2e-b759b1b3baf0 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.210581 Jul 24 01:12:53.684466 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 602/1079] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:53 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:53.747640 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd229fe8-966a-4a6c-8bd2-4bc71c16c138 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f" status: 200 len: 637 microversion: 2.1 time: 0.092009 Jul 24 01:12:53.749618 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 478/1080] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:53 2022] GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f => generated 637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:12:53.763816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4aa71100-21c3-4344-a224-7c3129c4f669 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update_all', calling method: .version_select at 0x7f05eb201a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:53.835052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4aa71100-21c3-4344-a224-7c3129c4f669 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:53.845896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4aa71100-21c3-4344-a224-7c3129c4f669 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:54.528098 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4aa71100-21c3-4344-a224-7c3129c4f669 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.769108 Jul 24 01:12:54.529000 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 603/1081] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:12:53 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 61 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:54.539776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2eae42f2-5ddf-43e6-943c-c6fca916a6d0 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eb420280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:55.034014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1870785401", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "0a1da61f-fe83-432c-9aa7-db32a73a802a"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:55.342123 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2eae42f2-5ddf-43e6-943c-c6fca916a6d0 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "DELETE /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.805566 Jul 24 01:12:55.344764 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 479/1082] 10.222.0.27 () {58 vars in 1295 bytes} [Sun Jul 24 01:12:54 2022] DELETE /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata/os_version => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:12:55.352437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] validate_networks() for [('0a1da61f-fe83-432c-9aa7-db32a73a802a', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:12:55.354998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:55.359267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:55.396224 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:55.396880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:55.399441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:55.400761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:55.976440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:56.032559 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eb78e113-4684-474c-ba7d-9ea00e6d0161 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.685529 Jul 24 01:12:56.036290 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 480/1083] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:55 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:56.065001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2727a024-b537-4b5d-97fe-25c7261685d3 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eb3e3a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:56.149840 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2727a024-b537-4b5d-97fe-25c7261685d3 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 37 microversion: 2.1 time: 0.097933 Jul 24 01:12:56.150530 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 481/1084] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:12:56 2022] GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 37 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:56.156721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8094f793-59c8-4986-a1ea-ca720e660e97 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:56.160101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8094f793-59c8-4986-a1ea-ca720e660e97 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:56.201927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8094f793-59c8-4986-a1ea-ca720e660e97 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:56.203304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8094f793-59c8-4986-a1ea-ca720e660e97 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:56.204168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8094f793-59c8-4986-a1ea-ca720e660e97 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:56.204607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8094f793-59c8-4986-a1ea-ca720e660e97 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:57.279232 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8094f793-59c8-4986-a1ea-ca720e660e97 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1813 microversion: 2.1 time: 1.127520 Jul 24 01:12:57.285815 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 482/1085] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:56 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1813 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:57.316786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-095b544a-7c5f-4bb1-b8e5-ed28bc0159ff tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update_all', calling method: .version_select at 0x7f05eb3fbd30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:57.432941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-095b544a-7c5f-4bb1-b8e5-ed28bc0159ff tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:57.458652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-095b544a-7c5f-4bb1-b8e5-ed28bc0159ff tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:58.013003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:12:58.015958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:12:58.016676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:12:58.017268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:12:58.018406 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:12:58.040240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.040694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.041500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.041978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.166514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Getting quotas for project ec53a779c92c4620a832da29e583581b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:58.189698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Getting quotas for user c1c7e27c899648168625087b1653df68 and project ec53a779c92c4620a832da29e583581b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:58.246096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:12:58.251866 n-d-master-1 devstack@n-api.service[119561]: WARNING nova.utils [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1870785401 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-187078540 Jul 24 01:12:58.253163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:12:58.319848 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-095b544a-7c5f-4bb1-b8e5-ed28bc0159ff tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 61 microversion: 2.1 time: 1.032468 Jul 24 01:12:58.320760 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 483/1086] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:12:57 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 61 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:58.325372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:58.327444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:58.347553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.357210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.358852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.359300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.413483 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64625303-c38a-4200-ba4a-2a3fd44dfa7e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.727247 Jul 24 01:12:58.417879 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 604/1087] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:12:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:12:58.434065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b525f18b-2274-41bf-b752-fd38215cf490 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:58.436720 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:12:58.436720 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:12:58.443643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b525f18b-2274-41bf-b752-fd38215cf490 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.445103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b525f18b-2274-41bf-b752-fd38215cf490 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.469380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b525f18b-2274-41bf-b752-fd38215cf490 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:58.471391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b525f18b-2274-41bf-b752-fd38215cf490 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:58.551980 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:12:58.559899 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b525f18b-2274-41bf-b752-fd38215cf490 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.138520 Jul 24 01:12:58.564386 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 605/1088] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:12:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:12:58.587512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3f4bb40a-ea10-4bb8-933f-36da8e2bd4f7 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eb6a8670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:58.635543 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e87ef35-0ffa-44c0-9134-2a3cc6df8282 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.311303 Jul 24 01:12:58.636183 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 484/1089] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:58 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:12:58.660499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-20ad9dec-76be-4de1-aac3-dc27d7430a02 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:58.661104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-20ad9dec-76be-4de1-aac3-dc27d7430a02 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:58.714383 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3f4bb40a-ea10-4bb8-933f-36da8e2bd4f7 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.146924 Jul 24 01:12:58.715964 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 606/1090] 10.222.0.27 () {58 vars in 1289 bytes} [Sun Jul 24 01:12:58 2022] GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata/os_distro => generated 33 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:58.740045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25a97f6f-457c-48c5-9071-ef93bb845705 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update_all', calling method: .version_select at 0x7f05eb0dbf70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:12:58.871783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-20ad9dec-76be-4de1-aac3-dc27d7430a02 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:12:58.890014 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-20ad9dec-76be-4de1-aac3-dc27d7430a02 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1232 microversion: 2.1 time: 0.245097 Jul 24 01:12:58.893747 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 485/1091] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:58 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1232 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:12:58.902062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-25a97f6f-457c-48c5-9071-ef93bb845705 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:12:58.924077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-25a97f6f-457c-48c5-9071-ef93bb845705 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:12:59.656145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:59.656801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:59.679269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.681610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.682521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.686383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.801345 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25a97f6f-457c-48c5-9071-ef93bb845705 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 61 microversion: 2.1 time: 1.074001 Jul 24 01:12:59.803251 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 607/1092] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:12:58 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 61 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:59.812235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8fcfb76f-50ab-4555-98ec-761c31cf5399 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eb201670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:59.901852 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8fcfb76f-50ab-4555-98ec-761c31cf5399 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.093661 Jul 24 01:12:59.902450 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 608/1093] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:12:59 2022] GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 61 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:12:59.923956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:12:59.937098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:12:59.958204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.959144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:12:59.961623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:12:59.962385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:00.034358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:00.121587 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5bb90bcf-a971-416f-bc4b-582cced7374a tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.469263 Jul 24 01:13:00.138224 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 486/1094] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:12:59 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:13:00.152068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b7f0398-a382-4b56-b588-df0c6943273a tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update_all', calling method: .version_select at 0x7f05eb1eb4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:00.170498 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:00.187747 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5b5d2fc9-9dc2-413f-bada-7b85e10abdcb tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1236 microversion: 2.1 time: 0.275099 Jul 24 01:13:00.209343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 609/1095] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:12:59 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1236 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:00.272084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1b7f0398-a382-4b56-b588-df0c6943273a tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:00.287192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1b7f0398-a382-4b56-b588-df0c6943273a tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:00.807011 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b7f0398-a382-4b56-b588-df0c6943273a tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.667221 Jul 24 01:13:00.814960 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 487/1096] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:13:00 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 61 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:00.824270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-62d2e0a2-389f-4997-ae34-36a23a07535e tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update_all', calling method: .version_select at 0x7f05eb002f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:00.928291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-62d2e0a2-389f-4997-ae34-36a23a07535e tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:00.943087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-62d2e0a2-389f-4997-ae34-36a23a07535e tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:01.145078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:01.146268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:01.162975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:01.180466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.197186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:01.209654 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.482630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:01.550074 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-468a9f6a-7208-421c-ab39-0f1445c9e954 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.409395 Jul 24 01:13:01.552130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 488/1097] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:01 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:01.564825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:01.566724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:01.587983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:01.588707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.589733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:01.590320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:01.809087 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-62d2e0a2-389f-4997-ae34-36a23a07535e tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.988635 Jul 24 01:13:01.815932 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 610/1098] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:13:00 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 64 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:01.822188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d62fa18-8037-4c44-83d4-a22544af6cae tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eaf2b5e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:01.895858 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d62fa18-8037-4c44-83d4-a22544af6cae tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.078320 Jul 24 01:13:01.902663 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 611/1099] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:13:01 2022] GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 64 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:01.911390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a639a2c5-e830-4143-a01e-a925731af03f tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update_all', calling method: .version_select at 0x7f05eb002040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:02.009985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:02.024211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8697e273-dd44-4fa8-9921-f988519d15ef tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1290 microversion: 2.1 time: 0.470817 Jul 24 01:13:02.030578 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 489/1100] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:01 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1290 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:02.041921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-a639a2c5-e830-4143-a01e-a925731af03f tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:02.060953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-a639a2c5-e830-4143-a01e-a925731af03f tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:02.093302 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:02.570924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:02.571541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:02.579443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:02.580657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:02.581426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:02.581977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:02.811448 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a639a2c5-e830-4143-a01e-a925731af03f tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.907250 Jul 24 01:13:02.812368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 612/1101] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:13:01 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 61 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:02.823535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea81fbc0-07cc-4952-bb87-d1e92d018568 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update', calling method: .version_select at 0x7f05eaf2b9d0>, body: {"meta": {"os_version": "alt"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:02.929547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ea81fbc0-07cc-4952-bb87-d1e92d018568 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:02.941083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ea81fbc0-07cc-4952-bb87-d1e92d018568 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:03.262683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:03.301098 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d7d1d1eb-a57f-46a0-b394-d734d36b794d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.733888 Jul 24 01:13:03.313183 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 490/1102] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:02 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:03.318591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:03.319213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:03.353474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.353960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.354758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.355202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.705615 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea81fbc0-07cc-4952-bb87-d1e92d018568 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.885662 Jul 24 01:13:03.710830 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 613/1103] 10.222.0.27 () {60 vars in 1312 bytes} [Sun Jul 24 01:13:02 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata/os_version => generated 31 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:03.714350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-34ef81ea-ebdf-42e5-be8b-b6cd399c37da tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "847a3035-bdaa-476f-a97f-0d6350cb6c26", "device": "/dev/xvdb"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:03.717131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34ef81ea-ebdf-42e5-be8b-b6cd399c37da tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:03.719326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:03.737416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34ef81ea-ebdf-42e5-be8b-b6cd399c37da tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.737908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34ef81ea-ebdf-42e5-be8b-b6cd399c37da tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.738238 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a761e020-90ac-4b2a-91f1-15933951796f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1290 microversion: 2.1 time: 0.423306 Jul 24 01:13:03.738699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34ef81ea-ebdf-42e5-be8b-b6cd399c37da tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:03.739132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34ef81ea-ebdf-42e5-be8b-b6cd399c37da tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:03.739470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 491/1104] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:03 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1290 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:03.744901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e155217-f478-42e1-9c14-00c9e92b016e tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eb3ad1f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:03.821144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e155217-f478-42e1-9c14-00c9e92b016e tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 58 microversion: 2.1 time: 0.078984 Jul 24 01:13:03.828093 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 492/1105] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:13:03 2022] GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 58 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:03.836081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-51949ee8-1c6e-462b-aac8-e780427f9591 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'update_all', calling method: .version_select at 0x7f05eb3498b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:03.948713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-51949ee8-1c6e-462b-aac8-e780427f9591 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:03.969777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-51949ee8-1c6e-462b-aac8-e780427f9591 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:04.562705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-34ef81ea-ebdf-42e5-be8b-b6cd399c37da tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "POST /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853965 Jul 24 01:13:04.571346 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 614/1106] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:13:03 2022] POST /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:04.601212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:04.603798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:04.620719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:04.625372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:04.627403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:04.628120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:04.831338 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-51949ee8-1c6e-462b-aac8-e780427f9591 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 61 microversion: 2.1 time: 1.001203 Jul 24 01:13:04.832130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 493/1107] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:13:03 2022] PUT /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 61 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:04.996845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:05.048020 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-604d4cfa-f534-4132-886c-7b43d5cb0a7b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.472575 Jul 24 01:13:05.049276 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 615/1108] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:04 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:05.088386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:05.089166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:05.112563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.113010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:05.131750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:05.132209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:05.264114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-894327681", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "adf394c3-0407-4590-8c41-4e59f65f117d"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:05.410540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] validate_networks() for [('adf394c3-0407-4590-8c41-4e59f65f117d', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:13:05.764383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:05.788675 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-afb786b1-0b34-48e1-a365-ba27737f4aae tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.736511 Jul 24 01:13:05.789585 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 616/1109] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:05 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:05.812273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dc4e0e24-07a3-4f27-b940-a44c6b86f873 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Action: 'create', calling method: .version_select at 0x7f05eaee2280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:05.937092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-dc4e0e24-07a3-4f27-b940-a44c6b86f873 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:05.949049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-dc4e0e24-07a3-4f27-b940-a44c6b86f873 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Getting quotas for user 208a9588c20943b192f340ccbe53b00b and project a32b4be640ce47c28766b103533975c2. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:06.683308 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dc4e0e24-07a3-4f27-b940-a44c6b86f873 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "POST /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.892147 Jul 24 01:13:06.684116 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 617/1110] 10.222.0.27 () {60 vars in 1280 bytes} [Sun Jul 24 01:13:05 2022] POST /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 85 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:06.809313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9d13a3e9-d5ba-4615-b25e-31dedf7c1f1d tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1560319611", "ram": 512, "vcpus": 1, "disk": 10, "id": 1230608192, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:06.811195 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:06.811195 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:13:06.836408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9d13a3e9-d5ba-4615-b25e-31dedf7c1f1d tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.150874 Jul 24 01:13:06.837025 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 618/1111] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:13:06 2022] POST /compute/v2.1/flavors => generated 416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:06.844310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a514e977-00ba-4138-8a03-fc81f2ee9e61 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:06.845399 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a514e977-00ba-4138-8a03-fc81f2ee9e61 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:06.852605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a514e977-00ba-4138-8a03-fc81f2ee9e61 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.853313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a514e977-00ba-4138-8a03-fc81f2ee9e61 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.853864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a514e977-00ba-4138-8a03-fc81f2ee9e61 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.854476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a514e977-00ba-4138-8a03-fc81f2ee9e61 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.881739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:13:06.882221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:13:06.882786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:13:06.883208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:13:06.883612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:13:06.928322 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a514e977-00ba-4138-8a03-fc81f2ee9e61 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090104 Jul 24 01:13:06.929188 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 619/1112] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:13:06 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:06.938290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:06.938957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:06.952585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.953037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.953879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.954312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.961438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.961977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:06.962855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:06.963292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.079053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:07.095834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for user f3de9a749c874cfc8c34deffb1001a79 and project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:07.145149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:13:07.151383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:13:07.206037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:07.260604 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c37a9184-803a-401f-97c9-ea5cef161add tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.326081 Jul 24 01:13:07.278211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 620/1113] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:06 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:07.281985 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ced57996-f664-43c3-a728-46bb21b50be9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.448650 Jul 24 01:13:07.285270 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 494/1114] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:13:07.297582 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d456855-e39c-406f-a147-12f340608513 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] Calling method '.version_select at 0x7f05eaee2ca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:07.303402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:07.309866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:07.322202 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:07.324283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.324930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.326214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.326647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.403154 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d456855-e39c-406f-a147-12f340608513 tempest-ImagesMetadataTestJSON-1288729578 tempest-ImagesMetadataTestJSON-1288729578-project] 10.222.0.27 "GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.123565 Jul 24 01:13:07.404192 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 621/1115] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:13:07 2022] GET /compute/v2.1/images/d1b3ad75-3223-4b97-b5e2-d7afbedf865f/metadata => generated 85 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:07.626611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cedcc44b-cee3-4813-97a8-2b108f618a3c tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:07.644557 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cedcc44b-cee3-4813-97a8-2b108f618a3c tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] HTTP exception thrown: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cedcc44b-cee3-4813-97a8-2b108f618a3c tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Request method failure captured: Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/flavors/1230608192/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JyfZ9FslBT4eT4BfiMExW3Tl1ppFovjGlZuobLUXfX6NEYPyQAGW-hurAblMxJB83dnqaexm-wBSU0z62CornK2hhk_MCSFSR2qU_9zH4Ud-U6pFVDaoVgOkXKIuGbkmRD0byFYKycT0aZuqjdblg9clsOlO86VKVfJmIt6Nc1kWi4 Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:07.650996 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa61fdd30c1148c78ec1262eac09d6fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 48d3d461293a497fbfde7044e5fa4c7b Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:07.652303 n-d-master-1 devstack@n-api.service[119561]: exception: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: action_args: {'flavor_id': '1230608192', 'id': 'hw:cpu_thread_policy'} Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:07.653343 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cedcc44b-cee3-4813-97a8-2b108f618a3c tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Returning 404 to user: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:07.657278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cedcc44b-cee3-4813-97a8-2b108f618a3c tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] 10.222.0.27 "GET /compute/v2.1/flavors/1230608192/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.247318 Jul 24 01:13:07.658878 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 622/1116] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:13:07 2022] GET /compute/v2.1/flavors/1230608192/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:07.677949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4c9310d-ca80-4508-af12-3b348c2ec89a tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:07.685134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4c9310d-ca80-4508-af12-3b348c2ec89a tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:07.714682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c9310d-ca80-4508-af12-3b348c2ec89a tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.715125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c9310d-ca80-4508-af12-3b348c2ec89a tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.716280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c9310d-ca80-4508-af12-3b348c2ec89a tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:07.716777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c9310d-ca80-4508-af12-3b348c2ec89a tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:07.806839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4c9310d-ca80-4508-af12-3b348c2ec89a tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144025 Jul 24 01:13:07.808200 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 623/1117] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:13:07 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:07.832194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-040a17d8-10bc-49f9-b56c-7406bbe987c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:07.832765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-040a17d8-10bc-49f9-b56c-7406bbe987c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:08.137580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-040a17d8-10bc-49f9-b56c-7406bbe987c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:08.157226 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-040a17d8-10bc-49f9-b56c-7406bbe987c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1214 microversion: 2.1 time: 0.347831 Jul 24 01:13:08.160343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 624/1118] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:07 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1214 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:08.174112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-619f3405-e051-4f9a-887c-91167af10ac3 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:08.176158 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:08.176158 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:13:08.177403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-619f3405-e051-4f9a-887c-91167af10ac3 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '48d3d461293a497fbfde7044e5fa4c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa61fdd30c1148c78ec1262eac09d6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-619f3405-e051-4f9a-887c-91167af10ac3 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Request method failure captured: Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/flavors/1230608192/os-extra_specs HTTP/1.1 Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 66 Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JyfZ9FslBT4eT4BfiMExW3Tl1ppFovjGlZuobLUXfX6NEYPyQAGW-hurAblMxJB83dnqaexm-wBSU0z62CornK2hhk_MCSFSR2qU_9zH4Ud-U6pFVDaoVgOkXKIuGbkmRD0byFYKycT0aZuqjdblg9clsOlO86VKVfJmIt6Nc1kWi4 Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:08.184941 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa61fdd30c1148c78ec1262eac09d6fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 48d3d461293a497fbfde7044e5fa4c7b Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 24 01:13:08.186483 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: action_args: {'flavor_id': '1230608192', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:13:08.187230 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 24 01:13:08.188392 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:08.191036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-619f3405-e051-4f9a-887c-91167af10ac3 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:08.192053 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-619f3405-e051-4f9a-887c-91167af10ac3 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] 10.222.0.27 "POST /compute/v2.1/flavors/1230608192/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.030529 Jul 24 01:13:08.192797 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 625/1119] 10.222.0.27 () {60 vars in 1223 bytes} [Sun Jul 24 01:13:08 2022] POST /compute/v2.1/flavors/1230608192/os-extra_specs => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:08.207240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2a51ab32-31d4-41dd-9354-d063215a755f req-b2a73b6f-c146-47a0-a69f-cd2f8f7fdee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4abc5a1-3a53-4246-ba5b-54c1449fb1c8", "tag": "190a02df-6d16-4646-adb5-db06e07a74fe"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:08.243853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2a51ab32-31d4-41dd-9354-d063215a755f req-b2a73b6f-c146-47a0-a69f-cd2f8f7fdee6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.244302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2a51ab32-31d4-41dd-9354-d063215a755f req-b2a73b6f-c146-47a0-a69f-cd2f8f7fdee6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.267244 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2a51ab32-31d4-41dd-9354-d063215a755f req-b2a73b6f-c146-47a0-a69f-cd2f8f7fdee6 service nova] Creating event network-changed:190a02df-6d16-4646-adb5-db06e07a74fe for instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 on n-h2-master-1 Jul 24 01:13:08.283784 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2a51ab32-31d4-41dd-9354-d063215a755f req-b2a73b6f-c146-47a0-a69f-cd2f8f7fdee6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089402 Jul 24 01:13:08.284400 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 626/1120] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:08.289542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:08.310461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:08.338266 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.338780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.339619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.340064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.379401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:08.387805 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5ad5808-929e-4a0d-89ad-1f1ba19e41f9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 1.099962 Jul 24 01:13:08.394457 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 495/1121] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:07 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:08.409722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81fddce0-7a29-45b1-b859-388cfb2003db tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:08.413845 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:08.413845 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:13:08.436559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:13:08.491383 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81fddce0-7a29-45b1-b859-388cfb2003db tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1230608192/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091701 Jul 24 01:13:08.491982 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 496/1122] 10.222.0.27 () {60 vars in 1223 bytes} [Sun Jul 24 01:13:08 2022] POST /compute/v2.1/flavors/1230608192/os-extra_specs => generated 66 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:08.507546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:08.508168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:08.515860 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:08.521783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.522249 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.523042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.523479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.614215 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:08.665480 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2db5ee2a-b7b5-4253-aaa6-753aecbf8358 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 204 len: 0 microversion: 2.1 time: 0.379467 Jul 24 01:13:08.666958 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 627/1123] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:13:08 2022] DELETE /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:13:08.676963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebe8b75c-56cd-4aef-b8b1-b480e6ea496d tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:08.678502 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:08.678502 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:13:08.680237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebe8b75c-56cd-4aef-b8b1-b480e6ea496d tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '48d3d461293a497fbfde7044e5fa4c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa61fdd30c1148c78ec1262eac09d6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebe8b75c-56cd-4aef-b8b1-b480e6ea496d tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Request method failure captured: Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JyfZ9FslBT4eT4BfiMExW3Tl1ppFovjGlZuobLUXfX6NEYPyQAGW-hurAblMxJB83dnqaexm-wBSU0z62CornK2hhk_MCSFSR2qU_9zH4Ud-U6pFVDaoVgOkXKIuGbkmRD0byFYKycT0aZuqjdblg9clsOlO86VKVfJmIt6Nc1kWi4 Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:08.684092 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa61fdd30c1148c78ec1262eac09d6fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 48d3d461293a497fbfde7044e5fa4c7b Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:08.685503 n-d-master-1 devstack@n-api.service[119561]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: action_args: {'flavor_id': '1230608192', 'id': 'hw:numa_nodes'} Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:13:08.687476 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 24 01:13:08.688682 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:08.693289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebe8b75c-56cd-4aef-b8b1-b480e6ea496d tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:08.694556 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ebe8b75c-56cd-4aef-b8b1-b480e6ea496d tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026186 Jul 24 01:13:08.699701 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 628/1124] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:13:08 2022] DELETE /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:08.707299 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:08.710414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:08.723470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.724506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.726418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:08.727679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:08.933198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:08.971694 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a28454c-e985-4d54-a115-08860d08fab2 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.478621 Jul 24 01:13:08.972719 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 497/1125] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:08 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:08.980766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f5a93b37-88f8-4a25-9fe5-1b6f9c7d6312 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:08.991617 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:08.991617 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:13:09.042037 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f5a93b37-88f8-4a25-9fe5-1b6f9c7d6312 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1230608192/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065208 Jul 24 01:13:09.043125 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 498/1126] 10.222.0.27 () {60 vars in 1223 bytes} [Sun Jul 24 01:13:08 2022] POST /compute/v2.1/flavors/1230608192/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:13:09.073438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2bf6d97-1cb2-48fa-a582-955575afdf55 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:09.075254 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:09.075254 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:13:09.076839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2bf6d97-1cb2-48fa-a582-955575afdf55 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '48d3d461293a497fbfde7044e5fa4c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa61fdd30c1148c78ec1262eac09d6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2bf6d97-1cb2-48fa-a582-955575afdf55 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Request method failure captured: Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 22 Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JyfZ9FslBT4eT4BfiMExW3Tl1ppFovjGlZuobLUXfX6NEYPyQAGW-hurAblMxJB83dnqaexm-wBSU0z62CornK2hhk_MCSFSR2qU_9zH4Ud-U6pFVDaoVgOkXKIuGbkmRD0byFYKycT0aZuqjdblg9clsOlO86VKVfJmIt6Nc1kWi4 Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:13:09.080097 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa61fdd30c1148c78ec1262eac09d6fd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa61fdd30c1148c78ec1262eac09d6fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: fa61fdd30c1148c78ec1262eac09d6fd Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 48d3d461293a497fbfde7044e5fa4c7b Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: {"hw:numa_nodes": "1"} Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:13:09.081404 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: action_args: {'flavor_id': '1230608192', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:13:09.082315 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 24 01:13:09.083411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.085942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2bf6d97-1cb2-48fa-a582-955575afdf55 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:09.087460 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c2bf6d97-1cb2-48fa-a582-955575afdf55 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789 tempest-FlavorsExtraSpecsNegativeTestJSON-86630789-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026146 Jul 24 01:13:09.088519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 499/1127] 10.222.0.27 () {60 vars in 1264 bytes} [Sun Jul 24 01:13:09 2022] PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes => generated 124 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:09.110360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fdd5bdc4-f79f-4b1d-87df-39fa7ea28f8d tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.112161 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:09.112161 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:13:09.148469 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fdd5bdc4-f79f-4b1d-87df-39fa7ea28f8d tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] HTTP exception thrown: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fdd5bdc4-f79f-4b1d-87df-39fa7ea28f8d tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Request method failure captured: Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/flavors/1230608192/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JygT-n5WNGKBPPGyNiEkjv0wxp7hMyVTfo0_ZQknqSA0sROzQCevO5hhay23O9BeCBb9FVnbJtpIpRSKergCYbmkUV5SjDp75JzQ1NZSAr9mt5M5nZVYM5ngoH8CqE3x-ILKVlihlhIRtPlHmYOz8K80Djb6Fl_Kh0FmHEwvkEutoQ Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 7f01dd536afd4fdb8b4ad1e49789c778 Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:13:09.154120 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f01dd536afd4fdb8b4ad1e49789c778", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 7f01dd536afd4fdb8b4ad1e49789c778 Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 747b30f6748741708d6e36b5f6ddf0c4 Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:13:09.155700 n-d-master-1 devstack@n-api.service[119562]: exception: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: action_args: {'flavor_id': '1230608192', 'id': 'hw:cpu_thread_policy'} Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:09.156433 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fdd5bdc4-f79f-4b1d-87df-39fa7ea28f8d tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Returning 404 to user: Flavor 1230608192 has no extra specs with key hw:cpu_thread_policy. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fdd5bdc4-f79f-4b1d-87df-39fa7ea28f8d tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1230608192/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.049077 Jul 24 01:13:09.160132 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 500/1128] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:13:09 2022] DELETE /compute/v2.1/flavors/1230608192/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:09.174018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e935aa4-884f-497e-989a-f3627689aa44 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:09.186524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9e935aa4-884f-497e-989a-f3627689aa44 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e935aa4-884f-497e-989a-f3627689aa44 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Request method failure captured: Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 27 Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JygT-n5WNGKBPPGyNiEkjv0wxp7hMyVTfo0_ZQknqSA0sROzQCevO5hhay23O9BeCBb9FVnbJtpIpRSKergCYbmkUV5SjDp75JzQ1NZSAr9mt5M5nZVYM5ngoH8CqE3x-ILKVlihlhIRtPlHmYOz8K80Djb6Fl_Kh0FmHEwvkEutoQ Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 7f01dd536afd4fdb8b4ad1e49789c778 Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:13:09.187956 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f01dd536afd4fdb8b4ad1e49789c778", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 7f01dd536afd4fdb8b4ad1e49789c778 Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 747b30f6748741708d6e36b5f6ddf0c4 Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: {"hw:cpu_policy": "shared"} Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:13:09.191326 n-d-master-1 devstack@n-api.service[119562]: exception: Request body and URI mismatch Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: action_args: {'flavor_id': '1230608192', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.193074 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.194959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:09.194959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:09.194959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 24 01:13:09.194959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.194959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e935aa4-884f-497e-989a-f3627689aa44 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:09.194959 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e935aa4-884f-497e-989a-f3627689aa44 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025833 Jul 24 01:13:09.194959 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 501/1129] 10.222.0.27 () {60 vars in 1264 bytes} [Sun Jul 24 01:13:09 2022] PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes => generated 73 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:09.195971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.204241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:09.217619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.218655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:09.220009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.222484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:09.355592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:09.381540 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a4f23de-af05-4264-847d-c0e55bba1595 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1683 microversion: 2.1 time: 0.680349 Jul 24 01:13:09.382243 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 629/1130] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:08 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1683 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:09.403110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-235090d0-7c9d-4ebc-a98a-5f3d33fb1a60 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-235090d0-7c9d-4ebc-a98a-5f3d33fb1a60 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Request method failure captured: Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 49 Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JygT-n5WNGKBPPGyNiEkjv0wxp7hMyVTfo0_ZQknqSA0sROzQCevO5hhay23O9BeCBb9FVnbJtpIpRSKergCYbmkUV5SjDp75JzQ1NZSAr9mt5M5nZVYM5ngoH8CqE3x-ILKVlihlhIRtPlHmYOz8K80Djb6Fl_Kh0FmHEwvkEutoQ Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 7f01dd536afd4fdb8b4ad1e49789c778 Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:13:09.405816 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f01dd536afd4fdb8b4ad1e49789c778", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f01dd536afd4fdb8b4ad1e49789c778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 7f01dd536afd4fdb8b4ad1e49789c778 Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 747b30f6748741708d6e36b5f6ddf0c4 Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 24 01:13:09.407411 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: action_args: {'flavor_id': '1230608192', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance: Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 24 01:13:09.408511 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.410477 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-235090d0-7c9d-4ebc-a98a-5f3d33fb1a60 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-235090d0-7c9d-4ebc-a98a-5f3d33fb1a60 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.013698 Jul 24 01:13:09.412007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 630/1131] 10.222.0.27 () {60 vars in 1264 bytes} [Sun Jul 24 01:13:09 2022] PUT /compute/v2.1/flavors/1230608192/os-extra_specs/hw:numa_nodes => generated 117 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:13:09.427928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.428560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:09.458867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.459328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:09.460128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:09.460566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:09.482519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:09.503040 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b39158fa-a29a-4ad0-b243-9612cd6adba9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1266 microversion: 2.1 time: 0.310730 Jul 24 01:13:09.512808 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 502/1132] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:09 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:09.518989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f2384ff-1798-4175-8751-96df17eb3778 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.519837 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:09.519837 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:13:09.556859 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2f2384ff-1798-4175-8751-96df17eb3778 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1230608192" status: 202 len: 0 microversion: 2.1 time: 0.049757 Jul 24 01:13:09.557613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 503/1133] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:13:09 2022] DELETE /compute/v2.1/flavors/1230608192 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:13:09.569924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f9f7377-7ea2-40c8-9423-7684a88939ce tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.638043 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f9f7377-7ea2-40c8-9423-7684a88939ce tempest-FlavorsExtraSpecsNegativeTestJSON-653960919 tempest-FlavorsExtraSpecsNegativeTestJSON-653960919-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070580 Jul 24 01:13:09.639013 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 504/1134] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:13:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:09.800156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:09.814661 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-081a0e62-7f29-44ca-87a0-429eabd61a31 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.404871 Jul 24 01:13:09.816432 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 631/1135] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:09 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:09.993114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:09.997316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:10.005459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.006452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.008109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.009395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.152045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:10.200235 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e2bfc51a-f9f0-4075-8f87-0b408788194b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.211135 Jul 24 01:13:10.204755 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 505/1136] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:09 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:10.401888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:10.402822 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:10.420528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.424121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.427187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.429874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.534080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:10.543272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:10.578078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.579204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.581375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.582054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.819012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:10.841817 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1cba309d-171d-485e-be9b-874a0305bc2c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1272 microversion: 2.1 time: 0.316823 Jul 24 01:13:10.853547 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 506/1137] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:10 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:10.858918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:10.859558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:10.891393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.891936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.900941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:10.902800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:10.913395 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:11.161942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:11.171790 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca0be57d-3823-46c8-84b7-91d700a20b70 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1683 microversion: 2.1 time: 0.776483 Jul 24 01:13:11.174979 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 632/1138] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:10 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1683 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:11.223052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:11.223585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:11.243922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:11.244331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:11.245805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:11.247515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:11.467186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:11.515925 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5830c905-a36f-43a9-a755-4a28ecb5d450 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.297132 Jul 24 01:13:11.528993 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 633/1139] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:11 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:13:11.586642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:11.596893 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e129151-f04d-40eb-87c5-3b94e29bcba8 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.741708 Jul 24 01:13:11.601441 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 507/1140] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:10 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:11.869368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23e03f82-39bf-4ffc-8477-3e4d36aa0901 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.254160 Jul 24 01:13:11.869964 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 634/1141] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:13:11 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 24 01:13:11.870287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:11.875254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:11.879367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3db0ac28-5bbb-4d96-969e-b6d395a0d9e8 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Calling method '.version_select at 0x7f05eae55940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:11.891255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:11.892316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:11.893582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:11.893582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:11.945504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3db0ac28-5bbb-4d96-969e-b6d395a0d9e8 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] HTTP exception thrown: Image not found. Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3db0ac28-5bbb-4d96-969e-b6d395a0d9e8 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Request method failure captured: Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyns_iE6yQoJDG6AYFPHIwF7R59fGGSqgHpHsje6E0NLgemJ1-LaEswMS_-gdjtru8b90mSViYFguguCCowsAuUquKYMbfau0E4armOLMUhbUfDrdrmC8-P1Cu1HAK9YI2Q6Vk0b72N8HizTsBIM-iQKTdZP_h1HjfQYrMKUbI2M0E Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:11.947966 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_84eb5576dfd24e7885a7bc84d961df68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d6a6b46cc4b4432bad7b924002f94ea0 Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '-1'} Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:11.949413 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:11.950776 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:11.952143 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3db0ac28-5bbb-4d96-969e-b6d395a0d9e8 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3db0ac28-5bbb-4d96-969e-b6d395a0d9e8 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.074570 Jul 24 01:13:11.954353 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 635/1142] 10.222.0.27 () {58 vars in 1133 bytes} [Sun Jul 24 01:13:11 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:13:11.962764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d98f96c7-485b-4f62-b748-43121a64892f tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Calling method '.version_select at 0x7f05eaee24c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:11.998992 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-d98f96c7-485b-4f62-b748-43121a64892f tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] HTTP exception thrown: Image not found. Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d98f96c7-485b-4f62-b748-43121a64892f tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Request method failure captured: Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/images/a6ba37d9-9bd3-4d86-ae25-ef8fa415006j HTTP/1.1 Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyns_iE6yQoJDG6AYFPHIwF7R59fGGSqgHpHsje6E0NLgemJ1-LaEswMS_-gdjtru8b90mSViYFguguCCowsAuUquKYMbfau0E4armOLMUhbUfDrdrmC8-P1Cu1HAK9YI2Q6Vk0b72N8HizTsBIM-iQKTdZP_h1HjfQYrMKUbI2M0E Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:12.000803 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_84eb5576dfd24e7885a7bc84d961df68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d6a6b46cc4b4432bad7b924002f94ea0 Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a6ba37d9-9bd3-4d86-ae25-ef8fa415006j'} Jul 24 01:13:12.003131 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a6ba37d9-9bd3-4d86-ae25-ef8fa415006j to delete Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.003899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6ba37d9-9bd3-4d86-ae25-ef8fa415006j could not be found. Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:12.004983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d98f96c7-485b-4f62-b748-43121a64892f tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:12.007032 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d98f96c7-485b-4f62-b748-43121a64892f tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] 10.222.0.27 "DELETE /compute/v2.1/images/a6ba37d9-9bd3-4d86-ae25-ef8fa415006j" status: 404 len: 62 microversion: 2.1 time: 0.044103 Jul 24 01:13:12.009054 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 636/1143] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:11 2022] DELETE /compute/v2.1/images/a6ba37d9-9bd3-4d86-ae25-ef8fa415006j => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:13:12.013045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e1f2df4-92a5-4ae1-af84-078801f818ad tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Calling method '.version_select at 0x7f05eae559d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:12.042167 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6e1f2df4-92a5-4ae1-af84-078801f818ad tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] HTTP exception thrown: Image not found. Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e1f2df4-92a5-4ae1-af84-078801f818ad tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Request method failure captured: Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/images/3ecf0375-c938-45b0-b83d-89155081d51b1 HTTP/1.1 Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyns_iE6yQoJDG6AYFPHIwF7R59fGGSqgHpHsje6E0NLgemJ1-LaEswMS_-gdjtru8b90mSViYFguguCCowsAuUquKYMbfau0E4armOLMUhbUfDrdrmC8-P1Cu1HAK9YI2Q6Vk0b72N8HizTsBIM-iQKTdZP_h1HjfQYrMKUbI2M0E Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:12.044291 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_84eb5576dfd24e7885a7bc84d961df68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d6a6b46cc4b4432bad7b924002f94ea0 Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '3ecf0375-c938-45b0-b83d-89155081d51b1'} Jul 24 01:13:12.045596 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3ecf0375-c938-45b0-b83d-89155081d51b1 to delete Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.046619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3ecf0375-c938-45b0-b83d-89155081d51b1 could not be found. Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:12.047701 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:13:12.052635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.055811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e1f2df4-92a5-4ae1-af84-078801f818ad tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:12.056957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e1f2df4-92a5-4ae1-af84-078801f818ad tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] 10.222.0.27 "DELETE /compute/v2.1/images/3ecf0375-c938-45b0-b83d-89155081d51b1" status: 404 len: 62 microversion: 2.1 time: 0.047797 Jul 24 01:13:12.058185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 637/1144] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:13:12 2022] DELETE /compute/v2.1/images/3ecf0375-c938-45b0-b83d-89155081d51b1 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:13:12.068954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6ce4991-fe7d-4538-9416-1e347b2bc658 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Calling method '.version_select at 0x7f05eb72bca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:12.108716 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-d6ce4991-fe7d-4538-9416-1e347b2bc658 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] HTTP exception thrown: Image not found. Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6ce4991-fe7d-4538-9416-1e347b2bc658 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Request method failure captured: Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/images/tempest-invalid-1763727046 HTTP/1.1 Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyns_iE6yQoJDG6AYFPHIwF7R59fGGSqgHpHsje6E0NLgemJ1-LaEswMS_-gdjtru8b90mSViYFguguCCowsAuUquKYMbfau0E4armOLMUhbUfDrdrmC8-P1Cu1HAK9YI2Q6Vk0b72N8HizTsBIM-iQKTdZP_h1HjfQYrMKUbI2M0E Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:12.111772 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_84eb5576dfd24e7885a7bc84d961df68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d6a6b46cc4b4432bad7b924002f94ea0 Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'tempest-invalid-1763727046'} Jul 24 01:13:12.113378 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1763727046 to delete Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.114221 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1763727046 could not be found. Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:12.115635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:13:12.116783 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.122047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6ce4991-fe7d-4538-9416-1e347b2bc658 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:12.123230 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d6ce4991-fe7d-4538-9416-1e347b2bc658 tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-1763727046" status: 404 len: 62 microversion: 2.1 time: 0.059750 Jul 24 01:13:12.124724 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 638/1145] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:13:12 2022] DELETE /compute/v2.1/images/tempest-invalid-1763727046 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:13:12.148054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c98df069-aa8b-4b69-81ba-97dc986e2e1e tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Calling method '.version_select at 0x7f05eae55f70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:12.178012 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c98df069-aa8b-4b69-81ba-97dc986e2e1e tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] HTTP exception thrown: Image not found. Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c98df069-aa8b-4b69-81ba-97dc986e2e1e tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Request method failure captured: Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/images/db668783-eb03-4fcc-b98c-45cbfdb187c1 HTTP/1.1 Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyns_iE6yQoJDG6AYFPHIwF7R59fGGSqgHpHsje6E0NLgemJ1-LaEswMS_-gdjtru8b90mSViYFguguCCowsAuUquKYMbfau0E4armOLMUhbUfDrdrmC8-P1Cu1HAK9YI2Q6Vk0b72N8HizTsBIM-iQKTdZP_h1HjfQYrMKUbI2M0E Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:12.184236 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_84eb5576dfd24e7885a7bc84d961df68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/84eb5576dfd24e7885a7bc84d961df68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 84eb5576dfd24e7885a7bc84d961df68 Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-653452628 Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d6a6b46cc4b4432bad7b924002f94ea0 Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-653452628-project Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'db668783-eb03-4fcc-b98c-45cbfdb187c1'} Jul 24 01:13:12.187335 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image db668783-eb03-4fcc-b98c-45cbfdb187c1 to delete Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.188213 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db668783-eb03-4fcc-b98c-45cbfdb187c1 could not be found. Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:12.189336 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:13:12.190504 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:12.194899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c98df069-aa8b-4b69-81ba-97dc986e2e1e tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:12.197537 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c98df069-aa8b-4b69-81ba-97dc986e2e1e tempest-ImagesDeleteNegativeTestJSON-653452628 tempest-ImagesDeleteNegativeTestJSON-653452628-project] 10.222.0.27 "DELETE /compute/v2.1/images/db668783-eb03-4fcc-b98c-45cbfdb187c1" status: 404 len: 62 microversion: 2.1 time: 0.056438 Jul 24 01:13:12.198656 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 639/1146] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:12 2022] DELETE /compute/v2.1/images/db668783-eb03-4fcc-b98c-45cbfdb187c1 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:13:12.210910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:12.211842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:12.220755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.221602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.222654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.223313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.433301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:12.445804 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e402bc3b-09bb-420b-bad6-df7bc9acfa59 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1272 microversion: 2.1 time: 0.587324 Jul 24 01:13:12.447566 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 508/1147] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:11 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1272 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:12.540501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:12.541891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:12.546371 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:13:12.547209 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 01:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba (ip 10.222.0.27) !!! Jul 24 01:13:12.561175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.566338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.568794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.574759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.622195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:12.632487 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6a9659f-0e0f-4e87-9c93-13299a26b127 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1683 microversion: 2.1 time: 0.431361 Jul 24 01:13:12.635179 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 640/1148] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:12 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1683 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:12.657960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:12.668267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:12.684803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.687344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.689349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:12.690404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:12.865824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:12.921457 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7387d267-3438-4e87-9c55-0340bf91c591 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.387247 Jul 24 01:13:12.942202 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 509/1149] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:12 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:13.372167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:13.393538 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-11aa8b96-d1a7-4172-9dff-7cd7abdb3d1e tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.756593 Jul 24 01:13:13.398429 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 641/1150] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:12 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:13.464312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:13.464996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:13.478318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:13.478781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:13.484612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:13.485291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:13.663409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:13.670558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:13.722630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:13.724043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:13.726284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:13.732749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.201819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:14.210747 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b04ff8f9-32d8-4627-9d29-f6c641ec7e94 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1615 microversion: 2.1 time: 0.558603 Jul 24 01:13:14.211339 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 642/1151] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:13 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1615 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:14.234250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:14.236958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:14.255173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.258658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.259751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.260353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.341189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:14.351364 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fddd9428-1362-4f9a-84a2-d94d73029958 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 0.890944 Jul 24 01:13:14.367546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 510/1152] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:13 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:14.426486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:14.428135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:14.436976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.439176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.442296 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.443865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.640241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:14.699289 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-393bcaac-5e42-445f-b1d0-e1073ab4174b tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.481267 Jul 24 01:13:14.709754 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 643/1153] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:14 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:14.768135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-68309bb9-e1fd-4fd4-8a35-fe9a31049318 req-b9a55d93-67e7-4991-b647-8b033d470605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91e88b1-cc02-4d11-8b50-36eaa04b5dba", "name": "network-vif-deleted", "tag": "d72066e3-ef54-493b-9c00-76e56950686e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:14.789425 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-68309bb9-e1fd-4fd4-8a35-fe9a31049318 req-b9a55d93-67e7-4991-b647-8b033d470605 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:14.790719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-68309bb9-e1fd-4fd4-8a35-fe9a31049318 req-b9a55d93-67e7-4991-b647-8b033d470605 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:14.804656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:14.811069 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-68309bb9-e1fd-4fd4-8a35-fe9a31049318 req-b9a55d93-67e7-4991-b647-8b033d470605 service nova] Creating event network-vif-deleted:d72066e3-ef54-493b-9c00-76e56950686e for instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba on n-h1-master-1 Jul 24 01:13:14.818042 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-68309bb9-e1fd-4fd4-8a35-fe9a31049318 req-b9a55d93-67e7-4991-b647-8b033d470605 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056035 Jul 24 01:13:14.823491 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 644/1154] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:14.823930 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e726c32-afa7-44fe-938d-8416c66fe4a1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.403441 Jul 24 01:13:14.824541 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 511/1155] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:14 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:15.230780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:15.231472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:15.250544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.254509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.256037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.260229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.369970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.377287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:15.379170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:15.385165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.387763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lazy-loading 'fault' on Instance uuid f91e88b1-cc02-4d11-8b50-36eaa04b5dba {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:15.393802 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.394648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.397694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.399634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.498629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b0f82f73ea4c14a51c5481e78d4493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9db762e4c14d538ea1c9de1b204c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:15.512673 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1cdbfe45-0fa1-43de-9778-8b2f65ca24c1 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 200 len: 1332 microversion: 2.1 time: 0.285044 Jul 24 01:13:15.514962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 645/1156] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:15 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 1332 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:15.668554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:15.678854 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac62a291-b46a-438c-9fdc-d5aeed5ba520 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 0.307261 Jul 24 01:13:15.679446 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 512/1157] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:15 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:15.724458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:15.725800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:15.747122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.748206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:15.756814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:15.763483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.170404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14c33264-d74a-4fc2-a5f6-e8aaf9dd21b7 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1409934553", "id": 1739685957, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:16.173196 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:16.173196 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:13:16.217286 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14c33264-d74a-4fc2-a5f6-e8aaf9dd21b7 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.700929 Jul 24 01:13:16.218252 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 646/1158] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:13:15 2022] POST /compute/v2.1/flavors => generated 468 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:13:16.231563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:16.232402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:16.252735 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.253202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.257898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.258568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.341534 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:16.405911 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5cd2b3b8-0795-4bf3-8b40-e4ed8ff8775d tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1927 microversion: 2.75 time: 0.685951 Jul 24 01:13:16.412868 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 513/1159] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:15 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1927 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:13:16.616981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:16.633065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ca40e87-35de-4b68-aaec-11406e15014a tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.410360 Jul 24 01:13:16.633903 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 647/1160] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:16 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:16.655876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d2cda62d-55e5-4cd8-916b-27995c7c2ff7 req-de8dd550-6ecc-4601-975f-8d8ec7d48857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9", "tag": "c7a256d7-1bd3-4c3b-be55-15cba137157f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:16.678882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d2cda62d-55e5-4cd8-916b-27995c7c2ff7 req-de8dd550-6ecc-4601-975f-8d8ec7d48857 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.680910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d2cda62d-55e5-4cd8-916b-27995c7c2ff7 req-de8dd550-6ecc-4601-975f-8d8ec7d48857 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.699942 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d2cda62d-55e5-4cd8-916b-27995c7c2ff7 req-de8dd550-6ecc-4601-975f-8d8ec7d48857 service nova] Creating event network-changed:c7a256d7-1bd3-4c3b-be55-15cba137157f for instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 on n-h2-master-1 Jul 24 01:13:16.707433 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d2cda62d-55e5-4cd8-916b-27995c7c2ff7 req-de8dd550-6ecc-4601-975f-8d8ec7d48857 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061671 Jul 24 01:13:16.708997 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 648/1161] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:16.717810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:16.719132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:16.729072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.729958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.731071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.732011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.763295 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] HTTP exception thrown: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Request method failure captured: Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba HTTP/1.1 Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JwH5qdfLjAgQyAzKlAMlCdLsTl5XLRd3qPed6xBUJUy2OLaZvEmh4tSBXAoJqC4JdrUK-vySoX77qlmCq6Hh0hzfPlAPN8pvd_NEt6t9tCIoJq4_QMdWcPXVOW_N0eXh87n6rcIHuWgSoORYyYKQD7F_SnhdgbiuJlEo_A8RpyZ-Ds Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 6c9db762e4c14d538ea1c9de1b204c95 Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:16.768658 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c9db762e4c14d538ea1c9de1b204c95", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 6c9db762e4c14d538ea1c9de1b204c95 Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachSCSIVolumeTestJSON-824135624-project Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 01b0f82f73ea4c14a51c5481e78d4493 Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-824135624-project Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:16.770626 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f91e88b1-cc02-4d11-8b50-36eaa04b5dba'} Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:16.773398 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:16.774882 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:16.776348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Returning 404 to user: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:16.776348 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a776cc94-b8fd-4d7d-9d1f-fda441ea9c04 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 404 len: 111 microversion: 2.1 time: 0.061757 Jul 24 01:13:16.776348 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 649/1162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:16 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:16.800149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:16.800787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:16.828528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.830325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.832022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:16.832519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:16.999277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bd20e66f-594c-4e10-ac3a-48322c96b491 tempest-FlavorsV261TestJSON-616148491 tempest-FlavorsV261TestJSON-616148491-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.020166 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bd20e66f-594c-4e10-ac3a-48322c96b491 tempest-FlavorsV261TestJSON-616148491 tempest-FlavorsV261TestJSON-616148491-project] 10.222.0.27 "GET /compute/v2.1/flavors/1739685957" status: 200 len: 468 microversion: 2.61 time: 0.602638 Jul 24 01:13:17.020794 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 514/1163] 10.222.0.27 () {60 vars in 1198 bytes} [Sun Jul 24 01:13:16 2022] GET /compute/v2.1/flavors/1739685957 => generated 468 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:13:17.043589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a6c86ba-7b9c-4f9f-811a-e3bd3336ff68 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '.version_select at 0x7f05eb3e3ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.053127 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:17.065967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:17.082780 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1ddb434a-4e68-4a32-b770-1d79784809f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 0.304878 Jul 24 01:13:17.084154 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 650/1164] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:16 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:17.111422 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-61f25d9a-d514-478c-bbb2-832edaa81c61 req-61e1ee85-ebcb-4789-b7c2-100ea615e399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abc5a1-3a53-4246-ba5b-54c1449fb1c8", "name": "network-vif-plugged", "status": "completed", "tag": "190a02df-6d16-4646-adb5-db06e07a74fe"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:17.116459 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a6c86ba-7b9c-4f9f-811a-e3bd3336ff68 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598550670" status: 202 len: 0 microversion: 2.1 time: 0.091754 Jul 24 01:13:17.118539 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 515/1165] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598550670 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:13:17.127528 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=20 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:17.143121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11e5dac8-0c9a-4481-95df-daba75705c54 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:17.148595 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:17.148595 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:13:17.159741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-61f25d9a-d514-478c-bbb2-832edaa81c61 req-61e1ee85-ebcb-4789-b7c2-100ea615e399 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.160486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-61f25d9a-d514-478c-bbb2-832edaa81c61 req-61e1ee85-ebcb-4789-b7c2-100ea615e399 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.209120 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-61f25d9a-d514-478c-bbb2-832edaa81c61 req-61e1ee85-ebcb-4789-b7c2-100ea615e399 service nova] Creating event network-vif-plugged:190a02df-6d16-4646-adb5-db06e07a74fe for instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 on n-h2-master-1 Jul 24 01:13:17.233902 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11e5dac8-0c9a-4481-95df-daba75705c54 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1739685957" status: 200 len: 469 microversion: 2.61 time: 0.111596 Jul 24 01:13:17.233902 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 516/1166] 10.222.0.27 () {62 vars in 1218 bytes} [Sun Jul 24 01:13:17 2022] PUT /compute/v2.1/flavors/1739685957 => generated 469 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:13:17.238571 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-61f25d9a-d514-478c-bbb2-832edaa81c61 req-61e1ee85-ebcb-4789-b7c2-100ea615e399 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128855 Jul 24 01:13:17.239672 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 651/1167] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:17.244582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-855116f6-563c-4857-b7d1-61382f4568a2 tempest-FlavorsV261TestJSON-616148491 tempest-FlavorsV261TestJSON-616148491-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.284790 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-855116f6-563c-4857-b7d1-61382f4568a2 tempest-FlavorsV261TestJSON-616148491 tempest-FlavorsV261TestJSON-616148491-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.044059 Jul 24 01:13:17.305855 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 517/1168] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:13:17 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:13:17.313799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e31b716b-6a09-4647-865f-e1508d419d33 tempest-FlavorsV261TestJSON-616148491 tempest-FlavorsV261TestJSON-616148491-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.341918 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e31b716b-6a09-4647-865f-e1508d419d33 tempest-FlavorsV261TestJSON-616148491 tempest-FlavorsV261TestJSON-616148491-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.032324 Jul 24 01:13:17.343631 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 652/1169] 10.222.0.27 () {60 vars in 1165 bytes} [Sun Jul 24 01:13:17 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:17.362169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2dd4c0ba-835e-45e5-8282-d9726076f7c0 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.362943 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:13:17.362943 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:13:17.383481 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2dd4c0ba-835e-45e5-8282-d9726076f7c0 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1739685957" status: 202 len: 0 microversion: 2.61 time: 0.029567 Jul 24 01:13:17.385426 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 518/1170] 10.222.0.27 () {60 vars in 1201 bytes} [Sun Jul 24 01:13:17 2022] DELETE /compute/v2.1/flavors/1739685957 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:13:17.393289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8578570-1506-4d8a-a181-80d03870d193 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.417466 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8578570-1506-4d8a-a181-80d03870d193 tempest-FlavorsV261TestJSON-689091212 tempest-FlavorsV261TestJSON-689091212-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.027923 Jul 24 01:13:17.418775 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 653/1171] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:13:17 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:13:17.428009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.429432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:17.457613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.459055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.460735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.462444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.651534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:17.652883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:17.682190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:17.683648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.686641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.691710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:17.694067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:17.752290 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7fbe1b2f-9386-4e6b-89c0-6ea3200cf142 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1933 microversion: 2.75 time: 0.329255 Jul 24 01:13:17.753218 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 519/1172] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:17 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1933 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:18.091837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:18.102887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:18.103493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:18.105225 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8faeb4e-3bb0-48cf-91a3-2734c2e56a1f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.458270 Jul 24 01:13:18.117015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.118023 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 654/1173] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:17 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:18.118898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:18.121048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.123194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:18.413983 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:18.424923 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee3e9a7d-0d7e-4e1e-ae4b-055085a4935a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 0.326030 Jul 24 01:13:18.428547 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 520/1174] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:18 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:18.773289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:18.774653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:18.776837 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=32 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:18.777835 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:18.792285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.792736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:18.793518 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:18.794975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:19.123772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:19.124478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:19.138935 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:19.139393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:19.145018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:19.146255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:19.383420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:19.429958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-15b3e460-095e-491f-9df3-70f43cc23843 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1933 microversion: 2.75 time: 0.660286 Jul 24 01:13:19.432471 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 655/1175] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:18 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1933 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:19.450565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:19.451041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:19.452283 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:19.459346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:19.459807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:19.461096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:19.461348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:19.466843 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ea3a5273-a728-45e7-8b6a-4f72b5164b27 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.347605 Jul 24 01:13:19.477165 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 521/1176] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:19 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:19.755352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:19.761151 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:19.771764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3818db45-c16d-421d-8cbe-5a60c12fd37a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 0.331387 Jul 24 01:13:19.772928 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 656/1177] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:19 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:20.457187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:20.459016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:20.474497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.475573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.476618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.477412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.484372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:20.485216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:20.497955 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.498529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.499614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.501893 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.599794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] Lazy-loading 'services' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:20.674361 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-37c846db-2dd1-4592-a17d-d04613b0d5a4 tempest-ServersAdmin275Test-1268115842 tempest-ServersAdmin275Test-1268115842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1918 microversion: 2.75 time: 0.223248 Jul 24 01:13:20.674949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 522/1178] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:20 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1918 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:20.705542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:20.706189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:20.709847 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:20.715950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.716765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.717955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.718600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.758107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:13:20.820778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:20.838401 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-972dd4f2-49b4-4dc8-a3e4-8ac73b1c0c53 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1332 microversion: 2.1 time: 0.352195 Jul 24 01:13:20.839694 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 657/1179] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:20 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1332 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:20.852037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:20.860470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:20.868016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.868744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:20.870558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:20.873217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.009281 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3c87260-f1bb-4cdd-8edd-64a9f9454846 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 204 len: 0 microversion: 2.75 time: 0.307363 Jul 24 01:13:21.015110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 523/1180] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:13:20 2022] DELETE /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:13:21.045381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:21.046151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:21.067661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.072946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.075704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.076899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.283984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:21.297655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:21.300259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:21.312413 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed3e4094-2815-4360-b340-f1260a5f891f tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1443 microversion: 2.75 time: 0.282019 Jul 24 01:13:21.317223 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 524/1181] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:21 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1443 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:21.856544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:21.857556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:21.889060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.889758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:21.891178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:21.898895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:22.401799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:22.404878 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:22.432968 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3cbe6b66-f080-44e6-8fc1-aebd8c71a67f tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1536 microversion: 2.1 time: 0.571961 Jul 24 01:13:22.434112 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 525/1182] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:21 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1536 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:13:22.438096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:22.448834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:22.450317 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 1.609235 Jul 24 01:13:22.450923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:22.451752 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 658/1183] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:20 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:22.455388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:22.458020 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-41997bd2-5654-4cd8-ac2b-d88a3b1dcd54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002824 Jul 24 01:13:22.459229 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 659/1184] 10.222.0.27 () {56 vars in 885 bytes} [Sun Jul 24 01:13:22 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 24 01:13:22.467494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eebdec22-f324-414b-a85b-7a3f3b36a377 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'create', calling method: .version_select at 0x7f05eaee2430>, body: {"pool": "61d246aa-98fb-42b3-a4f9-8547b5bbd4e2"} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:22.482581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:22.483185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:22.484084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:22.484630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:22.812994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:22.835603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:22.841068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:22.863731 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18a3c6a5-a358-48e1-97cb-db0422568fd1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1443 microversion: 2.75 time: 0.428057 Jul 24 01:13:22.866440 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 526/1185] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:22 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1443 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:23.470323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:23.471611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:23.492820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:23.501929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:23.502923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:23.503372 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.459410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:24.480116 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2197e46b-8f49-41fe-b1b3-62c7ac70490d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 1.015337 Jul 24 01:13:24.496368 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 527/1186] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:23 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:24.502857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:24.511909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:24.537117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.539728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.545139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.546625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.638090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.638858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.639546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lazy-loading 'fault' on Instance uuid ae0b2748-6b72-4185-b301-9e86d7ac02b8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:24.741363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:24.749470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:24.755618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c39d06504644aa29428fc9b130e73ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:24.772862 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cebdd101-2e8c-4e72-a24a-37d042592ef1 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 200 len: 1448 microversion: 2.75 time: 0.275144 Jul 24 01:13:24.777809 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 528/1187] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:24 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 1448 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:24.787611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5a46b0da-8b99-4dbd-8c57-dc4a0d37101a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:24.798915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a46b0da-8b99-4dbd-8c57-dc4a0d37101a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:24.816391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a46b0da-8b99-4dbd-8c57-dc4a0d37101a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.816831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a46b0da-8b99-4dbd-8c57-dc4a0d37101a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:24.826781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a46b0da-8b99-4dbd-8c57-dc4a0d37101a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:24.827411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a46b0da-8b99-4dbd-8c57-dc4a0d37101a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:25.316436 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5a46b0da-8b99-4dbd-8c57-dc4a0d37101a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1859 microversion: 2.1 time: 0.537470 Jul 24 01:13:25.317040 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 529/1188] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:24 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1859 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:25.334717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:25.336124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:25.352545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:25.353213 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:25.354203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:25.354797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:25.441153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lazy-loading 'flavor' on Instance uuid 38c4c870-8606-4888-81ee-c2a835a28957 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:13:25.464487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Going to try to live migrate instance to n-h1-master-1 {{(pid=119562) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:13:27.831229 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eebdec22-f324-414b-a85b-7a3f3b36a377 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.368201 Jul 24 01:13:27.834278 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 660/1189] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:13:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:27.845800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:27.847134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:27.880973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:27.882397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:27.884940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:27.889477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.300355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:28.319081 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24d741ce-ee52-4014-be79-a84f9c8f45d4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 0.481841 Jul 24 01:13:28.323533 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 661/1190] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:27 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:28.331076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:28.332323 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] [instance: ae0b2748-6b72-4185-b301-9e86d7ac02b8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:28.398453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.400065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.053s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.401213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.404084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.467495 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] HTTP exception thrown: Instance ae0b2748-6b72-4185-b301-9e86d7ac02b8 could not be found. Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Request method failure captured: Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 HTTP/1.1 Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JxhqJ8nGinkox5mmkPWkqmOBST6tCKbtbNhse_ZK5z98VOFgfDnNOK41MdwmYDzAv3NvHo8znewFeOOBGkxHwJol6ziVkarcD72qPwAsknOfOzrnN7EJ3ZN0FdUKNQxpoWZhe2MsJ_5IsUtv2q30ORCHkvfaWCFAk53Bk8B8E4kXWg Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.75 Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 6dc5a0a6cd7f48bc8c41a790c3f82cc6 Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdmin275Test-885749153 Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:28.473333 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6dc5a0a6cd7f48bc8c41a790c3f82cc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6dc5a0a6cd7f48bc8c41a790c3f82cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6dc5a0a6cd7f48bc8c41a790c3f82cc6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6dc5a0a6cd7f48bc8c41a790c3f82cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdmin275Test-885749153 Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 6dc5a0a6cd7f48bc8c41a790c3f82cc6 Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdmin275Test-885749153 Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdmin275Test-885749153-project Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3c39d06504644aa29428fc9b130e73ea Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdmin275Test-885749153-project Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ae0b2748-6b72-4185-b301-9e86d7ac02b8 could not be found. Jul 24 01:13:28.475171 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ae0b2748-6b72-4185-b301-9e86d7ac02b8'} Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae0b2748-6b72-4185-b301-9e86d7ac02b8 could not be found. Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:28.476232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae0b2748-6b72-4185-b301-9e86d7ac02b8 could not be found. Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae0b2748-6b72-4185-b301-9e86d7ac02b8 could not be found. Jul 24 01:13:28.477599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.478847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] Returning 404 to user: Instance ae0b2748-6b72-4185-b301-9e86d7ac02b8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:28.478847 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f629452a-2f4f-4f8f-8ec2-1c35ca1b1b82 tempest-ServersAdmin275Test-885749153 tempest-ServersAdmin275Test-885749153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8" status: 404 len: 111 microversion: 2.75 time: 0.151869 Jul 24 01:13:28.478847 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 662/1191] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:28 2022] GET /compute/v2.1/servers/ae0b2748-6b72-4185-b301-9e86d7ac02b8 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:13:28.488373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:28.499638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:28.517635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.518152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.518982 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.519435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.567183 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] HTTP exception thrown: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Request method failure captured: Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba HTTP/1.1 Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JwH5qdfLjAgQyAzKlAMlCdLsTl5XLRd3qPed6xBUJUy2OLaZvEmh4tSBXAoJqC4JdrUK-vySoX77qlmCq6Hh0hzfPlAPN8pvd_NEt6t9tCIoJq4_QMdWcPXVOW_N0eXh87n6rcIHuWgSoORYyYKQD7F_SnhdgbiuJlEo_A8RpyZ-Ds Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 6c9db762e4c14d538ea1c9de1b204c95 Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:28.568780 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c9db762e4c14d538ea1c9de1b204c95", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 6c9db762e4c14d538ea1c9de1b204c95 Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachSCSIVolumeTestJSON-824135624-project Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 01b0f82f73ea4c14a51c5481e78d4493 Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-824135624-project Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:28.570255 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f91e88b1-cc02-4d11-8b50-36eaa04b5dba'} Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:28.570992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:28.572159 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:28.574089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Returning 404 to user: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:28.575388 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e5664924-1035-47b0-827d-4500ca2bbf4d tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 404 len: 111 microversion: 2.1 time: 0.095068 Jul 24 01:13:28.577976 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 663/1192] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:13:28 2022] DELETE /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:28.590871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a7806c03-1b90-4f9f-8851-d420518c2e66 req-8ec94c8a-eea4-4c28-9f61-82d89d31f506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9", "name": "network-vif-plugged", "status": "completed", "tag": "c7a256d7-1bd3-4c3b-be55-15cba137157f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:28.612923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a7806c03-1b90-4f9f-8851-d420518c2e66 req-8ec94c8a-eea4-4c28-9f61-82d89d31f506 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.614350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a7806c03-1b90-4f9f-8851-d420518c2e66 req-8ec94c8a-eea4-4c28-9f61-82d89d31f506 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.640158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a7806c03-1b90-4f9f-8851-d420518c2e66 req-8ec94c8a-eea4-4c28-9f61-82d89d31f506 service nova] Creating event network-vif-plugged:c7a256d7-1bd3-4c3b-be55-15cba137157f for instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 on n-h2-master-1 Jul 24 01:13:28.651088 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a7806c03-1b90-4f9f-8851-d420518c2e66 req-8ec94c8a-eea4-4c28-9f61-82d89d31f506 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071481 Jul 24 01:13:28.653569 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 664/1193] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:28.664841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.163"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:28.674187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:28.690607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.692230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.694387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:28.696457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:28.773769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Acquired lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:13:28.964812 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f91e07ad-c197-4173-af4b-c2236122bfaa tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/action" status: 202 len: 0 microversion: 2.1 time: 3.634526 Jul 24 01:13:28.965640 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 530/1194] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:13:25 2022] POST /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/action => generated 0 bytes in 3637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:13:28.976412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf631e28-66d4-4fd3-a082-142ff78b3a87 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Action: 'create', calling method: .version_select at 0x7f05eb1eb9d0>, body: {"keypair": {"name": "tempest-keypair-925913692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjf7UtghsSGHtwh+uDnr1vmPbuqPiOL9A/VHbxnFWNRKhAYhzd+nXE3eDTAVlcPmkkSuGZKKJFYtwZGrPzL5gqIBfADRBY7nt33YDz0wB/hKFeyJ9l9R/LdF42xOSo2cQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:29.093072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-bf631e28-66d4-4fd3-a082-142ff78b3a87 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Getting quotas for project 651fa7eea7a04e8d83d2264c1638f8f2. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:29.139609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-bf631e28-66d4-4fd3-a082-142ff78b3a87 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Getting quotas for user f71f3d66b27b471d9772a0a01d3c89ed and project 651fa7eea7a04e8d83d2264c1638f8f2. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:29.225555 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf631e28-66d4-4fd3-a082-142ff78b3a87 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.258300 Jul 24 01:13:29.226675 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 531/1195] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:13:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 260 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:13:29.237239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:29.238936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] [instance: f91e88b1-cc02-4d11-8b50-36eaa04b5dba] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:29.252033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.256894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:29.263288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.264544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:29.283228 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] HTTP exception thrown: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Request method failure captured: Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba HTTP/1.1 Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JwH5qdfLjAgQyAzKlAMlCdLsTl5XLRd3qPed6xBUJUy2OLaZvEmh4tSBXAoJqC4JdrUK-vySoX77qlmCq6Hh0hzfPlAPN8pvd_NEt6t9tCIoJq4_QMdWcPXVOW_N0eXh87n6rcIHuWgSoORYyYKQD7F_SnhdgbiuJlEo_A8RpyZ-Ds Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 6c9db762e4c14d538ea1c9de1b204c95 Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:13:29.285501 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c9db762e4c14d538ea1c9de1b204c95", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c9db762e4c14d538ea1c9de1b204c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 6c9db762e4c14d538ea1c9de1b204c95 Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-824135624 Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachSCSIVolumeTestJSON-824135624-project Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 01b0f82f73ea4c14a51c5481e78d4493 Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-824135624-project Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:29.287077 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f91e88b1-cc02-4d11-8b50-36eaa04b5dba'} Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:29.287892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. Jul 24 01:13:29.289341 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:29.291982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] Returning 404 to user: Instance f91e88b1-cc02-4d11-8b50-36eaa04b5dba could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:29.293153 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e795be7-7925-4760-a19a-f9bf19f83485 tempest-AttachSCSIVolumeTestJSON-824135624 tempest-AttachSCSIVolumeTestJSON-824135624-project] 10.222.0.27 "GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba" status: 404 len: 111 microversion: 2.1 time: 0.062224 Jul 24 01:13:29.298159 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 532/1196] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:29 2022] GET /compute/v2.1/servers/f91e88b1-cc02-4d11-8b50-36eaa04b5dba => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:29.304117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:29.305962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:29.321856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.322603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:29.323661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:29.325000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:30.690290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:30.701194 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72e5b2cf-d511-42eb-8605-4fedbc4d1405 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 1.401845 Jul 24 01:13:30.703245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 533/1197] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:29 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:30.720831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:30.721927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:30.731026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:30.731815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:30.732910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:30.733853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:31.963280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:31.984331 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03bcfa8d-5223-4b24-abe5-1dfbdee72537 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1314 microversion: 2.1 time: 1.268473 Jul 24 01:13:31.989428 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 534/1198] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:30 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1314 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:32.504487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88bcf62b-3e18-4b58-8af2-10a52c2eb751 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eb156f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-287211393", "description": "tempest-description-1898965057"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:33.643231 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88bcf62b-3e18-4b58-8af2-10a52c2eb751 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.652343 Jul 24 01:13:33.651739 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 535/1199] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:13:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:33.660656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:33.663760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:33.690413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:33.690788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:33.691608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:33.696110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:34.630231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:34.652343 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f76e8f2f-ff1e-45b6-9cbf-2309007d9aa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.999016 Jul 24 01:13:34.657637 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 536/1200] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:33 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:34.676072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:34.679596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:34.699620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:34.701186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:34.703278 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:34.705426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:35.061171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Building network info cache for instance {{(pid=119561) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:13:35.496108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:35.512481 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c76a964c-f7ae-4319-a955-ec2106455054 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1501 microversion: 2.1 time: 0.853019 Jul 24 01:13:35.513090 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 537/1201] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:34 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1501 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:35.527421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ea383ecd-5a09-48d5-b44e-74856bf2aa9d tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eb156e50>, body: {"security_group_rule": {"parent_group_id": "cac5cee7-8e71-47fe-9eba-92c89d6f9f67", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:37.067324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Updating instance_info_cache with network_info: [{"id": "190a02df-6d16-4646-adb5-db06e07a74fe", "address": "fa:16:3e:c7:a5:7b", "network": {"id": "0a1da61f-fe83-432c-9aa7-db32a73a802a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2143654668-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec53a779c92c4620a832da29e583581b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap190a02df-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119561) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:13:37.093585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Releasing lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:13:37.096919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e1818b2-d50e-4075-8da7-c083954efa2b tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action" status: 202 len: 0 microversion: 2.1 time: 8.441545 Jul 24 01:13:37.098841 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 665/1202] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:13:28 2022] POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action => generated 0 bytes in 8445 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:13:37.117743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ea383ecd-5a09-48d5-b44e-74856bf2aa9d tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.602680 Jul 24 01:13:37.118962 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 538/1203] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:13:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:37.125417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:37.126529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:37.155021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.161605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.183071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.187456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.252332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:13:37.473140 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3701dec3-ae5f-4a03-aa30-d5292a286ba1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 204 len: 0 microversion: 2.1 time: 0.348065 Jul 24 01:13:37.474504 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 539/1204] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:13:37 2022] DELETE /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:13:37.498573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:37.499576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:37.515364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.516977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.518752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.520665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.710252 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c111cfc9-e707-469d-a6fe-865b267a7d8a req-46dd94be-aac5-4d9f-8655-83a0c22f88ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4abc5a1-3a53-4246-ba5b-54c1449fb1c8", "tag": "190a02df-6d16-4646-adb5-db06e07a74fe"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:37.726382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c111cfc9-e707-469d-a6fe-865b267a7d8a req-46dd94be-aac5-4d9f-8655-83a0c22f88ed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:37.726830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c111cfc9-e707-469d-a6fe-865b267a7d8a req-46dd94be-aac5-4d9f-8655-83a0c22f88ed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:37.748584 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c111cfc9-e707-469d-a6fe-865b267a7d8a req-46dd94be-aac5-4d9f-8655-83a0c22f88ed service nova] Creating event network-changed:190a02df-6d16-4646-adb5-db06e07a74fe for instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 on n-h2-master-1 Jul 24 01:13:37.755536 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c111cfc9-e707-469d-a6fe-865b267a7d8a req-46dd94be-aac5-4d9f-8655-83a0c22f88ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.648684 Jul 24 01:13:37.756394 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 666/1205] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:37.764201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2fb71e1f-138d-44b0-94da-1490d258a0d7 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'create', calling method: .version_select at 0x7f05eae4c940>, body: {"pool": "61d246aa-98fb-42b3-a4f9-8547b5bbd4e2"} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:38.641377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:38.651183 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4cecc32f-c33a-4c9b-8233-bc3c1a14c14e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 1.173514 Jul 24 01:13:38.662411 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 540/1206] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:37 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:38.668070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e122fb5-6f57-4d71-a18d-3c7b2d69c563 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eb1a6940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-619665174", "description": "tempest-description-1076998099"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:39.184588 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:39.404281 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e122fb5-6f57-4d71-a18d-3c7b2d69c563 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.739908 Jul 24 01:13:39.405261 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 541/1207] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:13:38 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:39.411460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:39.412408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:39.447921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:39.448779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:39.449850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:39.450522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:39.948995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:39.967202 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7bd38e57-6f7e-473a-a4f1-a59b26d3002c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 200 len: 1507 microversion: 2.1 time: 0.559945 Jul 24 01:13:39.968064 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 542/1208] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:39 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 1507 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:39.978466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1178582951", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b503e9fa-a7c0-4ae6-89b5-24742cb19945"}, {"port": "198efcd9-809d-4f5a-8feb-85171ce21b72", "tag": "port-1"}, {"port": "81ce7c7d-8b64-42e8-a880-98a660147477", "tag": "port-2"}, {"uuid": "a6f04043-05e2-46f6-b41f-5bd16da77ee9", "tag": "net-1"}, {"uuid": "a6f04043-05e2-46f6-b41f-5bd16da77ee9"}, {"uuid": "3760d803-f163-404a-b2c7-fc6b0d128472", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3760d803-f163-404a-b2c7-fc6b0d128472", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d2d2a8ca-180e-408c-9bfb-5881625dfc12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "466d1037-3e07-4e76-bc96-b9d11c9c3b5c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6dba4c93-5146-4f10-aef4-6f7131fabc60", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1192590057"}], "key_name": "tempest-keypair-925913692", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:40.311551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] validate_networks() for [('b503e9fa-a7c0-4ae6-89b5-24742cb19945', None, None, None, None, None), (None, None, '198efcd9-809d-4f5a-8feb-85171ce21b72', None, None, None), (None, None, '81ce7c7d-8b64-42e8-a880-98a660147477', None, None, None), ('a6f04043-05e2-46f6-b41f-5bd16da77ee9', None, None, None, None, None), ('a6f04043-05e2-46f6-b41f-5bd16da77ee9', None, None, None, None, None), ('3760d803-f163-404a-b2c7-fc6b0d128472', '10.2.2.100', None, None, None, None), ('3760d803-f163-404a-b2c7-fc6b0d128472', '10.2.2.200', None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:13:42.909607 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2fb71e1f-138d-44b0-94da-1490d258a0d7 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.150825 Jul 24 01:13:42.916819 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 667/1209] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:13:37 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:43.333960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79fd815e-1f76-4071-8b72-e48c1e787799 tempest-TenantUsagesNegativeTestJSON-1723639938 tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-23T01%3A13%3A38.370671&end=2022-07-25T01%3A13%3A38.370671" status: 404 len: 112 microversion: - time: 0.416642 Jul 24 01:13:43.335287 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 668/1210] 10.222.0.27 () {58 vars in 1315 bytes} [Sun Jul 24 01:13:42 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-23T01%3A13%3A38.370671&end=2022-07-25T01%3A13%3A38.370671 => generated 112 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 24 01:13:43.347930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7514dc9a-f98c-43e6-90c0-c23af25db0bc tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eaeac4c0>, body: {"security_group_rule": {"parent_group_id": "3642a5be-9507-49f4-978f-d95024580627", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:43.834982 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7514dc9a-f98c-43e6-90c0-c23af25db0bc tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.498613 Jul 24 01:13:43.835592 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 669/1211] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:13:43 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:43.842259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:43.843276 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:43.855711 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.861879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:43.863140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:43.864193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.246247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:44.260015 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e7135a1f-6f85-445d-8ddc-d52d80423556 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.423368 Jul 24 01:13:44.277338 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 670/1212] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:43 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:44.283434 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-bfc6021c-ba10-44d6-971b-ba727208c4b6 req-46528ae8-16ac-4a02-8484-097863aa765f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9", "name": "network-vif-deleted", "tag": "c7a256d7-1bd3-4c3b-be55-15cba137157f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:44.292639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bfc6021c-ba10-44d6-971b-ba727208c4b6 req-46528ae8-16ac-4a02-8484-097863aa765f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:44.293396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bfc6021c-ba10-44d6-971b-ba727208c4b6 req-46528ae8-16ac-4a02-8484-097863aa765f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.318368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-bfc6021c-ba10-44d6-971b-ba727208c4b6 req-46528ae8-16ac-4a02-8484-097863aa765f service nova] Creating event network-vif-deleted:c7a256d7-1bd3-4c3b-be55-15cba137157f for instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 on n-h2-master-1 Jul 24 01:13:44.328753 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-bfc6021c-ba10-44d6-971b-ba727208c4b6 req-46528ae8-16ac-4a02-8484-097863aa765f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049491 Jul 24 01:13:44.331848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 671/1213] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:44.342272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:44.346263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:44.363360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:44.364068 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.365024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:44.365558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.394894 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 HTTP/1.1 Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:44.407521 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:13:44.409037 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9'} Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:44.409887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:13:44.411175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:44.413837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:44.415158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-440509ca-98be-485b-80e6-0ee49aae8407 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 404 len: 111 microversion: 2.1 time: 0.081528 Jul 24 01:13:44.416044 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 672/1214] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:44 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:44.422065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.44"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:44.423152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:44.441962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:44.442520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.443527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:44.443960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:44.502296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Acquired lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:13:45.574750 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2.", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:13:45.575777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Releasing lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:13:45.576375 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2. Jul 24 01:13:45.576375 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-36c52863-b876-421a-a412-fc8acc041efc'] Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Request method failure captured: Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action HTTP/1.1 Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 45 Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JyWmFaa3LJ5zztTI0CmbVIe2P8cOGJrwY60a2JFtkpHROff9Pf3Z5RKaygeVvIV6YHpL-mohyBAT8SwVG1arRLl9W-CvrTZdsvkbKUKPhjqTVgtCp3H1wyPvrdP-fp-xAbBbyh_3FTDpxz823Ww3XcNe9uPa5x2wC8pg2McFVI5R1k Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:13:45.583088 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec53a779c92c4620a832da29e583581b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec53a779c92c4620a832da29e583581b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c1c7e27c899648168625087b1653df68 Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: {"addFloatingIp": {"address": "172.35.1.44"}} Jul 24 01:13:45.584917 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: exception: Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2. Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-36c52863-b876-421a-a412-fc8acc041efc'] Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b4abc5a1-3a53-4246-ba5b-54c1449fb1c8', 'body': {'addFloatingIp': {'address': '172.35.1.44'}}} Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:13:45.586019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:13:45.587288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2. Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36c52863-b876-421a-a412-fc8acc041efc'] Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2. Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36c52863-b876-421a-a412-fc8acc041efc'] Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.588454 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2. Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36c52863-b876-421a-a412-fc8acc041efc'] Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.589743 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2. Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36c52863-b876-421a-a412-fc8acc041efc'] Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Returning 400 to user: Cannot associate floating IP 172.35.1.44 (e87b86b6-52da-4fd9-bfec-2303ab1ffead) with port 190a02df-6d16-4646-adb5-db06e07a74fe using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 61d246aa-98fb-42b3-a4f9-8547b5bbd4e2. Jul 24 01:13:45.591066 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-36c52863-b876-421a-a412-fc8acc041efc'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:45.592021 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cb2579b3-baf5-4593-9613-ccb9076b2487 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action" status: 400 len: 380 microversion: 2.1 time: 1.167411 Jul 24 01:13:45.592021 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 673/1215] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:13:44 2022] POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action => generated 380 bytes in 1173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:13:45.604636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fab04149-e04a-4e63-bc41-e7f0b68dbda3 tempest-TenantUsagesNegativeTestJSON-1723639938 tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin] Calling method '.version_select at 0x7f05eb041dc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:45.621122 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-fab04149-e04a-4e63-bc41-e7f0b68dbda3 tempest-TenantUsagesNegativeTestJSON-1723639938 tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fab04149-e04a-4e63-bc41-e7f0b68dbda3 tempest-TenantUsagesNegativeTestJSON-1723639938 tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin] Request method failure captured: Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-simple-tenant-usage/6023d0f8f7d4483585c0443676fce3e5?start=2022-07-25T01%3A13%3A38.370671&end=2022-07-23T01%3A13%3A38.370671 HTTP/1.1 Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JzCJPzYtigJzFnDga_xmNAvs7MtR7CCUWyxFt3UTKUfMgfdOa2OEBci_V-wKQSZg7pEJd3Zwn_RB1ngxrRBG9GT_NKjQ_upEu7EAQ97d4NunplfR2umrKa9brfOsI1K7z_rJXbY7fmdzfywgbK0VfcUVXo64F8LnJxKW2aQ8DgQtxk Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 62c19142f37447f89f9edd357efe0313 Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1723639938 Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:13:45.630806 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/62c19142f37447f89f9edd357efe0313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/62c19142f37447f89f9edd357efe0313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_62c19142f37447f89f9edd357efe0313", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/62c19142f37447f89f9edd357efe0313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1723639938 Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 62c19142f37447f89f9edd357efe0313 Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1723639938 Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 60b93ca2f2dc44ecbd199629537fd433 Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid start time. The start time cannot occur after the end time. Jul 24 01:13:45.632448 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6023d0f8f7d4483585c0443676fce3e5'} Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 24 01:13:45.633396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fab04149-e04a-4e63-bc41-e7f0b68dbda3 tempest-TenantUsagesNegativeTestJSON-1723639938 tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:45.634832 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fab04149-e04a-4e63-bc41-e7f0b68dbda3 tempest-TenantUsagesNegativeTestJSON-1723639938 tempest-TenantUsagesNegativeTestJSON-1723639938-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/6023d0f8f7d4483585c0443676fce3e5?start=2022-07-25T01%3A13%3A38.370671&end=2022-07-23T01%3A13%3A38.370671" status: 400 len: 111 microversion: 2.1 time: 0.041427 Jul 24 01:13:45.635743 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 674/1216] 10.222.0.27 () {58 vars in 1411 bytes} [Sun Jul 24 01:13:45 2022] GET /compute/v2.1/os-simple-tenant-usage/6023d0f8f7d4483585c0443676fce3e5?start=2022-07-25T01%3A13%3A38.370671&end=2022-07-23T01%3A13%3A38.370671 => generated 111 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:13:45.643038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38e304e9-629b-4e20-9f32-4149920436bd tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eae4c700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-473542764", "description": "tempest-description-790541664"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:46.294036 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38e304e9-629b-4e20-9f32-4149920436bd tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.659581 Jul 24 01:13:46.294807 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 675/1217] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:13:45 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:46.303336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1277859958", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "adf394c3-0407-4590-8c41-4e59f65f117d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:46.436553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] validate_networks() for [('adf394c3-0407-4590-8c41-4e59f65f117d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:13:46.986930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:13:46.987940 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:13:46.988583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:13:46.990325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:13:46.990945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:13:47.025456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.026159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.027311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.027925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.043592 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:47.063902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Getting quotas for project 651fa7eea7a04e8d83d2264c1638f8f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:47.071373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Getting quotas for user f71f3d66b27b471d9772a0a01d3c89ed and project 651fa7eea7a04e8d83d2264c1638f8f2. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:47.290057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:13:47.291239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:13:47.291992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:13:47.293036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:13:47.294168 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:13:47.317305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.318323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.321005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.321690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.348392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:13:47.353516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:13:47.357183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d2d2a8ca-180e-408c-9bfb-5881625dfc12',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='466d1037-3e07-4e76-bc96-b9d11c9c3b5c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6dba4c93-5146-4f10-aef4-6f7131fabc60',volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:13:47.367606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for user f3de9a749c874cfc8c34deffb1001a79 and project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:13:47.388825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:13:47.391928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:13:47.462719 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4de7415c-be08-43f7-8f9b-5c33b0acbbd8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165693 Jul 24 01:13:47.470831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 676/1218] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:13:47.476514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:47.477478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:47.492492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.494429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.496852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:47.497610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:47.826593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:47.841026 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cfebd73f-6fbf-4f0e-92ce-2da1de387ff5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.368792 Jul 24 01:13:47.844972 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 677/1219] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:47 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:47.850972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14849683-1e6e-4271-ad55-6270b4f1e031 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '.version_select at 0x7f05eae26d30>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:48.210378 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-57a0afc6-a828-4b64-a675-b06d48b128ff tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.237968 Jul 24 01:13:48.211091 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 543/1220] 10.222.0.27 () {62 vars in 1188 bytes} [Sun Jul 24 01:13:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 8242 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:13:48.677485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b14c14a-13d0-419b-a229-f5ccf097c77c tempest-TenantUsagesNegativeTestJSON-1692964845 tempest-TenantUsagesNegativeTestJSON-1692964845-project] Calling method '.version_select at 0x7f05eb114160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:48.680248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4b14c14a-13d0-419b-a229-f5ccf097c77c tempest-TenantUsagesNegativeTestJSON-1692964845 tempest-TenantUsagesNegativeTestJSON-1692964845-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'adbae035c5d24e7eb2d053a0fbd13f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6023d0f8f7d4483585c0443676fce3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b14c14a-13d0-419b-a229-f5ccf097c77c tempest-TenantUsagesNegativeTestJSON-1692964845 tempest-TenantUsagesNegativeTestJSON-1692964845-project] Request method failure captured: Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-23T01%3A13%3A38.370671&end=2022-07-25T01%3A13%3A38.370671&detailed=1 HTTP/1.1 Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JzAZOAHMK1gqVcv5WWFWhDlAcXaq9VAEThKOmFXGoocFYHp-C-kQmm1NtJYlW_eTjksK5RRDW1T4oNZ-qT5g4Gf-uEnJY0nVsMI80QIF7MOh2gKkFpdwWLOD4QBkBR8iEZ6Lelsn8lKMmq8yq8joaV3j_NmhMtY9e8VX73CAo8rn5E Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 6023d0f8f7d4483585c0443676fce3e5 Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1692964845 Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:13:48.687132 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6023d0f8f7d4483585c0443676fce3e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6023d0f8f7d4483585c0443676fce3e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6023d0f8f7d4483585c0443676fce3e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6023d0f8f7d4483585c0443676fce3e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1692964845 Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 6023d0f8f7d4483585c0443676fce3e5 Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1692964845 Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TenantUsagesNegativeTestJSON-1692964845-project Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: adbae035c5d24e7eb2d053a0fbd13f28 Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1692964845-project Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: action_args: {} Jul 24 01:13:48.688547 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:13:48.689411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:13:48.692057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:13:48.701352 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 24 01:13:48.701352 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:13:48.701352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b14c14a-13d0-419b-a229-f5ccf097c77c tempest-TenantUsagesNegativeTestJSON-1692964845 tempest-TenantUsagesNegativeTestJSON-1692964845-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:13:48.701352 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b14c14a-13d0-419b-a229-f5ccf097c77c tempest-TenantUsagesNegativeTestJSON-1692964845 tempest-TenantUsagesNegativeTestJSON-1692964845-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-23T01%3A13%3A38.370671&end=2022-07-25T01%3A13%3A38.370671&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.478988 Jul 24 01:13:48.701352 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 544/1221] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Jul 24 01:13:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-23T01%3A13%3A38.370671&end=2022-07-25T01%3A13%3A38.370671&detailed=1 => generated 123 bytes in 481 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:48.711547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-caa19a2a-5c73-4068-b7c7-f38dcaf2c1e8 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eb1339d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-152538857", "description": "tempest-description-426868404"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:49.184906 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-caa19a2a-5c73-4068-b7c7-f38dcaf2c1e8 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.491185 Jul 24 01:13:49.186125 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 545/1222] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:13:48 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:49.196807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:49.198354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:49.214264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.217497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.219326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.222290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.347721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:49.363777 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9316450c-9939-4bed-ae21-3c49b52fbb16 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1211 microversion: 2.1 time: 0.176346 Jul 24 01:13:49.364358 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 546/1223] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:49 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1211 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:49.400848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3cd06da5-a711-4a78-89df-c255ac528b90 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:49.401606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3cd06da5-a711-4a78-89df-c255ac528b90 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:49.625798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cd06da5-a711-4a78-89df-c255ac528b90 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:49.637897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cd06da5-a711-4a78-89df-c255ac528b90 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:49.643990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cd06da5-a711-4a78-89df-c255ac528b90 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:49.649112 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3cd06da5-a711-4a78-89df-c255ac528b90 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1285 microversion: 2.32 time: 0.272410 Jul 24 01:13:49.650402 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 547/1224] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:49 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1285 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:49.659315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:49.660014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:49.667737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.668825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:49.669720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:49.670238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.101971 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14849683-1e6e-4271-ad55-6270b4f1e031 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e87b86b6-52da-4fd9-bfec-2303ab1ffead" status: 202 len: 0 microversion: 2.1 time: 2.255196 Jul 24 01:13:50.103429 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 678/1225] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:13:47 2022] DELETE /compute/v2.1/os-floating-ips/e87b86b6-52da-4fd9-bfec-2303ab1ffead => generated 0 bytes in 2258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:13:50.108383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2fff750-0ff8-4921-8fd0-84371908c705 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eaef5e50>, body: {"security_group_rule": {"parent_group_id": "1c04d4fa-1828-4f75-b32e-e9d60e06b4d2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "61037af4-99df-48b7-986d-2b629e946c5e"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:50.193021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:50.210219 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f95b7708-a98f-4b78-8812-9080da90f410 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.548440 Jul 24 01:13:50.211195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 548/1226] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:49 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:50.216042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.163"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:50.742165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:50.753719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.754480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:50.755735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:50.756398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:51.752702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Acquired lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:13:52.388049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2fff750-0ff8-4921-8fd0-84371908c705 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.283333 Jul 24 01:13:52.396454 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 679/1227] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:13:50 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:52.401627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:52.402281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:52.407432 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:52.423125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.423573 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.424441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.424882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.440403 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=57,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:52.567043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:52.583138 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2bda6a61-47c5-4429-a9f2-8e64e2824a7c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1273 microversion: 2.1 time: 0.185249 Jul 24 01:13:52.585918 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 680/1228] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:52 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:52.602102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:52.603094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:52.613527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.616696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:52.617831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:52.618699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.274090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:53.289435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:53.291051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:53.292221 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eb862159-a35e-450f-a28b-03cfacb704c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1593 microversion: 2.32 time: 0.703712 Jul 24 01:13:53.292925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 681/1229] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:52 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1593 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:53.808513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:53.810015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:53.820743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.824958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:53.827297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:53.828485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.698125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:54.717898 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef2399c7-3cce-42fb-852f-979f1a18e8c7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 1.412335 Jul 24 01:13:54.723521 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 682/1230] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:53 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:54.747037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-817f4a0e-d1de-49e9-86d7-4f85ceb18b1a req-d6b07667-a742-4774-8f0a-4fd496e0bb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c4c870-8606-4888-81ee-c2a835a28957", "name": "network-vif-unplugged", "status": "completed", "tag": "d4d5f9d8-92d8-4655-b5b7-0152abef78c0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:54.770913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-817f4a0e-d1de-49e9-86d7-4f85ceb18b1a req-d6b07667-a742-4774-8f0a-4fd496e0bb7f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:54.776150 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-817f4a0e-d1de-49e9-86d7-4f85ceb18b1a req-d6b07667-a742-4774-8f0a-4fd496e0bb7f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:54.801520 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-817f4a0e-d1de-49e9-86d7-4f85ceb18b1a req-d6b07667-a742-4774-8f0a-4fd496e0bb7f service nova] Creating event network-vif-unplugged:d4d5f9d8-92d8-4655-b5b7-0152abef78c0 for instance 38c4c870-8606-4888-81ee-c2a835a28957 on n-h2-master-1 Jul 24 01:13:54.823622 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-817f4a0e-d1de-49e9-86d7-4f85ceb18b1a req-d6b07667-a742-4774-8f0a-4fd496e0bb7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096779 Jul 24 01:13:54.824603 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 683/1231] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:54.843755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-27b12faa-99db-4524-a7a9-b3886b2e07b2 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eaef54c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1263539726", "description": "tempest-description-1047278770"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:55.823718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Building network info cache for instance {{(pid=119562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:13:56.072136 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-27b12faa-99db-4524-a7a9-b3886b2e07b2 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.246299 Jul 24 01:13:56.073266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 684/1232] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:13:54 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:56.079317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:56.080612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:56.105450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:56.106210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:56.110974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:56.113462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.043428 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:57.275814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:57.291563 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-80458c2c-3133-414e-a3b9-d16af5385911 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1315 microversion: 2.1 time: 1.216948 Jul 24 01:13:57.292153 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 685/1233] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:56 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1315 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:57.309615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:57.310550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:57.320499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.321216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.322237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:57.322857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:57.340752 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:57.381251 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:57.924322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:57.950749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:57.955677 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:57.961948 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5195d86f-d639-4915-8acb-647bc5357227 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1661 microversion: 2.32 time: 0.664416 Jul 24 01:13:57.975948 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 686/1234] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:13:57 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1661 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:13:57.994297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:57.994927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:58.006202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.006672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.007477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.007953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.399954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Updating instance_info_cache with network_info: [{"id": "190a02df-6d16-4646-adb5-db06e07a74fe", "address": "fa:16:3e:c7:a5:7b", "network": {"id": "0a1da61f-fe83-432c-9aa7-db32a73a802a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2143654668-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ec53a779c92c4620a832da29e583581b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap190a02df-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:13:58.415443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Releasing lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:13:58.416314 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0d4ab26-f7a9-4ee1-a752-9d0e45e1d1b9 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action" status: 202 len: 0 microversion: 2.1 time: 8.204138 Jul 24 01:13:58.419962 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 549/1235] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:13:50 2022] POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action => generated 0 bytes in 8205 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:13:58.424779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e5f0a859-b6c2-40c6-a029-d33a26a860b9 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eb1eb700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-960635461", "description": "tempest-description-1796903775"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:58.541092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:58.550651 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de32e670-4e5a-4d8d-b807-9724f2da53de tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.581270 Jul 24 01:13:58.551292 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 687/1236] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:57 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:58.558924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e20662cf-6721-4b03-b32e-5911f512f6e5 req-fe880a96-408c-4cc6-91dd-ebd574736d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c4c870-8606-4888-81ee-c2a835a28957", "tag": "d4d5f9d8-92d8-4655-b5b7-0152abef78c0"}, {"name": "network-changed", "server_uuid": "b4abc5a1-3a53-4246-ba5b-54c1449fb1c8", "tag": "190a02df-6d16-4646-adb5-db06e07a74fe"}, {"name": "network-changed", "server_uuid": "f5fc9a91-b438-478b-89bf-c5b70e390fd7", "tag": "61bcc3f2-0186-480b-9ea3-ef733d7ec2c3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:58.597652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e20662cf-6721-4b03-b32e-5911f512f6e5 req-fe880a96-408c-4cc6-91dd-ebd574736d87 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.614753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e20662cf-6721-4b03-b32e-5911f512f6e5 req-fe880a96-408c-4cc6-91dd-ebd574736d87 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.649032 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e20662cf-6721-4b03-b32e-5911f512f6e5 req-fe880a96-408c-4cc6-91dd-ebd574736d87 service nova] Creating event network-changed:d4d5f9d8-92d8-4655-b5b7-0152abef78c0 for instance 38c4c870-8606-4888-81ee-c2a835a28957 on n-h2-master-1 Jul 24 01:13:58.649698 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e20662cf-6721-4b03-b32e-5911f512f6e5 req-fe880a96-408c-4cc6-91dd-ebd574736d87 service nova] Creating event network-changed:190a02df-6d16-4646-adb5-db06e07a74fe for instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 on n-h2-master-1 Jul 24 01:13:58.664096 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e20662cf-6721-4b03-b32e-5911f512f6e5 req-fe880a96-408c-4cc6-91dd-ebd574736d87 service nova] Creating event network-changed:61bcc3f2-0186-480b-9ea3-ef733d7ec2c3 for instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 on n-h1-master-1 Jul 24 01:13:58.698765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e20662cf-6721-4b03-b32e-5911f512f6e5 req-fe880a96-408c-4cc6-91dd-ebd574736d87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.141766 Jul 24 01:13:58.699365 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 688/1237] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:58.715224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:58.717041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:13:58.729951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.730621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.732905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:13:58.733513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:13:58.818670 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e5f0a859-b6c2-40c6-a029-d33a26a860b9 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.400012 Jul 24 01:13:58.819710 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 550/1238] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:13:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:13:58.831951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50c10753-0ccc-4748-a703-942b59b2bb70 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '.version_select at 0x7f05eb3fb0d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:13:59.235119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:13:59.245423 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b25c66d1-5581-4335-b6b8-b38e8d6a0e7e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1315 microversion: 2.1 time: 0.544402 Jul 24 01:13:59.255446 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 689/1239] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:13:58 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:13:59.261008 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e054ae7-5a58-4458-8da5-054888d455f8 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eae4cdc0>, body: {"security_group_rule": {"parent_group_id": "a776fe24-e5b4-48a6-9270-b6ae6b3e9225", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4bc91c9d-90a5-467b-8b49-4de5c90f1998"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:13:59.631364 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:00.477294 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e054ae7-5a58-4458-8da5-054888d455f8 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.219426 Jul 24 01:14:00.478901 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 690/1240] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:13:59 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:00.493126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:00.494375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:00.522618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.523392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.526147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:00.527196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:00.746492 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:01.043571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:01.063685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:01.068391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:01.071008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50c10753-0ccc-4748-a703-942b59b2bb70 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/082f2070-6afd-470f-83ef-b1e12a037a14" status: 202 len: 0 microversion: 2.1 time: 2.249742 Jul 24 01:14:01.071782 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 551/1241] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:13:58 2022] DELETE /compute/v2.1/os-floating-ips/082f2070-6afd-470f-83ef-b1e12a037a14 => generated 0 bytes in 2251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:01.073485 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-becc91e5-4353-4567-85d5-561335a736ed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1708 microversion: 2.32 time: 0.591379 Jul 24 01:14:01.076296 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 691/1242] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:00 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1708 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:01.080167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:01.080994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:01.085526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:01.086188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:01.098130 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.098978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:01.100123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.100989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:01.118504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.126109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:01.128402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:01.131973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:01.591211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:01.609715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2b8b75b2-8b0c-4db1-80ba-e0b9aa16382c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.534472 Jul 24 01:14:01.611659 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 552/1243] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:01 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:01.612370 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:01.633210 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a1c15d06-34ee-4064-863a-fa9729383ad6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1315 microversion: 2.1 time: 0.551797 Jul 24 01:14:01.644111 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 692/1244] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:01 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:01.666887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-142d65a8-5e09-4c26-8dab-14f4d0357eec tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05ead9fca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:01.925168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-165805876", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "c346cd37-8708-458f-a9ad-b2bb44b94ef1"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:02.068062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] validate_networks() for [('c346cd37-8708-458f-a9ad-b2bb44b94ef1', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:14:02.356726 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-142d65a8-5e09-4c26-8dab-14f4d0357eec tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4bc91c9d-90a5-467b-8b49-4de5c90f1998" status: 202 len: 0 microversion: 2.1 time: 0.702384 Jul 24 01:14:02.357322 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 693/1245] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:01 2022] DELETE /compute/v2.1/os-security-groups/4bc91c9d-90a5-467b-8b49-4de5c90f1998 => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:02.364423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c91b37ce-c8e1-42f5-b642-e28612b20da1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c91b37ce-c8e1-42f5-b642-e28612b20da1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Request method failure captured: Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action HTTP/1.1 Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 34 Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JyWmFaa3LJ5zztTI0CmbVIe2P8cOGJrwY60a2JFtkpHROff9Pf3Z5RKaygeVvIV6YHpL-mohyBAT8SwVG1arRLl9W-CvrTZdsvkbKUKPhjqTVgtCp3H1wyPvrdP-fp-xAbBbyh_3FTDpxz823Ww3XcNe9uPa5x2wC8pg2McFVI5R1k Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:02.367227 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec53a779c92c4620a832da29e583581b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec53a779c92c4620a832da29e583581b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c1c7e27c899648168625087b1653df68 Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: {"addFloatingIp": {"address": ""}} Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:14:02.368779 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b4abc5a1-3a53-4246-ba5b-54c1449fb1c8', 'body': {'addFloatingIp': {'address': ''}}} Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi '' Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:02.369784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:14:02.371411 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:14:02.372920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 24 01:14:02.372920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:02.378504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c91b37ce-c8e1-42f5-b642-e28612b20da1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:02.386321 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c91b37ce-c8e1-42f5-b642-e28612b20da1 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action" status: 400 len: 142 microversion: 2.1 time: 0.027622 Jul 24 01:14:02.390586 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 694/1246] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:14:02 2022] POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action => generated 142 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:14:02.407351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:02.414500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:02.463602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:02.464099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:02.464948 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:02.465397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.040367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:03.053089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:03.057122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:03.059846 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d3ccc934-5884-49e1-9eaf-12a7cf33dd81 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1755 microversion: 2.32 time: 0.664670 Jul 24 01:14:03.061643 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 695/1247] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:02 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1755 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:03.076530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48013191-be5f-4434-9643-22818c433378 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eaee2430>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:03.240789 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-48013191-be5f-4434-9643-22818c433378 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/a776fe24-e5b4-48a6-9270-b6ae6b3e9225" status: 200 len: 248 microversion: 2.1 time: 0.176749 Jul 24 01:14:03.241573 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 696/1248] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:14:03 2022] GET /compute/v2.1/os-security-groups/a776fe24-e5b4-48a6-9270-b6ae6b3e9225 => generated 248 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:03.246856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:03.249698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:03.269179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.269948 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.270742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.271432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.279493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:14:03.281164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:14:03.281856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:14:03.282435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:14:03.283015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:14:03.303923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.304665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.306974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.308860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.349123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Acquired lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:14:03.365293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:03.382785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for user 735a3f7d7e454f14a7a4ed229affd75b and project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:03.423344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:14:03.425530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:14:03.525491 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-564dfd4a-cdf8-4b7d-9562-527169b7acfc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.910758 Jul 24 01:14:03.526210 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 553/1249] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:14:03.533879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:03.547527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:03.569821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.569938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.570733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.571182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.579477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Releasing lock "refresh_cache-b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:14:03.580079 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] HTTP exception thrown: floating IP not found Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Request method failure captured: Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action HTTP/1.1 Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 41 Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JyWmFaa3LJ5zztTI0CmbVIe2P8cOGJrwY60a2JFtkpHROff9Pf3Z5RKaygeVvIV6YHpL-mohyBAT8SwVG1arRLl9W-CvrTZdsvkbKUKPhjqTVgtCp3H1wyPvrdP-fp-xAbBbyh_3FTDpxz823Ww3XcNe9uPa5x2wC8pg2McFVI5R1k Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:03.582857 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec53a779c92c4620a832da29e583581b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec53a779c92c4620a832da29e583581b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c1c7e27c899648168625087b1653df68 Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:14:03.584487 n-d-master-1 devstack@n-api.service[119561]: exception: floating IP not found Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b4abc5a1-3a53-4246-ba5b-54c1449fb1c8', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:03.585286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 24 01:14:03.586711 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:03.590065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Returning 404 to user: floating IP not found {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:03.591323 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78a3dff1-c05d-42cf-aae0-b2949c36aa33 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action" status: 404 len: 67 microversion: 2.1 time: 0.348323 Jul 24 01:14:03.592094 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 697/1250] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:14:03 2022] POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action => generated 67 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:14:03.604786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:03.609767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:03.626757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.628719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.636850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:03.637616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:03.889310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:03.901953 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f72c5ec1-8e97-4c23-9a23-a7e92982e156 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1315 microversion: 2.1 time: 0.303711 Jul 24 01:14:03.903444 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 698/1251] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:03 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:03.935872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1a458c3-d39c-494e-9ef4-87ba46f64f55 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05ead89b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1446364442", "description": "tempest-description-491877741"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:04.049340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:04.069265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-059784ba-e18f-48f6-b968-ba87cdd03e4b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.540852 Jul 24 01:14:04.070897 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 554/1252] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:03 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:04.233115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ae245413-f7eb-4e7b-9814-f03abb65f4c2 req-e3e2d087-d8ce-4deb-99f6-2e2054a988fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fc9a91-b438-478b-89bf-c5b70e390fd7", "name": "network-vif-plugged", "status": "completed", "tag": "61bcc3f2-0186-480b-9ea3-ef733d7ec2c3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:04.254806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ae245413-f7eb-4e7b-9814-f03abb65f4c2 req-e3e2d087-d8ce-4deb-99f6-2e2054a988fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.256068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ae245413-f7eb-4e7b-9814-f03abb65f4c2 req-e3e2d087-d8ce-4deb-99f6-2e2054a988fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.271482 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ae245413-f7eb-4e7b-9814-f03abb65f4c2 req-e3e2d087-d8ce-4deb-99f6-2e2054a988fc service nova] Creating event network-vif-plugged:61bcc3f2-0186-480b-9ea3-ef733d7ec2c3 for instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 on n-h1-master-1 Jul 24 01:14:04.280055 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ae245413-f7eb-4e7b-9814-f03abb65f4c2 req-e3e2d087-d8ce-4deb-99f6-2e2054a988fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205801 Jul 24 01:14:04.282267 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 555/1253] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:04.298545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8389acdd-096e-4ade-86e6-441ca4a2f90c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:04.300158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8389acdd-096e-4ade-86e6-441ca4a2f90c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:04.532979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8389acdd-096e-4ade-86e6-441ca4a2f90c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:04.542386 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1a458c3-d39c-494e-9ef4-87ba46f64f55 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.618764 Jul 24 01:14:04.552191 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 699/1254] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:14:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:04.558501 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be60a6a9-4048-46ef-85ea-336c504257a5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:04.564186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8389acdd-096e-4ade-86e6-441ca4a2f90c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:04.568380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8389acdd-096e-4ade-86e6-441ca4a2f90c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:04.571918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8389acdd-096e-4ade-86e6-441ca4a2f90c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1261 microversion: 2.25 time: 0.288214 Jul 24 01:14:04.575540 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 556/1255] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:04 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1261 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:04.588688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:04.589365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:04.607715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.608212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.620320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:04.620777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:04.691374 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-be60a6a9-4048-46ef-85ea-336c504257a5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be60a6a9-4048-46ef-85ea-336c504257a5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Request method failure captured: Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action HTTP/1.1 Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 44 Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JyWmFaa3LJ5zztTI0CmbVIe2P8cOGJrwY60a2JFtkpHROff9Pf3Z5RKaygeVvIV6YHpL-mohyBAT8SwVG1arRLl9W-CvrTZdsvkbKUKPhjqTVgtCp3H1wyPvrdP-fp-xAbBbyh_3FTDpxz823Ww3XcNe9uPa5x2wC8pg2McFVI5R1k Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:04.693022 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec53a779c92c4620a832da29e583581b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec53a779c92c4620a832da29e583581b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c1c7e27c899648168625087b1653df68 Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:14:04.694688 n-d-master-1 devstack@n-api.service[119561]: exception: Floating IP not found for address 0.0.0.0. Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b4abc5a1-3a53-4246-ba5b-54c1449fb1c8', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:04.699591 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 24 01:14:04.701314 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:04.703303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be60a6a9-4048-46ef-85ea-336c504257a5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:04.703303 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be60a6a9-4048-46ef-85ea-336c504257a5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action" status: 404 len: 88 microversion: 2.1 time: 0.141009 Jul 24 01:14:04.703303 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 700/1256] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:14:04 2022] POST /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8/action => generated 88 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:14:04.708156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-301cd875-9b5b-4228-a182-5e0fa4743b2e tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05ead9f3a0>, body: {"security_group_rule": {"parent_group_id": "1918850b-0831-42ac-9d93-382d8a247df6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:05.161814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.190738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.195468 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.201304 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-46320187-323c-4f7c-98de-1cb72012493a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1755 microversion: 2.32 time: 0.624527 Jul 24 01:14:05.218373 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 557/1257] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:04 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1755 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:05.238480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:05.239662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:05.259839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.264960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.267975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.268963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.345267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:14:05.367168 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-301cd875-9b5b-4228-a182-5e0fa4743b2e tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.669801 Jul 24 01:14:05.381592 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 701/1258] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:14:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:05.398414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:05.403078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:05.425151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.425610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.426435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.426874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.480062 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9d849615-2b5c-44ff-ba8f-322bcad64535 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 204 len: 0 microversion: 2.1 time: 0.259834 Jul 24 01:14:05.480889 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 558/1259] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:14:05 2022] DELETE /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:14:05.488217 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:05.489174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:05.496422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.496967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.497879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.498554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.741490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.759361 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0152e746-3f6e-4180-8a19-66f35c884cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1315 microversion: 2.1 time: 0.366407 Jul 24 01:14:05.761596 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 702/1260] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:05 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:05.768109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61ec5b92-30df-4380-9fed-9ba0892eca72 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Action: 'create', calling method: .version_select at 0x7f05eae26430>, body: {"security_group_rule": {"parent_group_id": "1918850b-0831-42ac-9d93-382d8a247df6", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:05.876591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:05.893742 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-769feca9-12f4-4eb9-8b30-c895bf79ff7d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.411295 Jul 24 01:14:05.894371 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 559/1261] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:05 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:05.911560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:05.912556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:05.933204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.934319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:05.937113 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:05.938692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.147958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-61ec5b92-30df-4380-9fed-9ba0892eca72 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.384976 Jul 24 01:14:06.148829 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 703/1262] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:14:05 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:06.159446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:06.160135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:06.182458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.183118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.184528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.185180 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.205898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:06.215415 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de26ea2d-c10b-4314-bb01-b7dc5b9fb7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1542 microversion: 2.1 time: 0.319944 Jul 24 01:14:06.230777 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 560/1263] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:05 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1542 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:06.235910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cdfc83c0-a9e9-46f9-9518-44778ae83899 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eb1450d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:06.336553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:06.348513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:06.351731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:06.355437 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa18b302-6cf4-42c4-979c-8c30d4cbd729 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1321 microversion: 2.25 time: 0.200098 Jul 24 01:14:06.357764 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 704/1264] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:06 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:06.369974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:06.370664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:06.381405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.381904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.382705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.383153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.415936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cdfc83c0-a9e9-46f9-9518-44778ae83899 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/1918850b-0831-42ac-9d93-382d8a247df6" status: 200 len: 664 microversion: 2.1 time: 0.183605 Jul 24 01:14:06.416544 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 561/1265] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:14:06 2022] GET /compute/v2.1/os-security-groups/1918850b-0831-42ac-9d93-382d8a247df6 => generated 664 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:06.422373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2585fffd-46c7-4ec8-bfcc-bba738f38d7c req-e6fc5b96-8488-4cd0-a824-9b33be8f20ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c4c870-8606-4888-81ee-c2a835a28957", "name": "network-vif-unplugged", "status": "completed", "tag": "d4d5f9d8-92d8-4655-b5b7-0152abef78c0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:06.457222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2585fffd-46c7-4ec8-bfcc-bba738f38d7c req-e6fc5b96-8488-4cd0-a824-9b33be8f20ce service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:06.460406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2585fffd-46c7-4ec8-bfcc-bba738f38d7c req-e6fc5b96-8488-4cd0-a824-9b33be8f20ce service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:06.492340 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2585fffd-46c7-4ec8-bfcc-bba738f38d7c req-e6fc5b96-8488-4cd0-a824-9b33be8f20ce service nova] Creating event network-vif-unplugged:d4d5f9d8-92d8-4655-b5b7-0152abef78c0 for instance 38c4c870-8606-4888-81ee-c2a835a28957 on n-h2-master-1 Jul 24 01:14:06.512672 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2585fffd-46c7-4ec8-bfcc-bba738f38d7c req-e6fc5b96-8488-4cd0-a824-9b33be8f20ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094740 Jul 24 01:14:06.518344 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 562/1266] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:06.523892 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d13e814-7c18-4092-af1c-ae8eb8cf2ff8 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eb145670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:07.459140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:07.481587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:07.483155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:07.488826 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-358071a9-08c4-4924-9e27-50bc872db4cc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1755 microversion: 2.32 time: 1.127374 Jul 24 01:14:07.490788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 705/1267] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:06 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1755 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:07.507301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:07.508934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:07.520483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:07.523181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:07.524239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:07.527230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:07.911459 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d13e814-7c18-4092-af1c-ae8eb8cf2ff8 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/29fba41e-8b24-474b-9363-3fe897697a55" status: 202 len: 0 microversion: 2.1 time: 1.391413 Jul 24 01:14:07.912631 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 563/1268] 10.222.0.27 () {58 vars in 1286 bytes} [Sun Jul 24 01:14:06 2022] DELETE /compute/v2.1/os-security-group-rules/29fba41e-8b24-474b-9363-3fe897697a55 => generated 0 bytes in 1393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:07.919668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:07.921553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:07.944577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:07.945040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:07.945891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:07.946336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.017926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.030327 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a49d2fe0-8af8-4318-b713-6a0ecc1718f0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1503 microversion: 2.1 time: 0.538347 Jul 24 01:14:08.031866 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 706/1269] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:07 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1503 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:08.037010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.037932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:08.045398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.046901 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.047894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.048617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.092537 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:08.508814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.518980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ccc28a75-8c44-4f13-a9b1-55498365e173 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1542 microversion: 2.1 time: 0.485828 Jul 24 01:14:08.525384 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 707/1270] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:08 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1542 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:08.530697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.540066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.545354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:08.557743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92280005-b03d-4a18-a240-cc5790be94eb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.636454 Jul 24 01:14:08.560789 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 564/1271] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:07 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:08.590294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.590768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.591595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.595961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08cfccb5-486a-4140-b5e8-1ab44e3de166 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eb1a0040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.598187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.842287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.853608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.867249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:08.868793 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de14a3e6-2be4-47d0-b2af-6d0c47cd302a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1319 microversion: 2.25 time: 0.342160 Jul 24 01:14:08.869876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 708/1272] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:08 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:08.878584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:08.879408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:08.896921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.897620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:08.898599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:08.899196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.470693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:09.492742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:09.494519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:09.501187 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0556aa83-9abe-4498-b524-08d58d419517 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1802 microversion: 2.32 time: 0.629961 Jul 24 01:14:09.502328 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 709/1273] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:08 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1802 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:09.542435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:09.543226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:09.563396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.563894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.564811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.565370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.790183 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08cfccb5-486a-4140-b5e8-1ab44e3de166 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1918850b-0831-42ac-9d93-382d8a247df6" status: 202 len: 0 microversion: 2.1 time: 1.225446 Jul 24 01:14:09.794432 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 565/1274] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:08 2022] DELETE /compute/v2.1/os-security-groups/1918850b-0831-42ac-9d93-382d8a247df6 => generated 0 bytes in 1233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:09.801142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:09.802083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:09.815738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.820287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.821381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:09.822006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:09.831750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:09.841335 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea424d58-82d4-495e-adaa-75d9765c4541 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1542 microversion: 2.1 time: 0.302615 Jul 24 01:14:09.843649 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 710/1275] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:09 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:09.859199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58b0fcc4-5424-4e86-b61f-e5e5971a3f3f tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eae55790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:09.941374 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-58b0fcc4-5424-4e86-b61f-e5e5971a3f3f tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:14:09.941756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-58b0fcc4-5424-4e86-b61f-e5e5971a3f3f tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Neutron security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:14:09.942851 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-58b0fcc4-5424-4e86-b61f-e5e5971a3f3f tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] HTTP exception thrown: Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist Jul 24 01:14:09.942851 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-e5d684e4-4f86-4174-919b-08ca54bf04fa'] Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58b0fcc4-5424-4e86-b61f-e5e5971a3f3f tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Request method failure captured: Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-groups/4bc91c9d-90a5-467b-8b49-4de5c90f1998 HTTP/1.1 Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jy50hfRkTk73TL4SH1Wk9YuOExWK6z5pZDE_VU4uAockyEWkmIK24R55WOHfNnIkuTBCiPwqqFCJIHuePhKr6Zz_bXXW7YQ-PwJ8urxAV-z867HltE3Jdk-V_reNdBcSSgMCQqpoCE1HO1XRzK2-BJgwQh3Pn1cq0mRgfZqPdWs2Ao Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 86dcce798be5406685973e61c9014b0c Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-83527662 Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:09.945265 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dcce798be5406685973e61c9014b0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dcce798be5406685973e61c9014b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dcce798be5406685973e61c9014b0c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dcce798be5406685973e61c9014b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupRulesTestJSON-83527662 Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 86dcce798be5406685973e61c9014b0c Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-83527662 Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupRulesTestJSON-83527662-project Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: ab40062ec270461986a3dece91f0584c Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupRulesTestJSON-83527662-project Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: exception: Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-e5d684e4-4f86-4174-919b-08ca54bf04fa'] Jul 24 01:14:09.947128 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '4bc91c9d-90a5-467b-8b49-4de5c90f1998'} Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:09.948288 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5d684e4-4f86-4174-919b-08ca54bf04fa'] Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:14:09.949906 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5d684e4-4f86-4174-919b-08ca54bf04fa'] Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5d684e4-4f86-4174-919b-08ca54bf04fa'] Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:09.952932 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5d684e4-4f86-4174-919b-08ca54bf04fa'] Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58b0fcc4-5424-4e86-b61f-e5e5971a3f3f tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Returning 404 to user: Security group 4bc91c9d-90a5-467b-8b49-4de5c90f1998 does not exist Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-e5d684e4-4f86-4174-919b-08ca54bf04fa'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58b0fcc4-5424-4e86-b61f-e5e5971a3f3f tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4bc91c9d-90a5-467b-8b49-4de5c90f1998" status: 404 len: 194 microversion: 2.1 time: 0.096812 Jul 24 01:14:09.956524 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 711/1276] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:09 2022] DELETE /compute/v2.1/os-security-groups/4bc91c9d-90a5-467b-8b49-4de5c90f1998 => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:09.997753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:09.998607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:10.029061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.029839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.039164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.039869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.533283 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:10.545841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:10.551067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:10.555998 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a290115-0f54-4626-ae8a-d1360aba0809 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.599593 Jul 24 01:14:10.557182 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 712/1277] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:09 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:10.562297 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:10.569849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bbb68df9-e447-4ffa-9ba6-f85a0cc5fb3b tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eae26c10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:10.583778 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b01f3e4e-0100-4c3b-9db8-65ee5d4b4b13 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.780626 Jul 24 01:14:10.585110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 566/1278] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:09 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:10.590513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4bf6585d-15c8-4f82-954f-51a3ffa51bfe req-e0c8f234-08d4-4373-a3f5-104fb2d1f3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abc5a1-3a53-4246-ba5b-54c1449fb1c8", "name": "network-vif-unplugged", "status": "completed", "tag": "190a02df-6d16-4646-adb5-db06e07a74fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:10.622787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4bf6585d-15c8-4f82-954f-51a3ffa51bfe req-e0c8f234-08d4-4373-a3f5-104fb2d1f3b5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.623620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4bf6585d-15c8-4f82-954f-51a3ffa51bfe req-e0c8f234-08d4-4373-a3f5-104fb2d1f3b5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.659206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4bf6585d-15c8-4f82-954f-51a3ffa51bfe req-e0c8f234-08d4-4373-a3f5-104fb2d1f3b5 service nova] Creating event network-vif-unplugged:190a02df-6d16-4646-adb5-db06e07a74fe for instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 on n-h2-master-1 Jul 24 01:14:10.671411 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4bf6585d-15c8-4f82-954f-51a3ffa51bfe req-e0c8f234-08d4-4373-a3f5-104fb2d1f3b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084005 Jul 24 01:14:10.672801 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 567/1279] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:10.679926 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:10.684369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:10.703018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.708449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:10.710406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:10.712675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.210109 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bbb68df9-e447-4ffa-9ba6-f85a0cc5fb3b tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a776fe24-e5b4-48a6-9270-b6ae6b3e9225" status: 202 len: 0 microversion: 2.1 time: 0.647198 Jul 24 01:14:11.210763 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 713/1280] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:10 2022] DELETE /compute/v2.1/os-security-groups/a776fe24-e5b4-48a6-9270-b6ae6b3e9225 => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:11.216613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:11.216815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.243875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.244357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.245151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.245598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.279362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:11.304259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:11.310664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:11.312691 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-29187a84-3c77-4d4c-91dc-41536b198bad tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1802 microversion: 2.32 time: 0.638470 Jul 24 01:14:11.318414 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 568/1281] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:10 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1802 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:11.331983 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b72b6671-3c4c-4567-813d-b170a88e8129 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf4ede81-64ec-401f-9019-d03471a84b82"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:11.333083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b72b6671-3c4c-4567-813d-b170a88e8129 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:11.348993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b72b6671-3c4c-4567-813d-b170a88e8129 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.349452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b72b6671-3c4c-4567-813d-b170a88e8129 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.350549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b72b6671-3c4c-4567-813d-b170a88e8129 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:11.358543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b72b6671-3c4c-4567-813d-b170a88e8129 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:11.398380 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:11.500271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c7e27c899648168625087b1653df68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec53a779c92c4620a832da29e583581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:11.512360 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0651151c-b2c0-4f6d-8320-4e6f2d316790 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 200 len: 1542 microversion: 2.1 time: 0.300097 Jul 24 01:14:11.515220 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 714/1282] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:11 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 1542 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:11.523780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-11dfb783-f0c5-41c6-b171-306825df105c tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05ead43940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:11.948797 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b72b6671-3c4c-4567-813d-b170a88e8129 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624321 Jul 24 01:14:11.949513 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 569/1283] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:14:11 2022] POST /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:11.987958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:11.993065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:12.022469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.034958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.037598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.041465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.667582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:12.680303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:12.687018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:12.687310 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-11dfb783-f0c5-41c6-b171-306825df105c tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/61037af4-99df-48b7-986d-2b629e946c5e" status: 202 len: 0 microversion: 2.1 time: 1.169435 Jul 24 01:14:12.687930 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 715/1284] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:11 2022] DELETE /compute/v2.1/os-security-groups/61037af4-99df-48b7-986d-2b629e946c5e => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:12.692502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:12.693473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:12.703265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3d06a80-6d5a-4968-95ca-cd54f0f483c9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.741760 Jul 24 01:14:12.704126 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 570/1285] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:11 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:12.710113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.712892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.714314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.715505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.851435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-380e4478-c42a-4797-a975-a072af1466f4 req-093279bb-8572-4203-9ac0-55bae4de3df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abc5a1-3a53-4246-ba5b-54c1449fb1c8", "name": "network-vif-deleted", "tag": "190a02df-6d16-4646-adb5-db06e07a74fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:12.866660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-380e4478-c42a-4797-a975-a072af1466f4 req-093279bb-8572-4203-9ac0-55bae4de3df3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.878468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-380e4478-c42a-4797-a975-a072af1466f4 req-093279bb-8572-4203-9ac0-55bae4de3df3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.891374 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-380e4478-c42a-4797-a975-a072af1466f4 req-093279bb-8572-4203-9ac0-55bae4de3df3 service nova] Creating event network-vif-deleted:190a02df-6d16-4646-adb5-db06e07a74fe for instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 on n-h2-master-1 Jul 24 01:14:12.906819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-380e4478-c42a-4797-a975-a072af1466f4 req-093279bb-8572-4203-9ac0-55bae4de3df3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201270 Jul 24 01:14:12.912179 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 571/1286] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:12.925204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:12.930856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:12.945890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.946784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:12.949260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:12.950127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.329625 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:13.570053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:13.594788 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:13.597952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:13.599204 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8941c60e-37c1-4916-a112-e57543b9433c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1802 microversion: 2.32 time: 0.685547 Jul 24 01:14:13.599786 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 572/1287] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:12 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1802 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:13.621972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:13.622591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] [instance: b4abc5a1-3a53-4246-ba5b-54c1449fb1c8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:13.644143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.644773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.645466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.645843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.653842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:13.663541 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-871358fe-65cf-4499-89e6-3387153eae2b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.974853 Jul 24 01:14:13.664135 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 716/1288] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:12 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:13.684080 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] HTTP exception thrown: Instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 could not be found. Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Request method failure captured: Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 HTTP/1.1 Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JyWmFaa3LJ5zztTI0CmbVIe2P8cOGJrwY60a2JFtkpHROff9Pf3Z5RKaygeVvIV6YHpL-mohyBAT8SwVG1arRLl9W-CvrTZdsvkbKUKPhjqTVgtCp3H1wyPvrdP-fp-xAbBbyh_3FTDpxz823Ww3XcNe9uPa5x2wC8pg2McFVI5R1k Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:13.685771 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec53a779c92c4620a832da29e583581b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec53a779c92c4620a832da29e583581b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec53a779c92c4620a832da29e583581b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: ec53a779c92c4620a832da29e583581b Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: c1c7e27c899648168625087b1653df68 Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 could not be found. Jul 24 01:14:13.687633 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b4abc5a1-3a53-4246-ba5b-54c1449fb1c8'} Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 could not be found. Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:13.688538 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 could not be found. Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 could not be found. Jul 24 01:14:13.689995 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:13.691078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] Returning 404 to user: Instance b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:13.691078 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-013980d7-5437-424a-8551-ac9beb5c97e5 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445 tempest-FloatingIPsAssociationNegativeTestJSON-1939756445-project] 10.222.0.27 "GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8" status: 404 len: 111 microversion: 2.1 time: 0.073130 Jul 24 01:14:13.691078 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 573/1289] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:13 2022] GET /compute/v2.1/servers/b4abc5a1-3a53-4246-ba5b-54c1449fb1c8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:13.693283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-222cbc82-ba38-4b89-a444-f7668cbf5e9a req-aa9eace8-891c-40e8-a85b-358e8d970f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940ffed3-aa7a-4f34-b7ff-36bf1f302095", "tag": "66e73105-afa5-41a2-834d-bf1ca582b139"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:13.695002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af7bd7f1-bc8d-442c-b904-768fec7f5a46 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05ead89940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:13.716276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-222cbc82-ba38-4b89-a444-f7668cbf5e9a req-aa9eace8-891c-40e8-a85b-358e8d970f22 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.717620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-222cbc82-ba38-4b89-a444-f7668cbf5e9a req-aa9eace8-891c-40e8-a85b-358e8d970f22 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.733003 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-222cbc82-ba38-4b89-a444-f7668cbf5e9a req-aa9eace8-891c-40e8-a85b-358e8d970f22 service nova] Creating event network-changed:66e73105-afa5-41a2-834d-bf1ca582b139 for instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 on n-h2-master-1 Jul 24 01:14:13.753871 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-222cbc82-ba38-4b89-a444-f7668cbf5e9a req-aa9eace8-891c-40e8-a85b-358e8d970f22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063812 Jul 24 01:14:13.755162 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 574/1290] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:13.763377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:13.766604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:13.782363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.783149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:13.791248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:13.793173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:14.374383 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af7bd7f1-bc8d-442c-b904-768fec7f5a46 tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1c04d4fa-1828-4f75-b32e-e9d60e06b4d2" status: 202 len: 0 microversion: 2.1 time: 0.686335 Jul 24 01:14:14.375162 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 717/1291] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:13 2022] DELETE /compute/v2.1/os-security-groups/1c04d4fa-1828-4f75-b32e-e9d60e06b4d2 => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:14.382900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6dfbb730-6b72-40c6-947e-13315313378e tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eae095e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:14.552875 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:14.578991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:14.596746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:14.601602 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:14.606612 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d70c29aa-134e-4b20-9589-fbf5ea60e543 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.849844 Jul 24 01:14:14.607049 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 575/1292] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:13 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:14.623925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:14.625239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:14.648888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.653203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:14.657143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:14.657961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.302328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:15.321479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:15.330127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:15.332381 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90e236f8-e441-4800-af87-e875459936d6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1849 microversion: 2.32 time: 0.716664 Jul 24 01:14:15.333501 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 576/1293] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:14 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1849 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:14:15.355511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:15.360133 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:15.398227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:15.402935 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.405952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:15.407076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:15.951260 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6dfbb730-6b72-40c6-947e-13315313378e tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3642a5be-9507-49f4-978f-d95024580627" status: 202 len: 0 microversion: 2.1 time: 1.571898 Jul 24 01:14:15.956343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 718/1294] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:14 2022] DELETE /compute/v2.1/os-security-groups/3642a5be-9507-49f4-978f-d95024580627 => generated 0 bytes in 1578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:15.966870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:15.968442 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:16.007718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.008579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.010798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.012644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.045308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:16.058806 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb3d7190-bb32-416c-9383-143a5b2cb95e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1718 microversion: 2.1 time: 0.716845 Jul 24 01:14:16.069882 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 577/1295] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:15 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1718 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:16.087118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a7e5184-1dbc-41a8-9143-8b6dbc49aafc tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] Calling method '.version_select at 0x7f05eb1583a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:16.607452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:16.640139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:16.643529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:16.649712 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ddd16d2c-d3bb-42b9-a829-b24eebec2b56 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.691588 Jul 24 01:14:16.653436 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 719/1296] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:15 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:16.665163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:16.671604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:16.688417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.692928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.696001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:16.696717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:16.888115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a7e5184-1dbc-41a8-9143-8b6dbc49aafc tempest-SecurityGroupRulesTestJSON-83527662 tempest-SecurityGroupRulesTestJSON-83527662-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/cac5cee7-8e71-47fe-9eba-92c89d6f9f67" status: 202 len: 0 microversion: 2.1 time: 0.816971 Jul 24 01:14:16.890661 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 578/1297] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:14:16 2022] DELETE /compute/v2.1/os-security-groups/cac5cee7-8e71-47fe-9eba-92c89d6f9f67 => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:17.077032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:17.078302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:17.092470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.101608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.102982 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.103786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.215240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:17.242386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:17.249804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:17.255344 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dd7c5157-ea5c-4f52-97b0-f0ab38b6c8d5 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1849 microversion: 2.32 time: 0.600399 Jul 24 01:14:17.258360 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 720/1298] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:16 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1849 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:17.367270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-774728401", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "cd42099c-1e94-41ff-a355-0f977567989d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:17.460727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] validate_networks() for [('cd42099c-1e94-41ff-a355-0f977567989d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:14:17.469489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:17.481316 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ae33de0-9869-4a6c-a347-850a4d25be37 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1708 microversion: 2.1 time: 0.408494 Jul 24 01:14:17.482831 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 579/1299] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:17 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1708 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:17.509217 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df6c78b9-993a-44dc-ab0a-a53475d39ac4 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '.version_select at 0x7f05eb1eb670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:17.512132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df6c78b9-993a-44dc-ab0a-a53475d39ac4 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.514467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df6c78b9-993a-44dc-ab0a-a53475d39ac4 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.557218 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-df6c78b9-993a-44dc-ab0a-a53475d39ac4 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.051216 Jul 24 01:14:17.558738 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 580/1300] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:14:17 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:17.574094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b691030-ef41-45be-95a4-d4891594f556 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:17.575365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b691030-ef41-45be-95a4-d4891594f556 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:17.589385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b691030-ef41-45be-95a4-d4891594f556 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.591902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b691030-ef41-45be-95a4-d4891594f556 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:17.596762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b691030-ef41-45be-95a4-d4891594f556 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:17.597242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b691030-ef41-45be-95a4-d4891594f556 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.473415 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b691030-ef41-45be-95a4-d4891594f556 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1859 microversion: 2.1 time: 0.906859 Jul 24 01:14:18.479656 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 581/1301] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:17 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1859 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:18.492827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:18.493465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:18.508385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.508853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.509658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.510140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.864383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:14:18.864929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:14:18.865266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:14:18.865690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:14:18.866108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:14:18.886100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.886554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.887407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:18.887866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:18.936952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Getting quotas for project eb233b56b3734747a1dc864cc7c84b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:18.949631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Getting quotas for user 1d9ddb861cc146cda7dea654bc742c80 and project eb233b56b3734747a1dc864cc7c84b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:18.957146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:18.971436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:18.975930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:18.980981 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-70c045f0-a3f5-42ef-a076-b3ef89f589ac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.500203 Jul 24 01:14:18.984685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:14:18.987109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:14:18.987529 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 582/1302] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:18 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:18.996764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:18.998752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:19.018707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:19.019658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:19.020986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:19.021877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:19.090638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f19b1ac6-54ae-417a-b325-3224c9c7335c tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830965 Jul 24 01:14:19.091294 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 721/1303] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:14:19.106783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eecf3fed-6921-45e3-b0b6-97f6f20fba98 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:19.107419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eecf3fed-6921-45e3-b0b6-97f6f20fba98 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:19.131369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eecf3fed-6921-45e3-b0b6-97f6f20fba98 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:19.132259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eecf3fed-6921-45e3-b0b6-97f6f20fba98 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:19.134243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eecf3fed-6921-45e3-b0b6-97f6f20fba98 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:19.134968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eecf3fed-6921-45e3-b0b6-97f6f20fba98 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:19.559600 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eecf3fed-6921-45e3-b0b6-97f6f20fba98 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1859 microversion: 2.1 time: 0.456566 Jul 24 01:14:19.563788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 722/1304] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:19 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1859 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:19.568940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba07884e-5fa1-438b-a52c-55657e140566 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:19.571689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba07884e-5fa1-438b-a52c-55657e140566 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:19.573862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:19.612386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:19.616296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:19.623200 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c2cdacc7-4f59-4bd5-9aa8-35e26b425df0 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1849 microversion: 2.32 time: 0.632115 Jul 24 01:14:19.627883 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 583/1305] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:18 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1849 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:19.631534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba07884e-5fa1-438b-a52c-55657e140566 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:19.642137 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba07884e-5fa1-438b-a52c-55657e140566 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1215 microversion: 2.1 time: 0.076728 Jul 24 01:14:19.643148 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 723/1306] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:19 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:20.002731 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:20.003433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:20.019998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.020680 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.022668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.024497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.403758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:20.417773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:20.419623 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:20.423567 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb9b7cfb-d262-47af-9d96-48640670de34 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.426865 Jul 24 01:14:20.427526 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 584/1307] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:19 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:20.645781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:20.646607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:20.660736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:20.662317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:20.669221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.683616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.684964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.686123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.687438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.688157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:20.690035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:20.692688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:21.086001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:21.098511 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61afd6f5-fe44-4dcc-bc44-87dbd9eb5be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1267 microversion: 2.1 time: 0.441609 Jul 24 01:14:21.099245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 585/1308] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:20 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1267 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:21.242953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:21.268125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:21.271096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:21.274189 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14769e08-9e91-4e02-a255-c392618c2e82 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1849 microversion: 2.32 time: 0.633967 Jul 24 01:14:21.277297 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 724/1309] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:20 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1849 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:21.353647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e7fe2af4-eb9f-4a49-a3e1-d76b73af3a9f req-21519157-f3e5-4262-80ba-faf3e91b0bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "a6840e15-03ea-4322-b29f-77952f504989"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:21.370813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e7fe2af4-eb9f-4a49-a3e1-d76b73af3a9f req-21519157-f3e5-4262-80ba-faf3e91b0bcc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:21.371178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e7fe2af4-eb9f-4a49-a3e1-d76b73af3a9f req-21519157-f3e5-4262-80ba-faf3e91b0bcc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:21.398195 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7fe2af4-eb9f-4a49-a3e1-d76b73af3a9f req-21519157-f3e5-4262-80ba-faf3e91b0bcc service nova] Creating event network-changed:a6840e15-03ea-4322-b29f-77952f504989 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:14:21.430598 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e7fe2af4-eb9f-4a49-a3e1-d76b73af3a9f req-21519157-f3e5-4262-80ba-faf3e91b0bcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069479 Jul 24 01:14:21.438234 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 586/1310] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:14:21.444300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:21.445051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:21.476585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:21.476585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:21.496776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:21.504267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.096172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.112226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.116929 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:22.117646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:22.125623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:22.129962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.130249 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.131942 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dd45e1d-ea7d-49bd-986b-a3c60ee5edb4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.692075 Jul 24 01:14:22.143602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:22.143602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.144730 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 725/1311] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:21 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:22.297113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:22.298070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:22.312671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:22.313426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.318934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:22.319599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.376609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.395813 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-674f68c9-e1d8-40bb-819c-bc662a0597c3 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1273 microversion: 2.1 time: 0.282967 Jul 24 01:14:22.396422 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 587/1312] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:22 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:14:22.675328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2ab5daef-938b-4184-b955-a9d6b01a534d req-5cdca6ee-beec-4278-b288-4b05ec2473ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ffed3-aa7a-4f34-b7ff-36bf1f302095", "name": "network-vif-plugged", "status": "completed", "tag": "66e73105-afa5-41a2-834d-bf1ca582b139"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:22.690031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2ab5daef-938b-4184-b955-a9d6b01a534d req-5cdca6ee-beec-4278-b288-4b05ec2473ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:22.690487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2ab5daef-938b-4184-b955-a9d6b01a534d req-5cdca6ee-beec-4278-b288-4b05ec2473ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:22.721058 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2ab5daef-938b-4184-b955-a9d6b01a534d req-5cdca6ee-beec-4278-b288-4b05ec2473ad service nova] Creating event network-vif-plugged:66e73105-afa5-41a2-834d-bf1ca582b139 for instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 on n-h2-master-1 Jul 24 01:14:22.733313 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2ab5daef-938b-4184-b955-a9d6b01a534d req-5cdca6ee-beec-4278-b288-4b05ec2473ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060760 Jul 24 01:14:22.736760 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 588/1313] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:14:22.919580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.941021 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.947250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:22.953957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5414ec2a-138c-48d8-8ed6-334e24fc8786 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1849 microversion: 2.32 time: 0.659704 Jul 24 01:14:22.956087 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 726/1314] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:22 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1849 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:14:23.151579 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:23.152292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:23.186840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:23.187653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:23.188927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:23.189575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:23.419073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:23.419823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:23.426243 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:23.439805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:23.441401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:23.445836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:23.446478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:23.764801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:23.787712 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8f4bf15-ddc5-4996-8259-671b7e799739 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1273 microversion: 2.1 time: 0.368991 Jul 24 01:14:23.788465 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 727/1315] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:23 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:23.864393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:23.870857 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:23.879993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:23.881528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:23.882706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e1b7820-80c7-4f7f-a473-9f0c02823c8f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1361 microversion: 2.25 time: 0.735575 Jul 24 01:14:23.890155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 589/1316] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:23 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1361 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:23.978758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:23.979839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:23.998921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.002270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:24.005471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.006290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:24.630949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:24.642581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:24.651076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:24.656043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d61aace3-75eb-45d5-8c95-ad109b91d03a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1849 microversion: 2.32 time: 0.682167 Jul 24 01:14:24.676927 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 728/1317] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:23 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1849 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:24.806154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:24.807403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:24.828008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.844024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:24.845206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.845902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:24.904268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:24.905884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:24.915840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.923658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:24.927410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:24.930314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:25.512489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:25.527685 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac50d62a-46d2-4e0c-9862-8cae120a18cf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 0.721326 Jul 24 01:14:25.541565 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 590/1318] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:24 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:25.559481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:25.574779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:25.577987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:25.582429 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac0b4cfd-c1bc-41e8-a61c-24815fbef9e3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1558 microversion: 2.25 time: 0.681995 Jul 24 01:14:25.586377 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 729/1319] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:24 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1558 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:25.665007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e87b8ece-9749-4a23-b7e8-2eddb037c0e0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Calling method '.version_select at 0x7f05eb137820>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:25.723638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:25.727401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:25.747697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:25.748946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:25.750654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:25.754617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:25.824280 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e87b8ece-9749-4a23-b7e8-2eddb037c0e0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.281227 Jul 24 01:14:25.825500 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 591/1320] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:14:25 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:14:25.831825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:25.831825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:25.862270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:25.865198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:25.866168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:25.869402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:26.637962 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:26.642235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 940ffed3-aa7a-4f34-b7ff-36bf1f302095 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:14:26.680293 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d1af6adb-f965-4e03-b05d-a9e711957b6a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 2050 microversion: 2.25 time: 1.075871 Jul 24 01:14:26.681129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 730/1321] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:25 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 2050 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:26.693161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43cd4569-738c-4202-b68c-97e4a7c7f657 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Action: 'create', calling method: .version_select at 0x7f05eadbd670>, body: {"pool": "non_exist_pool"} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:26.773824 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-43cd4569-738c-4202-b68c-97e4a7c7f657 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] HTTP exception thrown: Floating IP pool not found. Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43cd4569-738c-4202-b68c-97e4a7c7f657 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Request method failure captured: Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 26 Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JzwXMeDj8bbIKcohsla8mboK8GwSxAxbRTODRX4EY3BgZlGmQhZg3RA041tsMTn4DG3_BIXo77G1gNWQJZM8MR66FSw1TOwMzKk-Z3koBINSeQGLwALn4oMbtqs-lLmSJ149AFRp5jKEWVJrE6xud_YiCxTL4G-LnfSOV4Kn1YRv6U Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8108854e56ae4763adc8b92e20fea723 Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1013057161 Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:26.775300 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8108854e56ae4763adc8b92e20fea723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8108854e56ae4763adc8b92e20fea723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8108854e56ae4763adc8b92e20fea723", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8108854e56ae4763adc8b92e20fea723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1013057161 Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8108854e56ae4763adc8b92e20fea723 Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1013057161 Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsNegativeTestJSON-1013057161-project Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d3ff3f6412d44e84b697d6baf677f8a3 Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1013057161-project Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: {"pool": "non_exist_pool"} Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: exception: Floating IP pool not found. Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 24 01:14:26.776822 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:26.777827 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43cd4569-738c-4202-b68c-97e4a7c7f657 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Returning 404 to user: Floating IP pool not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:26.779114 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43cd4569-738c-4202-b68c-97e4a7c7f657 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.094614 Jul 24 01:14:26.780747 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 731/1322] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:14:26 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:14:26.784850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8af6fb48-bbe0-458a-bc69-691952e6361d req-1068ac15-0ba9-42da-a9a6-513519449ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "198efcd9-809d-4f5a-8feb-85171ce21b72"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:26.829021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8af6fb48-bbe0-458a-bc69-691952e6361d req-1068ac15-0ba9-42da-a9a6-513519449ac7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:26.829498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8af6fb48-bbe0-458a-bc69-691952e6361d req-1068ac15-0ba9-42da-a9a6-513519449ac7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:26.877319 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8af6fb48-bbe0-458a-bc69-691952e6361d req-1068ac15-0ba9-42da-a9a6-513519449ac7 service nova] Creating event network-changed:198efcd9-809d-4f5a-8feb-85171ce21b72 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:14:26.891981 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8af6fb48-bbe0-458a-bc69-691952e6361d req-1068ac15-0ba9-42da-a9a6-513519449ac7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111599 Jul 24 01:14:26.901072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 732/1323] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:26.914590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:26.915953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:26.943719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:26.944467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:26.951692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:26.954769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:27.315154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:27.334047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:27.335847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:27.344060 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5dc7409a-90a7-40c3-9d3f-91d523077350 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1870 microversion: 2.32 time: 1.510416 Jul 24 01:14:27.346147 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 592/1324] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:25 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1870 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:27.359785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:27.368291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:27.394710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:27.395165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:27.395954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:27.396385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:27.402400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lazy-loading 'services' on Instance uuid 38c4c870-8606-4888-81ee-c2a835a28957 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:14:27.630815 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ccee428a-97de-463e-b3a7-525408638e5d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments/847a3035-bdaa-476f-a97f-0d6350cb6c26" status: 202 len: 0 microversion: 2.1 time: 0.727533 Jul 24 01:14:27.631649 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 733/1325] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:14:26 2022] DELETE /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments/847a3035-bdaa-476f-a97f-0d6350cb6c26 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:14:27.651116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:27.652431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:27.693809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:27.694752 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:27.698028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:27.699599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.279162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 940ffed3-aa7a-4f34-b7ff-36bf1f302095 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:14:28.315993 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-803639fd-94ec-4333-ac69-d67f459877db tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 2050 microversion: 2.25 time: 0.683034 Jul 24 01:14:28.323740 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 734/1326] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:27 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 2050 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:28.331375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-461312e2-b711-4e05-9b70-d55fd72422b0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Calling method '.version_select at 0x7f05ead89c10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:28.463012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:28.476453 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ebd72fab-eb09-483f-a174-a5bad604506a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 1.127691 Jul 24 01:14:28.477268 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 593/1327] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:27 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:28.494732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1edf477e-077d-456d-9ce4-3f4a8350271e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:28.515823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1edf477e-077d-456d-9ce4-3f4a8350271e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:28.570225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1edf477e-077d-456d-9ce4-3f4a8350271e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.570943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1edf477e-077d-456d-9ce4-3f4a8350271e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.572181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1edf477e-077d-456d-9ce4-3f4a8350271e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.574846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1edf477e-077d-456d-9ce4-3f4a8350271e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.655442 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1edf477e-077d-456d-9ce4-3f4a8350271e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163784 Jul 24 01:14:28.656816 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 594/1328] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:14:28 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:28.661775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74edb503-a837-4489-baf0-29634abe7bd7 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:28.674911 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:14:28.674911 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:14:28.676917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74edb503-a837-4489-baf0-29634abe7bd7 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.677765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74edb503-a837-4489-baf0-29634abe7bd7 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.678817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74edb503-a837-4489-baf0-29634abe7bd7 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.679469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74edb503-a837-4489-baf0-29634abe7bd7 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.716077 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:28.728608 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-74edb503-a837-4489-baf0-29634abe7bd7 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.070431 Jul 24 01:14:28.741590 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 595/1329] 10.222.0.27 () {60 vars in 1216 bytes} [Sun Jul 24 01:14:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:14:28.747063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:28.748094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:28.755209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.756060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.757025 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-461312e2-b711-4e05-9b70-d55fd72422b0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9c753c44-866d-4e44-a85d-e9949642b254 could not be found", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:14:28.757769 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-461312e2-b711-4e05-9b70-d55fd72422b0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] HTTP exception thrown: Floating IP not found for ID 9c753c44-866d-4e44-a85d-e9949642b254 Jul 24 01:14:28.758190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.758844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-461312e2-b711-4e05-9b70-d55fd72422b0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Request method failure captured: Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-floating-ips/9c753c44-866d-4e44-a85d-e9949642b254 HTTP/1.1 Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JzwXMeDj8bbIKcohsla8mboK8GwSxAxbRTODRX4EY3BgZlGmQhZg3RA041tsMTn4DG3_BIXo77G1gNWQJZM8MR66FSw1TOwMzKk-Z3koBINSeQGLwALn4oMbtqs-lLmSJ149AFRp5jKEWVJrE6xud_YiCxTL4G-LnfSOV4Kn1YRv6U Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8108854e56ae4763adc8b92e20fea723 Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1013057161 Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:28.759778 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8108854e56ae4763adc8b92e20fea723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8108854e56ae4763adc8b92e20fea723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8108854e56ae4763adc8b92e20fea723", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8108854e56ae4763adc8b92e20fea723"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1013057161 Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8108854e56ae4763adc8b92e20fea723 Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1013057161 Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsNegativeTestJSON-1013057161-project Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d3ff3f6412d44e84b697d6baf677f8a3 Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1013057161-project Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: exception: Floating IP not found for ID 9c753c44-866d-4e44-a85d-e9949642b254 Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '9c753c44-866d-4e44-a85d-e9949642b254'} Jul 24 01:14:28.761096 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:14:28.762036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9c753c44-866d-4e44-a85d-e9949642b254 could not be found Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c980dd5c-10f3-4bdc-a855-ab71db0cd78c'] Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9c753c44-866d-4e44-a85d-e9949642b254. Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:28.763202 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9c753c44-866d-4e44-a85d-e9949642b254 Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:28.764732 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:28.767166 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9c753c44-866d-4e44-a85d-e9949642b254 Jul 24 01:14:28.767166 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:28.767166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-461312e2-b711-4e05-9b70-d55fd72422b0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] Returning 404 to user: Floating IP not found for ID 9c753c44-866d-4e44-a85d-e9949642b254 {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:28.767166 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-461312e2-b711-4e05-9b70-d55fd72422b0 tempest-FloatingIPsNegativeTestJSON-1013057161 tempest-FloatingIPsNegativeTestJSON-1013057161-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/9c753c44-866d-4e44-a85d-e9949642b254" status: 404 len: 111 microversion: 2.1 time: 0.433703 Jul 24 01:14:28.767166 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 735/1330] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:14:28 2022] DELETE /compute/v2.1/os-floating-ips/9c753c44-866d-4e44-a85d-e9949642b254 => generated 111 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:28.772117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:28.773301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:28.809467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.809952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.810950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:28.811397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:28.900309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'flavor' on Instance uuid 940ffed3-aa7a-4f34-b7ff-36bf1f302095 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:14:28.917060 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:28.922407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Going to try to live migrate instance to n-h1-master-1 {{(pid=119561) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:14:29.641117 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:30.766468 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:30.786025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:30.790828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:30.792959 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9f3345a1-67dd-4bc8-a47a-b4d5b7a2d4b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1891 microversion: 2.32 time: 2.049317 Jul 24 01:14:30.808269 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 596/1331] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:28 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1891 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:30.814499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-37adfb21-9efd-4aae-8e5d-c1a3d277f7b1 req-1fccc248-4855-4320-928b-49ae2d112421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "81ce7c7d-8b64-42e8-a880-98a660147477"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:30.837376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-37adfb21-9efd-4aae-8e5d-c1a3d277f7b1 req-1fccc248-4855-4320-928b-49ae2d112421 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:30.839922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-37adfb21-9efd-4aae-8e5d-c1a3d277f7b1 req-1fccc248-4855-4320-928b-49ae2d112421 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:30.870087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-37adfb21-9efd-4aae-8e5d-c1a3d277f7b1 req-1fccc248-4855-4320-928b-49ae2d112421 service nova] Creating event network-changed:81ce7c7d-8b64-42e8-a880-98a660147477 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:14:30.883189 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-37adfb21-9efd-4aae-8e5d-c1a3d277f7b1 req-1fccc248-4855-4320-928b-49ae2d112421 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073361 Jul 24 01:14:30.884510 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 597/1332] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:30.899568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:30.908483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:30.917302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:30.925650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:30.930422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:30.935669 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:32.805338 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d52683fa-fa61-4880-b185-e6110b42a15e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095/action" status: 202 len: 0 microversion: 2.25 time: 4.041924 Jul 24 01:14:32.809012 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 736/1333] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:14:28 2022] POST /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095/action => generated 0 bytes in 4044 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:14:32.813932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-bcac22ef-7874-472d-ade8-57827f8fa464 req-d58483e4-b70e-44ef-bab4-897f69acdd71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b03b1da-6e6e-4724-bee5-bb323362d5b6", "tag": "0fe55644-bf16-42d2-bebf-3d1bbaba69ba"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:32.891021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bcac22ef-7874-472d-ade8-57827f8fa464 req-d58483e4-b70e-44ef-bab4-897f69acdd71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:32.891508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bcac22ef-7874-472d-ade8-57827f8fa464 req-d58483e4-b70e-44ef-bab4-897f69acdd71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:32.900673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:32.911068 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3abe7d68-edcc-4a1e-85f5-96b4bfcb512f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 2.025224 Jul 24 01:14:32.918021 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 598/1334] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:30 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:32.928993 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-bcac22ef-7874-472d-ade8-57827f8fa464 req-d58483e4-b70e-44ef-bab4-897f69acdd71 service nova] Creating event network-changed:0fe55644-bf16-42d2-bebf-3d1bbaba69ba for instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 on n-h2-master-1 Jul 24 01:14:32.937267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-962d0389-f138-48cc-84a9-f61b5d33ed5c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:32.942927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-bcac22ef-7874-472d-ade8-57827f8fa464 req-d58483e4-b70e-44ef-bab4-897f69acdd71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134413 Jul 24 01:14:32.943139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-962d0389-f138-48cc-84a9-f61b5d33ed5c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:32.945462 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 737/1335] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:32.974881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-962d0389-f138-48cc-84a9-f61b5d33ed5c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:32.975612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-962d0389-f138-48cc-84a9-f61b5d33ed5c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:32.983725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-962d0389-f138-48cc-84a9-f61b5d33ed5c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:32.984518 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-962d0389-f138-48cc-84a9-f61b5d33ed5c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:32.987865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:32.990593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:33.021178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.033241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.034249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.034555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.123453 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-962d0389-f138-48cc-84a9-f61b5d33ed5c tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203672 Jul 24 01:14:33.134455 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 599/1336] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:14:32 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:33.142242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:33.145354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:33.162186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.162980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.164389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.165035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.219047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:14:33.342520 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09dfc799-817d-40e0-b5bd-2a14bc1c0acb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 204 len: 0 microversion: 2.1 time: 0.205300 Jul 24 01:14:33.343618 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 600/1337] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:14:33 2022] DELETE /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:14:33.351997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:33.352839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:33.361912 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.362980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.364382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:33.364941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:33.967375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:33.989118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:33.990910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:33.992327 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e5e4ac47-bea2-4aab-a56c-742ba02f1906 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.045339 Jul 24 01:14:34.004969 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 738/1338] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:32 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:34.011303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e0c4eb44-73ba-4530-927d-0e299bd88773 req-d8f60985-6f51-43a0-8cf7-81a5a282a186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "7049bd24-a30d-473a-9ed1-ed88450f1b75"}, {"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "46b2e1a2-faec-4cdb-bff2-afbecdb5159d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:34.021326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e0c4eb44-73ba-4530-927d-0e299bd88773 req-d8f60985-6f51-43a0-8cf7-81a5a282a186 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.022570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e0c4eb44-73ba-4530-927d-0e299bd88773 req-d8f60985-6f51-43a0-8cf7-81a5a282a186 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.037387 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e0c4eb44-73ba-4530-927d-0e299bd88773 req-d8f60985-6f51-43a0-8cf7-81a5a282a186 service nova] Creating event network-changed:7049bd24-a30d-473a-9ed1-ed88450f1b75 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:14:34.038384 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e0c4eb44-73ba-4530-927d-0e299bd88773 req-d8f60985-6f51-43a0-8cf7-81a5a282a186 service nova] Creating event network-changed:46b2e1a2-faec-4cdb-bff2-afbecdb5159d for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:14:34.044066 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e0c4eb44-73ba-4530-927d-0e299bd88773 req-d8f60985-6f51-43a0-8cf7-81a5a282a186 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037254 Jul 24 01:14:34.045335 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 739/1339] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:34.050307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:34.053793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:34.055138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:34.063457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:34.065199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.067529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:34.068832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5a2a0c11-8908-4aee-8236-9a04cdeb4dbd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.723892 Jul 24 01:14:34.069601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.071312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.072032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.084805 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 601/1340] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:33 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:34.089792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:34.090308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:34.112188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.112638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.113611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.117116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.502906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:34.515318 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-200e0f9b-e4f2-4f8e-b1ae-40670e576781 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 0.429333 Jul 24 01:14:34.516140 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 602/1341] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:34 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:34.529866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1abeec08-7864-4748-a755-d3b889de3a28 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:34.531118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1abeec08-7864-4748-a755-d3b889de3a28 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:34.537993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1abeec08-7864-4748-a755-d3b889de3a28 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.538720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1abeec08-7864-4748-a755-d3b889de3a28 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.539666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1abeec08-7864-4748-a755-d3b889de3a28 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:34.540268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1abeec08-7864-4748-a755-d3b889de3a28 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:34.582160 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1abeec08-7864-4748-a755-d3b889de3a28 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064591 Jul 24 01:14:34.583354 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 603/1342] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:14:34 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:34.772753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:34.790319 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7803a19d-f48a-4d2f-a87b-6122a7885b24 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1555 microversion: 2.1 time: 0.743013 Jul 24 01:14:34.800784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 740/1343] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:34 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1555 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:35.012402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:35.014461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:35.033843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:35.034765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:35.035848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:35.036487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:35.094320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:35.095982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:35.114226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:35.118809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:35.120066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:35.120853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.056545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.075507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.080150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.085820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.087360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9beef17e-c7cc-4bf1-b46a-7ae3a8f5bbe1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.079518 Jul 24 01:14:36.088934 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 604/1344] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:35 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:36.104672 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.106256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:36.108210 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-054ce07a-56fb-4c4d-8168-a3e79f0ca186 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 1.018825 Jul 24 01:14:36.112749 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 741/1345] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:35 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:36.117976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-090b42c7-220f-40c3-9e26-e4f86cdc3f91 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:36.124117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-090b42c7-220f-40c3-9e26-e4f86cdc3f91 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:36.127150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:36.130295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:36.141638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090b42c7-220f-40c3-9e26-e4f86cdc3f91 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.142544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090b42c7-220f-40c3-9e26-e4f86cdc3f91 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.143535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090b42c7-220f-40c3-9e26-e4f86cdc3f91 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.144150 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090b42c7-220f-40c3-9e26-e4f86cdc3f91 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.146658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.147349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.148499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.149102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.230841 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-090b42c7-220f-40c3-9e26-e4f86cdc3f91 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116774 Jul 24 01:14:36.232202 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 742/1346] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:14:36 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:36.237393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:36.248336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:36.256356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.266950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.268232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:36.268862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:36.999655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:37.018222 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b837986-5253-4273-b64d-df31044979bf tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 0.915385 Jul 24 01:14:37.019972 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 605/1347] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:36 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:37.035516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-49d5a401-94c9-4c7f-a31d-d9472c3f20f5 req-264f0af2-00c2-42b1-89ea-535285ef4cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "8ba56271-68b3-4ab7-af7d-56a02d80b307"}, {"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "58bea69b-6e2f-4382-9914-db1f74f63054"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:37.105526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-49d5a401-94c9-4c7f-a31d-d9472c3f20f5 req-264f0af2-00c2-42b1-89ea-535285ef4cca service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.110668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-49d5a401-94c9-4c7f-a31d-d9472c3f20f5 req-264f0af2-00c2-42b1-89ea-535285ef4cca service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.128779 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-49d5a401-94c9-4c7f-a31d-d9472c3f20f5 req-264f0af2-00c2-42b1-89ea-535285ef4cca service nova] Creating event network-changed:8ba56271-68b3-4ab7-af7d-56a02d80b307 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:14:37.129403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-49d5a401-94c9-4c7f-a31d-d9472c3f20f5 req-264f0af2-00c2-42b1-89ea-535285ef4cca service nova] Creating event network-changed:58bea69b-6e2f-4382-9914-db1f74f63054 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:14:37.136282 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-49d5a401-94c9-4c7f-a31d-d9472c3f20f5 req-264f0af2-00c2-42b1-89ea-535285ef4cca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.114198 Jul 24 01:14:37.137322 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 606/1348] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:37.144728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:37.144867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:37.147571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:37.161909 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-50f13f54-c771-453b-abd9-9337003057b9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1555 microversion: 2.1 time: 0.928177 Jul 24 01:14:37.164121 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 743/1349] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:36 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1555 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:37.177551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.178471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.179245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:37.179770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.179891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:37.181299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.211086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.211504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:37.219316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:37.221871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.030807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.036617 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:38.042189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.047778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.050804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.052757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8374c01d-1310-4dcc-b0d8-03b9bbeabeb3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 0.913417 Jul 24 01:14:38.060864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.062743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.064142 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3b52306c-d6d3-49f1-8ff7-baae4a7b1e23 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.898890 Jul 24 01:14:38.067128 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 607/1350] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:37 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:38.075337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d5e51e7-cec4-41bb-95d4-88df96d5962a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:38.077213 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 744/1351] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:37 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:38.077883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d5e51e7-cec4-41bb-95d4-88df96d5962a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:38.083473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:38.084196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:38.089426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d5e51e7-cec4-41bb-95d4-88df96d5962a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.090237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d5e51e7-cec4-41bb-95d4-88df96d5962a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.091482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.091862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d5e51e7-cec4-41bb-95d4-88df96d5962a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.092999 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d5e51e7-cec4-41bb-95d4-88df96d5962a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.093131 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.094134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.094861 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.152212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d5e51e7-cec4-41bb-95d4-88df96d5962a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083177 Jul 24 01:14:38.153252 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 608/1352] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:14:38 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:14:38.181367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:38.182082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:38.190282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.191014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.192004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.192614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.693935 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:38.856817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:38.870439 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d0e5e7d5-5f00-4d61-93f4-3396b1115395 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1346 microversion: 2.1 time: 0.692481 Jul 24 01:14:38.871312 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 609/1353] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:38 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1346 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:38.880577 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f7cab4db-d8f5-4ff5-bb77-e9219d8c0768 req-5b07dd0a-5052-4add-a710-d816cf05f10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fc9a91-b438-478b-89bf-c5b70e390fd7", "name": "network-vif-deleted", "tag": "61bcc3f2-0186-480b-9ea3-ef733d7ec2c3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:38.906096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f7cab4db-d8f5-4ff5-bb77-e9219d8c0768 req-5b07dd0a-5052-4add-a710-d816cf05f10b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:38.906554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f7cab4db-d8f5-4ff5-bb77-e9219d8c0768 req-5b07dd0a-5052-4add-a710-d816cf05f10b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:38.941624 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f7cab4db-d8f5-4ff5-bb77-e9219d8c0768 req-5b07dd0a-5052-4add-a710-d816cf05f10b service nova] Creating event network-vif-deleted:61bcc3f2-0186-480b-9ea3-ef733d7ec2c3 for instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 on n-h1-master-1 Jul 24 01:14:38.959135 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f7cab4db-d8f5-4ff5-bb77-e9219d8c0768 req-5b07dd0a-5052-4add-a710-d816cf05f10b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081431 Jul 24 01:14:38.960938 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 610/1354] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:39.081994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:39.082917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:39.103060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.105046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:39.106086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.106694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:39.611084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:39.629314 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7a217e0-44f3-48d9-bf8e-69c3cee16545 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 1.548357 Jul 24 01:14:39.633010 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 745/1355] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:38 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:39.661653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:39.678425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:39.685828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.686597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:39.693448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:39.694195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.659289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:40.668615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:40.676394 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:40.678106 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b7eeec9-2bfa-4833-8ab4-13b29342167c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.602139 Jul 24 01:14:40.679313 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 611/1356] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:39 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:40.684119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:40.688802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:40.716792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.717256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:40.717940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.730820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.731388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.756153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:40.771730 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:40.777654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e42041c-4eb6-419d-86cd-b361f96a2b54 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 1.129254 Jul 24 01:14:40.779353 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 746/1357] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:39 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:40.785695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:40.794699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:40.802285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.819154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:40.821135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:40.821978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.006768 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:41.017718 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ff55208-d9a9-4be9-a2f1-2e22c63682c4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1346 microversion: 2.1 time: 0.337041 Jul 24 01:14:41.034774 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 612/1358] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:40 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1346 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:41.672338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:41.683085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c1f2175f-01c2-4430-abe3-f40679f88a09 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 0.902171 Jul 24 01:14:41.686669 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 747/1359] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:40 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:41.702623 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:41.703358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:41.723763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.725351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.726877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.732773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.735111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3443fd05-31f7-443a-bef5-ba61c831826f req-df626f1e-cfd0-4007-9e3e-b0df5887e636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ffed3-aa7a-4f34-b7ff-36bf1f302095", "name": "network-vif-unplugged", "status": "completed", "tag": "66e73105-afa5-41a2-834d-bf1ca582b139"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:41.750373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3443fd05-31f7-443a-bef5-ba61c831826f req-df626f1e-cfd0-4007-9e3e-b0df5887e636 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.753730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3443fd05-31f7-443a-bef5-ba61c831826f req-df626f1e-cfd0-4007-9e3e-b0df5887e636 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.766371 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:41.791534 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3443fd05-31f7-443a-bef5-ba61c831826f req-df626f1e-cfd0-4007-9e3e-b0df5887e636 service nova] Creating event network-vif-unplugged:66e73105-afa5-41a2-834d-bf1ca582b139 for instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 on n-h2-master-1 Jul 24 01:14:41.806678 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3443fd05-31f7-443a-bef5-ba61c831826f req-df626f1e-cfd0-4007-9e3e-b0df5887e636 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077008 Jul 24 01:14:41.814017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 748/1360] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:14:41.825292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:41.827171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:41.847556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.848401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:41.851017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:41.853168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:42.978798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:42.992377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:42.999198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:43.008475 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c24bac7-0263-499c-8798-ee6ab04e5610 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 1.187970 Jul 24 01:14:43.010097 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 749/1361] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:41 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:43.021437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:43.022464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:43.035775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.038589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.041778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.042725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.048956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:43.063960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:43.071825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:43.077579 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dff72292-7316-4693-bf52-2d1bd78b3a1c tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.379478 Jul 24 01:14:43.079138 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 613/1362] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:41 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:43.087909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:43.088890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:43.113336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.125744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.134826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.135552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.246701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:43.257220 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e1857bf2-9e1b-4239-a2b1-8f2a6bf7c29a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1346 microversion: 2.1 time: 0.245750 Jul 24 01:14:43.260947 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 750/1363] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:43 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1346 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:43.719724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a0a9c878-6219-4f79-845a-789448d74c1f req-ba961ba5-28a4-496c-81f9-7905c7ed35eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b03b1da-6e6e-4724-bee5-bb323362d5b6", "name": "network-vif-plugged", "status": "completed", "tag": "0fe55644-bf16-42d2-bebf-3d1bbaba69ba"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:43.738888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a0a9c878-6219-4f79-845a-789448d74c1f req-ba961ba5-28a4-496c-81f9-7905c7ed35eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.739343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a0a9c878-6219-4f79-845a-789448d74c1f req-ba961ba5-28a4-496c-81f9-7905c7ed35eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.776269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a0a9c878-6219-4f79-845a-789448d74c1f req-ba961ba5-28a4-496c-81f9-7905c7ed35eb service nova] Creating event network-vif-plugged:0fe55644-bf16-42d2-bebf-3d1bbaba69ba for instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 on n-h2-master-1 Jul 24 01:14:43.793213 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a0a9c878-6219-4f79-845a-789448d74c1f req-ba961ba5-28a4-496c-81f9-7905c7ed35eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081629 Jul 24 01:14:43.806323 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 751/1364] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:14:43.943965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9f0b1861-9b5a-4402-8238-edeaccc6148e req-edd9d759-58fb-4782-b296-d05dfbfe89b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940ffed3-aa7a-4f34-b7ff-36bf1f302095", "tag": "66e73105-afa5-41a2-834d-bf1ca582b139"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:43.959687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f0b1861-9b5a-4402-8238-edeaccc6148e req-edd9d759-58fb-4782-b296-d05dfbfe89b4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:43.963444 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f0b1861-9b5a-4402-8238-edeaccc6148e req-edd9d759-58fb-4782-b296-d05dfbfe89b4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:43.991248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9f0b1861-9b5a-4402-8238-edeaccc6148e req-edd9d759-58fb-4782-b296-d05dfbfe89b4 service nova] Creating event network-changed:66e73105-afa5-41a2-834d-bf1ca582b139 for instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 on n-h2-master-1 Jul 24 01:14:44.008203 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9f0b1861-9b5a-4402-8238-edeaccc6148e req-edd9d759-58fb-4782-b296-d05dfbfe89b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070971 Jul 24 01:14:44.014070 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 752/1365] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:44.029979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:44.030716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:44.048151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.048619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:44.049421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.055899 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:44.151050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:44.176743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-29cd6058-1e24-4677-b8d3-d254c634a717 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 1.091593 Jul 24 01:14:44.179154 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 614/1366] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:43 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:44.198909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:44.199532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:44.217620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.221461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:44.222869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:44.223475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:44.907991 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:44.920794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:44.932017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:44.974882 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c7c6af8-ccf0-4f83-948d-7376159187ab tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.950382 Jul 24 01:14:44.981620 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 753/1367] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:44 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:14:45.014792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:45.015654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:45.057117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:45.057817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:45.067184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:45.068448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:45.322740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:45.342083 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f650cbd-8488-40c0-936e-6229f9c7c5dc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1346 microversion: 2.1 time: 0.348440 Jul 24 01:14:45.343121 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 754/1368] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:44 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1346 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:45.373042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:45.376037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:45.402576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:45.414989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:45.417439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:45.420654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:45.425641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:45.426386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:45.437643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:45.447716 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-84688d52-1537-4894-8109-e5af8528755d tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.260199 Jul 24 01:14:45.455264 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 615/1369] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:44 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:45.757923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:45.774015 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e73e0e42-fb37-4e4a-bf4a-d8e857702d0f tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1315 microversion: 2.1 time: 0.429510 Jul 24 01:14:45.794671 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 755/1370] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:45 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:46.003956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:46.004744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:46.023650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.025964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.029251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.035238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.306160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:46.318233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:46.320141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:46.322148 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4fae0e8a-5ba5-44f3-9a90-b81491ce4091 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.325012 Jul 24 01:14:46.323745 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 616/1371] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:45 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:46.359358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:46.359990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:46.378307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.378682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.379488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.379930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.469167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:46.469880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:46.479328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.484699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.492268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.495379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.614342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:46.640556 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ee493bd-2bfc-42b2-a87d-38fe03519e50 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1346 microversion: 2.1 time: 0.283714 Jul 24 01:14:46.643495 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 756/1372] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:46 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1346 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:46.792211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:46.793449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:46.808912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.809654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:46.832178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:46.832931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.223081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:47.258789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:47.266617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:47.267879 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-332417f4-4327-4f7d-ae41-b1822a96d478 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 0.802841 Jul 24 01:14:47.288948 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 617/1373] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:46 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:47.343196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:47.343779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:47.371609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.372341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.373877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.379467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.396768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:47.412338 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-441ffbd8-1f4b-4ec4-acd6-6f75ee95e5ca tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1502 microversion: 2.1 time: 0.625094 Jul 24 01:14:47.427352 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 757/1374] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:46 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1502 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:47.438062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:47.438976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:47.471301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.472241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.474543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.476671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.590297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:14:47.796318 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ba448c5-9a6b-4d76-9df5-c3cbf69763a8 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 204 len: 0 microversion: 2.1 time: 0.365226 Jul 24 01:14:47.797095 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 758/1375] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:14:47 2022] DELETE /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:14:47.802719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:47.808248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:47.823891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.827277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:47.828356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:47.830755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:48.020245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:48.033687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71710607-027c-4231-844d-5f3212fe0223 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 200 len: 1346 microversion: 2.1 time: 0.231052 Jul 24 01:14:48.038263 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 759/1376] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:47 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 1346 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:48.054112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:48.058244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:48.074835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:48.085217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:48.086954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:48.088247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:48.108062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:48.123261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:48.125073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:48.126674 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d7f3fa4b-2de5-4e84-9316-db46b9b5f686 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.788718 Jul 24 01:14:48.128142 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 618/1377] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:47 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:48.297753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:48.298723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:48.317062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:48.317589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:48.318526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:48.319698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:49.535966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:49.544466 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4eae5eb-be86-4e9b-8fe0-7834894b4217 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1508 microversion: 2.1 time: 1.503341 Jul 24 01:14:49.547571 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 760/1378] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:48 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1508 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:49.567536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:49.568167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:49.572664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:49.597219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:49.597710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:49.598525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:49.600213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:49.603479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:49.605229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:49.614360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0dd99232-6e0a-4a5d-b820-a56695834f1a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.318135 Jul 24 01:14:49.618808 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 619/1379] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:48 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:14:49.633732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:49.644078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:49.662207 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:49.668687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:49.670430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:49.671901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 HTTP/1.1 Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:49.673423 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:49.674979 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f5fc9a91-b438-478b-89bf-c5b70e390fd7'} Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:49.675811 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:49.677193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:49.681000 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:49.681000 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-06902029-1484-4461-a9b8-7c3d82116063 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 404 len: 111 microversion: 2.1 time: 0.126063 Jul 24 01:14:49.681000 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 761/1380] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:49 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:49.687864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:49.952455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:49.953420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:49.963280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:49.963746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:49.964545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:49.964990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:50.002204 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7/os-volume_attachments HTTP/1.1 Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:50.015234 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:50.017047 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': 'f5fc9a91-b438-478b-89bf-c5b70e390fd7'} Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:50.018050 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:14:50.019696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:50.021633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:50.021633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9db620a3-1a3f-48f8-9d8c-24adf7c48cdc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071676 Jul 24 01:14:50.021633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 762/1381] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:14:49 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:50.330111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1706517105", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "adf394c3-0407-4590-8c41-4e59f65f117d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:50.393629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] validate_networks() for [('adf394c3-0407-4590-8c41-4e59f65f117d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:14:50.479588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:50.498266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:50.507380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:50.508695 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e5e17851-4b78-4ce3-99f0-ef509cc9ea08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.888728 Jul 24 01:14:50.509546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 620/1382] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:49 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:50.560446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:50.561313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:50.573591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:50.574304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:50.577310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:50.578043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.722505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9ddb861cc146cda7dea654bc742c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb233b56b3734747a1dc864cc7c84b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:51.730493 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-372c73d0-a7e4-49f8-9ec4-812f959d2c00 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 200 len: 1508 microversion: 2.1 time: 1.173799 Jul 24 01:14:51.731649 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 621/1383] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:50 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 1508 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:51.736512 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-21f579e2-ace5-45b4-950f-50cb0285a09c req-eb5eeb45-7c20-429e-929c-61a7e2604565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ffed3-aa7a-4f34-b7ff-36bf1f302095", "name": "network-vif-unplugged", "status": "completed", "tag": "66e73105-afa5-41a2-834d-bf1ca582b139"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:51.759945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-21f579e2-ace5-45b4-950f-50cb0285a09c req-eb5eeb45-7c20-429e-929c-61a7e2604565 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:51.760403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-21f579e2-ace5-45b4-950f-50cb0285a09c req-eb5eeb45-7c20-429e-929c-61a7e2604565 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.783912 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-21f579e2-ace5-45b4-950f-50cb0285a09c req-eb5eeb45-7c20-429e-929c-61a7e2604565 service nova] Creating event network-vif-unplugged:66e73105-afa5-41a2-834d-bf1ca582b139 for instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 on n-h2-master-1 Jul 24 01:14:51.807779 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-21f579e2-ace5-45b4-950f-50cb0285a09c req-eb5eeb45-7c20-429e-929c-61a7e2604565 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074725 Jul 24 01:14:51.811215 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 622/1384] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:51.821785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:51.827076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:51.839435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:51.840030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:51.840685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:51.841353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.692422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:52.709813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:52.711579 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:52.728374 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f2a18442-faeb-4fc4-a3bd-a6759af9c0ef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 0.898005 Jul 24 01:14:52.730787 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 623/1385] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:51 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:52.736669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:52.744387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:52.763956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.764424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.765238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.765738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.784573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:14:52.786695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:14:52.787559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:14:52.788807 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:14:52.789899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:14:52.815503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.816338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.817935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:52.818610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:52.904227 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:52.924036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for user f3de9a749c874cfc8c34deffb1001a79 and project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:52.953509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:14:52.961519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:14:53.068580 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4f6363b-3a06-4046-a61c-3e1dff8adc41 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.742269 Jul 24 01:14:53.070646 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 763/1386] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:14:53.075631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c293384e-8855-4b61-96c1-8a5f3d1dbce3 req-0f99456a-fa95-4862-a38a-85f1fcff29c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b03b1da-6e6e-4724-bee5-bb323362d5b6", "name": "network-vif-deleted", "tag": "0fe55644-bf16-42d2-bebf-3d1bbaba69ba"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:53.091054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c293384e-8855-4b61-96c1-8a5f3d1dbce3 req-0f99456a-fa95-4862-a38a-85f1fcff29c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.092954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c293384e-8855-4b61-96c1-8a5f3d1dbce3 req-0f99456a-fa95-4862-a38a-85f1fcff29c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.108618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c293384e-8855-4b61-96c1-8a5f3d1dbce3 req-0f99456a-fa95-4862-a38a-85f1fcff29c0 service nova] Creating event network-vif-deleted:0fe55644-bf16-42d2-bebf-3d1bbaba69ba for instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 on n-h2-master-1 Jul 24 01:14:53.129885 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c293384e-8855-4b61-96c1-8a5f3d1dbce3 req-0f99456a-fa95-4862-a38a-85f1fcff29c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046153 Jul 24 01:14:53.135571 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 764/1387] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:14:53.152200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:53.152931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.167611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.176670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.178035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.182051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.221932 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] HTTP exception thrown: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Request method failure captured: Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 HTTP/1.1 Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jzo7rZLJOD0Myf2A7EI_CHdKC9aAXcONOXBZMFq6Zcfw03ji0GH6avX8WjZu3a5RQjOKeweuqeNSkzAAWtP2OK7d11_YRtBJH7IW-NXTm3ujunsG8xA4R2nqnOcQvbGIvazCs3YWDX-3gS7t6H9l6m8WqIfY7kRTLx7SdKXNQ3A7kA Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:14:53.226564 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb233b56b3734747a1dc864cc7c84b1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1d9ddb861cc146cda7dea654bc742c80 Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.228342 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '7b03b1da-6e6e-4724-bee5-bb323362d5b6'} Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:53.229282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.230608 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.236306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:53.237451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Returning 404 to user: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:53.242764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6c2ff5a5-b17b-44cc-bfcf-49bc4b1bfe91 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 404 len: 111 microversion: 2.1 time: 0.105921 Jul 24 01:14:53.244799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:53.245473 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 765/1388] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:53 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:53.256907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f32bf7c-213c-4449-99d8-427b9ad6ae27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:53.261919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f32bf7c-213c-4449-99d8-427b9ad6ae27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.265403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:53.266659 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-26b0e4c7-c4e0-41a2-b754-8f77222a6d19 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.534702 Jul 24 01:14:53.267794 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 624/1389] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:52 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:53.272919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1725375299", "metadata": {"image_type": "test"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:53.274296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.289978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.302446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.303298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.303750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.324873 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] HTTP exception thrown: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Request method failure captured: Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6/action HTTP/1.1 Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 112 Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jzo7rZLJOD0Myf2A7EI_CHdKC9aAXcONOXBZMFq6Zcfw03ji0GH6avX8WjZu3a5RQjOKeweuqeNSkzAAWtP2OK7d11_YRtBJH7IW-NXTm3ujunsG8xA4R2nqnOcQvbGIvazCs3YWDX-3gS7t6H9l6m8WqIfY7kRTLx7SdKXNQ3A7kA Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:53.326721 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb233b56b3734747a1dc864cc7c84b1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1d9ddb861cc146cda7dea654bc742c80 Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1725375299", "metadata": {"image_type": "test"}}} Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:53.328405 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7b03b1da-6e6e-4724-bee5-bb323362d5b6', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1725375299', 'metadata': {'image_type': 'test'}}}} Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.329316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.331862 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.333410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:53.333410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:53.333410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.333410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.333410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Returning 404 to user: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:53.333410 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03a8d158-7fae-4a1f-b881-022badf17117 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "POST /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6/action" status: 404 len: 111 microversion: 2.1 time: 0.062397 Jul 24 01:14:53.337191 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 625/1390] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Jul 24 01:14:53 2022] POST /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:53.354668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e13277e-00c4-4157-bd94-e472f8516864 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-436066810", "metadata": {"image_type": "test"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:53.355786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e13277e-00c4-4157-bd94-e472f8516864 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Failed to fetch instance by id tempest-invalid-845723340 {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 24 01:14:53.356412 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9e13277e-00c4-4157-bd94-e472f8516864 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] HTTP exception thrown: Instance tempest-invalid-845723340 could not be found. Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e13277e-00c4-4157-bd94-e472f8516864 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Request method failure captured: Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/tempest-invalid-845723340/action HTTP/1.1 Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 111 Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jzo7rZLJOD0Myf2A7EI_CHdKC9aAXcONOXBZMFq6Zcfw03ji0GH6avX8WjZu3a5RQjOKeweuqeNSkzAAWtP2OK7d11_YRtBJH7IW-NXTm3ujunsG8xA4R2nqnOcQvbGIvazCs3YWDX-3gS7t6H9l6m8WqIfY7kRTLx7SdKXNQ3A7kA Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:53.358626 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb233b56b3734747a1dc864cc7c84b1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1d9ddb861cc146cda7dea654bc742c80 Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-436066810", "metadata": {"image_type": "test"}}} Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:53.360308 n-d-master-1 devstack@n-api.service[119562]: exception: Instance tempest-invalid-845723340 could not be found. Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'tempest-invalid-845723340', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-436066810', 'metadata': {'image_type': 'test'}}}} Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-845723340 could not be found. Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.361340 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-845723340 could not be found. Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-845723340 could not be found. Jul 24 01:14:53.363474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.364870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e13277e-00c4-4157-bd94-e472f8516864 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Returning 404 to user: Instance tempest-invalid-845723340 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:53.364870 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e13277e-00c4-4157-bd94-e472f8516864 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-845723340/action" status: 404 len: 100 microversion: 2.1 time: 0.021808 Jul 24 01:14:53.368321 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 626/1391] 10.222.0.27 () {60 vars in 1245 bytes} [Sun Jul 24 01:14:53 2022] POST /compute/v2.1/servers/tempest-invalid-845723340/action => generated 100 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:53.373455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f5c9862-8ed3-4241-aa44-ad048a1f8be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1755740991"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:53.374571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f5c9862-8ed3-4241-aa44-ad048a1f8be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 24 01:14:53.375068 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4f5c9862-8ed3-4241-aa44-ad048a1f8be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f5c9862-8ed3-4241-aa44-ad048a1f8be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Request method failure captured: Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 57 Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jzo7rZLJOD0Myf2A7EI_CHdKC9aAXcONOXBZMFq6Zcfw03ji0GH6avX8WjZu3a5RQjOKeweuqeNSkzAAWtP2OK7d11_YRtBJH7IW-NXTm3ujunsG8xA4R2nqnOcQvbGIvazCs3YWDX-3gS7t6H9l6m8WqIfY7kRTLx7SdKXNQ3A7kA Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:53.383741 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb233b56b3734747a1dc864cc7c84b1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1d9ddb861cc146cda7dea654bc742c80 Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: {"createImage": {"name": "tempest-test-snap-1755740991"}} Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:53.385522 n-d-master-1 devstack@n-api.service[119562]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1755740991'}}} Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.386609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.388766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.392531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f5c9862-8ed3-4241-aa44-ad048a1f8be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:53.395611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f5c9862-8ed3-4241-aa44-ad048a1f8be5 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.026438 Jul 24 01:14:53.396384 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 627/1392] 10.222.0.27 () {60 vars in 1274 bytes} [Sun Jul 24 01:14:53 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:53.408833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9cf89271-d228-4b60-8fc7-11b803c8ec58 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1453109894"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:53.414070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9cf89271-d228-4b60-8fc7-11b803c8ec58 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 24 01:14:53.414567 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9cf89271-d228-4b60-8fc7-11b803c8ec58 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9cf89271-d228-4b60-8fc7-11b803c8ec58 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Request method failure captured: Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 57 Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jzo7rZLJOD0Myf2A7EI_CHdKC9aAXcONOXBZMFq6Zcfw03ji0GH6avX8WjZu3a5RQjOKeweuqeNSkzAAWtP2OK7d11_YRtBJH7IW-NXTm3ujunsG8xA4R2nqnOcQvbGIvazCs3YWDX-3gS7t6H9l6m8WqIfY7kRTLx7SdKXNQ3A7kA Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:53.418568 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb233b56b3734747a1dc864cc7c84b1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1d9ddb861cc146cda7dea654bc742c80 Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: {"createImage": {"name": "tempest-test-snap-1453109894"}} Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:53.421032 n-d-master-1 devstack@n-api.service[119562]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1453109894'}}} Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.427333 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 24 01:14:53.429338 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.431423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9cf89271-d228-4b60-8fc7-11b803c8ec58 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:53.431423 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9cf89271-d228-4b60-8fc7-11b803c8ec58 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.015853 Jul 24 01:14:53.431423 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 628/1393] 10.222.0.27 () {60 vars in 1280 bytes} [Sun Jul 24 01:14:53 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:53.437728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:53.437728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.447736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.448205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.449004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.449450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.485423 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] HTTP exception thrown: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Request method failure captured: Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 HTTP/1.1 Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jzo7rZLJOD0Myf2A7EI_CHdKC9aAXcONOXBZMFq6Zcfw03ji0GH6avX8WjZu3a5RQjOKeweuqeNSkzAAWtP2OK7d11_YRtBJH7IW-NXTm3ujunsG8xA4R2nqnOcQvbGIvazCs3YWDX-3gS7t6H9l6m8WqIfY7kRTLx7SdKXNQ3A7kA Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:53.487244 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb233b56b3734747a1dc864cc7c84b1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1d9ddb861cc146cda7dea654bc742c80 Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.489047 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7b03b1da-6e6e-4724-bee5-bb323362d5b6'} Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:53.490375 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.492067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.494234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Returning 404 to user: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:53.503127 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-70489f09-cda9-418d-91da-40ebc4633f9a tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 404 len: 111 microversion: 2.1 time: 0.074925 Jul 24 01:14:53.505751 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 629/1394] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:14:53 2022] DELETE /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:53.518577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f32bf7c-213c-4449-99d8-427b9ad6ae27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:53.529973 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f32bf7c-213c-4449-99d8-427b9ad6ae27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6" status: 200 len: 1215 microversion: 2.1 time: 0.283050 Jul 24 01:14:53.544312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:53.545959 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 766/1395] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:53 2022] GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 => generated 1215 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:14:53.546165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] [instance: 7b03b1da-6e6e-4724-bee5-bb323362d5b6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.561479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-418d3fba-f8c4-4535-9a10-9a7877dd6e14 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:53.562289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-418d3fba-f8c4-4535-9a10-9a7877dd6e14 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.564320 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:53.565842 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.568335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.570416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.575897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.594301 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:53.607756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-418d3fba-f8c4-4535-9a10-9a7877dd6e14 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:14:53.627973 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] HTTP exception thrown: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Request method failure captured: Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 HTTP/1.1 Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jzo7rZLJOD0Myf2A7EI_CHdKC9aAXcONOXBZMFq6Zcfw03ji0GH6avX8WjZu3a5RQjOKeweuqeNSkzAAWtP2OK7d11_YRtBJH7IW-NXTm3ujunsG8xA4R2nqnOcQvbGIvazCs3YWDX-3gS7t6H9l6m8WqIfY7kRTLx7SdKXNQ3A7kA Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:53.639602 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb233b56b3734747a1dc864cc7c84b1b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb233b56b3734747a1dc864cc7c84b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eb233b56b3734747a1dc864cc7c84b1b Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-33385998 Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1d9ddb861cc146cda7dea654bc742c80 Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesNegativeTestJSON-33385998-project Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.641074 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7b03b1da-6e6e-4724-bee5-bb323362d5b6'} Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:53.647730 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. Jul 24 01:14:53.649407 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:53.653279 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] Returning 404 to user: Instance 7b03b1da-6e6e-4724-bee5-bb323362d5b6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:53.653279 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ce03a5b2-371a-4961-b2e2-10a5d75f93e9 tempest-ImagesNegativeTestJSON-33385998 tempest-ImagesNegativeTestJSON-33385998-project] 10.222.0.27 "GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6" status: 404 len: 111 microversion: 2.1 time: 0.126582 Jul 24 01:14:53.653279 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 630/1396] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:53 2022] GET /compute/v2.1/servers/7b03b1da-6e6e-4724-bee5-bb323362d5b6 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:53.748343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:53.749585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:53.761475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.762238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:53.763223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:53.764164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:54.284113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.api [None req-418d3fba-f8c4-4535-9a10-9a7877dd6e14 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] Instance Mapping does not exist while attempting local delete cleanup. Jul 24 01:14:54.288172 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-418d3fba-f8c4-4535-9a10-9a7877dd6e14 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6" status: 204 len: 0 microversion: 2.1 time: 0.728103 Jul 24 01:14:54.292534 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 767/1397] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:14:53 2022] DELETE /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:14:54.672186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf3498bb-d50f-42c1-b9d8-2536714e84af tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Action: 'create', calling method: .version_select at 0x7f05ead55d30>, body: {"pool": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:54.961877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:54.981065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:54.986639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:54.988605 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cea6af00-ff5c-42c9-a316-b3abfc8273b3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.245134 Jul 24 01:14:54.991188 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 631/1398] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:53 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:14:55.004337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:55.005427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:55.020470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.023370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.030061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:55.035876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:55.948028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:55.961011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:55.969962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:55.975197 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58aba084-798c-47ce-9c1e-2fb06e8130a1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1568 microversion: 2.25 time: 0.982432 Jul 24 01:14:55.980437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 632/1399] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:54 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1568 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:56.005217 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2b88522e-1e52-4b9f-a9db-3122ff3353a6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:56.008214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2b88522e-1e52-4b9f-a9db-3122ff3353a6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:56.030205 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-2b88522e-1e52-4b9f-a9db-3122ff3353a6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2b88522e-1e52-4b9f-a9db-3122ff3353a6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 HTTP/1.1 Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:14:56.032028 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:14:56.033764 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '69f948b6-44df-4699-843e-a9cbf75935a6'} Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:14:56.034798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:14:56.036253 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:14:56.043311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2b88522e-1e52-4b9f-a9db-3122ff3353a6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:14:56.045864 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2b88522e-1e52-4b9f-a9db-3122ff3353a6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6" status: 404 len: 111 microversion: 2.1 time: 0.057400 Jul 24 01:14:56.057813 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 633/1400] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:14:55 2022] GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:14:56.075124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:56.076926 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:56.659008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.659991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:56.663698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:56.664594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:57.196108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:57.219360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:57.226717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:14:57.232345 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f277992a-38b3-4667-80a5-2ce028294a78 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.160262 Jul 24 01:14:57.234110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 634/1401] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:56 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:14:57.246731 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1804422274", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "adf394c3-0407-4590-8c41-4e59f65f117d"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:14:57.375387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] validate_networks() for [('adf394c3-0407-4590-8c41-4e59f65f117d', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:14:58.713708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:14:58.714390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:14:58.714872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:14:58.715416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:14:58.717088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:14:58.741991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.743277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.744938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:58.746637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:58.829858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:14:58.849545 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:58.856498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for user f3de9a749c874cfc8c34deffb1001a79 and project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:14:58.919938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:14:58.951423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:14:59.236452 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-730e271f-1989-4773-99b6-b174231d2f1a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000565 Jul 24 01:14:59.237574 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 635/1402] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:14:59.257018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:14:59.269406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:14:59.296101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.297336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:14:59.299646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:14:59.304588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:00.332494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:00.361783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:00.366891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:00.377573 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e5cbf6e5-903b-454c-a47a-633f254bea3b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1558 microversion: 2.25 time: 1.129955 Jul 24 01:15:00.389282 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 636/1403] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:14:59 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1558 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:00.645467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-876336657", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "99bb338c-d9a7-432c-8774-bf59134c3ffb"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:00.804090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] validate_networks() for [('99bb338c-d9a7-432c-8774-bf59134c3ffb', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:15:00.982142 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf3498bb-d50f-42c1-b9d8-2536714e84af tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.686960 Jul 24 01:15:00.991275 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 768/1404] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:14:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:00.999629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:01.010099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:01.025138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.025607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:01.030696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:01.031155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:02.188982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:02.207819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:02.211354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:02.213811 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9db6faa0-13ef-44ea-8bac-83f1432f33fe tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.219433 Jul 24 01:15:02.217619 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 769/1405] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:00 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:02.223308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:02.225381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:02.234192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:02.235159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:02.236264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:02.237006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:02.862955 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:02.968702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:02.998399 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ec0de58b-63be-4c63-92be-614646181ef1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1273 microversion: 2.1 time: 0.779083 Jul 24 01:15:02.999037 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 770/1406] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:02 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1273 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:03.011119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c210c3d-d885-4ad9-b47b-be122213ce23 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '.version_select at 0x7f05ead55dc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:03.026817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c210c3d-d885-4ad9-b47b-be122213ce23 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.028412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c210c3d-d885-4ad9-b47b-be122213ce23 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.055105 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c210c3d-d885-4ad9-b47b-be122213ce23 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.047514 Jul 24 01:15:03.055654 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 771/1407] 10.222.0.27 () {60 vars in 1183 bytes} [Sun Jul 24 01:15:03 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:03.072546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b30cc8eb-ee68-48d1-89d4-23e8328b7afa tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Action: 'create', calling method: .version_select at 0x7f05eaeacf70>, body: {"pool": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:03.817312 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:03.849349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:03.850240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:03.850692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:03.851108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:03.851762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:03.939284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.939824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:03.944135 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:03.944595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:04.049648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Getting quotas for project faa16a8779184f18afc0118c7581b9b9. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:04.074790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Getting quotas for user 3428b2650a774c998b63ed06114872b0 and project faa16a8779184f18afc0118c7581b9b9. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:04.125361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:15:04.128732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:15:04.273168 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b67dbb4a-2301-4d48-9e8b-7cc2a8819390 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.880361 Jul 24 01:15:04.283585 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 637/1408] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:15:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:15:04.296989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:04.297904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:04.310416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:04.310985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:04.311893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:04.312457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:05.583780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 940ffed3-aa7a-4f34-b7ff-36bf1f302095 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:05.636965 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-96677ba0-2cc7-4f45-b56b-cd1b14042418 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 2050 microversion: 2.25 time: 1.351123 Jul 24 01:15:05.660717 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 638/1409] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:04 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 2050 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:05.677869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:05.678485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:05.697598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:05.709778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:05.710940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:05.719673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:06.991017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:07.015101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:07.017521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:07.020317 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02612ae1-8147-4a7a-98df-7a232a7ace29 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.350688 Jul 24 01:15:07.030456 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 639/1410] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:05 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:07.037195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:07.038174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:07.063563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:07.064343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:07.065437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:07.066216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:08.675007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:08.686379 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-165f1db4-a18d-47cf-adab-e11298043f2f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1315 microversion: 2.1 time: 1.654459 Jul 24 01:15:08.687436 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 640/1411] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:07 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1315 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:08.700803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:08.701781 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:08.721340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:08.721834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:08.723192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:08.723812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:09.446017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:09.457226 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf1f7193-03a4-46ec-a823-3869b6f192f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1317 microversion: 2.1 time: 0.768503 Jul 24 01:15:09.458243 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 641/1412] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:08 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:09.463275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-906694743", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "c346cd37-8708-458f-a9ad-b2bb44b94ef1"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:09.577193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] validate_networks() for [('c346cd37-8708-458f-a9ad-b2bb44b94ef1', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:15:12.231318 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:12.472468 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b30cc8eb-ee68-48d1-89d4-23e8328b7afa tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.404864 Jul 24 01:15:12.485092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:12.486807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:12.488152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:12.489262 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 772/1413] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:15:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:12.491050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:12.492045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:12.512402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:12.513093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:12.520773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.521501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.522516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.523658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.525458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.526692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.528894 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:12.529074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.535715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.583430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:12.590836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for user 735a3f7d7e454f14a7a4ed229affd75b and project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:12.621327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:15:12.624533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:15:12.713034 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3e479de-fab5-4790-8db9-6ef94f0366ae tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.253447 Jul 24 01:15:12.717303 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 642/1414] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3258 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:15:12.729846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:12.730841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:12.773438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.776577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:12.779672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:12.782347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:13.434461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:13.478234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:13.489202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:13.494271 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0536e596-0f05-4aa2-ba4b-f3eeaaaf4756 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.003172 Jul 24 01:15:13.502107 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 773/1415] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:12 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:13.512813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-37b3f50f-92df-4056-9db2-50df5c011385 req-5a297e16-5ac6-4531-b188-6066e51127cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23", "tag": "652f2c92-bfbb-42ab-b716-543ccfaef44c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:13.538305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-37b3f50f-92df-4056-9db2-50df5c011385 req-5a297e16-5ac6-4531-b188-6066e51127cc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:13.539234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-37b3f50f-92df-4056-9db2-50df5c011385 req-5a297e16-5ac6-4531-b188-6066e51127cc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:13.559643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-37b3f50f-92df-4056-9db2-50df5c011385 req-5a297e16-5ac6-4531-b188-6066e51127cc service nova] Creating event network-changed:652f2c92-bfbb-42ab-b716-543ccfaef44c for instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 on n-h2-master-1 Jul 24 01:15:13.566841 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-37b3f50f-92df-4056-9db2-50df5c011385 req-5a297e16-5ac6-4531-b188-6066e51127cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062093 Jul 24 01:15:13.568118 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 774/1416] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:13.586087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:13.587847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:13.597937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:13.598865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:13.600208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:13.600974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:13.621078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:13.635110 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b16507f-94a4-4059-a36d-eadd82710ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1315 microversion: 2.1 time: 0.914029 Jul 24 01:15:13.645607 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 643/1417] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:12 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1315 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:13.650333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a978cc3-137a-4b4f-b867-7b42fe8073e0 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Action: 'create', calling method: .version_select at 0x7f05eb363280>, body: {"pool": null} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:14.443910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:14.463325 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-905590ce-a4bf-4e12-811a-6431cb956f92 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1317 microversion: 2.1 time: 0.893302 Jul 24 01:15:14.464555 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 775/1418] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:13 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1317 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:14.479581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b80e06c4-b677-42d7-bd75-5d60744d09de req-75fda05d-18b1-495b-8cd9-6ec06b08f052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc411e9-88ab-485f-b9f0-e1b452857f21", "tag": "a0074f70-c1f5-40da-aa84-e9eb964ccd36"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:14.504653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b80e06c4-b677-42d7-bd75-5d60744d09de req-75fda05d-18b1-495b-8cd9-6ec06b08f052 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.506564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b80e06c4-b677-42d7-bd75-5d60744d09de req-75fda05d-18b1-495b-8cd9-6ec06b08f052 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.545813 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b80e06c4-b677-42d7-bd75-5d60744d09de req-75fda05d-18b1-495b-8cd9-6ec06b08f052 service nova] Creating event network-changed:a0074f70-c1f5-40da-aa84-e9eb964ccd36 for instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 on n-h2-master-1 Jul 24 01:15:14.560166 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b80e06c4-b677-42d7-bd75-5d60744d09de req-75fda05d-18b1-495b-8cd9-6ec06b08f052 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087384 Jul 24 01:15:14.562415 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 776/1419] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:14.577118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:14.577913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:14.597226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.597726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:14.598538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:14.598992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:15.299898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:15.322817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:15.329224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:15.330692 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df3bd263-5734-4c9d-9511-bcdb94da769c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1319 microversion: 2.25 time: 0.765515 Jul 24 01:15:15.331508 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 777/1420] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:14 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1319 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:15.342369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1045699306", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0b0a25ed-fae4-4f81-a013-333d811349fa"}], "block_device_mapping_v2": [{"uuid": "40272bed-e2b6-4c64-8ed7-bf9d1c8413b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:15.461332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] validate_networks() for [('0b0a25ed-fae4-4f81-a013-333d811349fa', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:15:17.172516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:17.178316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:17.179947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:17.184243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:17.186897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:17.218813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:17.222020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:17.224598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:17.225634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:17.299369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:17.318147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Getting quotas for user 40b5fc3b4b6d43ab9342da568567140d and project 58e5e52270c14573b0d4c868cb9fa69c. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:17.407637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:15:17.410296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40272bed-e2b6-4c64-8ed7-bf9d1c8413b1',volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:15:17.678328 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b95ca323-91b6-4fad-bf6d-bed3024b1b3f tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.345078 Jul 24 01:15:17.682166 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 778/1421] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:15:17.706301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:17.707054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:17.738274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:17.738777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:17.739879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:17.741710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:18.865622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:18.883946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:18.885516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:18.891090 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab9d591f-3d87-4511-9987-52796c680324 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.191928 Jul 24 01:15:18.906089 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 779/1422] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:17 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:18.906089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:18.906089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:18.906089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:18.906859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:18.907053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:18.907424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:19.556003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:19.581980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f53f96e-a9f8-4e95-af36-4804998bd3e9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1315 microversion: 2.1 time: 0.686905 Jul 24 01:15:19.617051 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 780/1423] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:18 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:19.939497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-149d73fd-101a-47b5-9691-3e4765967275 tempest-FloatingIPDetailsNegativeTestJSON-434454866 tempest-FloatingIPDetailsNegativeTestJSON-434454866-project] Calling method '.version_select at 0x7f05eae4ca60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:20.023788 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-149d73fd-101a-47b5-9691-3e4765967275 tempest-FloatingIPDetailsNegativeTestJSON-434454866 tempest-FloatingIPDetailsNegativeTestJSON-434454866-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 153fda7a-ecf3-40da-92bd-416a4e5908cc could not be found", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:15:20.024860 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-149d73fd-101a-47b5-9691-3e4765967275 tempest-FloatingIPDetailsNegativeTestJSON-434454866 tempest-FloatingIPDetailsNegativeTestJSON-434454866-project] HTTP exception thrown: Floating IP not found for ID 153fda7a-ecf3-40da-92bd-416a4e5908cc Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-149d73fd-101a-47b5-9691-3e4765967275 tempest-FloatingIPDetailsNegativeTestJSON-434454866 tempest-FloatingIPDetailsNegativeTestJSON-434454866-project] Request method failure captured: Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-floating-ips/153fda7a-ecf3-40da-92bd-416a4e5908cc HTTP/1.1 Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0iNBBIAa89OBuIgqvLxXjMD4IRxtep2yUIUmhIHkT_r_3-sLX6N15F2lQRe-IKNX3cmvCpnRp8VkI6juyyTE09pakdv7Duh986cMxO1M3We9r9oNP8gne-6GfaPPsUxK2aq4B6kip4_xKIG8MPQVnjFIVFrgSzL_GkaE8ml-MD7Xo Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 2b1d8c33b5254856bd1d395ca4ae080f Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-434454866 Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:15:20.029316 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b1d8c33b5254856bd1d395ca4ae080f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b1d8c33b5254856bd1d395ca4ae080f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b1d8c33b5254856bd1d395ca4ae080f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b1d8c33b5254856bd1d395ca4ae080f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-434454866 Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 2b1d8c33b5254856bd1d395ca4ae080f Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-434454866 Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-434454866-project Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1c7c2b8076ac434d8bbf9aa4fe72facb Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-434454866-project Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: exception: Floating IP not found for ID 153fda7a-ecf3-40da-92bd-416a4e5908cc Jul 24 01:15:20.031287 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '153fda7a-ecf3-40da-92bd-416a4e5908cc'} Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:15:20.032355 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 153fda7a-ecf3-40da-92bd-416a4e5908cc could not be found Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4210325-efbe-4d4e-8dd2-fba461b4486f'] Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 153fda7a-ecf3-40da-92bd-416a4e5908cc. Jul 24 01:15:20.033965 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 153fda7a-ecf3-40da-92bd-416a4e5908cc Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:20.035550 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:15:20.037319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:15:20.037319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 153fda7a-ecf3-40da-92bd-416a4e5908cc Jul 24 01:15:20.037319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:20.039145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-149d73fd-101a-47b5-9691-3e4765967275 tempest-FloatingIPDetailsNegativeTestJSON-434454866 tempest-FloatingIPDetailsNegativeTestJSON-434454866-project] Returning 404 to user: Floating IP not found for ID 153fda7a-ecf3-40da-92bd-416a4e5908cc {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:20.040247 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-149d73fd-101a-47b5-9691-3e4765967275 tempest-FloatingIPDetailsNegativeTestJSON-434454866 tempest-FloatingIPDetailsNegativeTestJSON-434454866-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/153fda7a-ecf3-40da-92bd-416a4e5908cc" status: 404 len: 111 microversion: 2.1 time: 0.421453 Jul 24 01:15:20.041428 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 781/1424] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:15:19 2022] GET /compute/v2.1/os-floating-ips/153fda7a-ecf3-40da-92bd-416a4e5908cc => generated 111 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:15:20.047415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:20.049122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:20.059889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.061342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.062437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.063071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.734360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a978cc3-137a-4b4f-b867-7b42fe8073e0 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.096189 Jul 24 01:15:20.735404 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 644/1425] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:15:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:20.740836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e20d634a-9577-4a66-8f5a-fba01267771d req-f9525a70-9db7-464e-9d8b-847f3b68be00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-plugged", "status": "completed", "tag": "46b2e1a2-faec-4cdb-bff2-afbecdb5159d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:20.759177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e20d634a-9577-4a66-8f5a-fba01267771d req-f9525a70-9db7-464e-9d8b-847f3b68be00 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.759714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e20d634a-9577-4a66-8f5a-fba01267771d req-f9525a70-9db7-464e-9d8b-847f3b68be00 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.790160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:20.799769 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e20d634a-9577-4a66-8f5a-fba01267771d req-f9525a70-9db7-464e-9d8b-847f3b68be00 service nova] Creating event network-vif-plugged:46b2e1a2-faec-4cdb-bff2-afbecdb5159d for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:20.804452 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b739a97b-89a2-4c94-8266-98128858e7df tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1317 microversion: 2.1 time: 0.761596 Jul 24 01:15:20.814593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e20d634a-9577-4a66-8f5a-fba01267771d req-f9525a70-9db7-464e-9d8b-847f3b68be00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077711 Jul 24 01:15:20.818398 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 645/1426] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:20.818796 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 782/1427] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:20 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:20.830597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:20.834307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:20.834932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:20.835083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:20.850878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.851341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.852203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.855662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.856792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.857379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:20.858129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:20.858763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:22.255435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:22.278365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:22.289836 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-938e24cf-1651-467d-9f06-671942641929 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1211 microversion: 2.1 time: 1.469551 Jul 24 01:15:22.290470 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 783/1428] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:20 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1211 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:22.300136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:22.305994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:22.307032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ab480a5c-aacb-4c7b-abd7-856c7409a4b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1361 microversion: 2.25 time: 1.487140 Jul 24 01:15:22.310870 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 646/1429] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:20 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1361 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:22.319509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:22.320507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:22.329760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:22.339056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:22.344765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:22.345395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:22.346678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:22.347544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:22.355337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:22.355801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:22.356629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:22.357077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:22.559740 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:22.608347 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=18 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:23.291805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:23.310355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:23.316347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:23.326676 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1164211c-c34b-4c2b-99a8-cdb2c90274c3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1879 microversion: 2.32 time: 1.019909 Jul 24 01:15:23.328230 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 784/1430] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:22 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1879 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:23.337434 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f0a22589-2f5a-4333-bef0-94f6cc2eadc7 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Action: 'create', calling method: .version_select at 0x7f05eae559d0>, body: {"pool": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:23.341526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:23.362266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9420cca7-3f1b-47e1-9f1f-a030b88eb99b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1315 microversion: 2.1 time: 1.049679 Jul 24 01:15:23.374056 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 647/1431] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:22 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1315 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:23.401517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:23.409034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:23.424065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:23.424838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:23.425852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:23.429966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:24.029859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:24.038570 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=81 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:24.067630 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ed994bb-e10d-4ebf-ad4f-42fdfc0fef1c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1317 microversion: 2.1 time: 0.691019 Jul 24 01:15:24.069226 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 648/1432] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:23 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:24.083984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2604f025-e210-4156-ad3a-9e55e1b31bfd req-9a0bd86f-1195-4397-8039-84c4863e1175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57ea22b-8e5e-44f8-b5d2-f83188711d47", "tag": "e4e506dc-13a9-4a9e-97a0-b99d991960ac"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:24.094965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2604f025-e210-4156-ad3a-9e55e1b31bfd req-9a0bd86f-1195-4397-8039-84c4863e1175 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:24.095463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2604f025-e210-4156-ad3a-9e55e1b31bfd req-9a0bd86f-1195-4397-8039-84c4863e1175 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:24.114246 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2604f025-e210-4156-ad3a-9e55e1b31bfd req-9a0bd86f-1195-4397-8039-84c4863e1175 service nova] Creating event network-changed:e4e506dc-13a9-4a9e-97a0-b99d991960ac for instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 on n-h2-master-1 Jul 24 01:15:24.120001 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2604f025-e210-4156-ad3a-9e55e1b31bfd req-9a0bd86f-1195-4397-8039-84c4863e1175 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048253 Jul 24 01:15:24.127998 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 649/1433] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:24.138791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-plugged", "status": "completed", "tag": "198efcd9-809d-4f5a-8feb-85171ce21b72"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-plugged", "status": "completed", "tag": "7049bd24-a30d-473a-9ed1-ed88450f1b75"}, {"server_uuid": "e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23", "name": "network-vif-plugged", "status": "completed", "tag": "652f2c92-bfbb-42ab-b716-543ccfaef44c"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-plugged", "status": "completed", "tag": "81ce7c7d-8b64-42e8-a880-98a660147477"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-plugged", "status": "completed", "tag": "a6840e15-03ea-4322-b29f-77952f504989"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-plugged", "status": "completed", "tag": "8ba56271-68b3-4ab7-af7d-56a02d80b307"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-plugged", "status": "completed", "tag": "58bea69b-6e2f-4382-9914-db1f74f63054"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:24.179706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:24.180432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:24.218486 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Creating event network-vif-plugged:198efcd9-809d-4f5a-8feb-85171ce21b72 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:24.220143 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Creating event network-vif-plugged:7049bd24-a30d-473a-9ed1-ed88450f1b75 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:24.226810 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Creating event network-vif-plugged:652f2c92-bfbb-42ab-b716-543ccfaef44c for instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 on n-h2-master-1 Jul 24 01:15:24.227877 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Creating event network-vif-plugged:81ce7c7d-8b64-42e8-a880-98a660147477 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:24.228856 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Creating event network-vif-plugged:a6840e15-03ea-4322-b29f-77952f504989 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:24.229790 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Creating event network-vif-plugged:8ba56271-68b3-4ab7-af7d-56a02d80b307 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:24.231975 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] Creating event network-vif-plugged:58bea69b-6e2f-4382-9914-db1f74f63054 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:24.259943 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8292358c-22a9-4184-a3af-cd1255fb68be req-df6a3908-36a0-4179-87e4-a3c984bbe1e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.130205 Jul 24 01:15:24.260598 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 650/1434] 10.222.0.27 () {64 vars in 1318 bytes} [Sun Jul 24 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:24.267251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:24.267966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:24.276207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:24.276711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:24.303974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:24.304449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:25.357528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:25.385696 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2f993dac-8a61-4d50-9012-450598bdef8b tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1211 microversion: 2.1 time: 1.123202 Jul 24 01:15:25.403194 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 651/1435] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:24 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1211 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:25.411854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:25.423679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:25.439293 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:25.440550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:25.442380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:25.444004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:26.432159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:26.442550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:26.444688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:26.447284 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5a4c1ba3-d03b-4f22-9113-90e7a556f25c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1361 microversion: 2.25 time: 1.042597 Jul 24 01:15:26.457805 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 652/1436] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:25 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1361 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:26.462960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-fbeec500-6b40-4a00-86c1-4cf567f40bb1 req-621884cc-e48c-47bf-bd00-2f8c82146aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756", "tag": "42c48376-af28-46ff-826d-a163933356db"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:26.477276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fbeec500-6b40-4a00-86c1-4cf567f40bb1 req-621884cc-e48c-47bf-bd00-2f8c82146aa5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:26.477894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fbeec500-6b40-4a00-86c1-4cf567f40bb1 req-621884cc-e48c-47bf-bd00-2f8c82146aa5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:26.502477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-fbeec500-6b40-4a00-86c1-4cf567f40bb1 req-621884cc-e48c-47bf-bd00-2f8c82146aa5 service nova] Creating event network-changed:42c48376-af28-46ff-826d-a163933356db for instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 on n-h1-master-1 Jul 24 01:15:26.508659 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-fbeec500-6b40-4a00-86c1-4cf567f40bb1 req-621884cc-e48c-47bf-bd00-2f8c82146aa5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059416 Jul 24 01:15:26.509775 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 653/1437] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:26.517335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:26.518241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:26.526396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:26.529388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:26.530547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:26.531181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:27.190260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:27.210341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:27.213820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:27.217313 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-615dee04-f6be-4588-828a-589016732245 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2831 microversion: 2.32 time: 0.705904 Jul 24 01:15:27.218452 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 654/1438] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:26 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2831 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:27.227446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:27.229381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:27.251046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:27.251961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:27.253481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:27.254702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:27.263474 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:27.332534 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:27.847263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:27.861960 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85226b8e-29ae-4839-b0e7-e64b4d677e62 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1315 microversion: 2.1 time: 0.641565 Jul 24 01:15:27.863027 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 655/1439] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:27 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:27.867977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:27.873412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:27.883412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:27.888520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:27.889611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:27.893633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:28.398905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:28.418862 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0376033c-d589-4b72-b246-44f672a69dbd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1508 microversion: 2.1 time: 0.553810 Jul 24 01:15:28.433947 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 656/1440] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:27 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1508 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:28.441814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-eeb3a34f-81ae-4b92-99a2-a433444f11bc req-4cc83e9f-6e50-4e32-94b4-ac9f50e4a22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc411e9-88ab-485f-b9f0-e1b452857f21", "name": "network-vif-plugged", "status": "completed", "tag": "a0074f70-c1f5-40da-aa84-e9eb964ccd36"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:28.455847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eeb3a34f-81ae-4b92-99a2-a433444f11bc req-4cc83e9f-6e50-4e32-94b4-ac9f50e4a22f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:28.456581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eeb3a34f-81ae-4b92-99a2-a433444f11bc req-4cc83e9f-6e50-4e32-94b4-ac9f50e4a22f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:28.480752 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-eeb3a34f-81ae-4b92-99a2-a433444f11bc req-4cc83e9f-6e50-4e32-94b4-ac9f50e4a22f service nova] Creating event network-vif-plugged:a0074f70-c1f5-40da-aa84-e9eb964ccd36 for instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 on n-h2-master-1 Jul 24 01:15:28.488545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-eeb3a34f-81ae-4b92-99a2-a433444f11bc req-4cc83e9f-6e50-4e32-94b4-ac9f50e4a22f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051781 Jul 24 01:15:28.489581 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 657/1441] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:28.500012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:28.501353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:28.513357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:28.514215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:28.515710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:28.516497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.286285 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f0a22589-2f5a-4333-bef0-94f6cc2eadc7 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.955896 Jul 24 01:15:29.294661 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 785/1442] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:15:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:29.300275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f05f682d-0055-4168-840a-b2fe062628e2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:29.305177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f05f682d-0055-4168-840a-b2fe062628e2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:29.315269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05f682d-0055-4168-840a-b2fe062628e2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.320222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:29.334361 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a95d9a52-7ef5-48ff-8105-e539fcde9e09 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1199 microversion: 2.1 time: 0.842624 Jul 24 01:15:29.335235 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 658/1443] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:28 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1199 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:29.336590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05f682d-0055-4168-840a-b2fe062628e2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.338858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05f682d-0055-4168-840a-b2fe062628e2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.340826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:29.345238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05f682d-0055-4168-840a-b2fe062628e2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.346288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:29.359324 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=9 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:29.366340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.367265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.368094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.369894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.748787 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f05f682d-0055-4168-840a-b2fe062628e2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.452456 Jul 24 01:15:29.749724 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 786/1444] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Jul 24 01:15:29 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1/os-interface => generated 1831 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:29.772753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:29.774424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:29.797625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.798903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.800604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.801905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.857371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:29.866861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:29.868486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:29.869724 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f8d581e-0d5b-42bc-bf91-5cb7a9258b81 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1361 microversion: 2.25 time: 0.533325 Jul 24 01:15:29.889940 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 659/1445] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:29 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1361 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:29.894834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:29.895442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:29.903266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.903959 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:29.904917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:29.905528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:30.240075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:30.241359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:30.252086 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1fbaecb5-d7e1-4a22-849f-97445496e5f5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1508 microversion: 2.1 time: 0.500574 Jul 24 01:15:30.254133 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 787/1446] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:29 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:30.256364 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2cc0deae-f99f-4129-9fa3-c2886179b48a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1315 microversion: 2.1 time: 0.365234 Jul 24 01:15:30.260884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3db5d0e5-36d0-48cb-b096-53a8a34df655 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Calling method '.version_select at 0x7f05eadbd790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:30.268718 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 660/1447] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:29 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:30.364388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-703955246", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "08c0cda2-b079-422b-bfb3-9cb6b5d64f85"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:30.466646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] validate_networks() for [('08c0cda2-b079-422b-bfb3-9cb6b5d64f85', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:15:30.765095 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3db5d0e5-36d0-48cb-b096-53a8a34df655 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/2ac4ee7c-08a7-456e-88c8-5fdef3fa24a9" status: 200 len: 142 microversion: 2.1 time: 0.508785 Jul 24 01:15:30.765722 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 788/1448] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:15:30 2022] GET /compute/v2.1/os-floating-ips/2ac4ee7c-08a7-456e-88c8-5fdef3fa24a9 => generated 142 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:30.776815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:30.779398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:30.804163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:30.805030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:30.806190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:30.806850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:30.950679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:30.952107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:30.952854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:30.953457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:30.954082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:31.077275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:31.093300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:31.095705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:31.099702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:31.101998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:31.162478 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9520175e-774a-44dc-a0f7-3b53476f9e2a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "POST /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23/action" status: 202 len: 1110 microversion: 2.1 time: 0.389711 Jul 24 01:15:31.172787 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 789/1449] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:30 2022] POST /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23/action => generated 1110 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 24 01:15:31.178365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:31.183545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:31.201278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:31.201639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:31.202689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:31.203472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:31.682951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:31.722205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:31.723048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:31.723635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:31.724754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:31.725858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:31.730603 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-125ba03d-224f-49af-aa9a-2163a0cbaced tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1199 microversion: 2.1 time: 0.553522 Jul 24 01:15:31.731761 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 790/1450] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:31 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1199 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:31.763412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b36948d1-f154-4546-a34e-5a7178b3879c tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Calling method '.version_select at 0x7f05eb53daf0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:31.763724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:31.764221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:31.768649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:31.769439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:31.849916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for project 641ace3f76eb466ba57c3f42b8173978. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:31.874456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for user 5da455c083744e7c814e8638483ffffe and project 641ace3f76eb466ba57c3f42b8173978. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:31.893066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:15:31.895750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:15:31.992849 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3725eb07-6b50-4a0e-8d56-2a19414b1ad9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720491 Jul 24 01:15:31.994365 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 661/1451] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:15:32.003773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:32.004410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:32.022330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:32.022796 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:32.023605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:32.024067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:32.780298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:32.808142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:32.820190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:32.822756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08188766-2019-4c20-98a9-eff5035aaf9f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1361 microversion: 2.25 time: 0.825535 Jul 24 01:15:32.824098 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 662/1452] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:31 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1361 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:32.833821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:32.835309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:32.853155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:32.856849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:32.858608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:32.862942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.321500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:33.333582 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec73b5f7-2d5c-44f6-afd0-f2ec4291506f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.507754 Jul 24 01:15:33.349812 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 663/1453] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:32 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:33.361838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:33.364616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:33.382759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.387759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.390632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.392401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.663366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:33.680655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4033e121-f326-460e-914f-0ac99fa8df5d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1502 microversion: 2.1 time: 0.329031 Jul 24 01:15:33.681721 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 664/1454] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:33 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:33.687106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-dd211529-e19e-4295-a2a8-b0fd4b4fea56 req-6d0d0b52-babf-454b-a452-2c7185059a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "tag": "a6840e15-03ea-4322-b29f-77952f504989"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:33.702628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dd211529-e19e-4295-a2a8-b0fd4b4fea56 req-6d0d0b52-babf-454b-a452-2c7185059a44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.705590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dd211529-e19e-4295-a2a8-b0fd4b4fea56 req-6d0d0b52-babf-454b-a452-2c7185059a44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.722077 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-dd211529-e19e-4295-a2a8-b0fd4b4fea56 req-6d0d0b52-babf-454b-a452-2c7185059a44 service nova] Creating event network-changed:a6840e15-03ea-4322-b29f-77952f504989 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:15:33.728274 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-dd211529-e19e-4295-a2a8-b0fd4b4fea56 req-6d0d0b52-babf-454b-a452-2c7185059a44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044591 Jul 24 01:15:33.729037 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 665/1455] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:33.735363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:33.736081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:33.743732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.744064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.745349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.746546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.930953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:33.944585 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f581511d-fe14-4e97-8d3e-5494cfcb33ba tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1276 microversion: 2.1 time: 0.213820 Jul 24 01:15:33.947288 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 666/1456] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:33 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:33.954116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:33.955167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:33.963006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.963847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:33.965440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:33.966251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.438072 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b36948d1-f154-4546-a34e-5a7178b3879c tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/2ac4ee7c-08a7-456e-88c8-5fdef3fa24a9" status: 202 len: 0 microversion: 2.1 time: 2.702491 Jul 24 01:15:34.440403 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 791/1457] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:15:31 2022] DELETE /compute/v2.1/os-floating-ips/2ac4ee7c-08a7-456e-88c8-5fdef3fa24a9 => generated 0 bytes in 2704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:34.445019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-abb48ea5-b7ae-471d-a411-d38463a95336 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:34.445560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-abb48ea5-b7ae-471d-a411-d38463a95336 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:34.453940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abb48ea5-b7ae-471d-a411-d38463a95336 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.454403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abb48ea5-b7ae-471d-a411-d38463a95336 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.455168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abb48ea5-b7ae-471d-a411-d38463a95336 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.457067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abb48ea5-b7ae-471d-a411-d38463a95336 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.574028 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-abb48ea5-b7ae-471d-a411-d38463a95336 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21/action" status: 202 len: 0 microversion: 2.1 time: 0.133442 Jul 24 01:15:34.578562 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 792/1458] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:34 2022] POST /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:34.585874 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:34.587231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:34.596259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.596867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.598959 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.599461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.601790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:34.602807 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:34.612706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a58cb91-101a-49be-97c2-433b44faa531 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1199 microversion: 2.1 time: 0.663962 Jul 24 01:15:34.613293 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 667/1459] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:33 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1199 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:34.812214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1750709487", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:34.847046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:34.856073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:34.858444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:34.859873 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-519e2bbe-3f00-4ef4-aa94-9c4d6fe454c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1361 microversion: 2.25 time: 0.282607 Jul 24 01:15:34.861292 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 793/1460] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:34 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:34.866185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f917cbeb-edc3-4bf3-a1e0-fad7a48d142b req-73a33a28-dd84-46a3-9755-0bcf3baef1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756", "name": "network-vif-plugged", "status": "completed", "tag": "42c48376-af28-46ff-826d-a163933356db"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:34.877218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f917cbeb-edc3-4bf3-a1e0-fad7a48d142b req-73a33a28-dd84-46a3-9755-0bcf3baef1dc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.878006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f917cbeb-edc3-4bf3-a1e0-fad7a48d142b req-73a33a28-dd84-46a3-9755-0bcf3baef1dc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.897141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:15:34.900741 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f917cbeb-edc3-4bf3-a1e0-fad7a48d142b req-73a33a28-dd84-46a3-9755-0bcf3baef1dc service nova] Creating event network-vif-plugged:42c48376-af28-46ff-826d-a163933356db for instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 on n-h1-master-1 Jul 24 01:15:34.908142 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f917cbeb-edc3-4bf3-a1e0-fad7a48d142b req-73a33a28-dd84-46a3-9755-0bcf3baef1dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044982 Jul 24 01:15:34.909518 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 794/1461] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:34.916219 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:34.917249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:34.925806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.926667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:34.928258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:34.929096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.324956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:35.346618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69894194-939d-4378-82c1-6d6d5f68f1c3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.435737 Jul 24 01:15:35.348261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 795/1462] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:34 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:35.368191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-513da6c9-673a-44ff-a8f3-f077b44ac61e tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Calling method '.version_select at 0x7f05eae5c280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:35.378006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:35.378710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:35.378830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:35.379404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:35.379886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:35.395944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.396663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.397659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.398514 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.422493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Getting quotas for project 8a078a3f8468439788ea2327659fb762. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:35.428724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Getting quotas for user 82276fe777fb4b08ac6baddf33d752ab and project 8a078a3f8468439788ea2327659fb762. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:35.444257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:15:35.446704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:15:35.513230 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76dc73db-1105-4beb-8157-fd8b5889ae5a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888103 Jul 24 01:15:35.521309 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 668/1463] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:15:35.523813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:35.526249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:35.535352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.535816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.536740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.537161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.766129 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-513da6c9-673a-44ff-a8f3-f077b44ac61e tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.414907 Jul 24 01:15:35.766992 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 796/1464] 10.222.0.27 () {58 vars in 1163 bytes} [Sun Jul 24 01:15:35 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:15:35.773012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:35.773870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:35.798706 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.800967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.803880 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:35.804377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:35.828549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:35.862007 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6301c46c-e8f7-425d-afba-4a1af5d56fc7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1487 microversion: 2.1 time: 0.326860 Jul 24 01:15:35.874458 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 669/1465] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:35 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1487 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:35.882539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-999e0707-beac-42ca-8122-00ce72d50571 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:35.885553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-999e0707-beac-42ca-8122-00ce72d50571 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:35.965307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-999e0707-beac-42ca-8122-00ce72d50571 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:35.976343 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-999e0707-beac-42ca-8122-00ce72d50571 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1217 microversion: 2.1 time: 0.097268 Jul 24 01:15:35.976822 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 670/1466] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:35 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:35.994530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:35.997264 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:36.013606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.014505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.015501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.016108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.022653 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:36.068698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:36.089759 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7f18329-683d-43df-9592-aca8305fa7ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1324 microversion: 2.1 time: 0.320968 Jul 24 01:15:36.090713 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 797/1467] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:35 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:36.102723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f31603fd-f598-446f-9b07-4f8328995cdd tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Calling method '.version_select at 0x7f05eae26700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:36.353019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:36.368669 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6cd13a6e-5de4-4a3a-9e0a-b1a5d375a694 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1199 microversion: 2.1 time: 0.381170 Jul 24 01:15:36.371726 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 671/1468] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:35 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1199 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:36.379831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:36.381240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:36.391096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.391965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.392996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.393842 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.403010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f31603fd-f598-446f-9b07-4f8328995cdd tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.311065 Jul 24 01:15:36.403614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 798/1469] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:15:36 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:36.412011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:36.412539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:36.420768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.421519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.422762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.423395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.466106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:15:36.566196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:36.582277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:36.586356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:36.588041 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16c3c8b3-29c7-456e-99e0-a5b14c1bfb15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1361 microversion: 2.25 time: 0.215113 Jul 24 01:15:36.588944 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 672/1470] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:36 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:36.597342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-10b9dc53-3df7-4923-b12d-2ad985e27055 req-4aab2f0f-d5a5-4db7-b2a7-f9b1f3d3c154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2cf16e-4b21-44e1-bb24-1a0a161bd395", "tag": "0b367a55-70f7-4219-ab6f-7d04eededace"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:36.614895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-10b9dc53-3df7-4923-b12d-2ad985e27055 req-4aab2f0f-d5a5-4db7-b2a7-f9b1f3d3c154 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.616310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-10b9dc53-3df7-4923-b12d-2ad985e27055 req-4aab2f0f-d5a5-4db7-b2a7-f9b1f3d3c154 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.623595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b1c48bbc-47ee-43c4-b482-d92038dc24bc tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 204 len: 0 microversion: 2.1 time: 0.217446 Jul 24 01:15:36.624716 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 799/1471] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:15:36 2022] DELETE /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:15:36.634429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:36.636259 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-10b9dc53-3df7-4923-b12d-2ad985e27055 req-4aab2f0f-d5a5-4db7-b2a7-f9b1f3d3c154 service nova] Creating event network-changed:0b367a55-70f7-4219-ab6f-7d04eededace for instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 on n-h2-master-1 Jul 24 01:15:36.638457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:36.643114 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-10b9dc53-3df7-4923-b12d-2ad985e27055 req-4aab2f0f-d5a5-4db7-b2a7-f9b1f3d3c154 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051615 Jul 24 01:15:36.647083 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 673/1472] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:36.651628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.652757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.653720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d209a861-be52-4f40-985a-6cc4cd093f1e tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Calling method '.version_select at 0x7f05eb0079d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:36.654320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.655077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.919666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:36.928570 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a3b2a40-25c8-4550-aba0-4632c19d7b09 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.299465 Jul 24 01:15:36.938249 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 800/1473] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:36 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:36.938249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:36.938249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:36.942140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.942673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:36.943775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:36.944038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.360891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:37.371632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7cd89e1-45c0-4b46-a0e6-58074a599b5a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1493 microversion: 2.1 time: 0.440355 Jul 24 01:15:37.372260 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 801/1474] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:36 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1493 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:37.377351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:37.378007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:37.388559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.389022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.389915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.390362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.553005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:37.563131 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-37e33c21-e3e7-41f3-985e-eae6399af1ec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1275 microversion: 2.1 time: 0.189762 Jul 24 01:15:37.563738 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 802/1475] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:37 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:37.573400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:37.573400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:37.577460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.577943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.578934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.579379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.918507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:37.934469 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d8350491-f8bf-46ef-8917-9c1fff29689e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1324 microversion: 2.1 time: 0.369258 Jul 24 01:15:37.944069 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 803/1476] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:37 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:37.951357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:37.952255 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:37.959843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.960888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:37.961873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:37.962625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:38.292132 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d209a861-be52-4f40-985a-6cc4cd093f1e tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/a00ef0a7-a98b-4cbd-a0b3-e52d344e86d1" status: 202 len: 0 microversion: 2.1 time: 1.643633 Jul 24 01:15:38.293449 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 674/1477] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:15:36 2022] DELETE /compute/v2.1/os-floating-ips/a00ef0a7-a98b-4cbd-a0b3-e52d344e86d1 => generated 0 bytes in 1645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:38.299542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:38.300269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:38.307792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:38.308405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:38.309295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:38.310057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:38.327811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:38.337451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8637d6ae-1ef1-4f23-9607-dc000a9c7c85 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1199 microversion: 2.1 time: 0.390943 Jul 24 01:15:38.338667 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 804/1478] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:37 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1199 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:38.345660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:38.346369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:38.353335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:38.353981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:38.354714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:38.356702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:38.903224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:38.911422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:38.913074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:38.914269 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5007606e-36c9-4bb6-ad47-54a098a85ee7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1557 microversion: 2.25 time: 0.619899 Jul 24 01:15:38.914883 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 675/1479] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:38 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1557 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:38.931138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7601fd21-80bc-43c5-820f-e1e1a3896e78 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Calling method '.version_select at 0x7f05eb349c10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:38.947077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:38.956040 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f3e84990-eda1-4673-a592-3a6de2d78cd9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.614876 Jul 24 01:15:38.956556 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 805/1480] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:38 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:38.961014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:38.961622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:38.968740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:38.969216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:38.970039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:38.970475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.259171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:39.267315 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-80934e1e-fbae-4c03-8204-431cf7c75e0d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1493 microversion: 2.1 time: 0.309783 Jul 24 01:15:39.267909 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 806/1481] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:38 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1493 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:39.281212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:39.281861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:39.288048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.288571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.289355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.289852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.676314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:39.684110 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63bd1a51-8e3b-424a-88b7-da9ef30227cf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1317 microversion: 2.1 time: 0.406631 Jul 24 01:15:39.693430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 807/1482] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:39 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:39.698532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:39.699978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:39.706259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.706814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:39.707657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:39.708159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.076736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:40.091848 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c520214b-08cc-4610-a7c2-caab2aab59d1 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 2049 microversion: 2.25 time: 0.396848 Jul 24 01:15:40.092448 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 808/1483] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:39 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 2049 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:40.097186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:40.097829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:40.106721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.107168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.107961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.108392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.409010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:40.419844 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef02d001-682a-4355-932c-ad336619b151 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1324 microversion: 2.1 time: 0.326241 Jul 24 01:15:40.420452 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 809/1484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:40 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:40.425909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:40.426525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:40.433969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.434593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.435393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.435832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.454911 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:40.577532 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7601fd21-80bc-43c5-820f-e1e1a3896e78 tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/79b11c1c-dce1-4a48-98dd-6f4e9df1f984" status: 202 len: 0 microversion: 2.1 time: 1.650117 Jul 24 01:15:40.579826 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 676/1485] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:15:38 2022] DELETE /compute/v2.1/os-floating-ips/79b11c1c-dce1-4a48-98dd-6f4e9df1f984 => generated 0 bytes in 1664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:40.588876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-09f1d3a3-deca-434e-aecf-7e7ed3100722 req-006d3e31-4fbd-459e-8d89-0368547b0a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57ea22b-8e5e-44f8-b5d2-f83188711d47", "name": "network-vif-plugged", "status": "completed", "tag": "e4e506dc-13a9-4a9e-97a0-b99d991960ac"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:40.606466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-09f1d3a3-deca-434e-aecf-7e7ed3100722 req-006d3e31-4fbd-459e-8d89-0368547b0a52 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.607068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-09f1d3a3-deca-434e-aecf-7e7ed3100722 req-006d3e31-4fbd-459e-8d89-0368547b0a52 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.622436 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-09f1d3a3-deca-434e-aecf-7e7ed3100722 req-006d3e31-4fbd-459e-8d89-0368547b0a52 service nova] Creating event network-vif-plugged:e4e506dc-13a9-4a9e-97a0-b99d991960ac for instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 on n-h2-master-1 Jul 24 01:15:40.632297 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-09f1d3a3-deca-434e-aecf-7e7ed3100722 req-006d3e31-4fbd-459e-8d89-0368547b0a52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050022 Jul 24 01:15:40.638744 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 677/1486] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:40.644966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:40.646126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:40.654169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.655003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.656127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.656795 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.758716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:40.771694 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-39fcead5-f6fd-4a3e-9da7-836efd052131 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1199 microversion: 2.1 time: 0.350054 Jul 24 01:15:40.775607 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 810/1487] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:40 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1199 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:40.778082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:40.778715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:40.785271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.785756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:40.786553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:40.787240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:41.124811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:41.132889 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b1b4201-438c-4110-9a02-9e5354289f5f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.492198 Jul 24 01:15:41.133626 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 678/1488] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:40 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:41.138540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:41.139461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:41.146157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:41.146607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:41.147533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:41.147973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:41.167084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:41.182672 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4ec8f14-b834-4b97-9a3f-8d9ef2e52d7f tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 2049 microversion: 2.25 time: 0.408627 Jul 24 01:15:41.184077 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 811/1489] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:40 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 2049 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:41.188815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed06574e-8fd4-48a6-8257-13d9aae9835c tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] Calling method '.version_select at 0x7f05eac98dc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:41.616761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:41.627086 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c5c6db69-cdde-408c-9a6a-6feb95ae0180 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 200 len: 1493 microversion: 2.1 time: 0.492281 Jul 24 01:15:41.627683 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 679/1490] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:41 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 1493 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:41.632489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:41.633112 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:41.640830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:41.641286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:41.642139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:41.642582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.488481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:42.497840 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6bdcffb3-19f8-4a4a-a7b5-79e22e821af6 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1317 microversion: 2.1 time: 0.869012 Jul 24 01:15:42.498700 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 680/1491] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:41 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:42.503890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a35fbab8-10b0-4a5b-9855-5e39529a3e71 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:42.505611 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:15:42.505611 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:15:42.507176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a35fbab8-10b0-4a5b-9855-5e39529a3e71 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.507786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a35fbab8-10b0-4a5b-9855-5e39529a3e71 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.508749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a35fbab8-10b0-4a5b-9855-5e39529a3e71 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.509406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a35fbab8-10b0-4a5b-9855-5e39529a3e71 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.541381 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a35fbab8-10b0-4a5b-9855-5e39529a3e71 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041214 Jul 24 01:15:42.542937 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 681/1492] 10.222.0.27 () {60 vars in 1216 bytes} [Sun Jul 24 01:15:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:15:42.548146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:42.549013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:42.555830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.556582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.557624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.558306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.868752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:42.876956 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c159cb5-1e08-454b-a638-9c5a1a6cc118 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1324 microversion: 2.1 time: 0.332718 Jul 24 01:15:42.877543 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 682/1493] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:42 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:42.882241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7ae74ce0-99ea-4c0c-96e5-e30bccc1cb51 req-edb62ddc-f733-4d1b-baa1-9e21ed3143c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa", "tag": "8fb2b79a-88da-458a-b886-b54a4965954d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:42.890983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7ae74ce0-99ea-4c0c-96e5-e30bccc1cb51 req-edb62ddc-f733-4d1b-baa1-9e21ed3143c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.891430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7ae74ce0-99ea-4c0c-96e5-e30bccc1cb51 req-edb62ddc-f733-4d1b-baa1-9e21ed3143c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.902914 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7ae74ce0-99ea-4c0c-96e5-e30bccc1cb51 req-edb62ddc-f733-4d1b-baa1-9e21ed3143c6 service nova] Creating event network-changed:8fb2b79a-88da-458a-b886-b54a4965954d for instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa on n-h1-master-1 Jul 24 01:15:42.908628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7ae74ce0-99ea-4c0c-96e5-e30bccc1cb51 req-edb62ddc-f733-4d1b-baa1-9e21ed3143c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029794 Jul 24 01:15:42.909266 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 683/1494] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:42.914607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:42.915279 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:42.922619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.923264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:42.924126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:42.924641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.135621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:43.146326 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-14db60fc-b28f-4d6b-b7c4-15c4e71418ad tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1383 microversion: 2.1 time: 0.235541 Jul 24 01:15:43.147079 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 684/1495] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:42 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1383 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:43.152814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:43.153613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.160956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.161732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.162660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.163218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.316120 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed06574e-8fd4-48a6-8257-13d9aae9835c tempest-FloatingIPDetailsTestJSON-1005394160 tempest-FloatingIPDetailsTestJSON-1005394160-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/58293054-738e-48a8-a910-2d3e00892d07" status: 202 len: 0 microversion: 2.1 time: 2.130762 Jul 24 01:15:43.316718 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 812/1496] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:15:41 2022] DELETE /compute/v2.1/os-floating-ips/58293054-738e-48a8-a910-2d3e00892d07 => generated 0 bytes in 2132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:43.322230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff61aca7-368f-45d0-b96a-fabb8c7fa54a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:43.322778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff61aca7-368f-45d0-b96a-fabb8c7fa54a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.325321 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:43.334016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff61aca7-368f-45d0-b96a-fabb8c7fa54a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.334508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff61aca7-368f-45d0-b96a-fabb8c7fa54a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.335460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff61aca7-368f-45d0-b96a-fabb8c7fa54a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.335978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff61aca7-368f-45d0-b96a-fabb8c7fa54a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.409504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff61aca7-368f-45d0-b96a-fabb8c7fa54a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756/action" status: 202 len: 0 microversion: 2.25 time: 0.091542 Jul 24 01:15:43.413060 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 813/1497] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:15:43 2022] POST /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:15:43.415861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:43.416569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.423529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.423984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.424765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.425205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.440094 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 HTTP/1.1 Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:15:43.441764 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:15:43.443690 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '4bc411e9-88ab-485f-b9f0-e1b452857f21'} Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:43.444686 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:15:43.449271 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:43.451007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:43.451007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d7d2e81-865f-45e6-8e55-37c6469570a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 404 len: 111 microversion: 2.1 time: 0.031611 Jul 24 01:15:43.451007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 814/1498] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:43 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:15:43.453582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:43.467866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ca5caa7-44c0-401a-92fd-048536d908e4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.319336 Jul 24 01:15:43.468909 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 685/1499] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:43 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:43.474515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:43.476188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.484206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.485924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.487582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.488119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.611830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b727e97c-24fc-4913-82b8-5375efff384b tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:43.612909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b727e97c-24fc-4913-82b8-5375efff384b tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.619999 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b727e97c-24fc-4913-82b8-5375efff384b tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.621120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b727e97c-24fc-4913-82b8-5375efff384b tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.622091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b727e97c-24fc-4913-82b8-5375efff384b tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.622634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b727e97c-24fc-4913-82b8-5375efff384b tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.754344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:43.772551 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7574c85e-12f4-4110-99f9-4da1a490b1ae tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 2054 microversion: 2.25 time: 0.302393 Jul 24 01:15:43.773136 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 686/1500] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:43 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 2054 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:43.778813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:43.780116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:43.787868 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.788326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.789118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:43.789561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:43.936501 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b727e97c-24fc-4913-82b8-5375efff384b tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1534 microversion: 2.1 time: 0.491278 Jul 24 01:15:43.937364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 815/1501] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:43 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1534 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:43.946867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1918927602", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "adf394c3-0407-4590-8c41-4e59f65f117d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:44.032089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] validate_networks() for [('adf394c3-0407-4590-8c41-4e59f65f117d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:15:44.236167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:44.251444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d4505406-f3b0-4ca2-941e-487ca1ced073 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1317 microversion: 2.1 time: 0.476619 Jul 24 01:15:44.265980 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 687/1502] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:43 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:44.273889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:44.275852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:44.286792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.287440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.288531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.289183 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.667608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:44.675683 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-608d0c01-3c82-4533-bd94-2f7f8e2c8c22 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1324 microversion: 2.1 time: 0.408076 Jul 24 01:15:44.676267 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 688/1503] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:44 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:44.681078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d61dd46-a09c-4731-ba59-5f775d80816e tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:44.681739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d61dd46-a09c-4731-ba59-5f775d80816e tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:44.688735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d61dd46-a09c-4731-ba59-5f775d80816e tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.689246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d61dd46-a09c-4731-ba59-5f775d80816e tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:44.690270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d61dd46-a09c-4731-ba59-5f775d80816e tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:44.690822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d61dd46-a09c-4731-ba59-5f775d80816e tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.139799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d61dd46-a09c-4731-ba59-5f775d80816e tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1534 microversion: 2.1 time: 0.462381 Jul 24 01:15:45.140691 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 689/1504] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:44 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1534 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:45.146800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:45.147815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:45.156218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.157099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.158567 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.159229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.264103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:15:45.264621 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:15:45.265089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:15:45.265731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:15:45.266188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:15:45.275821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.276274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.277898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.278347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.297768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:45.307549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for user f3de9a749c874cfc8c34deffb1001a79 and project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:45.325936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:15:45.328641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:15:45.381840 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cb31d1c1-5b02-41f6-847b-f164727ca118 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442618 Jul 24 01:15:45.382630 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 816/1505] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:15:45.387860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:45.388745 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:45.396009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.396464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.397258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.397716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.891246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:45.909117 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-181dad78-5350-490b-9515-f5463396a103 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.767138 Jul 24 01:15:45.912822 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 690/1506] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:45 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:45.919811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1b626e8d-e4ed-4575-88e9-48cd33453315 req-67e6f304-f1f3-4cbc-a886-ef4a05c3b9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc411e9-88ab-485f-b9f0-e1b452857f21", "name": "network-vif-deleted", "tag": "a0074f70-c1f5-40da-aa84-e9eb964ccd36"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:45.929529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1b626e8d-e4ed-4575-88e9-48cd33453315 req-67e6f304-f1f3-4cbc-a886-ef4a05c3b9b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.930329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1b626e8d-e4ed-4575-88e9-48cd33453315 req-67e6f304-f1f3-4cbc-a886-ef4a05c3b9b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.957243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1b626e8d-e4ed-4575-88e9-48cd33453315 req-67e6f304-f1f3-4cbc-a886-ef4a05c3b9b9 service nova] Creating event network-vif-deleted:a0074f70-c1f5-40da-aa84-e9eb964ccd36 for instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 on n-h2-master-1 Jul 24 01:15:45.967243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1b626e8d-e4ed-4575-88e9-48cd33453315 req-67e6f304-f1f3-4cbc-a886-ef4a05c3b9b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053045 Jul 24 01:15:45.968950 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 691/1507] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:45.971972 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=14 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:45.976931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a2bd828-52a0-45e8-bb3f-8b79279f76d3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:45.978534 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:15:45.978534 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:15:45.980480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a2bd828-52a0-45e8-bb3f-8b79279f76d3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.981250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a2bd828-52a0-45e8-bb3f-8b79279f76d3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:45.982382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a2bd828-52a0-45e8-bb3f-8b79279f76d3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:45.983319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a2bd828-52a0-45e8-bb3f-8b79279f76d3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.011145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:46.018047 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a2bd828-52a0-45e8-bb3f-8b79279f76d3 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047649 Jul 24 01:15:46.019430 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 692/1508] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:15:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:46.026549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:46.028157 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a2999cb-c00c-458d-8c71-669cdeacdc4a tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 2034 microversion: 2.25 time: 0.644139 Jul 24 01:15:46.028824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:46.043192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.043192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.043192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.043192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.044120 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 817/1509] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:45 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 2034 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:46.049768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:46.050722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:46.066557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.066825 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:46.067651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.068941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.069835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.253830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:46.265312 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dc2cc36-9c36-43d6-a31c-eac8a28e4819 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1219 microversion: 2.1 time: 0.215898 Jul 24 01:15:46.268381 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 818/1510] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:46 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1219 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:46.275340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:46.275967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:46.297045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.298628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.299713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.300139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.448292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:46.457370 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffbff52b-03c0-41d2-b0b5-ca8806253643 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1317 microversion: 2.1 time: 0.436414 Jul 24 01:15:46.462005 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 693/1511] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:46 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:46.467807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-aa80c63f-740e-43c8-ae30-258dd7ef4345 req-e179c64a-5521-40da-95e5-afe80d8a2a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2cf16e-4b21-44e1-bb24-1a0a161bd395", "name": "network-vif-plugged", "status": "completed", "tag": "0b367a55-70f7-4219-ab6f-7d04eededace"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:46.472684 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:46.477766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aa80c63f-740e-43c8-ae30-258dd7ef4345 req-e179c64a-5521-40da-95e5-afe80d8a2a60 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.478223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aa80c63f-740e-43c8-ae30-258dd7ef4345 req-e179c64a-5521-40da-95e5-afe80d8a2a60 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.492185 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-aa80c63f-740e-43c8-ae30-258dd7ef4345 req-e179c64a-5521-40da-95e5-afe80d8a2a60 service nova] Creating event network-vif-plugged:0b367a55-70f7-4219-ab6f-7d04eededace for instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 on n-h2-master-1 Jul 24 01:15:46.498259 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-aa80c63f-740e-43c8-ae30-258dd7ef4345 req-e179c64a-5521-40da-95e5-afe80d8a2a60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034637 Jul 24 01:15:46.498933 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 694/1512] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:46.505015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:46.506285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:46.513364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.513860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.514662 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.515112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.544455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lazy-loading 'flavor' on Instance uuid f57ea22b-8e5e-44f8-b5d2-f83188711d47 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:46.558726 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Going to try to live migrate instance to n-h1-master-1 {{(pid=119562) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:15:46.587397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:46.615261 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6c7cd04-ce2e-4527-acaf-490554ed87c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1324 microversion: 2.1 time: 0.345874 Jul 24 01:15:46.618120 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 819/1513] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:46 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:46.629003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:46.642031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:46.652755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.653580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.655388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:46.656530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:46.697495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'flavor' on Instance uuid 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:15:46.736752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Going to try to live migrate instance to n-h2-master-1 {{(pid=119561) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:15:49.014104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-27d1d75e-9bd7-44a3-baa9-cc78038a291a tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47/action" status: 202 len: 0 microversion: 2.1 time: 2.511683 Jul 24 01:15:49.015385 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 695/1514] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:46 2022] POST /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47/action => generated 0 bytes in 2515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:15:49.020923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:49.021560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:49.052792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.053627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.056689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.057378 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.351252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31cb3b3b-7095-4197-9f5b-234ac5a2bbb6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756/action" status: 202 len: 0 microversion: 2.25 time: 2.729438 Jul 24 01:15:49.357471 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 820/1515] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:15:46 2022] POST /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756/action => generated 0 bytes in 2739 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:15:49.361584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:49.377127 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4408baf9-9eb8-427e-a67e-63f0c08272e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.360693 Jul 24 01:15:49.380946 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 696/1516] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:49 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:49.392429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:49.393595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:49.408959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:49.414148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:49.425256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.426425 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.430083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.439211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.439834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.445022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:49.446851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.454759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:49.973915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:49.983959 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8e345456-b3ac-4ebb-a318-7398ed78e097 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.621813 Jul 24 01:15:49.985378 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 821/1517] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:49 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:49.994357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:49.996719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:50.008479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.010522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.012672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.013879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.030010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:50.038243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e6b1e72-a150-4558-9f23-1120b6ca7949 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1317 microversion: 2.1 time: 0.654452 Jul 24 01:15:50.044416 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 697/1518] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:49 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:50.054775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c01e7a71-a01d-4e37-babf-36f5fa2f821a req-49dac04c-5a68-43a7-ac36-cd8d169f51d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa", "name": "network-vif-plugged", "status": "completed", "tag": "8fb2b79a-88da-458a-b886-b54a4965954d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:50.073265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c01e7a71-a01d-4e37-babf-36f5fa2f821a req-49dac04c-5a68-43a7-ac36-cd8d169f51d0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.076524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c01e7a71-a01d-4e37-babf-36f5fa2f821a req-49dac04c-5a68-43a7-ac36-cd8d169f51d0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.117438 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c01e7a71-a01d-4e37-babf-36f5fa2f821a req-49dac04c-5a68-43a7-ac36-cd8d169f51d0 service nova] Creating event network-vif-plugged:8fb2b79a-88da-458a-b886-b54a4965954d for instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa on n-h1-master-1 Jul 24 01:15:50.129581 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c01e7a71-a01d-4e37-babf-36f5fa2f821a req-49dac04c-5a68-43a7-ac36-cd8d169f51d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083677 Jul 24 01:15:50.136315 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 698/1519] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:50.145014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:50.146290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:50.153426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.154096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.155520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.156214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.537905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:50.555882 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-049ec538-9c4a-4f43-9e14-87184815ab66 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.568636 Jul 24 01:15:50.566291 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 822/1520] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:49 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:50.568204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:50.569084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:50.577438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.578047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.578937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.579502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.635055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:50.649434 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1cf8484-21c4-401d-9aef-7b521283450d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.511245 Jul 24 01:15:50.650065 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 699/1521] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:50 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:50.659751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-57873c28-afa7-4b34-984c-512dbd0c58ec req-08876cce-531f-42d3-8502-3cea80a9af87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbcef7d1-f119-4018-9d80-58db946c1a64", "tag": "bb419d01-72ec-4f9e-8f32-00bf0e7c950e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:50.669803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-57873c28-afa7-4b34-984c-512dbd0c58ec req-08876cce-531f-42d3-8502-3cea80a9af87 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.670554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-57873c28-afa7-4b34-984c-512dbd0c58ec req-08876cce-531f-42d3-8502-3cea80a9af87 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.685482 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-57873c28-afa7-4b34-984c-512dbd0c58ec req-08876cce-531f-42d3-8502-3cea80a9af87 service nova] Creating event network-changed:bb419d01-72ec-4f9e-8f32-00bf0e7c950e for instance fbcef7d1-f119-4018-9d80-58db946c1a64 on n-h2-master-1 Jul 24 01:15:50.691620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-57873c28-afa7-4b34-984c-512dbd0c58ec req-08876cce-531f-42d3-8502-3cea80a9af87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036302 Jul 24 01:15:50.692893 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 700/1522] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:50.699479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:50.700667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:50.708879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.716515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:50.717636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:50.719178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.026057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.046473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.049390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.051798 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2bc43a31-eb6b-4b1f-ab94-26eeb37ece69 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.493870 Jul 24 01:15:51.052708 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 823/1523] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:50 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:51.061750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.062702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.072406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.075475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.077384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.078261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.173416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.184109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b916850-08a9-4fd0-8201-978c69b14cd6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.489732 Jul 24 01:15:51.185358 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 701/1524] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:50 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:51.195690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.196331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.203899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.204361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.205161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.205605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.401981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.410701 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-870ac69c-bad8-46f8-8128-0ee3b8e8bcfe tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.355855 Jul 24 01:15:51.424288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 824/1525] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:51.429965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.430902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.439648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.440521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.441648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.442395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.470572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.494412 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23052363-118a-4493-ae92-b89ec1dab100 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.307245 Jul 24 01:15:51.497285 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 702/1526] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:51.514620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-891d356d-5704-465f-a8a4-544671b3c112 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-960317155", "metadata": {"": ""}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-891d356d-5704-465f-a8a4-544671b3c112 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action HTTP/1.1 Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 106 Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:15:51.525830 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-960317155", "metadata": {"": ""}}} Jul 24 01:15:51.529528 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '5a2cf16e-4b21-44e1-bb24-1a0a161bd395', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-960317155', 'metadata': {'': ''}}}} Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'': ''} Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:51.531229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:51.535157 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-891d356d-5704-465f-a8a4-544671b3c112 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-891d356d-5704-465f-a8a4-544671b3c112 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action" status: 400 len: 170 microversion: 2.1 time: 0.030013 Jul 24 01:15:51.547872 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 703/1527] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Jul 24 01:15:51 2022] POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action => generated 170 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:15:51.553484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.554251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.573626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.574143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.575072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.575562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.702277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.713104 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:51.725096 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-57cf03be-53f0-4ff6-9308-48127db41814 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1317 microversion: 2.1 time: 0.299203 Jul 24 01:15:51.728137 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 825/1528] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:51.744353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.747619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.764985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.767552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.769765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.771779 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.913769 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:51.929760 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa2b8d43-d428-404f-b6a9-a638208c3d76 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.381153 Jul 24 01:15:51.930474 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 704/1529] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:51.949447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:51.950550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:51.959309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.959890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:51.965082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:51.965082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.008213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.017901 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a90a9693-0676-44ca-b22e-0440b94dc9e0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.277801 Jul 24 01:15:52.021908 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 826/1530] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:52.078365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.079479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.088493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.090170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.091856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.093030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.161551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.179312 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38d64bd9-6004-400b-8772-8dcb892fd74f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.234454 Jul 24 01:15:52.187445 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 705/1531] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:51 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:52.203423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69ac2b35-68de-4a05-aef4-5e57b1a17f89 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2094260169", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69ac2b35-68de-4a05-aef4-5e57b1a17f89 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action HTTP/1.1 Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 619 Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:15:52.208213 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:52.209832 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:15:52.210535 n-d-master-1 devstack@n-api.service[119562]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2094260169", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 24 01:15:52.210535 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:15:52.210535 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '5a2cf16e-4b21-44e1-bb24-1a0a161bd395', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2094260169', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 24 01:15:52.210780 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:52.211543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:52.212670 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:52.213474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:52.213474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:52.213474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:15:52.213474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:15:52.213474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:15:52.213474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:52.213931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69ac2b35-68de-4a05-aef4-5e57b1a17f89 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:52.213931 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-69ac2b35-68de-4a05-aef4-5e57b1a17f89 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action" status: 400 len: 938 microversion: 2.1 time: 0.014384 Jul 24 01:15:52.213931 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 706/1532] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Jul 24 01:15:52 2022] POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action => generated 938 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:15:52.217782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.218407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.227026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.227519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.228322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.228750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.389879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.403947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.406379 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.407847 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f7b5419-7dda-4be2-bd0d-38340a131433 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.340232 Jul 24 01:15:52.422014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 827/1533] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:52.427241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.427885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.435392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.435867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.436696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.437318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.459589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.471672 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a93a29f-4e75-496c-b16d-c7beb80cbbf6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.259989 Jul 24 01:15:52.479175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 707/1534] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:52.514437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.515192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.523418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.523985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.524973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.525770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.704644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.725876 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ab98361-b16b-4643-bb44-04be6957a0c4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.301875 Jul 24 01:15:52.727055 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 828/1535] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:52.749451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.751010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.759934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.761892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.762951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.763834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.790978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:52.801933 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2149c087-7189-4746-90e1-47e04322c494 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.291744 Jul 24 01:15:52.802935 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 708/1536] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:52.808511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:52.809361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:52.817612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.818506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:52.819544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:52.820209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.031432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:53.034598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:53.043748 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4924d660-3527-4db5-838f-b99f9c8d7a81 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1467 microversion: 2.1 time: 0.239175 Jul 24 01:15:53.053915 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 709/1537] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1467 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:53.054143 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be34cd8f-6b94-4f0e-b482-e40e2563de93 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.301442 Jul 24 01:15:53.054143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 829/1538] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:52 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:53.054319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:53.054319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:53.057639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.057901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.059139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.059361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.070243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1fd97146-a4f5-4824-9e30-59d251097da9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1fd97146-a4f5-4824-9e30-59d251097da9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action HTTP/1.1 Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 285 Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:15:53.077566 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:15:53.080721 n-d-master-1 devstack@n-api.service[119561]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '5a2cf16e-4b21-44e1-bb24-1a0a161bd395', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:15:53.081552 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:15:53.082566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:15:53.084176 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:15:53.085269 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:15:53.085269 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:15:53.086892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1fd97146-a4f5-4824-9e30-59d251097da9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:53.090824 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1fd97146-a4f5-4824-9e30-59d251097da9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action" status: 400 len: 619 microversion: 2.1 time: 0.030506 Jul 24 01:15:53.093396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 830/1539] 10.222.0.27 () {60 vars in 1278 bytes} [Sun Jul 24 01:15:53 2022] POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:15:53.103090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-112346286", "metadata": {"image_type": "test"}}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:53.105046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:53.114066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.115129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.116269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.116947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.172797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Getting quotas for project 8a078a3f8468439788ea2327659fb762. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:15:53.180735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Getting quotas for user 82276fe777fb4b08ac6baddf33d752ab and project 8a078a3f8468439788ea2327659fb762. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:15:53.305509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:53.315473 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-40bced7f-fdf0-44a5-a1e8-0e91f8624b4d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.269673 Jul 24 01:15:53.316067 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 710/1540] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:53 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:53.331283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:53.332304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:53.343482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.344230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.346976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.347616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.613372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-481438a9-c66f-46e7-b653-60ffb8be344d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "POST /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.514461 Jul 24 01:15:53.615073 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 831/1541] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:53 2022] POST /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:15:53.623861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:53.627690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:53.640661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.642896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.644568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.646209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.649879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:53.672145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0167fe21-22b4-4506-b136-0b9cc33e6d9c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.342798 Jul 24 01:15:53.673319 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 711/1542] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:53 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:53.679663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:53.691495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:53.709147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.710067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.711163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:53.711872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:53.718838 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:54.475342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:54.488986 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-00fdf2d1-1f61-4ce8-a37d-fa0b1eeba216 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.813148 Jul 24 01:15:54.493428 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 712/1543] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:53 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:54.508937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-96dedb21-7bdd-4f51-8eaf-02fae442865c tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb3748b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:54.612667 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-96dedb21-7bdd-4f51-8eaf-02fae442865c tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.117508 Jul 24 01:15:54.613466 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 713/1544] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:54 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:54.625339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:54.630847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:54.651077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.651691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.653157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.661588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.732279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:54.750618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:54.755611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:54.758368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a84c7568-78dc-459d-8fd5-ae4e97f31c59 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 1.141165 Jul 24 01:15:54.759571 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 832/1545] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:53 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:54.765272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:54.766763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:54.788194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.793239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:54.798220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:54.800839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.286748 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:55.316989 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:55.440402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:55.458240 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a98db85-e9ae-4712-86e5-7c567ffcf80c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.696808 Jul 24 01:15:55.459871 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 833/1546] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:54 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:55.490360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ded8e7a5-012e-4adb-ad8c-b5b8a2086448 req-772c3d88-fc21-425b-a5fd-ce23e87b348a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756", "name": "network-vif-unplugged", "status": "completed", "tag": "42c48376-af28-46ff-826d-a163933356db"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:55.518058 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:55.534932 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d40e5ab5-95cb-4d0d-82fa-6287d512dd38 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.914686 Jul 24 01:15:55.536681 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 714/1547] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:54 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:55.545654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ded8e7a5-012e-4adb-ad8c-b5b8a2086448 req-772c3d88-fc21-425b-a5fd-ce23e87b348a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:55.546360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:55.546593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ded8e7a5-012e-4adb-ad8c-b5b8a2086448 req-772c3d88-fc21-425b-a5fd-ce23e87b348a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.547616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:55.566370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:55.567219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.571831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:55.573547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.606350 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ded8e7a5-012e-4adb-ad8c-b5b8a2086448 req-772c3d88-fc21-425b-a5fd-ce23e87b348a service nova] Creating event network-vif-unplugged:42c48376-af28-46ff-826d-a163933356db for instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 on n-h1-master-1 Jul 24 01:15:55.615145 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ded8e7a5-012e-4adb-ad8c-b5b8a2086448 req-772c3d88-fc21-425b-a5fd-ce23e87b348a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153236 Jul 24 01:15:55.617389 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 834/1548] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:55.628459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:55.634078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:55.652091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:55.655552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.656395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:55.656839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:55.996866 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:56.066537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:56.080192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa0eaf04-0952-47c7-a84c-79802fd3859d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.541852 Jul 24 01:15:56.093021 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 715/1549] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:55 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:56.103075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ebe3bf12-f76b-49d8-8918-9c3b00b9d3b0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1446613158"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:56.105503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ebe3bf12-f76b-49d8-8918-9c3b00b9d3b0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:56.133430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe3bf12-f76b-49d8-8918-9c3b00b9d3b0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.134395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe3bf12-f76b-49d8-8918-9c3b00b9d3b0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.135539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe3bf12-f76b-49d8-8918-9c3b00b9d3b0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.137055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe3bf12-f76b-49d8-8918-9c3b00b9d3b0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.168943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:56.179084 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c2822e44-9ca1-4541-b229-0e01a2f5ef40 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.557578 Jul 24 01:15:56.190678 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 835/1550] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:55 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:56.196059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5321e03-6a5c-41f1-9d12-dd005b4ad413 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb5c9700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:56.274427 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b5321e03-6a5c-41f1-9d12-dd005b4ad413 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.082505 Jul 24 01:15:56.275982 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 836/1551] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:56 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:56.282361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:56.283557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:56.290738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.291580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.293731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.294459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.628083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:56.643706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:56.645995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:56.650765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e232aed-3bee-4e89-a9c0-3eb4783e0fe9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.372854 Jul 24 01:15:56.656480 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 837/1552] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:56 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:56.663921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:56.667885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:56.689212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.692325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.696220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.697060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.744120 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ebe3bf12-f76b-49d8-8918-9c3b00b9d3b0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action" status: 202 len: 0 microversion: 2.1 time: 0.641034 Jul 24 01:15:56.756520 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 716/1553] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:56 2022] POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:15:56.786134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1550834358"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:56.788379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:56.815195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.816015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.825287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:56.826141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:56.888851 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Cannot 'createImage' instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 while it is in task_state image_snapshot Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action HTTP/1.1 Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 85 Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:15:56.890600 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1550834358"}} Jul 24 01:15:56.892481 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'createImage' instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 while it is in task_state image_snapshot Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '5a2cf16e-4b21-44e1-bb24-1a0a161bd395', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1550834358'}}} Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:15:56.893508 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 while it is in task_state image_snapshot Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 while it is in task_state image_snapshot Jul 24 01:15:56.895577 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:15:56.897292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 409 to user: Cannot 'createImage' instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 while it is in task_state image_snapshot {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:15:56.897292 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4425a9f6-1d70-4d00-9ae2-35e0b8e0185a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action" status: 409 len: 159 microversion: 2.1 time: 0.128655 Jul 24 01:15:56.897292 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 717/1554] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:15:56 2022] POST /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395/action => generated 159 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:15:56.903522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fbc136c5-d4bf-499a-b395-26ee136b2882 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '.version_select at 0x7f05eb84d4c0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:57.104193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:57.128705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f54f51da-848d-41f9-9a81-05c1e64658a9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.470314 Jul 24 01:15:57.130205 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 838/1555] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:56 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:57.137818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:57.139213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:57.150873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.152485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.153842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.154545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.243849 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fbc136c5-d4bf-499a-b395-26ee136b2882 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/images/c45bd24a-d013-49cc-8f14-cfe42aa10753" status: 204 len: 0 microversion: 2.1 time: 0.344514 Jul 24 01:15:57.244819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 718/1556] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:56 2022] DELETE /compute/v2.1/images/c45bd24a-d013-49cc-8f14-cfe42aa10753 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:15:57.250363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:57.251683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:57.270006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.270467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.271260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.271697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.393750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:57.405185 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30d4b640-0667-477a-ab61-ce71c4a9bb8e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.273092 Jul 24 01:15:57.418063 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 839/1557] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:57 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:57.441007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:57.441931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:57.466289 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.467281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.468265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.468813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.681365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:57.689243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8cd77215-3cde-44c2-a2ff-ccf8208b94a2 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.443197 Jul 24 01:15:57.690438 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 719/1558] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:57 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:57.694824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:57.704340 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e4d85bb-f1b2-427b-881d-d008aaeaa7be tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1533 microversion: 2.1 time: 0.277268 Jul 24 01:15:57.707184 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 840/1559] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:57 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1533 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:57.718243 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4edcd3b2-d059-40db-bd1a-8186fb9f3cfc tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb881160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:57.719912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f135c573-6d58-40fb-b79c-3827ede9435f req-5c6d8f50-d973-4855-83da-6dcd5b2eefbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756", "tag": "42c48376-af28-46ff-826d-a163933356db"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:15:57.731008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f135c573-6d58-40fb-b79c-3827ede9435f req-5c6d8f50-d973-4855-83da-6dcd5b2eefbf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.731791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f135c573-6d58-40fb-b79c-3827ede9435f req-5c6d8f50-d973-4855-83da-6dcd5b2eefbf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.751581 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f135c573-6d58-40fb-b79c-3827ede9435f req-5c6d8f50-d973-4855-83da-6dcd5b2eefbf service nova] Creating event network-changed:42c48376-af28-46ff-826d-a163933356db for instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 on n-h1-master-1 Jul 24 01:15:57.763763 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4edcd3b2-d059-40db-bd1a-8186fb9f3cfc tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.072065 Jul 24 01:15:57.765092 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 720/1560] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:57 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:57.772405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:57.775046 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f135c573-6d58-40fb-b79c-3827ede9435f req-5c6d8f50-d973-4855-83da-6dcd5b2eefbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066099 Jul 24 01:15:57.776129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 841/1561] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:15:57.777042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:57.791366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.792019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:57.792890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:57.793257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:58.147512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:58.148232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:58.176172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:58.176694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:58.177546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:58.181115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:58.296652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:58.311462 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:58.316153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:58.317585 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8dc7b6ed-1e34-491d-b8dd-448f12430276 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.549371 Jul 24 01:15:58.340364 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 721/1562] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:57 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:15:58.423251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:58.423880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:58.438310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:58.438844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:58.446019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:58.446616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:58.737486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:58.751103 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-44792526-dbc5-4d56-8778-37fab0175add tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.607732 Jul 24 01:15:58.752028 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 842/1563] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:58 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:58.756832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:58.757453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:58.787542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:58.788042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:58.788847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:58.789293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:59.057157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:59.065236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-927dd2b7-c2b0-4f4a-b9e6-b3f4074a3058 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.645768 Jul 24 01:15:59.078310 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 722/1564] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:58 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:15:59.084357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:59.090694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:59.105126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:59.106595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:59.110998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:59.111754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:59.409772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:59.424332 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b7e9375-7318-42d5-96f8-04b7a0af2751 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1533 microversion: 2.1 time: 0.340382 Jul 24 01:15:59.425548 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 723/1565] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:59 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1533 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:59.434290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cfbe0891-4214-42d1-8c6c-de9493cff38d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb881f70>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:59.529830 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cfbe0891-4214-42d1-8c6c-de9493cff38d tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.102583 Jul 24 01:15:59.530353 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 724/1566] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:59 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:59.551924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:59.556474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:59.559917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:59.562813 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:59.573939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:59.574772 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9bb200a1-2ac6-4260-a5d8-086c769be403 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.821575 Jul 24 01:15:59.575572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:59.577462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:59.579454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:59.587451 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 843/1567] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:58 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:15:59.770473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:15:59.771230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:15:59.794009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:59.795482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:59.797119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:15:59.799544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:15:59.929489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:59.939783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:59.941637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:15:59.943022 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f63dc65d-0f5d-4c72-9866-48202c07da37 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.407239 Jul 24 01:15:59.956787 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 725/1568] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:15:59 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:00.084907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:00.085769 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:00.094621 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:00.096421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:00.097083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:00.098360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:00.099161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:00.111201 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-512db8e8-a0b8-46b9-9a2c-9b7119b75a8c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.346296 Jul 24 01:16:00.112465 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 844/1569] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:15:59 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:00.431591 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cc4bb164-8455-4da5-9cab-28a71ae91c10 req-7d793211-8cb8-4eb1-aee1-e8f2981b1496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcef7d1-f119-4018-9d80-58db946c1a64", "name": "network-vif-plugged", "status": "completed", "tag": "bb419d01-72ec-4f9e-8f32-00bf0e7c950e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:00.477032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc4bb164-8455-4da5-9cab-28a71ae91c10 req-7d793211-8cb8-4eb1-aee1-e8f2981b1496 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:00.478665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc4bb164-8455-4da5-9cab-28a71ae91c10 req-7d793211-8cb8-4eb1-aee1-e8f2981b1496 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:00.486363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:00.497971 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc4bb164-8455-4da5-9cab-28a71ae91c10 req-7d793211-8cb8-4eb1-aee1-e8f2981b1496 service nova] Creating event network-vif-plugged:bb419d01-72ec-4f9e-8f32-00bf0e7c950e for instance fbcef7d1-f119-4018-9d80-58db946c1a64 on n-h2-master-1 Jul 24 01:16:00.509008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-60d6f12e-70c3-4965-ac64-573bb272ab67 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.421930 Jul 24 01:16:00.509788 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 726/1570] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:00 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:00.510303 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cc4bb164-8455-4da5-9cab-28a71ae91c10 req-7d793211-8cb8-4eb1-aee1-e8f2981b1496 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083951 Jul 24 01:16:00.511671 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 845/1571] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:16:00.564073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-db088568-4bdd-4faf-9d48-1f0e579956e0 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb5c9160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:00.572938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:00.574761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:00.595117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:00.596391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:00.613410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:00.614223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:00.682292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-db088568-4bdd-4faf-9d48-1f0e579956e0 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.141552 Jul 24 01:16:00.688403 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 846/1572] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:00 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:00.696930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:00.708236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:00.740469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:00.741158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:00.742308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:00.742912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:01.200780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:01.220796 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d7ca85d9-6283-4fa1-9852-d3d4fc8949c9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1539 microversion: 2.1 time: 0.692488 Jul 24 01:16:01.229248 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 727/1573] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:00 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1539 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:01.249548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:01.250570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:01.262738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:01.267699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:01.270897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:01.278105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:01.287708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:01.301974 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6347401e-5e0a-40bc-a305-7bfc8081e52c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.612157 Jul 24 01:16:01.302590 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 847/1574] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:00 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:01.321315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:01.329072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:01.357142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:01.365955 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:01.366994 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:01.367459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:01.705908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:01.718844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:01.720703 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:01.723041 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0c5a268a-735f-4113-8e49-d16e9f9bf533 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.491369 Jul 24 01:16:01.730439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:01.741532 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 728/1575] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:01 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:01.741532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:01.741532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:01.754411 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4fecbb01-eae7-4268-a01f-ed23153827ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1315 microversion: 2.1 time: 0.450701 Jul 24 01:16:01.762051 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 848/1576] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:01 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:01.765763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:01.766340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:01.767665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de138cd4-2459-4d06-8652-7b02dfe4cdb7 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac46c10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:01.768598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:01.769146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:01.874808 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de138cd4-2459-4d06-8652-7b02dfe4cdb7 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.111100 Jul 24 01:16:01.878151 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 849/1577] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:01 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:02.107504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:02.123129 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28feec0d-e34d-4630-b54e-8ccff60b1994 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.386944 Jul 24 01:16:02.124624 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 729/1578] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:01 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:02.190365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e36a1e88-e669-4a68-bece-c8adf442ac91 req-02325b99-3243-4e4f-b02a-f7409cbc2cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756", "name": "network-vif-unplugged", "status": "completed", "tag": "42c48376-af28-46ff-826d-a163933356db"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:02.209227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e36a1e88-e669-4a68-bece-c8adf442ac91 req-02325b99-3243-4e4f-b02a-f7409cbc2cdb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:02.209907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e36a1e88-e669-4a68-bece-c8adf442ac91 req-02325b99-3243-4e4f-b02a-f7409cbc2cdb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:02.242133 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e36a1e88-e669-4a68-bece-c8adf442ac91 req-02325b99-3243-4e4f-b02a-f7409cbc2cdb service nova] Creating event network-vif-unplugged:42c48376-af28-46ff-826d-a163933356db for instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 on n-h1-master-1 Jul 24 01:16:02.258462 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e36a1e88-e669-4a68-bece-c8adf442ac91 req-02325b99-3243-4e4f-b02a-f7409cbc2cdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072665 Jul 24 01:16:02.275643 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 730/1579] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:02.294855 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:02.297137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:02.315678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:02.316009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:02.316809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:02.317245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:02.374871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ff77985-4864-4d9f-9651-a2f0ad668604 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eacb60d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1061039800", "description": "tempest-description-1294484039"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:02.705066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:02.714548 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4766c9ed-dd6f-438e-a6d4-59f617a4286d tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1539 microversion: 2.1 time: 0.436479 Jul 24 01:16:02.715135 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 731/1580] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:02 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1539 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:02.725223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:02.734194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:02.742819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:02.745046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:02.747519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:02.748789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:02.777572 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:02.961828 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1ff77985-4864-4d9f-9651-a2f0ad668604 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.826258 Jul 24 01:16:02.965865 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 850/1581] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:02 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:02.978535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:02.980671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:03.013044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:03.017036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:03.018332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:03.019107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:03.168879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:03.192685 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9d9c98fa-dc99-4217-a5a5-2f3395fe8726 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 0.475587 Jul 24 01:16:03.193808 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 732/1582] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:02 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:03.231932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:03.238642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:03.256788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:03.257439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:03.258534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:03.260104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:03.359474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:03.368090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:03.369960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:03.371431 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c3a0402b-c411-4f16-a280-0ff4b2c9c4d2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.403471 Jul 24 01:16:03.372612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 851/1583] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:02 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:03.377501 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-396c007d-c170-4e36-9f1c-204a683361b8 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eacba9d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:03.434360 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-396c007d-c170-4e36-9f1c-204a683361b8 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.060370 Jul 24 01:16:03.435154 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 852/1584] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:03 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:03.440631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-623a7b18-adb8-456e-9c70-3056aecd44de tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eac98dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-901292959", "description": "tempest-description-1901605833"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:03.669701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:03.695251 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a5b434a-0f63-42fd-b61d-17d92c1b4c93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1502 microversion: 2.1 time: 0.496622 Jul 24 01:16:03.695958 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 733/1585] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:03 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1502 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:03.704692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:03.705657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:03.714309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:03.715056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:03.716395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:03.717060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:03.963075 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-623a7b18-adb8-456e-9c70-3056aecd44de tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.526746 Jul 24 01:16:03.966303 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 853/1586] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:03.971404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4623f8d9-4af3-4cc9-887b-58089d841cf8 req-c111fda0-9b6c-4941-8a4d-0e2ce6190ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa", "name": "network-vif-plugged", "status": "completed", "tag": "8fb2b79a-88da-458a-b886-b54a4965954d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:04.004600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4623f8d9-4af3-4cc9-887b-58089d841cf8 req-c111fda0-9b6c-4941-8a4d-0e2ce6190ffa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:04.006565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4623f8d9-4af3-4cc9-887b-58089d841cf8 req-c111fda0-9b6c-4941-8a4d-0e2ce6190ffa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:04.030201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:04.036763 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4623f8d9-4af3-4cc9-887b-58089d841cf8 req-c111fda0-9b6c-4941-8a4d-0e2ce6190ffa service nova] Creating event network-vif-plugged:8fb2b79a-88da-458a-b886-b54a4965954d for instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa on n-h1-master-1 Jul 24 01:16:04.040202 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e325cb90-a6c4-4f72-b86f-5841a2606f14 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.342975 Jul 24 01:16:04.041419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 734/1587] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:03 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:04.048124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:04.053950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:04.061161 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4623f8d9-4af3-4cc9-887b-58089d841cf8 req-c111fda0-9b6c-4941-8a4d-0e2ce6190ffa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093183 Jul 24 01:16:04.062058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:04.062229 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 854/1588] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:04.063249 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:04.064251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:04.065008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:04.074292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:04.079458 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:04.101141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:04.102118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:04.103417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:04.104218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:04.128360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lazy-loading 'flavor' on Instance uuid fbcef7d1-f119-4018-9d80-58db946c1a64 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:04.437931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:04.466685 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a9adf1da-73f1-44e9-97c0-ec6c840dee46 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1539 microversion: 2.1 time: 0.402752 Jul 24 01:16:04.476614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 855/1589] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:04 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1539 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:04.476614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1150003562", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "f5ce1bc7-c250-4074-923e-d47eda57456b"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:04.606088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] validate_networks() for [('f5ce1bc7-c250-4074-923e-d47eda57456b', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:16:04.762077 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad7e15bf-d2e2-48da-af33-3e67abbde7c3 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64/action" status: 202 len: 0 microversion: 2.1 time: 0.718491 Jul 24 01:16:04.763478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 735/1590] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:04 2022] POST /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:04.771555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:04.772562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:04.780275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:04.781020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:04.782048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:04.782660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:05.758683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:05.772335 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fa72c42-7fa2-4ca1-a358-762b3d28fc3f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1515 microversion: 2.1 time: 1.006165 Jul 24 01:16:05.775460 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 736/1591] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:04 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1515 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:05.785476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:05.788136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:05.802694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:05.807071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:05.808592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:05.809894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.297945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:16:06.298455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:16:06.298824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:16:06.299241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:16:06.299652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:16:06.316565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.317017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.317855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.318296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.346201 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:06.356659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Getting quotas for project 59f19f4a68ce46019ac8f50a275b2d3d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:06.372064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Getting quotas for user cee3f1e6e5ba4185a4080a27d7c21702 and project 59f19f4a68ce46019ac8f50a275b2d3d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:06.393447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:16:06.401876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:16:06.438079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:06.453651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:06.455790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:06.458968 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8620e618-1e5a-4ed1-89b8-05e5fb29e26b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.682103 Jul 24 01:16:06.471453 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 737/1592] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:05 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:06.484037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19e65dce-3b3e-480e-92c0-26c3f4e5f5a4 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb349280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:06.519094 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e43f8204-78fe-4dd1-8084-6724823b335d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050090 Jul 24 01:16:06.522273 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 856/1593] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:16:06.541627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:06.542922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:06.560096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.561453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.562745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.563382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.574893 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-19e65dce-3b3e-480e-92c0-26c3f4e5f5a4 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.096337 Jul 24 01:16:06.579904 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 738/1594] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:06 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:06.586627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:06.598754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:06.616433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.617211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:06.618371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:06.619157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:07.282493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:07.300865 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24c79a1a-04c6-44e9-9f40-acf40c3f645c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.777164 Jul 24 01:16:07.303020 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 857/1595] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:06 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:07.323273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:07.324262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:07.345872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:07.346511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:07.347587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:07.348304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:07.503897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:07.513435 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8895c09-d71e-4a9b-881a-129a2d3bf13e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.932071 Jul 24 01:16:07.523076 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 739/1596] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:06 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:07.538587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aca2f6b1-2ea3-4712-89ad-15584099832b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:07.540137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aca2f6b1-2ea3-4712-89ad-15584099832b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:07.895791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aca2f6b1-2ea3-4712-89ad-15584099832b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:07.908875 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aca2f6b1-2ea3-4712-89ad-15584099832b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1216 microversion: 2.1 time: 0.381049 Jul 24 01:16:07.910643 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 740/1597] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:07 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1216 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:07.949889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:07.952811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:07.970235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:08.000793 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e259de6-85ed-4133-a809-db7869ab357e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1534 microversion: 2.1 time: 0.696329 Jul 24 01:16:08.001188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.001959 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.003168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.015446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.015766 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 858/1598] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:07 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1534 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:08.048934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cc0cef5b-bb34-40b1-ad89-d00a8f9a0577 req-a4c41b98-50e0-4a72-a513-e0bdcac5561e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57ea22b-8e5e-44f8-b5d2-f83188711d47", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e506dc-13a9-4a9e-97a0-b99d991960ac"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:08.093491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc0cef5b-bb34-40b1-ad89-d00a8f9a0577 req-a4c41b98-50e0-4a72-a513-e0bdcac5561e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.097350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc0cef5b-bb34-40b1-ad89-d00a8f9a0577 req-a4c41b98-50e0-4a72-a513-e0bdcac5561e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.171253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc0cef5b-bb34-40b1-ad89-d00a8f9a0577 req-a4c41b98-50e0-4a72-a513-e0bdcac5561e service nova] Creating event network-vif-unplugged:e4e506dc-13a9-4a9e-97a0-b99d991960ac for instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 on n-h2-master-1 Jul 24 01:16:08.193188 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cc0cef5b-bb34-40b1-ad89-d00a8f9a0577 req-a4c41b98-50e0-4a72-a513-e0bdcac5561e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172254 Jul 24 01:16:08.198956 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 859/1599] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:08.210141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-93da463e-5945-4e30-96f3-b10ca555277b req-f2b94ad0-4425-4313-95d9-4df32d64f626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756", "name": "network-vif-plugged", "status": "completed", "tag": "42c48376-af28-46ff-826d-a163933356db"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:08.257071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-93da463e-5945-4e30-96f3-b10ca555277b req-f2b94ad0-4425-4313-95d9-4df32d64f626 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.260892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-93da463e-5945-4e30-96f3-b10ca555277b req-f2b94ad0-4425-4313-95d9-4df32d64f626 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.295169 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-93da463e-5945-4e30-96f3-b10ca555277b req-f2b94ad0-4425-4313-95d9-4df32d64f626 service nova] Creating event network-vif-plugged:42c48376-af28-46ff-826d-a163933356db for instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 on n-h1-master-1 Jul 24 01:16:08.309906 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-93da463e-5945-4e30-96f3-b10ca555277b req-f2b94ad0-4425-4313-95d9-4df32d64f626 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108821 Jul 24 01:16:08.313576 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 860/1600] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:08.327547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:08.332324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:08.364003 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.367005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.368111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.378159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.567551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:08.580953 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e96229a-a058-4506-bd9b-28d091c29aca tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1521 microversion: 2.1 time: 0.655581 Jul 24 01:16:08.617434 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 741/1601] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:07 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:08.648638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b8523a2-ce03-4fd2-b633-e83b91ba8c8b tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb3f1790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:08.735929 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b8523a2-ce03-4fd2-b633-e83b91ba8c8b tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.115786 Jul 24 01:16:08.742150 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 742/1602] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:08 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:08.747394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:08.751340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:08.754081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:08.761660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:08.764911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:08.767771 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a300ec14-e142-40b4-ad7e-4509f1e9088c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1567 microversion: 2.25 time: 0.451582 Jul 24 01:16:08.768634 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 861/1603] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:08 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1567 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:08.774911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:08.775817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:08.784348 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.784801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.785605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.787936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.788467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.788647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:08.789697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:08.790313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:09.426632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:09.443583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f967dbbe-a085-475a-911f-daa5fdd65feb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.673522 Jul 24 01:16:09.444775 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 862/1604] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:08 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:09.450648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:09.458915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:09.474265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:09.475037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:09.476330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:09.478291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:09.747291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:09.758227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58ef6243-03fd-4aea-a420-80edfaf29638 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 1.019836 Jul 24 01:16:09.764690 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 743/1605] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:08 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:09.773328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:09.776311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:09.794248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:09.798226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:09.799438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:09.800141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:09.875592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:09.884647 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40b6cac6-50fd-4427-833c-d580df2c535e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1274 microversion: 2.1 time: 0.438569 Jul 24 01:16:09.898762 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 863/1606] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:09 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1274 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:09.911424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:09.914467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:09.928050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:09.930667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:09.935172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:09.937584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:10.643541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:10.658511 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c2750f1b-7176-4eff-aa16-235fa80a8809 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1521 microversion: 2.1 time: 0.890367 Jul 24 01:16:10.659225 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 744/1607] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:09 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1521 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:10.672242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78c46598-33b7-4878-9617-87c3f8b5c9a2 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb3ac820>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:10.736113 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78c46598-33b7-4878-9617-87c3f8b5c9a2 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.073459 Jul 24 01:16:10.743253 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 745/1608] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:10 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:10.749303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:10.750957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:10.758052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:10.758910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:10.760213 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:10.761486 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:10.763481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:10.774527 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c31f5a09-ed9c-4144-8cd7-2eba51f54b49 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1521 microversion: 2.1 time: 0.874416 Jul 24 01:16:10.781716 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 864/1609] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:09 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1521 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:10.794648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:10.795734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:10.803626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:10.804484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:10.805511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:10.806223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.268712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:11.286416 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae9bfc68-4730-4f03-a05b-d7398cef5e99 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.503231 Jul 24 01:16:11.287393 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 865/1610] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:10 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:11.292330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a685e07c-043f-4cea-bb88-e9a3c570c2db req-69c9a349-2914-4421-9521-2a5efdd9ce6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23", "name": "network-vif-unplugged", "status": "completed", "tag": "652f2c92-bfbb-42ab-b716-543ccfaef44c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:11.293183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:11.314175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:11.320082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:11.327489 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1fcfa187-a829-4857-97a8-ff852d38e63e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1542 microversion: 2.25 time: 0.578496 Jul 24 01:16:11.328832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a685e07c-043f-4cea-bb88-e9a3c570c2db req-69c9a349-2914-4421-9521-2a5efdd9ce6b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.329357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a685e07c-043f-4cea-bb88-e9a3c570c2db req-69c9a349-2914-4421-9521-2a5efdd9ce6b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.331116 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 746/1611] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:10 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1542 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:11.347456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5d6988e2-6826-4e12-967f-b27596695423 req-b77350d6-1947-4a19-8ff4-7ae1d2f57162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57ea22b-8e5e-44f8-b5d2-f83188711d47", "tag": "e4e506dc-13a9-4a9e-97a0-b99d991960ac"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:11.362516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5d6988e2-6826-4e12-967f-b27596695423 req-b77350d6-1947-4a19-8ff4-7ae1d2f57162 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.363210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5d6988e2-6826-4e12-967f-b27596695423 req-b77350d6-1947-4a19-8ff4-7ae1d2f57162 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.368967 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a685e07c-043f-4cea-bb88-e9a3c570c2db req-69c9a349-2914-4421-9521-2a5efdd9ce6b service nova] Creating event network-vif-unplugged:652f2c92-bfbb-42ab-b716-543ccfaef44c for instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 on n-h2-master-1 Jul 24 01:16:11.384364 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5d6988e2-6826-4e12-967f-b27596695423 req-b77350d6-1947-4a19-8ff4-7ae1d2f57162 service nova] Creating event network-changed:e4e506dc-13a9-4a9e-97a0-b99d991960ac for instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 on n-h2-master-1 Jul 24 01:16:11.394770 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a685e07c-043f-4cea-bb88-e9a3c570c2db req-69c9a349-2914-4421-9521-2a5efdd9ce6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105686 Jul 24 01:16:11.395261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 866/1612] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:11.395771 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5d6988e2-6826-4e12-967f-b27596695423 req-b77350d6-1947-4a19-8ff4-7ae1d2f57162 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060977 Jul 24 01:16:11.397131 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 747/1613] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:11.408410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:11.410808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:11.418334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:11.418901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.420264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:11.421494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.422628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.423310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.430647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.438876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.441865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.442723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.553908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:11.675605 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:11.728077 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad5cf86d-0ea2-4180-882b-37840c2623e2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 204 len: 0 microversion: 2.1 time: 0.331396 Jul 24 01:16:11.728901 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 867/1614] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:11 2022] DELETE /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:11.737175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:11.738481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:11.762923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.763881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.765431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.766264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.868420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:11.882068 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c6495901-8190-4623-a9b2-10cdddad7457 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.478843 Jul 24 01:16:11.895312 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 748/1615] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:11 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:11.895952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7da1faec-12b9-4a64-bb30-e0ef28792872 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '.version_select at 0x7f05eb801e50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:11.898538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7da1faec-12b9-4a64-bb30-e0ef28792872 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.898992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7da1faec-12b9-4a64-bb30-e0ef28792872 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.906258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:11.914130 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7da1faec-12b9-4a64-bb30-e0ef28792872 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3024 microversion: 2.25 time: 0.021863 Jul 24 01:16:11.914293 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-128da3fb-f86f-45ab-961b-db9e98003cdc tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1274 microversion: 2.1 time: 0.181231 Jul 24 01:16:11.916476 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 749/1616] 10.222.0.27 () {60 vars in 1183 bytes} [Sun Jul 24 01:16:11 2022] GET /compute/v2.1/os-migrations => generated 3024 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:11.922035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:11.923274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:11.927335 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 868/1617] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:11 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:11.934692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20818c13-aeb6-40e4-81dc-d97a4033b434 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb0ea9d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:11.957959 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.958913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:11.960045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:11.962200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.020253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20818c13-aeb6-40e4-81dc-d97a4033b434 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.091375 Jul 24 01:16:12.021134 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 869/1618] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:11 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:12.045105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:12.046065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:12.061372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.062159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.063118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.063737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.507103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:12.507103 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-05d1d8d1-726c-4bbe-b234-1aba6dd8a1f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1527 microversion: 2.1 time: 0.572566 Jul 24 01:16:12.507103 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 750/1619] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:11 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1527 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:12.507103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:12.507676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:12.509305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:12.519555 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-96fcf9ee-f44b-4cc1-aee9-bd4e18be6864 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1521 microversion: 2.1 time: 0.497099 Jul 24 01:16:12.520514 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 870/1620] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:12 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:12.522711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.523311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.527239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:12.527859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:12.534776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.535228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.536039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.536488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.537819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.539088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.871257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:12.879963 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:12.899818 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d2cc50e-6126-461c-8e25-a9f73366a679 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 2034 microversion: 2.25 time: 0.407491 Jul 24 01:16:12.901853 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 751/1621] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:12 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 2034 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:12.907313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:12.908857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:12.916221 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:12.923094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.923971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.925691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:12.926407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:12.930736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:12.941026 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45888fee-f298-4dcc-991c-d029ab4c9838 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.419204 Jul 24 01:16:12.941644 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 871/1622] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:12 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:12.948554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a05e40e-5e40-437c-b054-9dc1cbfa4adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Action: 'create', calling method: .version_select at 0x7f05eaee2ca0>, body: {"keypair": {"name": "tempest-keypair-866869818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEybtcZppyoSQcQhIF5afqWug9xRTUC8cOLuKs0vVhQ4JczEEOZGxmTI87kdy3ZR9oZ9G51TmF1fRrLB1ymaAhhXzYBcsV1IEx36gzpseYAKDLIszPc+A0aDoxBqOyI/A=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:12.964269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-5a05e40e-5e40-437c-b054-9dc1cbfa4adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for project e6caac543f0e47e5908eb146739cddca. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:12.971348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-5a05e40e-5e40-437c-b054-9dc1cbfa4adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for user 735a3f7d7e454f14a7a4ed229affd75b and project e6caac543f0e47e5908eb146739cddca. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:12.988435 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a05e40e-5e40-437c-b054-9dc1cbfa4adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [644dbb73-be2b-44c2-a8d5-c9a7e4d5e15e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 01:16:13.251293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:13.263633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-080dced9-0a4e-4c77-b093-d10e20031a49 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.360233 Jul 24 01:16:13.273342 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 752/1623] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:12 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:13.285871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:13.286492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:13.297764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:13.298215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:13.299010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:13.299607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:13.692272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:13.700772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-93450e78-0ae1-403c-a60a-6084f1b9358a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1316 microversion: 2.1 time: 0.426224 Jul 24 01:16:13.706220 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 753/1624] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:13 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:13.713871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e2491c0-c923-46cb-b276-a6f8ef9c0c59 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb545430>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:13.825180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e2491c0-c923-46cb-b276-a6f8ef9c0c59 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.117701 Jul 24 01:16:13.826131 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 754/1625] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:13 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:13.835646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:13.836274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:13.870808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:13.871797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:13.873562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:13.874248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:14.000570 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a05e40e-5e40-437c-b054-9dc1cbfa4adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [644dbb73-be2b-44c2-a8d5-c9a7e4d5e15e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36328. Jul 24 01:16:14.028004 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5a05e40e-5e40-437c-b054-9dc1cbfa4adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 1.083408 Jul 24 01:16:14.036336 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 872/1626] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:16:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1093 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:16:14.055209 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:14.058735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:14.086648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:14.087124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:14.091103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:14.093255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:14.735610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:14.744429 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd995fe4-e563-4950-8da0-19b2ca2b7211 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1527 microversion: 2.1 time: 0.912588 Jul 24 01:16:14.750557 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 755/1627] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:13 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1527 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:14.755594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f3ead2a9-38e3-4582-97bd-2587c182c1fd req-bd85850f-90d9-4398-ac21-3b6e1804b2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23", "name": "network-vif-plugged", "status": "completed", "tag": "652f2c92-bfbb-42ab-b716-543ccfaef44c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:14.782167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f3ead2a9-38e3-4582-97bd-2587c182c1fd req-bd85850f-90d9-4398-ac21-3b6e1804b2c1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:14.782994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f3ead2a9-38e3-4582-97bd-2587c182c1fd req-bd85850f-90d9-4398-ac21-3b6e1804b2c1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:14.820636 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f3ead2a9-38e3-4582-97bd-2587c182c1fd req-bd85850f-90d9-4398-ac21-3b6e1804b2c1 service nova] Creating event network-vif-plugged:652f2c92-bfbb-42ab-b716-543ccfaef44c for instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 on n-h2-master-1 Jul 24 01:16:14.829181 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f3ead2a9-38e3-4582-97bd-2587c182c1fd req-bd85850f-90d9-4398-ac21-3b6e1804b2c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077248 Jul 24 01:16:14.829823 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 756/1628] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:14.850010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:14.850734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:14.876943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:14.879093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:14.881549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:14.884161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:15.136800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:15.158253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c3d4f5f1-93f0-4f65-b0a6-e5e8d99bc0e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1521 microversion: 2.1 time: 1.120399 Jul 24 01:16:15.159648 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 873/1629] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:14 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1521 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:15.165230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:15.166157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:15.174388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:15.175035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:15.176021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:15.176630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:15.626149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:15.638382 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e8e75e2f-e101-40a5-b9db-6fa93b041870 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.806966 Jul 24 01:16:15.639394 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 757/1630] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:14 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:15.652795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:15.654391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:15.671936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:15.673558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:15.676021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:15.677543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:15.787494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:15.796972 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5625fe41-9290-464e-b451-6d7aa485d6cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.635870 Jul 24 01:16:15.806200 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 874/1631] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:15 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:15.824078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be946894-0a6f-458b-9568-adcab2131752 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac480d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:15.959250 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be946894-0a6f-458b-9568-adcab2131752 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.139307 Jul 24 01:16:15.966028 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 875/1632] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:15 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:15.982431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-072fb6ed-5718-40bd-81f6-e1e71539e313 req-a50c83b8-0903-4518-af1c-1824370fe323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2cf16e-4b21-44e1-bb24-1a0a161bd395", "name": "network-vif-deleted", "tag": "0b367a55-70f7-4219-ab6f-7d04eededace"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:16.014956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-072fb6ed-5718-40bd-81f6-e1e71539e313 req-a50c83b8-0903-4518-af1c-1824370fe323 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.019764 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-072fb6ed-5718-40bd-81f6-e1e71539e313 req-a50c83b8-0903-4518-af1c-1824370fe323 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.050562 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-072fb6ed-5718-40bd-81f6-e1e71539e313 req-a50c83b8-0903-4518-af1c-1824370fe323 service nova] Creating event network-vif-deleted:0b367a55-70f7-4219-ab6f-7d04eededace for instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 on n-h2-master-1 Jul 24 01:16:16.062011 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-072fb6ed-5718-40bd-81f6-e1e71539e313 req-a50c83b8-0903-4518-af1c-1824370fe323 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094366 Jul 24 01:16:16.063134 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 876/1633] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:16.081353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3fe618d2-a3f6-4ed1-81f6-438003db9756 req-1799eb8b-9544-444c-9cae-7c70e8fcfe97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf89049-7c79-4806-a7b3-d93339198383", "tag": "7694388d-3b85-4312-99b8-2dacc55207b7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:16.107006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fe618d2-a3f6-4ed1-81f6-438003db9756 req-1799eb8b-9544-444c-9cae-7c70e8fcfe97 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.107605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fe618d2-a3f6-4ed1-81f6-438003db9756 req-1799eb8b-9544-444c-9cae-7c70e8fcfe97 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.127823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:16.138949 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3fe618d2-a3f6-4ed1-81f6-438003db9756 req-1799eb8b-9544-444c-9cae-7c70e8fcfe97 service nova] Creating event network-changed:7694388d-3b85-4312-99b8-2dacc55207b7 for instance ddf89049-7c79-4806-a7b3-d93339198383 on n-h1-master-1 Jul 24 01:16:16.142181 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef8f60ba-bfbf-4d54-982c-55061f3ebf43 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1316 microversion: 2.1 time: 0.499218 Jul 24 01:16:16.142782 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 758/1634] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:15 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:16.158507 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3fe618d2-a3f6-4ed1-81f6-438003db9756 req-1799eb8b-9544-444c-9cae-7c70e8fcfe97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093740 Jul 24 01:16:16.159153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:16.160640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:16.172617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.173080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.173905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.174349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.175942 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 877/1635] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:16.201948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:16.202808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:16.221468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.221945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.222725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.241737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.259452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.259925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.261978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lazy-loading 'fault' on Instance uuid 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:16.331164 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:16.349847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:16.367709 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-96b83ba2-48be-45da-a2dc-033f0d496e14 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 200 len: 1314 microversion: 2.1 time: 0.220309 Jul 24 01:16:16.370564 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 759/1636] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:16 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:16.657456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:16.658501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:16.674947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.676097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.679302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.681330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.685952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:16.725507 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36b11744-3cf9-403e-9042-f16d46771f60 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1521 microversion: 2.1 time: 0.548172 Jul 24 01:16:16.732641 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 878/1637] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:16 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:16.826015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:16.827072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:16.838149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.843868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:16.845219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:16.846104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:17.094168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:17.114527 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a73827a4-9f38-403b-811e-76ae1ec04edb tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.460027 Jul 24 01:16:17.115744 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 760/1638] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:16 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:17.140319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13c9bbdc-afe6-4360-b427-ce4a961dff58 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eba618b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:17.151826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:17.162166 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7a89b8c-0e18-4674-84c8-4722695c3594 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.341712 Jul 24 01:16:17.162752 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 879/1639] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:16 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:17.177829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:17.180563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:17.192729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:17.193609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:17.194675 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:17.195287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:17.252548 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13c9bbdc-afe6-4360-b427-ce4a961dff58 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1421 microversion: 2.1 time: 0.132730 Jul 24 01:16:17.256034 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 761/1640] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:17 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1421 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:17.386895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:17.387524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:17.410578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:17.411136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:17.412607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:17.413061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:17.460628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 HTTP/1.1 Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:16:17.467223 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:16:17.469075 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '5a2cf16e-4b21-44e1-bb24-1a0a161bd395'} Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:17.469998 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:16:17.472204 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:17.474067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:17.474067 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c720d81-2705-4497-a93c-8f115edf07a0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 404 len: 111 microversion: 2.1 time: 0.086556 Jul 24 01:16:17.480888 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 762/1641] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:17 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:17.485845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ca56bdf7-b117-4f4e-9998-d98128994a8d req-d5070994-1b59-48b4-88fe-26d91c911ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57ea22b-8e5e-44f8-b5d2-f83188711d47", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e506dc-13a9-4a9e-97a0-b99d991960ac"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:17.500039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ca56bdf7-b117-4f4e-9998-d98128994a8d req-d5070994-1b59-48b4-88fe-26d91c911ba4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:17.500526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ca56bdf7-b117-4f4e-9998-d98128994a8d req-d5070994-1b59-48b4-88fe-26d91c911ba4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:17.525327 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ca56bdf7-b117-4f4e-9998-d98128994a8d req-d5070994-1b59-48b4-88fe-26d91c911ba4 service nova] Creating event network-vif-unplugged:e4e506dc-13a9-4a9e-97a0-b99d991960ac for instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 on n-h2-master-1 Jul 24 01:16:17.538166 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ca56bdf7-b117-4f4e-9998-d98128994a8d req-d5070994-1b59-48b4-88fe-26d91c911ba4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055831 Jul 24 01:16:17.545598 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 763/1642] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:17.562903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3396800-83d8-4f28-bfab-495e8f7aa108 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'create', calling method: .version_select at 0x7f05eb66a8b0>, body: {"keypair": {"name": "tempest-keypair-1054236768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGu+cVDCz5zcIwxn2bSXFJUThmVHJOTeWVisfex3QtBCHz234pjBtxm8b6VHV2mGZcWvm0+f7BoH7nPNnTdP/5LP2Htc7//MzDEHO3RN4TvitowaCxLg4O4DjicXzq5XA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:17.593722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3396800-83d8-4f28-bfab-495e8f7aa108 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for project 641ace3f76eb466ba57c3f42b8173978. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:17.608762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3396800-83d8-4f28-bfab-495e8f7aa108 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for user 5da455c083744e7c814e8638483ffffe and project 641ace3f76eb466ba57c3f42b8173978. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:17.635072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:17.638014 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f3396800-83d8-4f28-bfab-495e8f7aa108 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [ff0344bc-4ade-40b6-9e5a-a22cf0a0b248] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 01:16:17.648512 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6544007d-acf3-462a-a3f3-f3ce4f9a149e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1316 microversion: 2.1 time: 0.482663 Jul 24 01:16:17.649499 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 880/1643] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:17 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:17.654748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2048765663", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "c346cd37-8708-458f-a9ad-b2bb44b94ef1"}], "security_groups": [{"name": "tempest-securitygroup--2045496614"}], "key_name": "tempest-keypair-866869818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:17.832130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] validate_networks() for [('c346cd37-8708-458f-a9ad-b2bb44b94ef1', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:16:18.647348 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [None req-f3396800-83d8-4f28-bfab-495e8f7aa108 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [ff0344bc-4ade-40b6-9e5a-a22cf0a0b248] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36410. Jul 24 01:16:18.675474 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3396800-83d8-4f28-bfab-495e8f7aa108 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.126404 Jul 24 01:16:18.676699 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 764/1644] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:16:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:18.683398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:18.684407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:18.692612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.693387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:18.694448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.695100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:18.759545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:16:18.760816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:16:18.761308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:16:18.761740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:16:18.762159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:16:18.773358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.774064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:18.775664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.776906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:18.799153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:18.806871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for user 735a3f7d7e454f14a7a4ed229affd75b and project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:18.823658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:16:18.826661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:16:18.898862 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-185e266b-e7ce-42d4-ae91-7c4e5cf09d1c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.247880 Jul 24 01:16:18.906712 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 881/1645] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:16:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:16:18.912733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:18.913764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:18.922166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.923038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:18.924071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:18.924676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:19.122009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:19.144013 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad11ec16-4b6b-4c38-950c-295192d4e4d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1506 microversion: 2.1 time: 0.465892 Jul 24 01:16:19.146622 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 765/1646] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:18 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:19.162350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:19.171503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:19.181713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:19.186085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:19.191062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:19.191798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:19.662280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:19.674267 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cb0fa99c-53f7-43bd-a24f-6f3052ca685a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1393 microversion: 2.1 time: 0.765423 Jul 24 01:16:19.678079 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 882/1647] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:18 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1393 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:19.686244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cac8acd0-1289-4186-b2e2-c5990f6dd843 req-7ee6d126-2ee6-499e-abbf-ea3ae91d3c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57ea22b-8e5e-44f8-b5d2-f83188711d47", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e506dc-13a9-4a9e-97a0-b99d991960ac"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:19.699536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cac8acd0-1289-4186-b2e2-c5990f6dd843 req-7ee6d126-2ee6-499e-abbf-ea3ae91d3c99 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:19.701139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cac8acd0-1289-4186-b2e2-c5990f6dd843 req-7ee6d126-2ee6-499e-abbf-ea3ae91d3c99 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:19.729278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cac8acd0-1289-4186-b2e2-c5990f6dd843 req-7ee6d126-2ee6-499e-abbf-ea3ae91d3c99 service nova] Creating event network-vif-unplugged:e4e506dc-13a9-4a9e-97a0-b99d991960ac for instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 on n-h2-master-1 Jul 24 01:16:19.736374 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cac8acd0-1289-4186-b2e2-c5990f6dd843 req-7ee6d126-2ee6-499e-abbf-ea3ae91d3c99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056356 Jul 24 01:16:19.737483 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 883/1648] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:19.743756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ac3820d-deb7-432f-9558-57761d66a3b3 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac46550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:19.809633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ac3820d-deb7-432f-9558-57761d66a3b3 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1430 microversion: 2.1 time: 0.070087 Jul 24 01:16:19.810692 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 884/1649] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:19 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1430 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:19.818095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:19.819479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:19.829222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:19.830186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:19.831325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:19.831946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.350799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:20.363417 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ace932d-ed52-479d-8323-40fe6fb7538f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 1.211910 Jul 24 01:16:20.364464 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 766/1650] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:19 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:20.371202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:20.372142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:20.379807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.380692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.382043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.382712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.419657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:20.428236 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2a1aaa5-2f5f-4392-86ff-65176ab98e82 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1316 microversion: 2.1 time: 0.615689 Jul 24 01:16:20.430696 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 885/1651] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:19 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:20.435599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:20.436489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:20.449656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.450854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.452211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.452800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.471056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:20.484580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:20.486729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:20.488878 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e52b8c3-4dbe-4af5-a799-fc0122a096c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1337 microversion: 2.25 time: 0.122816 Jul 24 01:16:20.490658 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 767/1652] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:20 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1337 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:20.510402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-313437e9-e638-458f-8882-c63c1b22c8fc tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb107670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:20.606592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-313437e9-e638-458f-8882-c63c1b22c8fc tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 200 len: 1430 microversion: 2.1 time: 0.113625 Jul 24 01:16:20.608742 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 768/1653] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:20 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 1430 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:20.619853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:20.624986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:20.632799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.633147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.633990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.634432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.787086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:20.800563 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e71f2188-550f-4ab2-baa0-27f19b046938 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 200 len: 1506 microversion: 2.1 time: 0.368725 Jul 24 01:16:20.802407 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 886/1654] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:20 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:20.808978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:20.810256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:20.820071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.821019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.823652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.824474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.881311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:20.908228 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-654470ad-5000-4528-ab74-94ea93c339bf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1467 microversion: 2.1 time: 0.292098 Jul 24 01:16:20.910981 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 769/1655] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:20 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1467 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:20.923355 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:20.926434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:20.948843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.949316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:20.954993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:20.955521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.030249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:21.125228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:21.153322 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e9ab491-b77a-46cf-bba9-c73fc976b0f0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1383 microversion: 2.1 time: 0.349483 Jul 24 01:16:21.153965 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 887/1656] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:20 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1383 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:21.160449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-26f904ed-8312-4a0b-aff6-87f90d797c55 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eacb6ee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.197447 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b12666c-cbdb-473d-9e62-9957e685e5f4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 204 len: 0 microversion: 2.1 time: 0.283854 Jul 24 01:16:21.198914 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 770/1657] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:20 2022] DELETE /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:21.205241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e4d1e00-0d44-47d5-af20-dae164a3e842 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '.version_select at 0x7f05eb0aaca0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.208172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e4d1e00-0d44-47d5-af20-dae164a3e842 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.208638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e4d1e00-0d44-47d5-af20-dae164a3e842 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.212362 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-26f904ed-8312-4a0b-aff6-87f90d797c55 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/9fcc346b-5e09-42b6-9557-a6eb28d96f08" status: 200 len: 784 microversion: 2.1 time: 0.056895 Jul 24 01:16:21.214148 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 888/1658] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:21 2022] GET /compute/v2.1/images/9fcc346b-5e09-42b6-9557-a6eb28d96f08 => generated 784 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:21.235658 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e4d1e00-0d44-47d5-af20-dae164a3e842 tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.035269 Jul 24 01:16:21.236650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5286736-fda2-46b9-99d6-bd5388754671 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.239039 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 771/1659] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:16:21 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:21.242018 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:21.251272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3f5f7be-e885-4d52-9f47-f3720ee777ba tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.252281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e3f5f7be-e885-4d52-9f47-f3720ee777ba tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:21.254057 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b5286736-fda2-46b9-99d6-bd5388754671 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029954 Jul 24 01:16:21.254792 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 889/1660] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:16:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:16:21.266617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f5f7be-e885-4d52-9f47-f3720ee777ba tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.267019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8ecb103-2717-4a6f-a8a9-8f37521e145b tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac4b160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.267541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f5f7be-e885-4d52-9f47-f3720ee777ba tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.268540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f5f7be-e885-4d52-9f47-f3720ee777ba tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.269250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f5f7be-e885-4d52-9f47-f3720ee777ba tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.446937 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3f5f7be-e885-4d52-9f47-f3720ee777ba tempest-LiveMigrationTest-243414628 tempest-LiveMigrationTest-243414628-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1534 microversion: 2.1 time: 0.199740 Jul 24 01:16:21.470310 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 772/1661] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:21 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1534 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:21.472350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1469624770", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "99bb338c-d9a7-432c-8774-bf59134c3ffb"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:21.591395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] validate_networks() for [('99bb338c-d9a7-432c-8774-bf59134c3ffb', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:16:21.891282 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8ecb103-2717-4a6f-a8a9-8f37521e145b tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "DELETE /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 204 len: 0 microversion: 2.1 time: 0.629576 Jul 24 01:16:21.896150 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 890/1662] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:21 2022] DELETE /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:21.902468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:21.903081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:21.912232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.913125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:21.914347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:21.915068 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.187430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:22.195509 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ea30c58-cf85-44f1-9ccd-b4dd9e775197 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.298379 Jul 24 01:16:22.196972 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 891/1663] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:21 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:22.202687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:22.203365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:22.209718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.210398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.211182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.211619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.217542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:16:22.217825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:16:22.218446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:16:22.219055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:16:22.219603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:16:22.230867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.231668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.232697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.233368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.244304 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:22.256110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Getting quotas for project faa16a8779184f18afc0118c7581b9b9. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:22.262749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Getting quotas for user 3428b2650a774c998b63ed06114872b0 and project faa16a8779184f18afc0118c7581b9b9. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:22.279483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:16:22.282387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:16:22.343866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-174498c4-cf79-44ac-a0d9-54e7f00ca7f0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880895 Jul 24 01:16:22.349906 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 773/1664] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:16:22.359771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:22.360375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:22.371148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.372374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.373644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.373988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.399817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:22.411693 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba0a64f4-ac83-4edf-8aae-654b30fd7c31 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1316 microversion: 2.1 time: 0.213228 Jul 24 01:16:22.413113 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 892/1665] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:22 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:22.420389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:22.421306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:22.429244 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:22.435499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.437577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.440365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.441517 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.584984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5ad787bc-9599-4eb7-946b-295129ec5b94 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 204 len: 0 microversion: 2.1 time: 0.232119 Jul 24 01:16:22.589322 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 774/1666] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:22 2022] DELETE /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:22.596531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0e607dd4-b455-4d7d-a732-30c3858caf89 req-1bbc4156-cedd-4174-b6c0-af85f789d936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf89049-7c79-4806-a7b3-d93339198383", "name": "network-vif-plugged", "status": "completed", "tag": "7694388d-3b85-4312-99b8-2dacc55207b7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:22.606324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0e607dd4-b455-4d7d-a732-30c3858caf89 req-1bbc4156-cedd-4174-b6c0-af85f789d936 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.606901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0e607dd4-b455-4d7d-a732-30c3858caf89 req-1bbc4156-cedd-4174-b6c0-af85f789d936 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.622197 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0e607dd4-b455-4d7d-a732-30c3858caf89 req-1bbc4156-cedd-4174-b6c0-af85f789d936 service nova] Creating event network-vif-plugged:7694388d-3b85-4312-99b8-2dacc55207b7 for instance ddf89049-7c79-4806-a7b3-d93339198383 on n-h1-master-1 Jul 24 01:16:22.627928 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0e607dd4-b455-4d7d-a732-30c3858caf89 req-1bbc4156-cedd-4174-b6c0-af85f789d936 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037040 Jul 24 01:16:22.628920 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 775/1667] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:22.636628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9a84e0f-5b38-4cf5-921d-91fc222b98ff tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb3ad550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:22.673092 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f9a84e0f-5b38-4cf5-921d-91fc222b98ff tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] HTTP exception thrown: Image not found. Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9a84e0f-5b38-4cf5-921d-91fc222b98ff tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Request method failure captured: Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 HTTP/1.1 Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J01oV_qc0QP89xmQy0JV7FOvzAc0DrVoRYDWd2lsexTaqp7AGAM2eNMm6HbaTtX0Ethg9ZrBcg9ssgXEySU8p4KWNRE2wslDzrU0zb7TRUxpWyQauXuax5yoEynRfDwcsLX9IAuRigD7FuBPfBQE2Y-5SPlRG7lXlc9RbjOgnDgrZs Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8a078a3f8468439788ea2327659fb762 Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:16:22.677169 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a078a3f8468439788ea2327659fb762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a078a3f8468439788ea2327659fb762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a078a3f8468439788ea2327659fb762", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a078a3f8468439788ea2327659fb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8a078a3f8468439788ea2327659fb762 Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerTestJSON-400466620-project Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 82276fe777fb4b08ac6baddf33d752ab Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerTestJSON-400466620-project Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd52e5d9b-6921-40bd-a3d4-829da7323d44'} Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:22.682044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d52e5d9b-6921-40bd-a3d4-829da7323d44 Jul 24 01:16:22.684907 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:16:22.687384 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d52e5d9b-6921-40bd-a3d4-829da7323d44 could not be found. Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:22.688942 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9a84e0f-5b38-4cf5-921d-91fc222b98ff tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:22.693447 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9a84e0f-5b38-4cf5-921d-91fc222b98ff tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 404 len: 62 microversion: 2.1 time: 0.048280 Jul 24 01:16:22.695964 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 776/1668] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:22 2022] GET /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:16:22.695964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1463843604", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:22.740852 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:22.759929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:22.764568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:22.767406 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c61fe6c-3c1a-4867-a72f-16fdde077265 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.352921 Jul 24 01:16:22.769049 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 893/1669] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:22 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:22.786624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a14011e-a651-4362-9a24-5971bf58c2a9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:22.787806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a14011e-a651-4362-9a24-5971bf58c2a9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:22.801189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] validate_networks() for [('08c0cda2-b079-422b-bfb3-9cb6b5d64f85', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:16:22.882623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a14011e-a651-4362-9a24-5971bf58c2a9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:22.910148 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a14011e-a651-4362-9a24-5971bf58c2a9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1218 microversion: 2.1 time: 0.122241 Jul 24 01:16:22.914819 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 894/1670] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:22 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:22.942282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:22.942962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:22.956757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.957592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.958611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:22.960290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:22.964212 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:23.297269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:23.312994 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bec3b6a-54aa-44dc-8200-2f911193c32e tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1389 microversion: 2.1 time: 0.377792 Jul 24 01:16:23.314972 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 895/1671] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:22 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1389 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:23.325924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:23.330547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:23.342570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.342945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.346161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.349780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.569653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:16:23.570675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:16:23.571536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:16:23.572160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:16:23.572587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:16:23.595540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.596202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.601777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.602398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.653491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for project 641ace3f76eb466ba57c3f42b8173978. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:23.664323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for user 5da455c083744e7c814e8638483ffffe and project 641ace3f76eb466ba57c3f42b8173978. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:23.687248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:16:23.689900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:16:23.744331 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-19a80e58-d433-422e-bdd6-00bbafa7cdfb tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.063975 Jul 24 01:16:23.746054 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 777/1672] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:16:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:16:23.751643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e56e138-f923-43f2-8e8a-ec8203531dfd tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1262397719"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:23.753207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e56e138-f923-43f2-8e8a-ec8203531dfd tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:23.762215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e56e138-f923-43f2-8e8a-ec8203531dfd tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.764628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e56e138-f923-43f2-8e8a-ec8203531dfd tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.765635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e56e138-f923-43f2-8e8a-ec8203531dfd tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:23.766294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e56e138-f923-43f2-8e8a-ec8203531dfd tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:23.997125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:24.014024 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:24.016855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:24.018611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-096c279a-251c-4300-9dcc-cc8c97a80f3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2950 microversion: 2.32 time: 0.702654 Jul 24 01:16:24.036338 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 896/1673] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:23 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2950 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:24.043175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:24.045154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:24.053506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.054355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:24.055957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.056921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:24.441377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:24.448913 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e56e138-f923-43f2-8e8a-ec8203531dfd tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "POST /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.697855 Jul 24 01:16:24.451446 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 778/1674] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:23 2022] POST /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:16:24.462752 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3bd074bc-f8c0-466a-9f7f-836b20cf168d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.422391 Jul 24 01:16:24.467958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:24.468672 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:24.471004 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 897/1675] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:24 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:24.485921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.487227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:24.490830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4d42ba8-a4e3-49b2-9c2a-118d3919d3e6 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:24.492368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.500324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4d42ba8-a4e3-49b2-9c2a-118d3919d3e6 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:24.501744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:24.672238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b4d42ba8-a4e3-49b2-9c2a-118d3919d3e6 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:24.681578 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4d42ba8-a4e3-49b2-9c2a-118d3919d3e6 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1225 microversion: 2.1 time: 0.209006 Jul 24 01:16:24.695200 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 898/1676] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:24 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:24.707237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:24.707869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:24.734093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.737933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:24.742342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:24.744018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.004327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:25.014660 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63ee5df4-99dc-4c2f-8684-8be1674aa5e3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1316 microversion: 2.1 time: 0.561399 Jul 24 01:16:25.017164 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 779/1677] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:24 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:25.030692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:25.038984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:25.046892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.050061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.054240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.054996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.133085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:25.149143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:25.151780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:25.153231 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a9f45e60-15da-4f8b-a950-2fe6af40d968 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.455579 Jul 24 01:16:25.159607 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 899/1678] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:24 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:25.165870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-55cbd8c7-8054-4285-a91d-3de25c99e2d1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:25.170330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-55cbd8c7-8054-4285-a91d-3de25c99e2d1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:25.191249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55cbd8c7-8054-4285-a91d-3de25c99e2d1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.191716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55cbd8c7-8054-4285-a91d-3de25c99e2d1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.192796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55cbd8c7-8054-4285-a91d-3de25c99e2d1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.193244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55cbd8c7-8054-4285-a91d-3de25c99e2d1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.215431 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:25.224302 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1484834d-97fc-4921-bf1b-5711a0ae3971 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1276 microversion: 2.1 time: 0.199355 Jul 24 01:16:25.230202 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 780/1679] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:25 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:25.235821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:25.236789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:25.239186 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:25.250688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.251409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.252310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.252855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.346627 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-55cbd8c7-8054-4285-a91d-3de25c99e2d1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.185580 Jul 24 01:16:25.347283 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 900/1680] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Jul 24 01:16:25 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1/os-interface => generated 1831 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:25.352900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ddcc3302-0b31-45f1-82f8-e2c679498c82 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eacb6550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:25.382167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:25.391530 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a8a1af2c-2540-49a4-b5d1-672bc92fba9a tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1347 microversion: 2.1 time: 0.159419 Jul 24 01:16:25.392388 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 781/1681] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:25 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1347 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:25.397330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c9ef640b-8539-4f47-9fc1-d07f8b59657a req-8ebb5a2a-c3d7-412f-abe3-efa7f58f9fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0", "tag": "e51ff2a6-c9bc-4402-a926-4d10ea46461f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:25.407246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c9ef640b-8539-4f47-9fc1-d07f8b59657a req-8ebb5a2a-c3d7-412f-abe3-efa7f58f9fa7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.407703 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c9ef640b-8539-4f47-9fc1-d07f8b59657a req-8ebb5a2a-c3d7-412f-abe3-efa7f58f9fa7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.416569 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ddcc3302-0b31-45f1-82f8-e2c679498c82 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.067749 Jul 24 01:16:25.417437 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 901/1682] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:25 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:25.424673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ea229467-6d1c-4de8-aba0-6bd467cc3cae req-c92d087b-3a0e-46e2-8aa0-c89a592a9594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23", "name": "network-vif-deleted", "tag": "652f2c92-bfbb-42ab-b716-543ccfaef44c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:25.428230 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c9ef640b-8539-4f47-9fc1-d07f8b59657a req-8ebb5a2a-c3d7-412f-abe3-efa7f58f9fa7 service nova] Creating event network-changed:e51ff2a6-c9bc-4402-a926-4d10ea46461f for instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 on n-h2-master-1 Jul 24 01:16:25.434010 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c9ef640b-8539-4f47-9fc1-d07f8b59657a req-8ebb5a2a-c3d7-412f-abe3-efa7f58f9fa7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040351 Jul 24 01:16:25.434811 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 782/1683] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:25.435415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ea229467-6d1c-4de8-aba0-6bd467cc3cae req-c92d087b-3a0e-46e2-8aa0-c89a592a9594 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.435930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ea229467-6d1c-4de8-aba0-6bd467cc3cae req-c92d087b-3a0e-46e2-8aa0-c89a592a9594 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.451712 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ea229467-6d1c-4de8-aba0-6bd467cc3cae req-c92d087b-3a0e-46e2-8aa0-c89a592a9594 service nova] Creating event network-vif-deleted:652f2c92-bfbb-42ab-b716-543ccfaef44c for instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 on n-h2-master-1 Jul 24 01:16:25.456643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ea229467-6d1c-4de8-aba0-6bd467cc3cae req-c92d087b-3a0e-46e2-8aa0-c89a592a9594 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037859 Jul 24 01:16:25.457409 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 902/1684] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:25.482439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:25.483315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:25.490566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.491572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.492365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.492804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.689202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b96bba2d-2bc2-4ff8-811f-873eda4aed91 req-d527c3d4-ac38-420f-9605-66258c06cb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa", "name": "network-vif-unplugged", "status": "completed", "tag": "8fb2b79a-88da-458a-b886-b54a4965954d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:25.717307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b96bba2d-2bc2-4ff8-811f-873eda4aed91 req-d527c3d4-ac38-420f-9605-66258c06cb6d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.718582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b96bba2d-2bc2-4ff8-811f-873eda4aed91 req-d527c3d4-ac38-420f-9605-66258c06cb6d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.746781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b96bba2d-2bc2-4ff8-811f-873eda4aed91 req-d527c3d4-ac38-420f-9605-66258c06cb6d service nova] Creating event network-vif-unplugged:8fb2b79a-88da-458a-b886-b54a4965954d for instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa on n-h1-master-1 Jul 24 01:16:25.764269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b96bba2d-2bc2-4ff8-811f-873eda4aed91 req-d527c3d4-ac38-420f-9605-66258c06cb6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080182 Jul 24 01:16:25.765771 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 903/1685] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:16:25.782048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:25.789147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:25.797386 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5cfec6b-6cf8-4ffd-bdcb-904ae6cfc7a0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.320432 Jul 24 01:16:25.800198 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 783/1686] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:25 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:25.806723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:25.839380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.840541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:25.845914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:25.846915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.020611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.034199 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-706f98b8-c0e8-4556-bca5-500f40f13500 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1285 microversion: 2.1 time: 0.266796 Jul 24 01:16:26.035975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:26.037113 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 904/1687] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:25 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:26.037576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:26.054717 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.055710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.058890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.059604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.179278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:26.180631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:26.200332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.200782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.202025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.203265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.275134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.284700 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-247dced6-0630-466f-b6f6-82b758b5bd6f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1504 microversion: 2.1 time: 0.253734 Jul 24 01:16:26.285987 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 784/1688] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:26 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:26.290819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:26.293315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:26.299772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.300590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.302517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.304111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.414604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.426127 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e68d21c2-c233-4fa0-829f-ca41677734c6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1276 microversion: 2.1 time: 0.138537 Jul 24 01:16:26.426719 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 785/1689] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:26 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:26.434037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1061039800"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:26.434590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:26.437759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.442033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.442501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.443623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.444065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.447188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.449489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.450692 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3bbbb5ed-520b-4900-99fb-c1d34be70ca0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.277617 Jul 24 01:16:26.461064 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 905/1690] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:26 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:16:26.461064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:26.461064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:26.464840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.465553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.466297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.466742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.564223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:26.571958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64918230-d85d-4fbf-9671-9bc1a20dffc5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1184 microversion: 2.1 time: 0.119596 Jul 24 01:16:26.587570 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 906/1691] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:26 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1184 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:26.592694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97e0644c-152b-454f-a098-9af29196caaf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac6e700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:26.641107 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97e0644c-152b-454f-a098-9af29196caaf tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.052242 Jul 24 01:16:26.641722 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 907/1692] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:26 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:26.676380 n-d-master-1 devstack@n-api.service[119562]: INFO nova.network.security_group_api [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Adding security group f8ae1cba-0924-4183-9199-55794f9cc368 to port 7694388d-3b85-4312-99b8-2dacc55207b7 Jul 24 01:16:26.817918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:26.818769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:26.836062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.836809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:26.837807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:26.842399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.388260 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6d06717-a47a-4f97-9377-b70804028131 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383/action" status: 202 len: 0 microversion: 2.1 time: 0.960311 Jul 24 01:16:27.389860 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 786/1693] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:26 2022] POST /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383/action => generated 0 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:27.395365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:27.396818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:27.410511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.413169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.414268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.419209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.499246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:27.507925 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24f13764-4049-4a01-98b6-646b475a71ea tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.695443 Jul 24 01:16:27.508516 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 908/1694] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:26 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:27.523190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-901292959"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:27.523734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:27.540765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.542102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.543164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.543774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.807455 n-d-master-1 devstack@n-api.service[119561]: INFO nova.network.security_group_api [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Adding security group e0653d00-b9d9-45d1-b6ac-ee88acce313d to port 7694388d-3b85-4312-99b8-2dacc55207b7 Jul 24 01:16:27.812059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:27.824679 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1bec3832-7356-45da-897f-3b618234fdd4 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1325 microversion: 2.1 time: 0.433424 Jul 24 01:16:27.825383 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 787/1695] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:27 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:27.838035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:27.839644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:27.870653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.872089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:27.873091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:27.873725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.105654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:28.115138 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d0c57aa-39b5-40e3-a4ae-89b466495c79 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.288219 Jul 24 01:16:28.126903 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 788/1696] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:27 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:28.132727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-eb785cd8-92c7-4750-9310-9e44254636d5 req-d48f9c89-55a6-4057-83ac-876cd1ef7d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57ea22b-8e5e-44f8-b5d2-f83188711d47", "name": "network-vif-deleted", "tag": "e4e506dc-13a9-4a9e-97a0-b99d991960ac"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:28.143573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eb785cd8-92c7-4750-9310-9e44254636d5 req-d48f9c89-55a6-4057-83ac-876cd1ef7d8a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.144416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eb785cd8-92c7-4750-9310-9e44254636d5 req-d48f9c89-55a6-4057-83ac-876cd1ef7d8a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.168561 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-eb785cd8-92c7-4750-9310-9e44254636d5 req-d48f9c89-55a6-4057-83ac-876cd1ef7d8a service nova] Creating event network-vif-deleted:e4e506dc-13a9-4a9e-97a0-b99d991960ac for instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 on n-h1-master-1 Jul 24 01:16:28.183847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-eb785cd8-92c7-4750-9310-9e44254636d5 req-d48f9c89-55a6-4057-83ac-876cd1ef7d8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055007 Jul 24 01:16:28.184963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 789/1697] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:28.196255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:28.197273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:28.212303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.217799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.218866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.219492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.473326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:28.488615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:28.490919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:28.501818 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d91f44f1-6d8d-4ca7-9e4f-f877b50a4167 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.315149 Jul 24 01:16:28.512113 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 790/1698] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:28 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:28.512113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6cdc22a8-c8eb-402a-9ca0-92508574a3d5 req-b6b9664c-f8a6-4b1a-a9aa-3c33ec114234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf89049-7c79-4806-a7b3-d93339198383", "tag": "7694388d-3b85-4312-99b8-2dacc55207b7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:28.540908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6cdc22a8-c8eb-402a-9ca0-92508574a3d5 req-b6b9664c-f8a6-4b1a-a9aa-3c33ec114234 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.546634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6cdc22a8-c8eb-402a-9ca0-92508574a3d5 req-b6b9664c-f8a6-4b1a-a9aa-3c33ec114234 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.587502 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6cdc22a8-c8eb-402a-9ca0-92508574a3d5 req-b6b9664c-f8a6-4b1a-a9aa-3c33ec114234 service nova] Creating event network-changed:7694388d-3b85-4312-99b8-2dacc55207b7 for instance ddf89049-7c79-4806-a7b3-d93339198383 on n-h1-master-1 Jul 24 01:16:28.605877 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6cdc22a8-c8eb-402a-9ca0-92508574a3d5 req-b6b9664c-f8a6-4b1a-a9aa-3c33ec114234 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099832 Jul 24 01:16:28.610558 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 791/1699] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:28.624558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:28.630155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:28.654138 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.654778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.655835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.656482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.673886 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:28.785439 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:28.811338 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:28.829253 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-98d2f6b4-517f-4894-b5f9-e641aab361ba tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1184 microversion: 2.1 time: 0.214201 Jul 24 01:16:28.840686 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 792/1700] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:28 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1184 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:28.846822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9353db06-a617-46ba-ace8-7d9fd8d4e6f3 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb1079d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:28.903011 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9353db06-a617-46ba-ace8-7d9fd8d4e6f3 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.060835 Jul 24 01:16:28.905658 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 793/1701] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:28 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:28.910668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:28.911536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:28.920797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.921254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:28.922084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:28.922715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.033108 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7408de37-8314-4b84-b23e-6822d63241d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383/action" status: 202 len: 0 microversion: 2.1 time: 1.522656 Jul 24 01:16:29.033891 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 909/1702] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:27 2022] POST /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383/action => generated 0 bytes in 1525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:29.039069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:29.039691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:29.058242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.058772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.059807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.060637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.690626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:29.700897 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f5eda2f5-bddf-4839-8fb6-3775e41c6f8c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1325 microversion: 2.1 time: 0.665920 Jul 24 01:16:29.715919 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 910/1703] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:29 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1325 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:29.719808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:29.724425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-17d1d177-64af-4d0f-a8a8-f3141714e550 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:29.725533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-17d1d177-64af-4d0f-a8a8-f3141714e550 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:29.736998 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c739c58f-44b5-4f89-b02e-9fa5d2516a93 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.830041 Jul 24 01:16:29.738512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17d1d177-64af-4d0f-a8a8-f3141714e550 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.739247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 794/1704] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:28 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:29.742283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17d1d177-64af-4d0f-a8a8-f3141714e550 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.743287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17d1d177-64af-4d0f-a8a8-f3141714e550 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.743914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17d1d177-64af-4d0f-a8a8-f3141714e550 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.758082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:29.761762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:29.780790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.782279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:29.784707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:29.786246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.258080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:30.271300 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f00a4ae-69e8-40cd-9bbd-5ab0993a5a6d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.527858 Jul 24 01:16:30.282314 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 795/1705] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:29 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:30.295361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:30.296394 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:30.312171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.315689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.316822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.320002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.569372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-17d1d177-64af-4d0f-a8a8-f3141714e550 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.851916 Jul 24 01:16:30.570612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 911/1706] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:16:29 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383/os-security-groups => generated 1158 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:30.576320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:30.577169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:30.591577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.596858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.599720 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.600485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.701991 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:30.714527 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-56fe65bc-dc47-423c-9a39-8c3f10b181f8 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1184 microversion: 2.1 time: 0.139965 Jul 24 01:16:30.718048 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 912/1707] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:30 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1184 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:30.732716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:30.742954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:30.745151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-80d14eee-25f4-4188-b56a-4ef95d35a341 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eacba550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:30.752858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:30.755962 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dab454a4-abe1-4da6-8691-83b98a0229da tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.471992 Jul 24 01:16:30.758684 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 796/1708] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:30 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:30.766658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-81d60bff-e7bc-4d8c-96d9-4b2c64a74a47 req-de9acc31-4372-4bef-a265-d41b712b6f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818c7702-66f8-4672-b67b-5a05d9197c59", "tag": "5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:30.779588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-81d60bff-e7bc-4d8c-96d9-4b2c64a74a47 req-de9acc31-4372-4bef-a265-d41b712b6f1f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.782393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-81d60bff-e7bc-4d8c-96d9-4b2c64a74a47 req-de9acc31-4372-4bef-a265-d41b712b6f1f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.809434 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-81d60bff-e7bc-4d8c-96d9-4b2c64a74a47 req-de9acc31-4372-4bef-a265-d41b712b6f1f service nova] Creating event network-changed:5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8 for instance 818c7702-66f8-4672-b67b-5a05d9197c59 on n-h1-master-1 Jul 24 01:16:30.816316 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-81d60bff-e7bc-4d8c-96d9-4b2c64a74a47 req-de9acc31-4372-4bef-a265-d41b712b6f1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056124 Jul 24 01:16:30.821032 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 797/1709] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:30.852014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1ac0767-daf9-4f76-8b9e-b757d69090b4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eb158790>, body: {"security_group": {"name": " tempest-securitygroup -380716468 ", "description": "tempest-description-122471012"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:30.853500 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-80d14eee-25f4-4188-b56a-4ef95d35a341 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.132075 Jul 24 01:16:30.855126 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 913/1710] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:30 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:30.861658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7bd8705d-d850-4292-b985-fd9fe979f823 req-de377753-9fe7-43ee-99e7-587f64e626bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf89049-7c79-4806-a7b3-d93339198383", "tag": "7694388d-3b85-4312-99b8-2dacc55207b7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:30.871758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7bd8705d-d850-4292-b985-fd9fe979f823 req-de377753-9fe7-43ee-99e7-587f64e626bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.872480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7bd8705d-d850-4292-b985-fd9fe979f823 req-de377753-9fe7-43ee-99e7-587f64e626bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.887761 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7bd8705d-d850-4292-b985-fd9fe979f823 req-de377753-9fe7-43ee-99e7-587f64e626bf service nova] Creating event network-changed:7694388d-3b85-4312-99b8-2dacc55207b7 for instance ddf89049-7c79-4806-a7b3-d93339198383 on n-h1-master-1 Jul 24 01:16:30.895510 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7bd8705d-d850-4292-b985-fd9fe979f823 req-de377753-9fe7-43ee-99e7-587f64e626bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038015 Jul 24 01:16:30.896498 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 914/1711] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:30.908144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:30.912098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:30.924283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.925153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:30.926969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:30.927743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:31.197258 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1ac0767-daf9-4f76-8b9e-b757d69090b4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.374447 Jul 24 01:16:31.204622 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 798/1712] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:30 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:31.210887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:31.211645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:31.238373 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:31.238797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:31.239598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:31.240061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:31.344699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:31.366100 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd253da2-a0fe-44d8-b022-4c9eeb7b6b45 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1325 microversion: 2.1 time: 0.464392 Jul 24 01:16:31.368590 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 915/1713] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:30 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1325 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:31.384168 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8873cade-1e1f-40be-bcbb-c84a096f55a1 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eacbfdc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:31.628972 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8873cade-1e1f-40be-bcbb-c84a096f55a1 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4" status: 200 len: 222 microversion: 2.1 time: 0.258891 Jul 24 01:16:31.630040 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 916/1714] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:16:31 2022] GET /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4 => generated 222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:31.641206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:31.642200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:31.664295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:31.668031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:31.669162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:31.669997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:31.724626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:31.743804 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2cb4835e-3044-4248-bba0-f89c43cb13b0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.536574 Jul 24 01:16:31.749519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 799/1715] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:31 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:31.762410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2438d69a-9471-43b6-9696-c91d0a2289f0 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eb158790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:32.414277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:32.426611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a4e382ec-83c9-4130-a5d3-a9ed2ebd143f tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.795061 Jul 24 01:16:32.428603 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 917/1716] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:31 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:32.439871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:32.440917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:32.455819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.456705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.457725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.461018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.571727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:32.601401 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5a3c3242-6323-4535-9228-8c1ce5826528 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1184 microversion: 2.1 time: 0.171136 Jul 24 01:16:32.613951 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 918/1717] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:32 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1184 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:32.621557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:32.622711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:32.629310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.629969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.630833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.631783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:32.878808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:32.881435 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:32.896167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:32.903707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:32.905345 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e9ee0461-85e6-4b1c-b41d-f2ef3f985474 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.290294 Jul 24 01:16:32.906772 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 919/1718] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:32 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:32.911600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7cb0ad2-5416-4cc6-8dfc-5a23ff06abfe tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac57e50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:32.961598 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2438d69a-9471-43b6-9696-c91d0a2289f0 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4" status: 202 len: 0 microversion: 2.1 time: 1.210097 Jul 24 01:16:32.962942 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 800/1719] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:16:31 2022] DELETE /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4 => generated 0 bytes in 1212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:32.968668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d9eae3f7-eff6-4463-bfb0-785fb707f525 req-a5223dfc-9386-473c-ba4c-afa66f7d4d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa", "name": "network-vif-plugged", "status": "completed", "tag": "8fb2b79a-88da-458a-b886-b54a4965954d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:32.989056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d9eae3f7-eff6-4463-bfb0-785fb707f525 req-a5223dfc-9386-473c-ba4c-afa66f7d4d9f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:32.993397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d9eae3f7-eff6-4463-bfb0-785fb707f525 req-a5223dfc-9386-473c-ba4c-afa66f7d4d9f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.028428 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d9eae3f7-eff6-4463-bfb0-785fb707f525 req-a5223dfc-9386-473c-ba4c-afa66f7d4d9f service nova] Creating event network-vif-plugged:8fb2b79a-88da-458a-b886-b54a4965954d for instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa on n-h1-master-1 Jul 24 01:16:33.033435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7cb0ad2-5416-4cc6-8dfc-5a23ff06abfe tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.125360 Jul 24 01:16:33.039062 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 920/1720] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:32 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:33.047217 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d9eae3f7-eff6-4463-bfb0-785fb707f525 req-a5223dfc-9386-473c-ba4c-afa66f7d4d9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082632 Jul 24 01:16:33.055702 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 801/1721] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:33.061789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:33.066887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:33.067520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:33.068500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:33.088895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.089784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.090947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.093396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.127820 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.128216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.129026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.129470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.627875 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:33.645576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:33.654758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:33.663794 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5666fed4-5a52-46d8-8420-76ea324c1c75 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1325 microversion: 2.1 time: 0.623563 Jul 24 01:16:33.669188 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b525aa3-1cad-4122-979a-7efe3de5152d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.601522 Jul 24 01:16:33.675547 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 921/1722] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:33 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1325 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:33.679438 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 802/1723] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:33 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:33.685705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-536fdcaa-9a33-4ab4-8927-812b472235f0 req-11fa93f7-4238-43a6-8e89-7637861148d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0158e48-08e8-45ed-8d5b-0b111804db53", "tag": "e27ff98b-fed4-4f66-ae66-5f45d4f089aa"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:33.694606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e74443d-3979-4c21-8b67-fdacb491217d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eb03bc10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:33.704743 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=18 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:33.710964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-536fdcaa-9a33-4ab4-8927-812b472235f0 req-11fa93f7-4238-43a6-8e89-7637861148d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.714976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-536fdcaa-9a33-4ab4-8927-812b472235f0 req-11fa93f7-4238-43a6-8e89-7637861148d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.749811 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-536fdcaa-9a33-4ab4-8927-812b472235f0 req-11fa93f7-4238-43a6-8e89-7637861148d7 service nova] Creating event network-changed:e27ff98b-fed4-4f66-ae66-5f45d4f089aa for instance f0158e48-08e8-45ed-8d5b-0b111804db53 on n-h2-master-1 Jul 24 01:16:33.759505 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-536fdcaa-9a33-4ab4-8927-812b472235f0 req-11fa93f7-4238-43a6-8e89-7637861148d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082432 Jul 24 01:16:33.762163 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 922/1724] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:33.773889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:33.778166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:33.802495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.802957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.803755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.804196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.847085 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-3e74443d-3979-4c21-8b67-fdacb491217d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:16:33.848595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-3e74443d-3979-4c21-8b67-fdacb491217d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:16:33.849492 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3e74443d-3979-4c21-8b67-fdacb491217d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:16:33.849492 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-1e3e2f74-6060-4ba5-9882-c351df0029ac'] Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e74443d-3979-4c21-8b67-fdacb491217d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4 HTTP/1.1 Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:16:33.852558 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: exception: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-1e3e2f74-6060-4ba5-9882-c351df0029ac'] Jul 24 01:16:33.854647 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9e50a6e8-63e0-4189-a103-9d9fafd36bf4'} Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:33.855643 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e3e2f74-6060-4ba5-9882-c351df0029ac'] Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:16:33.856943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e3e2f74-6060-4ba5-9882-c351df0029ac'] Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e3e2f74-6060-4ba5-9882-c351df0029ac'] Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:33.858199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:33.860309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:33.860309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:33.860309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:33.860309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:33.860309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:16:33.860309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e3e2f74-6060-4ba5-9882-c351df0029ac'] Jul 24 01:16:33.860309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:33.866118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e74443d-3979-4c21-8b67-fdacb491217d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:16:33.866118 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-1e3e2f74-6060-4ba5-9882-c351df0029ac'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:33.867335 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3e74443d-3979-4c21-8b67-fdacb491217d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4" status: 404 len: 194 microversion: 2.1 time: 0.186809 Jul 24 01:16:33.868376 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 803/1725] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:16:33 2022] GET /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4 => generated 194 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:33.881547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:33.882461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:33.900342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.901420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.906412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.907611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.986913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:33.997628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:33.998723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lazy-loading 'fault' on Instance uuid f57ea22b-8e5e-44f8-b5d2-f83188711d47 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:34.163010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:34.183710 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-22f5f31e-bdde-46e9-8824-94c93c23e449 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 200 len: 1143 microversion: 2.1 time: 0.314069 Jul 24 01:16:34.185172 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 804/1726] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:33 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 1143 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:34.195035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15d53a92-b9d2-4a2f-b7fb-80e971f17c4e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eb935a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1840623298", "description": "tempest-description-622418746"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:34.365193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:34.374699 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-950d2606-037a-4b34-9d64-5760be3772d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.610940 Jul 24 01:16:34.377743 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 923/1727] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:33 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:34.384498 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:34.385915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:34.394932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.395683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.397190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.397868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.615997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15d53a92-b9d2-4a2f-b7fb-80e971f17c4e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.429391 Jul 24 01:16:34.616604 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 805/1728] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:34.622103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd9d9514-c4c7-4dae-9c81-b0b17352d975 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb003790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:34.681485 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=20 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:34.717970 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd9d9514-c4c7-4dae-9c81-b0b17352d975 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.099196 Jul 24 01:16:34.719954 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 806/1729] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:34 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:34.730950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-026f7392-5609-470a-aacf-60c9f5fcfef4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eaff69d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1219370611", "description": "tempest-description-1304736288"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:34.737987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:34.756589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:34.762391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:34.764824 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d45505b-b3b2-4b95-993c-0de5afa726fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.385271 Jul 24 01:16:34.766427 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 924/1730] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:34 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:34.774319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:34.775536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:34.785616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.786796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:34.787687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:34.788688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.116811 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-026f7392-5609-470a-aacf-60c9f5fcfef4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.392980 Jul 24 01:16:35.118419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 807/1731] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:34 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:35.132558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.133516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:35.154932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.155390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.156198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.156636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.184573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:35.194278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fea4a227-d25a-4096-ac86-ace143559a2d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.426382 Jul 24 01:16:35.196983 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 925/1732] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:34 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:35.202797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c222f3e8-9f5b-4b03-8f6a-1ebb1d8ec232 req-980f8580-f65c-4c7a-a7d8-baa7a8215503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0", "name": "network-vif-plugged", "status": "completed", "tag": "e51ff2a6-c9bc-4402-a926-4d10ea46461f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:35.212550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c222f3e8-9f5b-4b03-8f6a-1ebb1d8ec232 req-980f8580-f65c-4c7a-a7d8-baa7a8215503 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.213834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c222f3e8-9f5b-4b03-8f6a-1ebb1d8ec232 req-980f8580-f65c-4c7a-a7d8-baa7a8215503 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.226634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c222f3e8-9f5b-4b03-8f6a-1ebb1d8ec232 req-980f8580-f65c-4c7a-a7d8-baa7a8215503 service nova] Creating event network-vif-plugged:e51ff2a6-c9bc-4402-a926-4d10ea46461f for instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 on n-h2-master-1 Jul 24 01:16:35.232310 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c222f3e8-9f5b-4b03-8f6a-1ebb1d8ec232 req-980f8580-f65c-4c7a-a7d8-baa7a8215503 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Jul 24 01:16:35.233287 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 926/1733] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:35.238744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-571037fd-a827-44d4-97d9-d56ca6fa2272 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eac64d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1903145371", "description": "tempest-description-1033185555"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:35.418976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:35.430690 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d9443c71-0888-438b-b255-ad8a88c4f70b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1325 microversion: 2.1 time: 0.308795 Jul 24 01:16:35.433945 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 808/1734] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1325 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:35.441108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.442034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: f57ea22b-8e5e-44f8-b5d2-f83188711d47] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:35.458334 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.458795 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.459600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.460045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.481514 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] HTTP exception thrown: Instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 could not be found. Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Request method failure captured: Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 HTTP/1.1 Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JuXJE-19GYaxEAwjVcbaWDi5Bp8TgetE_QJRtbaq8mDO8m8DoTB8F7K30XvJ8BZ5ix5t3urWMobhW2rVFDGVvZknkC7i0u79VrIRR8PID-g4Sn2FCcc-xBxMEnJMmvgLkLo0nnHA8s6kSH2h_PAdDhDmB3OfYfmWuI4EpuSJyknesE Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:16:35.491944 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58e5e52270c14573b0d4c868cb9fa69c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-LiveMigrationTest-1771055910-project Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 40b5fc3b4b6d43ab9342da568567140d Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-LiveMigrationTest-1771055910-project Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 could not be found. Jul 24 01:16:35.493814 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f57ea22b-8e5e-44f8-b5d2-f83188711d47'} Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 could not be found. Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:35.495287 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 could not be found. Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 could not be found. Jul 24 01:16:35.496681 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:35.498964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Returning 404 to user: Instance f57ea22b-8e5e-44f8-b5d2-f83188711d47 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:35.498964 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b3e27be-8f3f-4c82-a0b0-54086202a3b5 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47" status: 404 len: 111 microversion: 2.1 time: 0.058172 Jul 24 01:16:35.501962 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 809/1735] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/servers/f57ea22b-8e5e-44f8-b5d2-f83188711d47 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:35.512409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.516909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:35.531282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.531961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.533017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:35.533645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:35.618791 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-571037fd-a827-44d4-97d9-d56ca6fa2272 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.383988 Jul 24 01:16:35.620176 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 927/1736] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:35.633115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1d2e529-0fcf-449c-93c4-2869c069fa5e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eac7d280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.833694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:35.858777 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5939ec9a-73b1-4743-9fdb-86c901c22ae1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.355613 Jul 24 01:16:35.875848 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 810/1737] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:35.886729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36b1ff4e-fd7b-4af4-a649-db40f19df509 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eaff63a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.981094 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-36b1ff4e-fd7b-4af4-a649-db40f19df509 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.104150 Jul 24 01:16:35.982596 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 811/1738] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:35.991111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:35.992616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:36.003575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.004342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.005307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.005934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.236418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c1d2e529-0fcf-449c-93c4-2869c069fa5e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.608133 Jul 24 01:16:36.237564 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 928/1739] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:36.243078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:36.244194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:36.259170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.259617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.261066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.265916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.287507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:36.297398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:36.309562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:36.314061 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad30d172-d76c-4f57-8e86-606bdbb9781b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.327151 Jul 24 01:16:36.318164 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 812/1740] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:35 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:36.348114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf5eb04f-3d4d-458a-bc43-989eb48da588 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eb832940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:36.629054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:36.638239 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-276ec2d1-51c9-4a21-997c-7d690475bf42 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1508 microversion: 2.1 time: 0.399373 Jul 24 01:16:36.653114 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 929/1741] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:36 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:36.658674 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:36.659564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:36.668093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.668836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.669872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.670474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.881653 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf5eb04f-3d4d-458a-bc43-989eb48da588 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32" status: 202 len: 0 microversion: 2.1 time: 0.562197 Jul 24 01:16:36.882595 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 813/1742] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:16:36 2022] DELETE /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:36.889110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:36.890140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:36.906891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.908562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.912519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:36.913357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:36.939181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:36.950070 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c3acbed-f4e8-4f85-8b8d-15157796a213 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1325 microversion: 2.1 time: 0.295028 Jul 24 01:16:36.950684 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 930/1743] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:36 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:36.955845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-974e0999-b67c-45d8-8be8-df367d290b62 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eac7d820>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:36.996431 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-974e0999-b67c-45d8-8be8-df367d290b62 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:16:36.997912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-974e0999-b67c-45d8-8be8-df367d290b62 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:16:36.999073 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-974e0999-b67c-45d8-8be8-df367d290b62 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:16:36.999073 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-8209f18c-3464-41df-b291-5dbb5e370c2a'] Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-974e0999-b67c-45d8-8be8-df367d290b62 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32 HTTP/1.1 Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:16:37.001641 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: exception: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-8209f18c-3464-41df-b291-5dbb5e370c2a'] Jul 24 01:16:37.003427 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '64f1f771-64ab-4c38-8434-9b2cb3d74c32'} Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.004523 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8209f18c-3464-41df-b291-5dbb5e370c2a'] Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:16:37.006036 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8209f18c-3464-41df-b291-5dbb5e370c2a'] Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8209f18c-3464-41df-b291-5dbb5e370c2a'] Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.007579 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.009216 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:37.009216 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:37.009216 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:37.009216 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:37.009216 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:16:37.009216 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8209f18c-3464-41df-b291-5dbb5e370c2a'] Jul 24 01:16:37.009216 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.011427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-974e0999-b67c-45d8-8be8-df367d290b62 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:16:37.011427 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-8209f18c-3464-41df-b291-5dbb5e370c2a'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:37.012602 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-974e0999-b67c-45d8-8be8-df367d290b62 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32" status: 404 len: 194 microversion: 2.1 time: 0.060740 Jul 24 01:16:37.014783 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 931/1744] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:16:36 2022] GET /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:37.025413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8056dfaf-bfc2-4311-91c0-f64a85cea65a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac169d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:37.140926 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8056dfaf-bfc2-4311-91c0-f64a85cea65a tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.119286 Jul 24 01:16:37.142669 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 932/1745] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:37 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:37.170620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-17f9a2c8-0750-462c-979a-44c9eb71dfef tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eac161f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:37.254823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:37.270388 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4497ac95-d2ca-40f3-bdc3-917f3e9691ea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.385527 Jul 24 01:16:37.272554 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 814/1746] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:36 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:37.334365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:37.335982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:37.344512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.345353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.346634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.347332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.591699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:37.605359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:37.609965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:37.613864 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3a32bd7-301d-4cc2-b62f-a17d0172d7bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1411 microversion: 2.25 time: 0.285244 Jul 24 01:16:37.629627 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 815/1747] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:37 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1411 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:16:37.638829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ef405a7b-116b-43ea-a29a-d6edaa424883 req-83fe862a-105a-4d36-baa8-060077a2b29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818c7702-66f8-4672-b67b-5a05d9197c59", "name": "network-vif-plugged", "status": "completed", "tag": "5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:37.664477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ef405a7b-116b-43ea-a29a-d6edaa424883 req-83fe862a-105a-4d36-baa8-060077a2b29e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.665606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ef405a7b-116b-43ea-a29a-d6edaa424883 req-83fe862a-105a-4d36-baa8-060077a2b29e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.693475 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-17f9a2c8-0750-462c-979a-44c9eb71dfef tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4" status: 202 len: 0 microversion: 2.1 time: 0.548609 Jul 24 01:16:37.694652 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 933/1748] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:16:37 2022] DELETE /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:37.694959 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ef405a7b-116b-43ea-a29a-d6edaa424883 req-83fe862a-105a-4d36-baa8-060077a2b29e service nova] Creating event network-vif-plugged:5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8 for instance 818c7702-66f8-4672-b67b-5a05d9197c59 on n-h1-master-1 Jul 24 01:16:37.703465 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ef405a7b-116b-43ea-a29a-d6edaa424883 req-83fe862a-105a-4d36-baa8-060077a2b29e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072156 Jul 24 01:16:37.703731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:37.704526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:37.704928 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 816/1749] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:37.734077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.734547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.735364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:37.735813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:37.755630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f30df8fc-9ef4-4fde-a93b-53c3c13af738 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eaff69d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:37.862649 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-f30df8fc-9ef4-4fde-a93b-53c3c13af738 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:16:37.863440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-f30df8fc-9ef4-4fde-a93b-53c3c13af738 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:16:37.864172 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f30df8fc-9ef4-4fde-a93b-53c3c13af738 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:16:37.864172 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-b94edb0c-d3a0-40eb-a2d3-7155e85add76'] Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f30df8fc-9ef4-4fde-a93b-53c3c13af738 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4 HTTP/1.1 Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:16:37.867991 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: exception: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-b94edb0c-d3a0-40eb-a2d3-7155e85add76'] Jul 24 01:16:37.869926 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '54fee49b-1242-4b2a-9c37-a91e75b24de4'} Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.871063 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94edb0c-d3a0-40eb-a2d3-7155e85add76'] Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:16:37.872734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94edb0c-d3a0-40eb-a2d3-7155e85add76'] Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94edb0c-d3a0-40eb-a2d3-7155e85add76'] Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.874254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b94edb0c-d3a0-40eb-a2d3-7155e85add76'] Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f30df8fc-9ef4-4fde-a93b-53c3c13af738 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:16:37.875985 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-b94edb0c-d3a0-40eb-a2d3-7155e85add76'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:37.881256 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f30df8fc-9ef4-4fde-a93b-53c3c13af738 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4" status: 404 len: 194 microversion: 2.1 time: 0.167827 Jul 24 01:16:37.881256 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 817/1750] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:16:37 2022] GET /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4 => generated 194 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:37.890482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-064fa138-ab27-4db4-a474-6b8e3c0792f0 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eb107c10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.286711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:38.296879 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a904fb2-bbe3-43f7-924e-8754345ee8a8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1529 microversion: 2.1 time: 0.600495 Jul 24 01:16:38.310452 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 934/1751] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:37 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1529 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:38.320305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.320924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:38.335641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.336091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.336873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.337370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.456048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-064fa138-ab27-4db4-a474-6b8e3c0792f0 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e" status: 202 len: 0 microversion: 2.1 time: 0.573269 Jul 24 01:16:38.457440 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 818/1752] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:16:37 2022] DELETE /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:16:38.467113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-951f572a-bc72-40c3-9c6b-8db6683347ea tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb8be0d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.566391 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-951f572a-bc72-40c3-9c6b-8db6683347ea tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.104010 Jul 24 01:16:38.568584 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 819/1753] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:38.578801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.579551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:38.591707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.592165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.593485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.594467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.679767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:38.691466 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-109515e7-fcd7-4330-882f-685da56c4e4c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1325 microversion: 2.1 time: 0.379452 Jul 24 01:16:38.711854 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 935/1754] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1325 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:38.721705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24e6f39b-1573-4e3e-b73e-c624d179ec91 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eac578b0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.818959 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-24e6f39b-1573-4e3e-b73e-c624d179ec91 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:16:38.819790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-24e6f39b-1573-4e3e-b73e-c624d179ec91 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group dc91c59f-380d-4b6a-93d4-98c61649654e not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:16:38.820411 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-24e6f39b-1573-4e3e-b73e-c624d179ec91 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:16:38.820411 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f70b11f6-22f3-4bd0-9f33-4a4780157d75'] Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24e6f39b-1573-4e3e-b73e-c624d179ec91 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e HTTP/1.1 Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:16:38.823444 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: exception: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f70b11f6-22f3-4bd0-9f33-4a4780157d75'] Jul 24 01:16:38.825382 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'dc91c59f-380d-4b6a-93d4-98c61649654e'} Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:38.826315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f70b11f6-22f3-4bd0-9f33-4a4780157d75'] Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:16:38.828043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f70b11f6-22f3-4bd0-9f33-4a4780157d75'] Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f70b11f6-22f3-4bd0-9f33-4a4780157d75'] Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:38.831199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f70b11f6-22f3-4bd0-9f33-4a4780157d75'] Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24e6f39b-1573-4e3e-b73e-c624d179ec91 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f70b11f6-22f3-4bd0-9f33-4a4780157d75'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24e6f39b-1573-4e3e-b73e-c624d179ec91 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e" status: 404 len: 194 microversion: 2.1 time: 0.111766 Jul 24 01:16:38.834774 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 936/1755] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:38.851851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:38.852609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:38.872346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.874202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.875252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:38.881020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:38.940315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:38.950513 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1fb897f0-4b6c-4556-b4eb-634a469ed3c7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.375449 Jul 24 01:16:38.951326 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 820/1756] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:38.955862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d30f41b-4feb-4ce7-aef0-4dcde9801c18 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eb003040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:39.252225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:39.262949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:39.266617 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:39.280481 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c9a3929-7a90-4b17-ac84-db48e99d1675 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1608 microversion: 2.25 time: 0.446912 Jul 24 01:16:39.281265 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 937/1757] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1608 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:16:39.306087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8da76ff4-d8d6-409e-b211-d0774f570375 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:39.306518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8da76ff4-d8d6-409e-b211-d0774f570375 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:39.323525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8da76ff4-d8d6-409e-b211-d0774f570375 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.323986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8da76ff4-d8d6-409e-b211-d0774f570375 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.324980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8da76ff4-d8d6-409e-b211-d0774f570375 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.327935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8da76ff4-d8d6-409e-b211-d0774f570375 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.381074 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d30f41b-4feb-4ce7-aef0-4dcde9801c18 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.428898 Jul 24 01:16:39.382042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 821/1758] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:16:38 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:39.388684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:39.396384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:39.414505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.415043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.415834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:39.416511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:39.497696 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8da76ff4-d8d6-409e-b211-d0774f570375 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.199968 Jul 24 01:16:39.504101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 938/1759] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Jul 24 01:16:39 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:16:39.509127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5ead1a7-0cc0-4dd4-ba00-40291eb750cb tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eac643a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-98289853", "description": "tempest-description-267424881"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:39.986498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:39.999333 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad6acfdc-2be0-48e2-bd85-3b486b9d3aad tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1529 microversion: 2.1 time: 0.613436 Jul 24 01:16:40.001648 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 822/1760] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:39 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1529 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:40.013535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbcc583a-0a3e-4e78-b639-9aa8d64bf441 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb3499d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:40.126925 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbcc583a-0a3e-4e78-b639-9aa8d64bf441 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.123596 Jul 24 01:16:40.129764 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 823/1761] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:40 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:40.149718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:40.152362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:40.172833 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5ead1a7-0cc0-4dd4-ba00-40291eb750cb tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.665351 Jul 24 01:16:40.172833 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 939/1762] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:39 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:40.176397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7ca483eb-2540-477e-a569-2fd56380b724 req-c16699c3-7fd9-4c1f-b42f-9a3ead23f772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0158e48-08e8-45ed-8d5b-0b111804db53", "name": "network-vif-plugged", "status": "completed", "tag": "e27ff98b-fed4-4f66-ae66-5f45d4f089aa"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:40.191577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.192034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.192832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.205032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.206189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7ca483eb-2540-477e-a569-2fd56380b724 req-c16699c3-7fd9-4c1f-b42f-9a3ead23f772 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.211320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7ca483eb-2540-477e-a569-2fd56380b724 req-c16699c3-7fd9-4c1f-b42f-9a3ead23f772 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.281788 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7ca483eb-2540-477e-a569-2fd56380b724 req-c16699c3-7fd9-4c1f-b42f-9a3ead23f772 service nova] Creating event network-vif-plugged:e27ff98b-fed4-4f66-ae66-5f45d4f089aa for instance f0158e48-08e8-45ed-8d5b-0b111804db53 on n-h2-master-1 Jul 24 01:16:40.292497 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7ca483eb-2540-477e-a569-2fd56380b724 req-c16699c3-7fd9-4c1f-b42f-9a3ead23f772 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118774 Jul 24 01:16:40.306845 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 940/1763] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:40.323880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:40.326613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:40.341599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.346453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.350081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.350870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.599070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:40.608644 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e82fbc98-28ff-438f-9cb5-695847979f7a tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1523 microversion: 2.1 time: 0.477754 Jul 24 01:16:40.617203 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 824/1764] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:40 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:40.622296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-260ed4d9-7b99-445f-a62b-f3520ae7122c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eb117940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1340339962", "description": "tempest-description-1430155330"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:40.709660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:40.726839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af678cea-0879-4622-bc10-8d87a7682c88 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1318 microversion: 2.1 time: 0.409599 Jul 24 01:16:40.736124 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 941/1765] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:40 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:40.756433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:40.760947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:40.790608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.799304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.800360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:40.803952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:40.898871 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-260ed4d9-7b99-445f-a62b-f3520ae7122c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.280459 Jul 24 01:16:40.899583 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 825/1766] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:16:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:40.978283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1228309953", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "f5ce1bc7-c250-4074-923e-d47eda57456b"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:41.100977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] validate_networks() for [('f5ce1bc7-c250-4074-923e-d47eda57456b', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:16:41.123997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:41.133358 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f8ed5e4-77cd-469c-8749-a9b538bd51c0 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1523 microversion: 2.1 time: 0.395981 Jul 24 01:16:41.135082 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 942/1767] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:40 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:41.144015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:41.147762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:41.162992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.163740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.167313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.170462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.502019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:41.520292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9789806c-6e42-46e7-a6f5-a5863fe3f164 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1529 microversion: 2.1 time: 0.377065 Jul 24 01:16:41.521689 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 943/1768] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:41 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1529 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:41.540148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2f4797e-2bf2-4d56-98ab-83e4181d519c tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eac30790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:41.622588 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2f4797e-2bf2-4d56-98ab-83e4181d519c tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1427 microversion: 2.1 time: 0.094524 Jul 24 01:16:41.623183 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 944/1769] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:41 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:41.641467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f963f435-bcd8-4c71-a0a3-6d2741e75f69 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1219645192"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:41.642787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f963f435-bcd8-4c71-a0a3-6d2741e75f69 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:41.670297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f963f435-bcd8-4c71-a0a3-6d2741e75f69 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.670780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f963f435-bcd8-4c71-a0a3-6d2741e75f69 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.673922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f963f435-bcd8-4c71-a0a3-6d2741e75f69 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.674406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f963f435-bcd8-4c71-a0a3-6d2741e75f69 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.904850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:16:41.905800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:16:41.906574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:16:41.907371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:16:41.907954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:16:41.921015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.922024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.923375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:41.923984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:41.934093 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:41.952883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Getting quotas for project 59f19f4a68ce46019ac8f50a275b2d3d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:41.960893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Getting quotas for user cee3f1e6e5ba4185a4080a27d7c21702 and project 59f19f4a68ce46019ac8f50a275b2d3d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:41.987037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:16:41.993080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:16:42.158547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5f788a0d-acce-4f70-8c07-71d9883a3ba9 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185456 Jul 24 01:16:42.162157 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 826/1770] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:16:42.174210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:42.175835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:42.187295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.188144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.189147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.190640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.236180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:42.247901 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f963f435-bcd8-4c71-a0a3-6d2741e75f69 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59/action" status: 202 len: 0 microversion: 2.1 time: 0.618024 Jul 24 01:16:42.253779 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 945/1771] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:41 2022] POST /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:16:42.267792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fe364691-a03a-4170-a4a6-a5c702dac7fe req-45980194-f666-4cd0-8a63-874a27ba04ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0", "tag": "e51ff2a6-c9bc-4402-a926-4d10ea46461f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:42.291692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fe364691-a03a-4170-a4a6-a5c702dac7fe req-45980194-f666-4cd0-8a63-874a27ba04ff service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.292151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fe364691-a03a-4170-a4a6-a5c702dac7fe req-45980194-f666-4cd0-8a63-874a27ba04ff service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.363726 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fe364691-a03a-4170-a4a6-a5c702dac7fe req-45980194-f666-4cd0-8a63-874a27ba04ff service nova] Creating event network-changed:e51ff2a6-c9bc-4402-a926-4d10ea46461f for instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 on n-h2-master-1 Jul 24 01:16:42.385596 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fe364691-a03a-4170-a4a6-a5c702dac7fe req-45980194-f666-4cd0-8a63-874a27ba04ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126013 Jul 24 01:16:42.392443 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 946/1772] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:42.435200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:42.436081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:42.449841 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a4227d1-39a0-4549-86be-0c6e0b17d244 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 204 len: 0 microversion: 2.1 time: 0.283681 Jul 24 01:16:42.452031 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 827/1773] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:42 2022] DELETE /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:42.456593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.460217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.463161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.464861 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.466535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cdebeaff-45ae-4f9e-8c51-ba11af3affd4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:42.470336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cdebeaff-45ae-4f9e-8c51-ba11af3affd4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:42.519489 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:42.596031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cdebeaff-45ae-4f9e-8c51-ba11af3affd4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:42.611191 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cdebeaff-45ae-4f9e-8c51-ba11af3affd4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1216 microversion: 2.1 time: 0.157144 Jul 24 01:16:42.611949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 828/1774] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:42 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:42.623009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f0ff31e1-1ed9-4598-800d-7c62d001f2d1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '.version_select at 0x7f05eb03b280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:42.810944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:42.825960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e79ef194-597a-4813-90e3-5f2fa844c102 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1508 microversion: 2.1 time: 0.429808 Jul 24 01:16:42.829232 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 947/1775] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:42 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1508 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:42.845090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:42.847585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:42.880590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.881993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.885911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.887029 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.950347 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f0ff31e1-1ed9-4598-800d-7c62d001f2d1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c" status: 204 len: 0 microversion: 2.1 time: 0.336268 Jul 24 01:16:42.950837 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 829/1776] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:42 2022] DELETE /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:42.957473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:42.959875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:42.983489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.986263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:42.987324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:42.989367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:43.618539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:43.628288 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fcb985dd-17aa-4507-9a63-2fdab683bbaa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1524 microversion: 2.1 time: 0.676075 Jul 24 01:16:43.632687 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 830/1777] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:42 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1524 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:43.644913 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-344baf57-7970-47be-8927-18a3c37356e3 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb03bd30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:43.734120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:43.745844 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79722a71-6ae6-452f-bfab-37b420c10535 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 200 len: 1668 microversion: 2.1 time: 0.912002 Jul 24 01:16:43.752488 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 948/1778] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:42 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 1668 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:43.768901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9731460c-65b4-441a-9d97-e154ca3e0dcd req-36f0be6d-7ccf-4b4d-b16b-eed00718e551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcef7d1-f119-4018-9d80-58db946c1a64", "name": "network-vif-plugged", "status": "completed", "tag": "bb419d01-72ec-4f9e-8f32-00bf0e7c950e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:43.779623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9731460c-65b4-441a-9d97-e154ca3e0dcd req-36f0be6d-7ccf-4b4d-b16b-eed00718e551 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:43.780448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9731460c-65b4-441a-9d97-e154ca3e0dcd req-36f0be6d-7ccf-4b4d-b16b-eed00718e551 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:43.795939 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9731460c-65b4-441a-9d97-e154ca3e0dcd req-36f0be6d-7ccf-4b4d-b16b-eed00718e551 service nova] Creating event network-vif-plugged:bb419d01-72ec-4f9e-8f32-00bf0e7c950e for instance fbcef7d1-f119-4018-9d80-58db946c1a64 on n-h2-master-1 Jul 24 01:16:43.802104 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9731460c-65b4-441a-9d97-e154ca3e0dcd req-36f0be6d-7ccf-4b4d-b16b-eed00718e551 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047982 Jul 24 01:16:43.803101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 949/1779] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:43.810741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:43.812482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:43.828022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:43.828890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:43.830049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:43.830737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:44.438346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:44.449427 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6528668e-b686-4117-99c5-8d32babf8b70 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1508 microversion: 2.1 time: 0.644862 Jul 24 01:16:44.451682 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 950/1780] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:43 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1508 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:44.465886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc454afb-97f8-4ba9-b749-fbd937b3752c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '.version_select at 0x7f05eac57a60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.035135 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cc454afb-97f8-4ba9-b749-fbd937b3752c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Image not found. Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc454afb-97f8-4ba9-b749-fbd937b3752c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c HTTP/1.1 Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:16:50.038571 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '765f241f-5cf7-43d5-a0f6-84b0a4d7d92c'} Jul 24 01:16:50.040445 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:16:50.042340 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 765f241f-5cf7-43d5-a0f6-84b0a4d7d92c Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:16:50.043789 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 765f241f-5cf7-43d5-a0f6-84b0a4d7d92c could not be found. Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:50.045761 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.047366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc454afb-97f8-4ba9-b749-fbd937b3752c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:50.048684 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc454afb-97f8-4ba9-b749-fbd937b3752c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c" status: 404 len: 62 microversion: 2.1 time: 5.587425 Jul 24 01:16:50.048684 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 951/1781] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:44 2022] GET /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c => generated 62 bytes in 5592 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:16:50.054389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.055289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.061011 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:50.081793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.082413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.083626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.084078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.102459 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-344baf57-7970-47be-8927-18a3c37356e3 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1436 microversion: 2.1 time: 6.464707 Jul 24 01:16:50.104181 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 831/1782] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:43 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1436 bytes in 6467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:50.111709 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b92ae44-e1ce-4b26-94e5-ce1275f489f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:50.113239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b92ae44-e1ce-4b26-94e5-ce1275f489f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.121199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b92ae44-e1ce-4b26-94e5-ce1275f489f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.122116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b92ae44-e1ce-4b26-94e5-ce1275f489f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.123124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b92ae44-e1ce-4b26-94e5-ce1275f489f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.124355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b92ae44-e1ce-4b26-94e5-ce1275f489f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.238420 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b92ae44-e1ce-4b26-94e5-ce1275f489f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "PUT /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1080 microversion: 2.1 time: 0.132955 Jul 24 01:16:50.248572 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 832/1783] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:16:50 2022] PUT /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1080 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:50.255933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.259536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.267919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.268648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.269620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.270245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.386910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:50.396494 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9ca0929-9e12-4859-9f4f-11468ff2950f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1316 microversion: 2.1 time: 0.350632 Jul 24 01:16:50.407612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 952/1784] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:50.413011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.413986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 38c4c870-8606-4888-81ee-c2a835a28957] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.421583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.422099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.422886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.423585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.439304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] HTTP exception thrown: Instance 38c4c870-8606-4888-81ee-c2a835a28957 could not be found. Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Request method failure captured: Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 HTTP/1.1 Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JuXJE-19GYaxEAwjVcbaWDi5Bp8TgetE_QJRtbaq8mDO8m8DoTB8F7K30XvJ8BZ5ix5t3urWMobhW2rVFDGVvZknkC7i0u79VrIRR8PID-g4Sn2FCcc-xBxMEnJMmvgLkLo0nnHA8s6kSH2h_PAdDhDmB3OfYfmWuI4EpuSJyknesE Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:16:50.441184 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58e5e52270c14573b0d4c868cb9fa69c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-LiveMigrationTest-1771055910-project Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 40b5fc3b4b6d43ab9342da568567140d Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-LiveMigrationTest-1771055910-project Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 38c4c870-8606-4888-81ee-c2a835a28957 could not be found. Jul 24 01:16:50.442976 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '38c4c870-8606-4888-81ee-c2a835a28957'} Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c4c870-8606-4888-81ee-c2a835a28957 could not be found. Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:50.443926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c4c870-8606-4888-81ee-c2a835a28957 could not be found. Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c4c870-8606-4888-81ee-c2a835a28957 could not be found. Jul 24 01:16:50.445602 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:50.448769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Returning 404 to user: Instance 38c4c870-8606-4888-81ee-c2a835a28957 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:50.450141 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f2695a53-21d1-4266-82fa-85b5aafce92d tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957" status: 404 len: 111 microversion: 2.1 time: 0.041044 Jul 24 01:16:50.451317 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 953/1785] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/38c4c870-8606-4888-81ee-c2a835a28957 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:50.456806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-41c9b898-5d9d-4361-9db9-d529ef2f99bf req-ef9e8e39-c589-4265-96f9-7d36d6247295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c4c870-8606-4888-81ee-c2a835a28957", "name": "network-vif-deleted", "tag": "d4d5f9d8-92d8-4655-b5b7-0152abef78c0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:50.467631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-41c9b898-5d9d-4361-9db9-d529ef2f99bf req-ef9e8e39-c589-4265-96f9-7d36d6247295 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.468821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-41c9b898-5d9d-4361-9db9-d529ef2f99bf req-ef9e8e39-c589-4265-96f9-7d36d6247295 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.482979 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-41c9b898-5d9d-4361-9db9-d529ef2f99bf req-ef9e8e39-c589-4265-96f9-7d36d6247295 service nova] Creating event network-vif-deleted:d4d5f9d8-92d8-4655-b5b7-0152abef78c0 for instance 38c4c870-8606-4888-81ee-c2a835a28957 on n-h1-master-1 Jul 24 01:16:50.488851 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-41c9b898-5d9d-4361-9db9-d529ef2f99bf req-ef9e8e39-c589-4265-96f9-7d36d6247295 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035833 Jul 24 01:16:50.490084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 954/1786] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:50.498585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d01375fe-56d3-467f-a357-e2778f90aad4 req-6528287e-3b38-49bc-88a8-c33bf4a2753e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8bab37-21be-406c-9066-85ba99e725c2", "tag": "284e09b9-757e-49af-b049-18d56b72b9ae"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:50.512037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d01375fe-56d3-467f-a357-e2778f90aad4 req-6528287e-3b38-49bc-88a8-c33bf4a2753e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.513278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d01375fe-56d3-467f-a357-e2778f90aad4 req-6528287e-3b38-49bc-88a8-c33bf4a2753e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.528253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d01375fe-56d3-467f-a357-e2778f90aad4 req-6528287e-3b38-49bc-88a8-c33bf4a2753e service nova] Creating event network-changed:284e09b9-757e-49af-b049-18d56b72b9ae for instance 3d8bab37-21be-406c-9066-85ba99e725c2 on n-h2-master-1 Jul 24 01:16:50.529631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:50.533623 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d01375fe-56d3-467f-a357-e2778f90aad4 req-6528287e-3b38-49bc-88a8-c33bf4a2753e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041749 Jul 24 01:16:50.534575 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 955/1787] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:50.538952 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1611b901-5c04-476d-adc9-50844f6c3745 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1524 microversion: 2.1 time: 0.289093 Jul 24 01:16:50.539733 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 833/1788] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:50.544161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-77893323-5f93-4d1c-bbb5-80ece69ee226 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eb0aa670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.545889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.546663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.558836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.559383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.560244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.560965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.602607 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-77893323-5f93-4d1c-bbb5-80ece69ee226 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 200 len: 1436 microversion: 2.1 time: 0.061603 Jul 24 01:16:50.604474 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 834/1789] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 1436 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:50.620656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-90bbaedb-ba60-4d14-9978-a90477c3a4d8 req-3cd7ecb2-5765-4dfa-8708-981b118ccc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818c7702-66f8-4672-b67b-5a05d9197c59", "name": "network-vif-plugged", "status": "completed", "tag": "5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:50.658965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-90bbaedb-ba60-4d14-9978-a90477c3a4d8 req-3cd7ecb2-5765-4dfa-8708-981b118ccc0e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.659765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-90bbaedb-ba60-4d14-9978-a90477c3a4d8 req-3cd7ecb2-5765-4dfa-8708-981b118ccc0e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.677517 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-90bbaedb-ba60-4d14-9978-a90477c3a4d8 req-3cd7ecb2-5765-4dfa-8708-981b118ccc0e service nova] Creating event network-vif-plugged:5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8 for instance 818c7702-66f8-4672-b67b-5a05d9197c59 on n-h1-master-1 Jul 24 01:16:50.684687 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-90bbaedb-ba60-4d14-9978-a90477c3a4d8 req-3cd7ecb2-5765-4dfa-8708-981b118ccc0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078534 Jul 24 01:16:50.685299 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 835/1790] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:50.694117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.694834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.704837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.705298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.706128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.708221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.765421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:50.774223 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-603a9411-ecfc-42dc-82bd-76d6f62a8b25 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1523 microversion: 2.1 time: 0.238169 Jul 24 01:16:50.779889 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 956/1791] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:50.794982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-92f6887a-e0f1-41c8-b368-490d251d27b7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '.version_select at 0x7f05eac16b80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.832010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-92f6887a-e0f1-41c8-b368-490d251d27b7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679968791" status: 202 len: 0 microversion: 2.1 time: 0.050268 Jul 24 01:16:50.833530 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 957/1792] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679968791 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:50.842632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:50.845263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:50.857726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.858198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.859017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:50.859584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:50.980745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:50.992113 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cc6e133c-3770-4586-a784-8d7aefa17e83 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1506 microversion: 2.1 time: 0.305402 Jul 24 01:16:51.014271 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 836/1793] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:51.024035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.026010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.029695 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:51.036226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.036837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.037814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.039190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.085302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:51.132750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:51.143870 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-620b279f-65a0-40a1-ac91-a5643d978154 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1467 microversion: 2.1 time: 0.308928 Jul 24 01:16:51.157697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 958/1794] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:50 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1467 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:51.162972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.163845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.172801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.173588 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.174683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.175391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.232654 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75975dc5-1195-4f70-994a-3b8a90c7aa7c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 204 len: 0 microversion: 2.1 time: 0.215957 Jul 24 01:16:51.235095 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 837/1795] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:51 2022] DELETE /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:51.245570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43862a65-d59b-4ed0-a483-d331620e3eec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eaff6160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.577577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:51.589336 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f17e7bd4-b3d6-485c-8b07-4d59b596c69e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1506 microversion: 2.1 time: 0.427540 Jul 24 01:16:51.605660 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 959/1796] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:51 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:51.614001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.614682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.628797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.631854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.632967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.634519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.932938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:51.934722 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:51.945299 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f18e58fa-15b2-4bd0-a489-a522e402f4d7 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1529 microversion: 2.1 time: 0.338054 Jul 24 01:16:51.946329 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 960/1797] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:51 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1529 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:51.952350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:51.952800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:51.959556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.960018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:51.961163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:51.961315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.229642 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43862a65-d59b-4ed0-a483-d331620e3eec tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "DELETE /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e" status: 204 len: 0 microversion: 2.1 time: 0.989604 Jul 24 01:16:52.231938 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 838/1798] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:51 2022] DELETE /compute/v2.1/images/f7d86b88-1ab2-439f-8870-b703c8e0499e => generated 0 bytes in 996 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:52.237464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:52.239138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:52.249596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.250771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.252235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.253202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.410982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:52.424516 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c404191-6c6e-461a-823b-0bfd9f64124d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1316 microversion: 2.1 time: 0.474289 Jul 24 01:16:52.426397 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 961/1799] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:51 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:52.448588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:52.450455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:52.457644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.458419 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.459465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.459905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.525339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:52.533559 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aff880dd-80fb-46d5-b3de-74c493327a1d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1524 microversion: 2.1 time: 0.300112 Jul 24 01:16:52.535829 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 839/1800] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:52 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1524 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:52.541101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f5b54ea-52e2-4d07-acd4-7feae3097694 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '.version_select at 0x7f05eaff6af0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:52.586906 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-5f5b54ea-52e2-4d07-acd4-7feae3097694 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] HTTP exception thrown: Image not found. Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f5b54ea-52e2-4d07-acd4-7feae3097694 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Request method failure captured: Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 HTTP/1.1 Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J01oV_qc0QP89xmQy0JV7FOvzAc0DrVoRYDWd2lsexTaqp7AGAM2eNMm6HbaTtX0Ethg9ZrBcg9ssgXEySU8p4KWNRE2wslDzrU0zb7TRUxpWyQauXuax5yoEynRfDwcsLX9IAuRigD7FuBPfBQE2Y-5SPlRG7lXlc9RbjOgnDgrZs Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8a078a3f8468439788ea2327659fb762 Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:16:52.589092 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a078a3f8468439788ea2327659fb762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a078a3f8468439788ea2327659fb762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a078a3f8468439788ea2327659fb762", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a078a3f8468439788ea2327659fb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8a078a3f8468439788ea2327659fb762 Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerTestJSON-400466620-project Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 82276fe777fb4b08ac6baddf33d752ab Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerTestJSON-400466620-project Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd52e5d9b-6921-40bd-a3d4-829da7323d44'} Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:52.590906 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d52e5d9b-6921-40bd-a3d4-829da7323d44 to delete Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.592007 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d52e5d9b-6921-40bd-a3d4-829da7323d44 could not be found. Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:52.593318 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:16:52.594798 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:52.595590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:16:52.595590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:16:52.596871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:16:52.598004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f5b54ea-52e2-4d07-acd4-7feae3097694 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:52.598153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:16:52.599105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:16:52.599533 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5f5b54ea-52e2-4d07-acd4-7feae3097694 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "DELETE /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44" status: 404 len: 62 microversion: 2.1 time: 0.062163 Jul 24 01:16:52.603730 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 840/1801] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:52 2022] DELETE /compute/v2.1/images/d52e5d9b-6921-40bd-a3d4-829da7323d44 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:16:52.609090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:52.609889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:52.612017 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:52.623461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.624382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.625413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.626089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.655077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:52.675954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:52.684117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.684705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.685580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.686143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.721919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e9f5c04f-149a-4ba3-9fba-76823b10bccf tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "POST /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53/action" status: 202 len: 1112 microversion: 2.1 time: 0.290177 Jul 24 01:16:52.723217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 962/1802] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:52 2022] POST /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53/action => generated 1112 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 24 01:16:52.736286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:52.737224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:52.746698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.748071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.763662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.765582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.768836 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23a66a1e-d528-4fd1-84d3-cc8c4269fea0 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 204 len: 0 microversion: 2.1 time: 0.163376 Jul 24 01:16:52.770176 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 841/1803] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:52 2022] DELETE /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:52.778127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:52.779153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:52.787961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.789776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.790757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:52.791562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:52.807521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:52.978943 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8c85bc70-3b2d-4f38-a8ba-d063dbbfa318 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 204 len: 0 microversion: 2.1 time: 0.253484 Jul 24 01:16:52.982431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 963/1804] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:52 2022] DELETE /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:52.993812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.001119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.009977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.010443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.011235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.011681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.036150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:53.048871 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f139dd3-f21e-46b9-a527-0fdeb55bb04e tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.276390 Jul 24 01:16:53.049572 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 842/1805] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:52 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:53.056288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.057556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.080136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.080524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.081321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.081955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.284645 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:53.294727 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:53.298122 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7fc88af4-45c4-4ed5-841b-4b8fdc55d433 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1484 microversion: 2.1 time: 0.313577 Jul 24 01:16:53.299345 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 964/1806] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:52 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1484 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:53.304346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.305306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.313988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.314913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.315951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.316943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.333998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:53.343884 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-392f1df3-b565-43e7-adcc-c6b95a58d7bc tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1529 microversion: 2.1 time: 0.292454 Jul 24 01:16:53.345220 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 843/1807] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:53 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1529 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:53.453918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.454901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.467065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.468015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.471245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:53.475354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.475883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.482098 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a3d7980-ac8b-4115-b644-064e52b7d99e tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1473 microversion: 2.1 time: 0.179199 Jul 24 01:16:53.486419 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 965/1808] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:53 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:53.504264 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:53.552922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:53.553540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:53.567481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.568971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.570355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.571138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.701266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:53.710604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5ba8a5c-c80f-4a5a-8356-24d9b0386b04 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1316 microversion: 2.1 time: 0.259666 Jul 24 01:16:53.711984 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 844/1809] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:53 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:53.750109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-17587fc2-6720-475d-9cf3-f03a8cf3b1d7 req-2d868dc3-e05f-412d-8f26-bd60ead3a51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8bab37-21be-406c-9066-85ba99e725c2", "name": "network-vif-plugged", "status": "completed", "tag": "284e09b9-757e-49af-b049-18d56b72b9ae"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:53.765008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-17587fc2-6720-475d-9cf3-f03a8cf3b1d7 req-2d868dc3-e05f-412d-8f26-bd60ead3a51b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:53.765921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-17587fc2-6720-475d-9cf3-f03a8cf3b1d7 req-2d868dc3-e05f-412d-8f26-bd60ead3a51b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:53.791920 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-17587fc2-6720-475d-9cf3-f03a8cf3b1d7 req-2d868dc3-e05f-412d-8f26-bd60ead3a51b service nova] Creating event network-vif-plugged:284e09b9-757e-49af-b049-18d56b72b9ae for instance 3d8bab37-21be-406c-9066-85ba99e725c2 on n-h2-master-1 Jul 24 01:16:53.809560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-17587fc2-6720-475d-9cf3-f03a8cf3b1d7 req-2d868dc3-e05f-412d-8f26-bd60ead3a51b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072043 Jul 24 01:16:53.815805 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 845/1810] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:16:53.828810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:53.838795 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67d465e8-bb71-43e1-a2ac-99a95fbd52da tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1524 microversion: 2.1 time: 0.289415 Jul 24 01:16:53.840124 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 966/1811] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:53 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1524 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:54.069458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:54.070550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:54.080520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.081286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.082375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.083205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.262029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:54.274720 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b7635ae-9f3c-4720-a90e-2a14ff16d17c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.211679 Jul 24 01:16:54.278583 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 846/1812] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:54 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:54.320872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:54.322211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:54.333327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.334114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.335077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.335677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.366999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:54.367687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:54.376080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.376929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.378068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:54.378741 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:54.949387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:54.958958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-295fd3c0-3237-4ee3-959a-4fb16becebae tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1484 microversion: 2.1 time: 0.645992 Jul 24 01:16:54.960918 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 967/1813] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:54 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1484 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:54.976657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:54.977595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:54.991419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:54.999848 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-69131526-b059-45d1-adf6-bfc3dc8ad69c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1529 microversion: 2.1 time: 0.636840 Jul 24 01:16:55.001763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.002699 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 847/1814] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:54 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1529 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:55.003214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.004404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.005012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.009234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:55.015744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:55.026439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.038383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.039433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.039965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.616659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:55.629063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05c91525-8c0b-4411-8fe2-3a9568318c16 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1473 microversion: 2.1 time: 0.666372 Jul 24 01:16:55.634650 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:55.638014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 968/1815] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:54 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1473 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:55.647307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:55.648138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:55.649690 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a4b590a-bd84-4cf0-a220-9adadfc9b3a6 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1316 microversion: 2.1 time: 0.644055 Jul 24 01:16:55.662825 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 848/1816] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:55 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:55.679405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:55.680673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.681318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.682469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.683320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.687380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:55.707159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.707919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:55.711146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:55.712024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.209296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:56.217522 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eccc429f-df53-4d7d-8f6c-e8d8de617177 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1524 microversion: 2.1 time: 0.578099 Jul 24 01:16:56.218318 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 969/1817] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:55 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1524 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:56.232918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-95875bdb-1c98-4efb-b9d9-cd0fd86e3a8d req-8758ca64-8177-4342-9edb-411349d0c131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa", "name": "network-vif-unplugged", "status": "completed", "tag": "8fb2b79a-88da-458a-b886-b54a4965954d"}, {"server_uuid": "818c7702-66f8-4672-b67b-5a05d9197c59", "name": "network-vif-unplugged", "status": "completed", "tag": "5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:56.242635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-95875bdb-1c98-4efb-b9d9-cd0fd86e3a8d req-8758ca64-8177-4342-9edb-411349d0c131 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.243369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-95875bdb-1c98-4efb-b9d9-cd0fd86e3a8d req-8758ca64-8177-4342-9edb-411349d0c131 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.261702 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-95875bdb-1c98-4efb-b9d9-cd0fd86e3a8d req-8758ca64-8177-4342-9edb-411349d0c131 service nova] Creating event network-vif-unplugged:8fb2b79a-88da-458a-b886-b54a4965954d for instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa on n-h1-master-1 Jul 24 01:16:56.262451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-95875bdb-1c98-4efb-b9d9-cd0fd86e3a8d req-8758ca64-8177-4342-9edb-411349d0c131 service nova] Creating event network-vif-unplugged:5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8 for instance 818c7702-66f8-4672-b67b-5a05d9197c59 on n-h1-master-1 Jul 24 01:16:56.286704 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-95875bdb-1c98-4efb-b9d9-cd0fd86e3a8d req-8758ca64-8177-4342-9edb-411349d0c131 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.058038 Jul 24 01:16:56.287688 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 970/1818] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:56.293274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-686e59e3-3af2-4655-9fbc-a29d040ddaf0 req-c398e703-2317-4161-82bc-4f134793fbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5044972f-10c9-4250-87ea-7e65fdad75f5", "name": "network-vif-deleted", "tag": "72a9224c-8d72-4822-b153-758b0b86416b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:56.314002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-686e59e3-3af2-4655-9fbc-a29d040ddaf0 req-c398e703-2317-4161-82bc-4f134793fbd1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.314694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-686e59e3-3af2-4655-9fbc-a29d040ddaf0 req-c398e703-2317-4161-82bc-4f134793fbd1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.316863 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:56.327972 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b412a1b3-26ed-47cb-9285-c79ab9532eb8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.662654 Jul 24 01:16:56.337551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 849/1819] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:55 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:56.341355 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.342503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.348415 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-686e59e3-3af2-4655-9fbc-a29d040ddaf0 req-c398e703-2317-4161-82bc-4f134793fbd1 service nova] Creating event network-vif-deleted:72a9224c-8d72-4822-b153-758b0b86416b for instance 5044972f-10c9-4250-87ea-7e65fdad75f5 on n-h1-master-1 Jul 24 01:16:56.354501 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-686e59e3-3af2-4655-9fbc-a29d040ddaf0 req-c398e703-2317-4161-82bc-4f134793fbd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064920 Jul 24 01:16:56.355114 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 971/1820] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:56.364741 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.365197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.366018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.371542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.373007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.373354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.386819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.387581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.388700 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.389364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.418761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.419285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.419817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lazy-loading 'fault' on Instance uuid 5044972f-10c9-4250-87ea-7e65fdad75f5 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:16:56.584884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:56.587313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:56.599066 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d2cb32ce-d883-4de7-a1f8-411f9ff7b9ed tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 200 len: 1300 microversion: 2.1 time: 0.262846 Jul 24 01:16:56.599632 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 850/1821] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:56 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 1300 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:56.609266 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0cdb124b-0144-44e1-bcd6-212ba30cce01 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 200 len: 1487 microversion: 2.1 time: 0.252588 Jul 24 01:16:56.610602 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 972/1822] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:56 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 1487 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:56.614491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-18052c95-81e7-42a4-8fa5-48d1f79da917 req-5e81d7c8-8798-4134-9356-b3308ed68ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818c7702-66f8-4672-b67b-5a05d9197c59", "name": "network-vif-deleted", "tag": "5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:56.627334 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-18052c95-81e7-42a4-8fa5-48d1f79da917 req-5e81d7c8-8798-4134-9356-b3308ed68ab2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.627783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-18052c95-81e7-42a4-8fa5-48d1f79da917 req-5e81d7c8-8798-4134-9356-b3308ed68ab2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.647615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.647853 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-18052c95-81e7-42a4-8fa5-48d1f79da917 req-5e81d7c8-8798-4134-9356-b3308ed68ab2 service nova] Creating event network-vif-deleted:5c707fe3-1bd7-45d6-8809-a0fd68e8d6e8 for instance 818c7702-66f8-4672-b67b-5a05d9197c59 on n-h1-master-1 Jul 24 01:16:56.649110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.654700 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-18052c95-81e7-42a4-8fa5-48d1f79da917 req-5e81d7c8-8798-4134-9356-b3308ed68ab2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049522 Jul 24 01:16:56.655440 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 851/1823] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:56.658427 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.658880 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.659670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.660112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.674570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:56.675593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.689414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.690001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.690807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.691362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.745018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82276fe777fb4b08ac6baddf33d752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a078a3f8468439788ea2327659fb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:56.752696 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-11665fc5-bfd8-4eaa-933d-de69aacc85ac tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 200 len: 1431 microversion: 2.1 time: 0.110287 Jul 24 01:16:56.753272 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 973/1824] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:56 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 1431 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:56.915442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:56.923051 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e423b236-997d-4efe-8f25-a9b5c248a136 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1505 microversion: 2.1 time: 0.253170 Jul 24 01:16:56.923629 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 852/1825] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:56 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:56.939515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-98289853"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:56.940051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:56.946161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.946698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:56.948061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:56.948617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.092484 n-d-master-1 devstack@n-api.service[119561]: INFO nova.network.security_group_api [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Adding security group a02bc833-e293-4e4a-8a3d-64f6164a0359 to port 284e09b9-757e-49af-b049-18d56b72b9ae Jul 24 01:16:57.234638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.235259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.242433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.243285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.245083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.245920 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.526468 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:57.534949 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-46be2da3-09e5-4bc9-aac0-f17f0c5b1521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1524 microversion: 2.1 time: 0.304350 Jul 24 01:16:57.535836 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 853/1826] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:57 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1524 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:57.541326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.542069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.552700 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.553429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.554459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.555063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.616973 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0049d69e-7d7b-4d70-adab-77d67a443bcd tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2/action" status: 202 len: 0 microversion: 2.1 time: 0.681434 Jul 24 01:16:57.618392 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 974/1827] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:56 2022] POST /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:57.629327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.630279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 5044972f-10c9-4250-87ea-7e65fdad75f5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.647834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.648818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.649940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.651505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.676907 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] HTTP exception thrown: Instance 5044972f-10c9-4250-87ea-7e65fdad75f5 could not be found. Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Request method failure captured: Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 HTTP/1.1 Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JuXJE-19GYaxEAwjVcbaWDi5Bp8TgetE_QJRtbaq8mDO8m8DoTB8F7K30XvJ8BZ5ix5t3urWMobhW2rVFDGVvZknkC7i0u79VrIRR8PID-g4Sn2FCcc-xBxMEnJMmvgLkLo0nnHA8s6kSH2h_PAdDhDmB3OfYfmWuI4EpuSJyknesE Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:16:57.686579 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58e5e52270c14573b0d4c868cb9fa69c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-LiveMigrationTest-1771055910-project Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 40b5fc3b4b6d43ab9342da568567140d Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-LiveMigrationTest-1771055910-project Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 5044972f-10c9-4250-87ea-7e65fdad75f5 could not be found. Jul 24 01:16:57.688170 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '5044972f-10c9-4250-87ea-7e65fdad75f5'} Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5044972f-10c9-4250-87ea-7e65fdad75f5 could not be found. Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:57.688999 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5044972f-10c9-4250-87ea-7e65fdad75f5 could not be found. Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5044972f-10c9-4250-87ea-7e65fdad75f5 could not be found. Jul 24 01:16:57.690358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.694619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Returning 404 to user: Instance 5044972f-10c9-4250-87ea-7e65fdad75f5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:57.698970 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ace99c4c-8999-4da3-b3d1-9c79ebceb963 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5" status: 404 len: 111 microversion: 2.1 time: 0.079168 Jul 24 01:16:57.706147 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 975/1828] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:57 2022] GET /compute/v2.1/servers/5044972f-10c9-4250-87ea-7e65fdad75f5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:57.715037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b88707ae-eb26-4634-b5eb-e968f7e299b3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eabfe550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.833401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:57.846823 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b376bb4-20af-42e4-9b43-834d466f0543 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.309197 Jul 24 01:16:57.847638 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 854/1829] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:57 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:57.854173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.855807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.863260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.863874 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.866982 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.867594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.892441 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 HTTP/1.1 Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:16:57.894483 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:16:57.896271 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '818c7702-66f8-4672-b67b-5a05d9197c59'} Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:57.897269 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:16:57.898975 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.901761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:57.903111 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ca46e17-2199-4142-a136-f9b33bcf2dea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 404 len: 111 microversion: 2.1 time: 0.053089 Jul 24 01:16:57.903111 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 855/1830] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:57 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:57.914846 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-b88707ae-eb26-4634-b5eb-e968f7e299b3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use.", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:16:57.918538 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b88707ae-eb26-4634-b5eb-e968f7e299b3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use. Jul 24 01:16:57.918538 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f46ce12b-b483-4b1f-acaa-d51a1433b20e'] Jul 24 01:16:57.919075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.919588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b88707ae-eb26-4634-b5eb-e968f7e299b3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359 HTTP/1.1 Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:16:57.920421 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: exception: Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use. Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f46ce12b-b483-4b1f-acaa-d51a1433b20e'] Jul 24 01:16:57.922347 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a02bc833-e293-4e4a-8a3d-64f6164a0359'} Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:57.923254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use. Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f46ce12b-b483-4b1f-acaa-d51a1433b20e'] Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use. Jul 24 01:16:57.924519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f46ce12b-b483-4b1f-acaa-d51a1433b20e'] Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use. Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f46ce12b-b483-4b1f-acaa-d51a1433b20e'] Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.925785 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use. Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f46ce12b-b483-4b1f-acaa-d51a1433b20e'] Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b88707ae-eb26-4634-b5eb-e968f7e299b3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 400 to user: Security Group a02bc833-e293-4e4a-8a3d-64f6164a0359 in use. Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f46ce12b-b483-4b1f-acaa-d51a1433b20e'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b88707ae-eb26-4634-b5eb-e968f7e299b3 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359" status: 400 len: 185 microversion: 2.1 time: 0.214228 Jul 24 01:16:57.927589 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 976/1831] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:16:57 2022] DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359 => generated 185 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:16:57.930571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:57.930854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] [instance: a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.933161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.933946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.934942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.935630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.946190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.948891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.950134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.954007 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:57.972712 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] HTTP exception thrown: Instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa could not be found. Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Request method failure captured: Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa HTTP/1.1 Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J01oV_qc0QP89xmQy0JV7FOvzAc0DrVoRYDWd2lsexTaqp7AGAM2eNMm6HbaTtX0Ethg9ZrBcg9ssgXEySU8p4KWNRE2wslDzrU0zb7TRUxpWyQauXuax5yoEynRfDwcsLX9IAuRigD7FuBPfBQE2Y-5SPlRG7lXlc9RbjOgnDgrZs Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8a078a3f8468439788ea2327659fb762 Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:16:57.974604 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a078a3f8468439788ea2327659fb762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a078a3f8468439788ea2327659fb762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a078a3f8468439788ea2327659fb762", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a078a3f8468439788ea2327659fb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8a078a3f8468439788ea2327659fb762 Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-400466620 Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesOneServerTestJSON-400466620-project Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 82276fe777fb4b08ac6baddf33d752ab Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesOneServerTestJSON-400466620-project Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: exception: Instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa could not be found. Jul 24 01:16:57.976377 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa'} Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa could not be found. Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:16:57.977645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa could not be found. Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa could not be found. Jul 24 01:16:57.980631 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:16:57.982367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] Returning 404 to user: Instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:16:57.982490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:16:57.982596 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3affb279-4e97-4498-8d02-2b38ab8a4f74 tempest-ImagesOneServerTestJSON-400466620 tempest-ImagesOneServerTestJSON-400466620-project] 10.222.0.27 "GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa" status: 404 len: 111 microversion: 2.1 time: 0.056553 Jul 24 01:16:57.986465 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 977/1832] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:57 2022] GET /compute/v2.1/servers/a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:57.990204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fd54d95c-31e8-4eaa-bf04-3c898352b967 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:57.991351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fd54d95c-31e8-4eaa-bf04-3c898352b967 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:57.999077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd54d95c-31e8-4eaa-bf04-3c898352b967 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:57.999689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd54d95c-31e8-4eaa-bf04-3c898352b967 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.000584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd54d95c-31e8-4eaa-bf04-3c898352b967 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.001128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd54d95c-31e8-4eaa-bf04-3c898352b967 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.130392 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fd54d95c-31e8-4eaa-bf04-3c898352b967 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2/action" status: 202 len: 0 microversion: 2.1 time: 0.143427 Jul 24 01:16:58.131100 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 978/1833] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:16:57 2022] POST /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:16:58.155134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-734551681", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:58.173184 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b21a18c-1a4d-48ad-82cb-ce9c4cf9edc7 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "DELETE /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 204 len: 0 microversion: 2.1 time: 0.259156 Jul 24 01:16:58.174027 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 856/1834] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:16:57 2022] DELETE /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:16:58.179646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:58.181436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:58.189299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.189797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.190759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.191202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.286489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] validate_networks() for [('08c0cda2-b079-422b-bfb3-9cb6b5d64f85', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:16:58.493422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:58.514948 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b2d1cbf-4701-449d-89ea-17bf278559f5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1574 microversion: 2.1 time: 0.339746 Jul 24 01:16:58.526187 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 857/1835] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:58 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1574 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:58.532998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:58.533853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:58.549712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.550484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.551469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.556986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.955595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:58.964564 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56838a53-b951-4710-9fb0-6441c327cbd9 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1500 microversion: 2.1 time: 0.436674 Jul 24 01:16:58.965487 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 858/1836] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:58 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1500 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:58.971349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:58.972173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:58.979565 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.980223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:58.981027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:58.981469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.239468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:16:59.239988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:16:59.240361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:16:59.240971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:16:59.242546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:16:59.254199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.255249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.256229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.256851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.271973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:59.279382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for project 641ace3f76eb466ba57c3f42b8173978. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:16:59.280596 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23faf028-3afe-4e5d-beb3-461757a0dde9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1506 microversion: 2.1 time: 0.312856 Jul 24 01:16:59.285715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Getting quotas for user 5da455c083744e7c814e8638483ffffe and project 641ace3f76eb466ba57c3f42b8173978. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:16:59.289766 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 859/1837] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:58 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:59.298917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-80d8b572-2385-4dc3-ae1c-aa75dc370cfa req-30b5d033-991f-447a-a31c-a6f08c7a0af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa", "name": "network-vif-deleted", "tag": "8fb2b79a-88da-458a-b886-b54a4965954d"}, {"name": "network-changed", "server_uuid": "3d8bab37-21be-406c-9066-85ba99e725c2", "tag": "284e09b9-757e-49af-b049-18d56b72b9ae"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:59.301228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:16:59.303973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:16:59.311486 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-80d8b572-2385-4dc3-ae1c-aa75dc370cfa req-30b5d033-991f-447a-a31c-a6f08c7a0af1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.311946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-80d8b572-2385-4dc3-ae1c-aa75dc370cfa req-30b5d033-991f-447a-a31c-a6f08c7a0af1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.325799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-80d8b572-2385-4dc3-ae1c-aa75dc370cfa req-30b5d033-991f-447a-a31c-a6f08c7a0af1 service nova] Creating event network-vif-deleted:8fb2b79a-88da-458a-b886-b54a4965954d for instance a21d5c5c-d9fe-4116-afeb-d2b26f28f3fa on n-h1-master-1 Jul 24 01:16:59.326763 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-80d8b572-2385-4dc3-ae1c-aa75dc370cfa req-30b5d033-991f-447a-a31c-a6f08c7a0af1 service nova] Creating event network-changed:284e09b9-757e-49af-b049-18d56b72b9ae for instance 3d8bab37-21be-406c-9066-85ba99e725c2 on n-h2-master-1 Jul 24 01:16:59.338194 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-80d8b572-2385-4dc3-ae1c-aa75dc370cfa req-30b5d033-991f-447a-a31c-a6f08c7a0af1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046270 Jul 24 01:16:59.338949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 860/1838] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:59.344753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:59.345596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:59.352134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.352663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.354299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.354994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.364746 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f210e7b8-66bd-4a75-a566-3077d3376855 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.228909 Jul 24 01:16:59.367108 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 979/1839] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:16:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:16:59.400641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb6e1e1f-916c-4f4d-b0a4-db1102660727 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:59.401639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb6e1e1f-916c-4f4d-b0a4-db1102660727 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:59.491012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb6e1e1f-916c-4f4d-b0a4-db1102660727 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:59.513264 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb6e1e1f-916c-4f4d-b0a4-db1102660727 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1224 microversion: 2.1 time: 0.129089 Jul 24 01:16:59.523130 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 980/1840] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:59 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:59.538790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:59.543812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:59.556685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.557602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.558755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.560147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.674545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:59.680361 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:59.697927 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-83cedcdb-9969-4f38-9228-0ac43bc58a22 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.355444 Jul 24 01:16:59.699032 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 861/1841] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:59 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:16:59.756764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:16:59.768608 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b7a8f0e5-ad36-4caf-a3bf-d2ae6fd46185 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1574 microversion: 2.1 time: 0.236638 Jul 24 01:16:59.769723 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 981/1842] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:59 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:16:59.778641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9ea7aec9-0af9-4572-85e9-1b80627206f2 req-6b9e70e0-edf4-48f7-8a8b-8dde4373054e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcef7d1-f119-4018-9d80-58db946c1a64", "name": "network-vif-unplugged", "status": "completed", "tag": "bb419d01-72ec-4f9e-8f32-00bf0e7c950e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:16:59.789349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9ea7aec9-0af9-4572-85e9-1b80627206f2 req-6b9e70e0-edf4-48f7-8a8b-8dde4373054e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.789933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9ea7aec9-0af9-4572-85e9-1b80627206f2 req-6b9e70e0-edf4-48f7-8a8b-8dde4373054e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.831464 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9ea7aec9-0af9-4572-85e9-1b80627206f2 req-6b9e70e0-edf4-48f7-8a8b-8dde4373054e service nova] Creating event network-vif-unplugged:bb419d01-72ec-4f9e-8f32-00bf0e7c950e for instance fbcef7d1-f119-4018-9d80-58db946c1a64 on n-h2-master-1 Jul 24 01:16:59.852454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9ea7aec9-0af9-4572-85e9-1b80627206f2 req-6b9e70e0-edf4-48f7-8a8b-8dde4373054e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077629 Jul 24 01:16:59.853953 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 862/1843] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:16:59.983517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:16:59.984367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:16:59.995128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.995590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:16:59.996392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:16:59.997033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.030506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.031227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.031888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lazy-loading 'fault' on Instance uuid 975740f0-20a6-4d5b-8e57-766c11d09594 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:00.083036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b5fc3b4b6d43ab9342da568567140d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e5e52270c14573b0d4c868cb9fa69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:00.093764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa1a4694-35d3-4a03-91c8-cecee0bfbfa1 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 200 len: 1301 microversion: 2.1 time: 0.114299 Jul 24 01:17:00.094347 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 982/1844] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:16:59 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:00.287088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c74cf0b8-d03a-4ba4-9f39-4bb45f38d7e2 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eb107790>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+9AL3lhw9TvET5ewlAgLVSNPPI3ZfdYryP/vd/+85B4gqq/dKdMtJqqgZTJQ18uSBWhJVCwLW9vgXca34kudEMM06xyDkhOv1f2qWY63M/R01vlK7y0Rad6WbwWouMsw=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.294672 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c74cf0b8-d03a-4ba4-9f39-4bb45f38d7e2 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 24 01:17:00.299355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:00.300025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c74cf0b8-d03a-4ba4-9f39-4bb45f38d7e2 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 257 Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:00.301235 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+9AL3lhw9TvET5ewlAgLVSNPPI3ZfdYryP/vd/+85B4gqq/dKdMtJqqgZTJQ18uSBWhJVCwLW9vgXca34kudEMM06xyDkhOv1f2qWY63M/R01vlK7y0Rad6WbwWouMsw=="}} Jul 24 01:17:00.303907 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+9AL3lhw9TvET5ewlAgLVSNPPI3ZfdYryP/vd/+85B4gqq/dKdMtJqqgZTJQ18uSBWhJVCwLW9vgXca34kudEMM06xyDkhOv1f2qWY63M/R01vlK7y0Rad6WbwWouMsw=='}}} Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 24 01:17:00.304941 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 24 01:17:00.306971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.308715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c74cf0b8-d03a-4ba4-9f39-4bb45f38d7e2 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.310385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.310385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.310385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.310385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.310718 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c74cf0b8-d03a-4ba4-9f39-4bb45f38d7e2 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.202522 Jul 24 01:17:00.315375 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 863/1845] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:17:00.323130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a939ace-ffad-44ce-a3fb-33f7c80f5a7e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eb1f0040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-222672578", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.341130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4a939ace-ffad-44ce-a3fb-33f7c80f5a7e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:00.347531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4a939ace-ffad-44ce-a3fb-33f7c80f5a7e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for user af549d9da3ff44bfbf9760282e493426 and project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:00.375826 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4a939ace-ffad-44ce-a3fb-33f7c80f5a7e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a939ace-ffad-44ce-a3fb-33f7c80f5a7e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 2166 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-222672578", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:00.394729 n-d-master-1 devstack@n-api.service[119562]: exception: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-222672578', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.397599 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a939ace-ffad-44ce-a3fb-33f7c80f5a7e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.400775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4a939ace-ffad-44ce-a3fb-33f7c80f5a7e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.082626 Jul 24 01:17:00.406904 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 864/1846] 10.222.0.27 () {60 vars in 1159 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:00.412696 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4374caf2-6818-492d-9085-2d99c86e76b3 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eafb0c10>, body: {"keypair": {"name": "tempest-keypair-355671791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaE8TW+wtMZMLWr/AIK7n3ayL8Gqf07sHFF0qUwJgcH1Ld2Fxbky7Pizo+ZI2pnkcH8HQ+Amc0Kg27HllyaZQJYcztU63cUHZyGtOAVXJjt7le0IsYut6wzBpX5rEFQiQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.429018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4374caf2-6818-492d-9085-2d99c86e76b3 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:00.434517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4374caf2-6818-492d-9085-2d99c86e76b3 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for user af549d9da3ff44bfbf9760282e493426 and project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:00.465962 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4374caf2-6818-492d-9085-2d99c86e76b3 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057719 Jul 24 01:17:00.467189 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 865/1847] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:00.481301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9de78d26-26e6-405e-8d82-2cc642488c2f tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eafb01f0>, body: {"keypair": {"name": "tempest-keypair-355671791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlxRuI2/CYvO7Uu3ReIKRbcKgwBt09VNxa30+66EOUtkUXWgXoAjbTniQDJ1xs6oE8e3Z+7tayAGYxyo086ywv9D/se68eWeTQZmxM13j6KbzWXhNSZIaSSstPaCj1ofg=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.483760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:00.498463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9de78d26-26e6-405e-8d82-2cc642488c2f tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:00.504527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9de78d26-26e6-405e-8d82-2cc642488c2f tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for user af549d9da3ff44bfbf9760282e493426 and project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:00.508929 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e22b9a69-6dc4-4064-aab3-9eac36bc4714 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1506 microversion: 2.1 time: 0.213704 Jul 24 01:17:00.515383 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 983/1848] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:00 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:00.522543 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:00.531789 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9de78d26-26e6-405e-8d82-2cc642488c2f tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] HTTP exception thrown: Key pair 'tempest-keypair-355671791' already exists. Jul 24 01:17:00.533916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:00.534624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:00.542825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.543272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.544128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.544584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9de78d26-26e6-405e-8d82-2cc642488c2f tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 272 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: {"keypair": {"name": "tempest-keypair-355671791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlxRuI2/CYvO7Uu3ReIKRbcKgwBt09VNxa30+66EOUtkUXWgXoAjbTniQDJ1xs6oE8e3Z+7tayAGYxyo086ywv9D/se68eWeTQZmxM13j6KbzWXhNSZIaSSstPaCj1ofg=="}} Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: exception: Key pair 'tempest-keypair-355671791' already exists. Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-355671791', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlxRuI2/CYvO7Uu3ReIKRbcKgwBt09VNxa30+66EOUtkUXWgXoAjbTniQDJ1xs6oE8e3Z+7tayAGYxyo086ywv9D/se68eWeTQZmxM13j6KbzWXhNSZIaSSstPaCj1ofg=='}}} Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result.read() Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'af549d9da3ff44bfbf9760282e493426-tempest-keypair-355671791' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 24 01:17:00.544843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi session.flush() Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result.read() Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 24 01:17:00.549848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'af549d9da3ff44bfbf9760282e493426-tempest-keypair-355671791' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 24, 1, 17, 0, 523562), 'updated_at': None, 'name': 'tempest-keypair-355671791', 'user_id': 'af549d9da3ff44bfbf9760282e493426', 'fingerprint': '1f:01:7f:f5:07:28:ca:4c:a3:17:e4:3d:9e:b8:a6:95', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlxRuI2/CYvO7Uu3ReIKRbcKgwBt09VNxa30+66EOUtkUXWgXoAjbTniQDJ1xs6oE8e3Z+7tayAGYxyo086ywv9D/se68eWeTQZmxM13j6KbzWXhNSZIaSSstPaCj1ofg==', 'type': 'ssh'}] Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi keypair.create() Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._create() Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-355671791' already exists. Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 24 01:17:00.556392 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-355671791' already exists. Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-355671791' already exists. Jul 24 01:17:00.565151 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.566486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9de78d26-26e6-405e-8d82-2cc642488c2f tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 409 to user: Key pair 'tempest-keypair-355671791' already exists. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.571170 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9de78d26-26e6-405e-8d82-2cc642488c2f tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.091260 Jul 24 01:17:00.573437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 866/1849] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:17:00.580319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c4b69a9-38b8-4197-8c6d-066ad41bf263 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Calling method '.version_select at 0x7f05eaf415e0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:00.605020 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c4b69a9-38b8-4197-8c6d-066ad41bf263 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-355671791" status: 202 len: 0 microversion: 2.1 time: 0.030101 Jul 24 01:17:00.612214 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 867/1850] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:17:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-355671791 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:00.617866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36cc0b4c-8c5d-4722-97a0-36cb756d1ded tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eb1f0040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIySXWYe6MvvEjk5DuhgBNX8q6v0XGIrLp6Fvptz8TUm8tNQyHZ8YDGzGgM59dQapQMtik7rT1Go/EHQNG9oGjoAeryLosPHl8vxOv5hlOcSzh8HCZ/Dd5muFIzgx8nkw=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36cc0b4c-8c5d-4722-97a0-36cb756d1ded tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 247 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIySXWYe6MvvEjk5DuhgBNX8q6v0XGIrLp6Fvptz8TUm8tNQyHZ8YDGzGgM59dQapQMtik7rT1Go/EHQNG9oGjoAeryLosPHl8vxOv5hlOcSzh8HCZ/Dd5muFIzgx8nkw=="}} Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIySXWYe6MvvEjk5DuhgBNX8q6v0XGIrLp6Fvptz8TUm8tNQyHZ8YDGzGgM59dQapQMtik7rT1Go/EHQNG9oGjoAeryLosPHl8vxOv5hlOcSzh8HCZ/Dd5muFIzgx8nkw=='}}} Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi '' Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:17:00.622331 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36cc0b4c-8c5d-4722-97a0-36cb756d1ded tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-36cc0b4c-8c5d-4722-97a0-36cb756d1ded tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010476 Jul 24 01:17:00.627519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 868/1851] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:17:00.633349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2c307f8-2fa4-4c22-bd03-483c169a520b tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eaf41280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-737464720", "public_key": " "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.642815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:00.651490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-a2c307f8-2fa4-4c22-bd03-483c169a520b tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:00.652615 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dc955863-7eb6-42fa-9887-dc7a6e6f99d3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1220 microversion: 2.1 time: 0.124388 Jul 24 01:17:00.653284 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 984/1852] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:00 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1220 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:00.663089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-a2c307f8-2fa4-4c22-bd03-483c169a520b tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for user af549d9da3ff44bfbf9760282e493426 and project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:00.681734 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a2c307f8-2fa4-4c22-bd03-483c169a520b tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2c307f8-2fa4-4c22-bd03-483c169a520b tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 94 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-737464720", "public_key": " "}} Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: exception: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-737464720', 'public_key': ' '}}} Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.683841 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2c307f8-2fa4-4c22-bd03-483c169a520b tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2c307f8-2fa4-4c22-bd03-483c169a520b tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.056067 Jul 24 01:17:00.689198 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 869/1853] 10.222.0.27 () {60 vars in 1157 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:00.699293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da930c7d-f69e-45f9-bfa6-932d415c2064 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eac7d1f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4JrrW76p0xdzX+wipsJd5huXiF0gV/Xvqx2HXHHDmqa7glRogCSESAcmU+jsojxTgMcfXcF4vHH8Xg42AQuguVCqElFN/u6OZk9R6P0dqlcpDdqQKABeQ65IuRESIqyA=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da930c7d-f69e-45f9-bfa6-932d415c2064 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 507 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4JrrW76p0xdzX+wipsJd5huXiF0gV/Xvqx2HXHHDmqa7glRogCSESAcmU+jsojxTgMcfXcF4vHH8Xg42AQuguVCqElFN/u6OZk9R6P0dqlcpDdqQKABeQ65IuRESIqyA=="}} Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4JrrW76p0xdzX+wipsJd5huXiF0gV/Xvqx2HXHHDmqa7glRogCSESAcmU+jsojxTgMcfXcF4vHH8Xg42AQuguVCqElFN/u6OZk9R6P0dqlcpDdqQKABeQ65IuRESIqyA=='}}} Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 24 01:17:00.702100 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.706092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da930c7d-f69e-45f9-bfa6-932d415c2064 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.708766 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-da930c7d-f69e-45f9-bfa6-932d415c2064 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012140 Jul 24 01:17:00.708766 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 985/1854] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:17:00.716246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:00.717025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:00.718144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-063b9d74-dbcf-481d-9729-32a86c7fa866 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Action: 'create', calling method: .version_select at 0x7f05eac254c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1376715833", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:00.723892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.725277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.725277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.725565 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.747398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-063b9d74-dbcf-481d-9729-32a86c7fa866 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:00.756647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-063b9d74-dbcf-481d-9729-32a86c7fa866 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Getting quotas for user af549d9da3ff44bfbf9760282e493426 and project 2bbddc1704b84539b5e602d6546ba743. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:00.758409 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:00.785244 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-063b9d74-dbcf-481d-9729-32a86c7fa866 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-063b9d74-dbcf-481d-9729-32a86c7fa866 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 118 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1376715833", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: exception: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1376715833', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 24 01:17:00.788073 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-063b9d74-dbcf-481d-9729-32a86c7fa866 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-063b9d74-dbcf-481d-9729-32a86c7fa866 tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.075443 Jul 24 01:17:00.798296 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 986/1855] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 24 01:17:00.804172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:00.804172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:00.810451 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.810990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.811909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:00.812400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:00.917366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:00.928848 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50aaef30-8ed9-48ef-b5e5-faf30b73c5e9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.218166 Jul 24 01:17:00.940755 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 870/1856] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:00 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:00.941919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-98e383f5-af50-44e7-9427-94cc80c1164e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Calling method '.version_select at 0x7f05f80a6700>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:00.965438 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-98e383f5-af50-44e7-9427-94cc80c1164e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1488118338 not found for user af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-98e383f5-af50-44e7-9427-94cc80c1164e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Request method failure captured: Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1488118338 HTTP/1.1 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2MfyyEhscMBNCyAEzc1UZJB1eeXOPdRqOk5MJAym8sROaaCc8JSXGgOscd543oMDgsif7x47id4vKPxmpbDr16GZHOeNDHHsWu_BC-NhbjxVHvEZFazlX7CyQsJTig0C-KZW3hVZUe99jc_urWJWnkIy7Yfy6rRw-Y_W1ZjoRpfss Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2bbddc1704b84539b5e602d6546ba743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2bbddc1704b84539b5e602d6546ba743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2bbddc1704b84539b5e602d6546ba743 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-334388871 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-334388871-project Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: exception: Keypair tempest-keypair-non-existent-1488118338 not found for user af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'tempest-keypair-non-existent-1488118338'} Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1488118338 not found for user af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.967291 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1488118338 not found for user af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1488118338 not found for user af549d9da3ff44bfbf9760282e493426 Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:00.975057 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-98e383f5-af50-44e7-9427-94cc80c1164e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1488118338 not found for user af549d9da3ff44bfbf9760282e493426 {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:00.980332 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-98e383f5-af50-44e7-9427-94cc80c1164e tempest-KeyPairsNegativeTestJSON-334388871 tempest-KeyPairsNegativeTestJSON-334388871-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1488118338" status: 404 len: 145 microversion: 2.1 time: 0.042560 Jul 24 01:17:00.982693 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 871/1857] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:17:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1488118338 => generated 145 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:01.004369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:01.006646 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:01.015001 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9e49249-9906-4bdb-8c60-fcacabda56e8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1574 microversion: 2.1 time: 0.219596 Jul 24 01:17:01.015634 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 987/1858] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:00 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:01.111680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:01.112563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] [instance: 975740f0-20a6-4d5b-8e57-766c11d09594] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:01.125203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.128790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.129920 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.130735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.154972 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] HTTP exception thrown: Instance 975740f0-20a6-4d5b-8e57-766c11d09594 could not be found. Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Request method failure captured: Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 HTTP/1.1 Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JuXJE-19GYaxEAwjVcbaWDi5Bp8TgetE_QJRtbaq8mDO8m8DoTB8F7K30XvJ8BZ5ix5t3urWMobhW2rVFDGVvZknkC7i0u79VrIRR8PID-g4Sn2FCcc-xBxMEnJMmvgLkLo0nnHA8s6kSH2h_PAdDhDmB3OfYfmWuI4EpuSJyknesE Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58e5e52270c14573b0d4c868cb9fa69c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58e5e52270c14573b0d4c868cb9fa69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-LiveMigrationTest-1771055910 Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 58e5e52270c14573b0d4c868cb9fa69c Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-LiveMigrationTest-1771055910 Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-LiveMigrationTest-1771055910-project Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 40b5fc3b4b6d43ab9342da568567140d Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-LiveMigrationTest-1771055910-project Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 975740f0-20a6-4d5b-8e57-766c11d09594 could not be found. Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '975740f0-20a6-4d5b-8e57-766c11d09594'} Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975740f0-20a6-4d5b-8e57-766c11d09594 could not be found. Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975740f0-20a6-4d5b-8e57-766c11d09594 could not be found. Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:01.156926 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.161405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:01.161405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:01.161405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:01.161405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:01.161405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:01.161405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975740f0-20a6-4d5b-8e57-766c11d09594 could not be found. Jul 24 01:17:01.161405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:01.164028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] Returning 404 to user: Instance 975740f0-20a6-4d5b-8e57-766c11d09594 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:01.165145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72cc524a-4c2b-471f-89e4-4151d661e260 tempest-LiveMigrationTest-1771055910 tempest-LiveMigrationTest-1771055910-project] 10.222.0.27 "GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594" status: 404 len: 111 microversion: 2.1 time: 0.058081 Jul 24 01:17:01.170351 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 872/1859] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:01 2022] GET /compute/v2.1/servers/975740f0-20a6-4d5b-8e57-766c11d09594 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:01.361226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3066fc77-04d6-456e-83df-4404faaacec3 req-8cf94b07-7f3a-4bba-b848-04da531f30c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975740f0-20a6-4d5b-8e57-766c11d09594", "name": "network-vif-deleted", "tag": "cebc9e40-12d5-4535-ae92-0157bc5f293e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:01.377914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3066fc77-04d6-456e-83df-4404faaacec3 req-8cf94b07-7f3a-4bba-b848-04da531f30c1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.378357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3066fc77-04d6-456e-83df-4404faaacec3 req-8cf94b07-7f3a-4bba-b848-04da531f30c1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.404413 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3066fc77-04d6-456e-83df-4404faaacec3 req-8cf94b07-7f3a-4bba-b848-04da531f30c1 service nova] Creating event network-vif-deleted:cebc9e40-12d5-4535-ae92-0157bc5f293e for instance 975740f0-20a6-4d5b-8e57-766c11d09594 on n-h1-master-1 Jul 24 01:17:01.411148 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3066fc77-04d6-456e-83df-4404faaacec3 req-8cf94b07-7f3a-4bba-b848-04da531f30c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053705 Jul 24 01:17:01.412211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 988/1860] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:01.528177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:01.528790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:01.545527 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.546384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.548429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.549056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.673533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:01.674279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:01.687400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.687853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.689004 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.689449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.796359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:01.804255 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bc741c4a-985d-4b63-a466-a4f7f5cadc5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1282 microversion: 2.1 time: 0.136111 Jul 24 01:17:01.804848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 989/1861] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:01 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:01.876071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:01.887759 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3ce6510-18d4-43fd-8bb5-2827dfcd0cb4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 200 len: 1449 microversion: 2.1 time: 0.363343 Jul 24 01:17:01.889245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 873/1862] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:01 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 1449 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:01.906162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:01.906886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:01.913296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.913665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.914681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.915269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.945774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:01.952134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:01.953163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:01.958251 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.api [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Working on deleting snapshot 5ab577f9-ddef-48f0-99be-20769fe0e4fd from shelved instance... Jul 24 01:17:01.960161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.960973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:01.962156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:01.963853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:02.536723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:02.547834 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4dbf7bef-977c-4fd1-b57b-0ba63dc0a0d7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.602450 Jul 24 01:17:02.566812 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 874/1863] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:01 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:02.592580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:02.593229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:02.619410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:02.640142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:02.643091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:02.644908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:02.827229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Doing local delete in cell 0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=119561) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 24 01:17:02.828404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:02.829946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:02.830831 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.api [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 24 01:17:02.841642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] deallocate_for_instance() {{(pid=119561) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 24 01:17:03.240454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:03.253016 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d21b9ad6-4abf-4a8b-bc55-eb7ff5efb449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1572 microversion: 2.1 time: 0.681904 Jul 24 01:17:03.258333 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 875/1864] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:02 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1572 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:03.269216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:03.282276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:03.291583 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:03.293190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:03.294296 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:03.295236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:03.646178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:03.658754 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d45053f3-9e12-4eec-b8b6-2774024d51a1 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1324 microversion: 2.1 time: 0.395990 Jul 24 01:17:03.659773 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 876/1865] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:03 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:03.667107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1340339962"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:03.667659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:03.682303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:03.682795 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:03.684421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:03.684882 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.008224 n-d-master-1 devstack@n-api.service[119562]: INFO nova.network.security_group_api [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Adding security group 30f30396-5b50-498a-9214-79330d5c7b96 to port 284e09b9-757e-49af-b049-18d56b72b9ae Jul 24 01:17:04.186893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Updating instance_info_cache with network_info: [] {{(pid=119561) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:17:04.454292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79a8292d-98ac-48d1-903a-515fc164f70e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 204 len: 0 microversion: 2.1 time: 2.552169 Jul 24 01:17:04.454985 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 990/1866] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:01 2022] DELETE /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 0 bytes in 2555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:04.459947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:04.461575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:04.468605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:04.469108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.469914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:04.470355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:04.893783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:04.911978 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af9f8bd7-f2b0-49e3-ba86-bb2195074357 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.455540 Jul 24 01:17:04.922328 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 991/1867] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:04 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:05.166060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-840104f0-0609-4367-9ab6-3d1d69694c68 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eac25670>, body: {"keypair": {"name": "tempest-keypair-1271977303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcOtu9Y+jGE8E1bB2Z3F50OPXGfkQVlDUlAv+Lb2Y5OSuFZ21I73A285eiwSBBqpgrITfvCFraYOVnVYtz7VT7aGM1oz6X8a30WBf30vPXuKKlbfxMfpaEX0/nfcKSz3Q=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:05.183003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-840104f0-0609-4367-9ab6-3d1d69694c68 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:05.188653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-840104f0-0609-4367-9ab6-3d1d69694c68 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:05.226252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-840104f0-0609-4367-9ab6-3d1d69694c68 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.302392 Jul 24 01:17:05.227430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 992/1868] 10.222.0.27 () {62 vars in 1198 bytes} [Sun Jul 24 01:17:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 304 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 24 01:17:05.237572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cd051e0a-3127-4d45-9a61-11cbab94d456 req-e9cba9f1-2875-495d-ac04-a9e7f8fa93b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcef7d1-f119-4018-9d80-58db946c1a64", "name": "network-vif-deleted", "tag": "bb419d01-72ec-4f9e-8f32-00bf0e7c950e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:05.252077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cd051e0a-3127-4d45-9a61-11cbab94d456 req-e9cba9f1-2875-495d-ac04-a9e7f8fa93b1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:05.252907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cd051e0a-3127-4d45-9a61-11cbab94d456 req-e9cba9f1-2875-495d-ac04-a9e7f8fa93b1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:05.276843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.server_external_events [req-cd051e0a-3127-4d45-9a61-11cbab94d456 req-e9cba9f1-2875-495d-ac04-a9e7f8fa93b1 service nova] Unable to find a host for instance fbcef7d1-f119-4018-9d80-58db946c1a64. Dropping event network-vif-deleted {{(pid=119561) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 24 01:17:05.279207 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cd051e0a-3127-4d45-9a61-11cbab94d456 req-e9cba9f1-2875-495d-ac04-a9e7f8fa93b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049938 Jul 24 01:17:05.283892 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 993/1869] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 24 01:17:05.292483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:05.293440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:05.300293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:05.301193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:05.304313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:05.304982 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:05.328327 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 HTTP/1.1 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: exception: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'fbcef7d1-f119-4018-9d80-58db946c1a64'} Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:05.334790 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:05.339890 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16eb9c29-e1f8-46e4-907c-c7979a41b0cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 404 len: 111 microversion: 2.1 time: 0.053519 Jul 24 01:17:05.357513 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 994/1870] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:05 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:05.357513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:05.357513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:05.370419 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:05.371227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:05.373012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:05.373545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:05.433167 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c96da863-9fa1-44ef-905f-dc67bb7fdb59 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2/action" status: 202 len: 0 microversion: 2.1 time: 1.771462 Jul 24 01:17:05.437029 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 877/1871] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:17:03 2022] POST /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2/action => generated 0 bytes in 1774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:05.441629 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d136f567-30f7-4c30-98cb-41a0806b36a9 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eb562f70>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:05.468507 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d136f567-30f7-4c30-98cb-41a0806b36a9 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1271977303" status: 200 len: 513 microversion: 2.2 time: 0.032351 Jul 24 01:17:05.473983 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 878/1872] 10.222.0.27 () {60 vars in 1257 bytes} [Sun Jul 24 01:17:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1271977303 => generated 513 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:05.487667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acc60a63-7d95-4364-94e6-d1db3646f4d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eaf49550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:05.849781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:05.860208 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7945a14f-e4a9-4410-8093-c7204ecac26b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1324 microversion: 2.1 time: 0.513032 Jul 24 01:17:05.861088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 995/1873] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:05 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:05.866201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-546f1586-0608-4a4e-8756-cb5c499a6fa4 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eabbdd30>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:05.892113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-546f1586-0608-4a4e-8756-cb5c499a6fa4 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271977303" status: 204 len: 0 microversion: 2.2 time: 0.029396 Jul 24 01:17:05.893167 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 996/1874] 10.222.0.27 () {60 vars in 1260 bytes} [Sun Jul 24 01:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271977303 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:05.901410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-575669891", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "adf394c3-0407-4590-8c41-4e59f65f117d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:05.926091 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-acc60a63-7d95-4364-94e6-d1db3646f4d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use.", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:05.927483 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-acc60a63-7d95-4364-94e6-d1db3646f4d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use. Jul 24 01:17:05.927483 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-778e85ac-19c3-45ec-8496-c0092f0ce885'] Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acc60a63-7d95-4364-94e6-d1db3646f4d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96 HTTP/1.1 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: exception: Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use. Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-778e85ac-19c3-45ec-8496-c0092f0ce885'] Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '30f30396-5b50-498a-9214-79330d5c7b96'} Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:05.930092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use. Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-778e85ac-19c3-45ec-8496-c0092f0ce885'] Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use. Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-778e85ac-19c3-45ec-8496-c0092f0ce885'] Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use. Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-778e85ac-19c3-45ec-8496-c0092f0ce885'] Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use. Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-778e85ac-19c3-45ec-8496-c0092f0ce885'] Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acc60a63-7d95-4364-94e6-d1db3646f4d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 400 to user: Security Group 30f30396-5b50-498a-9214-79330d5c7b96 in use. Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-778e85ac-19c3-45ec-8496-c0092f0ce885'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-acc60a63-7d95-4364-94e6-d1db3646f4d8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96" status: 400 len: 185 microversion: 2.1 time: 0.460356 Jul 24 01:17:05.937082 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 879/1875] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:05 2022] DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96 => generated 185 bytes in 461 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:17:05.954084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-065fed32-f156-4b31-b91e-0f363d019256 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eb1f0040>, body: {"keypair": {"name": "tempest-keypair-1009390553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHsqc0VuYZpetUG5sNwD/GXzM4BcpnkLNPfWLGEYoDApe+Bu/Ulwf9kp60cxR3Uwq309qfmm6lyqki1dtqTIHsXeCEuYZOODiLaqZjepFDypYWgCCzQ/AkpvTsSIv8BOA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:05.980718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-065fed32-f156-4b31-b91e-0f363d019256 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:05.986923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-065fed32-f156-4b31-b91e-0f363d019256 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:05.988622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] validate_networks() for [('adf394c3-0407-4590-8c41-4e59f65f117d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:06.032531 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-065fed32-f156-4b31-b91e-0f363d019256 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.094302 Jul 24 01:17:06.033752 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 880/1876] 10.222.0.27 () {62 vars in 1198 bytes} [Sun Jul 24 01:17:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 24 01:17:06.043790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.044497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:06.060893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.061536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.062524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.062971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.422699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:06.430355 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec629cdb-2a71-40d7-bab1-9ff3dd7b37f9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.395024 Jul 24 01:17:06.430940 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 881/1877] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:06 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:06.436941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.437574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:06.444414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.445147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.445961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.446611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.482802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:06.604754 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-207b26e9-cffc-48bd-9ba3-45d6cdf46449 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 204 len: 0 microversion: 2.1 time: 0.171604 Jul 24 01:17:06.606503 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 882/1878] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:06 2022] DELETE /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:06.614300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb1effc2-5c6e-442a-b06d-04b429cf7584 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eaf4af70>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.641068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:06.642570 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:06.643105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:06.643976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:06.644660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:06.644831 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb1effc2-5c6e-442a-b06d-04b429cf7584 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009390553" status: 204 len: 0 microversion: 2.2 time: 0.036480 Jul 24 01:17:06.646155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 883/1879] 10.222.0.27 () {60 vars in 1260 bytes} [Sun Jul 24 01:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009390553 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:06.651831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.653328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:06.659325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.659792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.661027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.662072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.675836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.678057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.679655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:06.680351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:06.689222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:06.695934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for user f3de9a749c874cfc8c34deffb1001a79 and project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:06.713290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:06.716425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:06.798748 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae225a38-93c5-4e77-b9e1-c23035c6722d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904148 Jul 24 01:17:06.799422 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 997/1880] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:17:06.810177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-62cc3792-4f67-4568-8caf-f8931a2ac470 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eab64e50>, body: {"keypair": {"name": "tempest-keypair-953288703", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:06.852011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-62cc3792-4f67-4568-8caf-f8931a2ac470 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:06.862773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-62cc3792-4f67-4568-8caf-f8931a2ac470 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:06.896317 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-62cc3792-4f67-4568-8caf-f8931a2ac470 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.095790 Jul 24 01:17:06.897978 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 998/1881] 10.222.0.27 () {62 vars in 1198 bytes} [Sun Jul 24 01:17:06 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 24 01:17:06.903547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d4654141-edf5-4e23-9615-944e28362bae tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.904620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d4654141-edf5-4e23-9615-944e28362bae tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:06.975480 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d4654141-edf5-4e23-9615-944e28362bae tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:06.988253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d4654141-edf5-4e23-9615-944e28362bae tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1214 microversion: 2.1 time: 0.088444 Jul 24 01:17:06.988993 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 999/1882] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:06 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:06.996359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:06.997135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:07.005751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.006515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.007493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.008000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.080397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:07.094235 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d2db1c78-d4ef-4cd2-9e5e-44548952128c tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1647 microversion: 2.1 time: 0.446186 Jul 24 01:17:07.095322 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 884/1883] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:06 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1647 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:07.101203 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fee4c2ee-e22c-4c69-8b2f-5c65d409d4d8 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eb117f70>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.126016 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fee4c2ee-e22c-4c69-8b2f-5c65d409d4d8 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-953288703" status: 204 len: 0 microversion: 2.2 time: 0.029329 Jul 24 01:17:07.134004 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 885/1884] 10.222.0.27 () {60 vars in 1257 bytes} [Sun Jul 24 01:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-953288703 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:07.143609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-68454207-b653-4eaa-8da8-ae6a50e00b4a tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eb349820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2100447031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJZf7XCyLnq+tY8k+iDrUtMel3AAIfbGMPFdwCrcxEjcupZ43h+DG9OOMJFZ4HR9wpbVWibptnpbXoXYMTBiuF3yWZ9S9T2O9Ov0uJQqbrSArV8jagK5oq+yC/ta2csHw=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:07.178400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-68454207-b653-4eaa-8da8-ae6a50e00b4a tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:07.187300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-68454207-b653-4eaa-8da8-ae6a50e00b4a tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:07.220112 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-68454207-b653-4eaa-8da8-ae6a50e00b4a tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.083921 Jul 24 01:17:07.230721 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 886/1885] 10.222.0.27 () {62 vars in 1198 bytes} [Sun Jul 24 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 24 01:17:07.242225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37f4ebfa-1dd5-497f-8276-3444bbf7e9f3 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eaf4aaf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-739179362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0lwJVJht1xu85xOdRMZmXNCWQsqjuY4YKe65QtbiJ/mLednd8D0+aU6KTAWbDkRGs8aRsb4yCAnbqKBHO7QDnCTRxsNxzA5ugh4/K6maiJ7wIoHOgxmDSLED3mH3j6EA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:07.268910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-37f4ebfa-1dd5-497f-8276-3444bbf7e9f3 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:07.276150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-37f4ebfa-1dd5-497f-8276-3444bbf7e9f3 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:07.318912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:07.328268 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c59ab4c6-29fa-4453-8afc-246f6dad971b tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1324 microversion: 2.1 time: 0.337625 Jul 24 01:17:07.330255 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-37f4ebfa-1dd5-497f-8276-3444bbf7e9f3 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.098191 Jul 24 01:17:07.331879 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1000/1886] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:06 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:07.347816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ee75fbf4-82cc-4e7b-951f-ef2de0f5f7d9 req-b675cd45-3b8b-4ca8-8b67-b6f23d2b4940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6efb0f8c-ab32-4040-9db4-312cb30e476d", "tag": "0af9965a-a16f-4406-ac0a-2090b1d0b745"}, {"name": "network-changed", "server_uuid": "3d8bab37-21be-406c-9066-85ba99e725c2", "tag": "284e09b9-757e-49af-b049-18d56b72b9ae"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:07.348615 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 887/1887] 10.222.0.27 () {62 vars in 1198 bytes} [Sun Jul 24 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 24 01:17:07.363181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ee75fbf4-82cc-4e7b-951f-ef2de0f5f7d9 req-b675cd45-3b8b-4ca8-8b67-b6f23d2b4940 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.363648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ee75fbf4-82cc-4e7b-951f-ef2de0f5f7d9 req-b675cd45-3b8b-4ca8-8b67-b6f23d2b4940 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.364797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-844a0cf5-05f0-4944-9905-5a34171e6033 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eb117f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1581387185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEY2x1Vr+wfaHXTupz7yepo3RkCCqoYMaiFkIyaCfpiLIoYw8QJFqvJN1HA9KjV2P7zaHtm3EN0biS0V5jy5nObwIepPCmi0uVJEUxA+huxD5btSjOeDK+EIoQ9QNuN/g=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:07.385903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-844a0cf5-05f0-4944-9905-5a34171e6033 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:07.392365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-844a0cf5-05f0-4944-9905-5a34171e6033 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:07.413830 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ee75fbf4-82cc-4e7b-951f-ef2de0f5f7d9 req-b675cd45-3b8b-4ca8-8b67-b6f23d2b4940 service nova] Creating event network-changed:0af9965a-a16f-4406-ac0a-2090b1d0b745 for instance 6efb0f8c-ab32-4040-9db4-312cb30e476d on n-h1-master-1 Jul 24 01:17:07.414361 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ee75fbf4-82cc-4e7b-951f-ef2de0f5f7d9 req-b675cd45-3b8b-4ca8-8b67-b6f23d2b4940 service nova] Creating event network-changed:284e09b9-757e-49af-b049-18d56b72b9ae for instance 3d8bab37-21be-406c-9066-85ba99e725c2 on n-h2-master-1 Jul 24 01:17:07.419154 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:07.432395 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-844a0cf5-05f0-4944-9905-5a34171e6033 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.082179 Jul 24 01:17:07.435194 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ee75fbf4-82cc-4e7b-951f-ef2de0f5f7d9 req-b675cd45-3b8b-4ca8-8b67-b6f23d2b4940 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083631 Jul 24 01:17:07.436315 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 888/1888] 10.222.0.27 () {62 vars in 1198 bytes} [Sun Jul 24 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 24 01:17:07.438808 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1001/1889] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:07.447938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-93fb17bd-4908-40fc-b987-733a10f05c34 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eafb09d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.451979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.452798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:07.457237 n-d-master-1 devstack@n-api.service[119562]: WARNING oslo_db.sqlalchemy.utils [None req-93fb17bd-4908-40fc-b987-733a10f05c34 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 24 01:17:07.460066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.460751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.461883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:07.463318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:07.502718 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-93fb17bd-4908-40fc-b987-733a10f05c34 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.061366 Jul 24 01:17:07.510466 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 889/1890] 10.222.0.27 () {60 vars in 1176 bytes} [Sun Jul 24 01:17:07 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:07.516175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15fe230d-9620-44c6-81f1-2906ca2640ac tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eafb0b80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.541936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15fe230d-9620-44c6-81f1-2906ca2640ac tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1581387185" status: 204 len: 0 microversion: 2.2 time: 0.028546 Jul 24 01:17:07.549145 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 890/1891] 10.222.0.27 () {60 vars in 1320 bytes} [Sun Jul 24 01:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1581387185 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:07.561600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38d2355e-d93d-4d68-8ff6-4b81d95b372a tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eb8228b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.593988 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38d2355e-d93d-4d68-8ff6-4b81d95b372a tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-739179362" status: 204 len: 0 microversion: 2.2 time: 0.041630 Jul 24 01:17:07.598950 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 891/1892] 10.222.0.27 () {60 vars in 1317 bytes} [Sun Jul 24 01:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-739179362 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:07.605442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25385eea-52b0-4209-a2b3-afec4f7d6ff0 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eb3f1280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.631822 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-25385eea-52b0-4209-a2b3-afec4f7d6ff0 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2100447031" status: 204 len: 0 microversion: 2.2 time: 0.031519 Jul 24 01:17:07.640587 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 892/1893] 10.222.0.27 () {60 vars in 1320 bytes} [Sun Jul 24 01:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2100447031 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:07.646955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6bbd000a-ae18-4dd3-a137-ad14b8e38199 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eaff53a0>, body: {"keypair": {"name": "tempest-keypair-2019294808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbmWZqeBydNWRgmXgTQ37tfHeyOTc6u/FY+gOV3DzaPId3KUOB3QpVkGysmz/Je69aIJS1F7ZMV3YFolkXkjvfdadWMKJzxGmbEgIaFc5BISVdQdgdIDD3kznN9A4o6Ww=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:07.664918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6bbd000a-ae18-4dd3-a137-ad14b8e38199 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:07.672007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6bbd000a-ae18-4dd3-a137-ad14b8e38199 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:07.707247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6bbd000a-ae18-4dd3-a137-ad14b8e38199 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.065406 Jul 24 01:17:07.708237 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 893/1894] 10.222.0.27 () {62 vars in 1198 bytes} [Sun Jul 24 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 24 01:17:07.718973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c88aafa-1193-4f1d-b8cf-f0e763541779 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eaf41280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.731158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c88aafa-1193-4f1d-b8cf-f0e763541779 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-2019294808" status: 200 len: 513 microversion: 2.2 time: 0.016148 Jul 24 01:17:07.731886 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 894/1895] 10.222.0.27 () {60 vars in 1257 bytes} [Sun Jul 24 01:17:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2019294808 => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:07.746660 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3262361e-74bf-4d3e-a7a3-783dfd136492 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eaf63040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.752057 n-d-master-1 devstack@n-api.service[119562]: WARNING oslo_db.sqlalchemy.utils [None req-3262361e-74bf-4d3e-a7a3-783dfd136492 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 24 01:17:07.759106 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3262361e-74bf-4d3e-a7a3-783dfd136492 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.019248 Jul 24 01:17:07.759764 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 895/1896] 10.222.0.27 () {60 vars in 1176 bytes} [Sun Jul 24 01:17:07 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:07.778374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:07.780673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c773009-ed2b-4cd7-bd4a-ed6b1b2830d9 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eaf63790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:07.795342 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a0815c67-9124-40e0-b19e-e3ac9ee54bc6 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.350966 Jul 24 01:17:07.800737 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1002/1897] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:07 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:07.806200 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c773009-ed2b-4cd7-bd4a-ed6b1b2830d9 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2019294808" status: 204 len: 0 microversion: 2.2 time: 0.034786 Jul 24 01:17:07.807277 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 896/1898] 10.222.0.27 () {60 vars in 1260 bytes} [Sun Jul 24 01:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2019294808 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:07.816616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Action: 'create', calling method: .version_select at 0x7f05eac255e0>, body: {"keypair": {"name": "tempest-keypair-1165022416", "type": "x509"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:07.835665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:07.842284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:07.861090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.processutils [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpycx3zy5l/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpycx3zy5l/temp.key -subj /CN=f9bd5d6997fd4f61b74e823d75f3e9f8 -extensions v3_req_client {{(pid=119561) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 24 01:17:08.006434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.007130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:08.019633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.020069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.021603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.022073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.291620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:08.311242 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-71fcc21c-6630-473f-ab81-b9ff03bf2f10 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1266 microversion: 2.1 time: 0.308749 Jul 24 01:17:08.321644 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 897/1899] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:08 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:08.327491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.328113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:08.345552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.346041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.346852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.347288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.393881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.processutils [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpycx3zy5l/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpycx3zy5l/temp.key -subj /CN=f9bd5d6997fd4f61b74e823d75f3e9f8 -extensions v3_req_client" returned: 0 in 0.532s {{(pid=119561) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 24 01:17:08.396792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.processutils [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpycx3zy5l/temp.key -password pass: {{(pid=119561) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 24 01:17:08.480155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.processutils [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpycx3zy5l/temp.key -password pass:" returned: 0 in 0.083s {{(pid=119561) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 24 01:17:08.573273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:08.587264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Getting quotas for user f9bd5d6997fd4f61b74e823d75f3e9f8 and project 58be8e29b7a844adafd15b55b50ca36d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:08.596011 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:08.657421 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4e46c048-8fca-4e40-9b70-45d8048920f6 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.845012 Jul 24 01:17:08.658700 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1003/1900] 10.222.0.27 () {62 vars in 1197 bytes} [Sun Jul 24 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 847 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:17:08.667908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.668884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:08.675927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.676688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.677888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.678329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.919136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:08.927604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b32891ca-4592-4298-afe2-a838ebe8de7e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1647 microversion: 2.1 time: 0.604133 Jul 24 01:17:08.928889 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 898/1901] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:08 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1647 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:08.939684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f8b3909-0cce-4408-ab3c-82b0bd675cac tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eaf41160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.956109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f8b3909-0cce-4408-ab3c-82b0bd675cac tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1165022416" status: 200 len: 1534 microversion: 2.2 time: 0.025847 Jul 24 01:17:08.959606 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 899/1902] 10.222.0.27 () {60 vars in 1257 bytes} [Sun Jul 24 01:17:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1165022416 => generated 1534 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:08.975783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:08.976521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:08.991362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.995997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:08.997118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:08.997834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.008537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:09.017171 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d43652b-baea-4c28-82d2-2df2a29b3a65 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1324 microversion: 2.1 time: 0.357213 Jul 24 01:17:09.032890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1004/1903] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:08 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:09.044986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf1d23de-a997-49e2-8127-ea6092816d26 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eabbd280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:09.048204 n-d-master-1 devstack@n-api.service[119561]: WARNING oslo_db.sqlalchemy.utils [None req-cf1d23de-a997-49e2-8127-ea6092816d26 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 24 01:17:09.067071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf1d23de-a997-49e2-8127-ea6092816d26 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.031708 Jul 24 01:17:09.069256 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1005/1904] 10.222.0.27 () {60 vars in 1176 bytes} [Sun Jul 24 01:17:09 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:09.085478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2f9625e-a00c-4883-9808-fcd504aa48a8 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] Calling method '.version_select at 0x7f05eab5db80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:09.171258 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2f9625e-a00c-4883-9808-fcd504aa48a8 tempest-KeyPairsV22TestJSON-1072136218 tempest-KeyPairsV22TestJSON-1072136218-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165022416" status: 204 len: 0 microversion: 2.2 time: 0.096205 Jul 24 01:17:09.172850 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1006/1905] 10.222.0.27 () {60 vars in 1260 bytes} [Sun Jul 24 01:17:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165022416 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:09.329261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:09.330691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:09.344101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.346118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.347569 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.347823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.416900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:09.432360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52a4f70b-0c58-493f-8199-4756fa35cc16 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.461523 Jul 24 01:17:09.442530 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 900/1906] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:08 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:09.488230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:09.502122 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-74147ae5-3ba6-4ff7-b0eb-85c769fa84a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1272 microversion: 2.1 time: 0.176795 Jul 24 01:17:09.515353 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1007/1907] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:09 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:09.947600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:09.948369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:09.955763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.956195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:09.957201 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:09.957638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.037331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:10.038076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:10.045821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.046412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.047472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.048622 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.065222 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:10.293139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:10.305486 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9bc7e189-6722-40bb-b931-63c552a2da1e tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1647 microversion: 2.1 time: 0.362679 Jul 24 01:17:10.308798 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 901/1908] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:09 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1647 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:10.372609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:10.382263 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a3d11f4-c295-4812-9ab4-9cfc06d40434 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1324 microversion: 2.1 time: 0.348765 Jul 24 01:17:10.383616 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1008/1909] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:10 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:10.453057 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:10.453884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:10.463522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.464280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.466466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.467171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.521760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:10.522982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:10.535087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.536048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.537692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.538391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.751658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:10.767687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-54194d8b-83e3-4feb-ab27-c1593ff54e2b tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1272 microversion: 2.1 time: 0.251149 Jul 24 01:17:10.780798 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1009/1910] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:10 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:10.786842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-441eb7ac-3532-4831-a144-2f0065c47684 req-5f9461ca-6565-4cc8-8534-9ed2d64c12d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6efb0f8c-ab32-4040-9db4-312cb30e476d", "name": "network-vif-plugged", "status": "completed", "tag": "0af9965a-a16f-4406-ac0a-2090b1d0b745"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:10.809226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-441eb7ac-3532-4831-a144-2f0065c47684 req-5f9461ca-6565-4cc8-8534-9ed2d64c12d9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.809841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-441eb7ac-3532-4831-a144-2f0065c47684 req-5f9461ca-6565-4cc8-8534-9ed2d64c12d9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.829084 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-441eb7ac-3532-4831-a144-2f0065c47684 req-5f9461ca-6565-4cc8-8534-9ed2d64c12d9 service nova] Creating event network-vif-plugged:0af9965a-a16f-4406-ac0a-2090b1d0b745 for instance 6efb0f8c-ab32-4040-9db4-312cb30e476d on n-h1-master-1 Jul 24 01:17:10.838089 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-441eb7ac-3532-4831-a144-2f0065c47684 req-5f9461ca-6565-4cc8-8534-9ed2d64c12d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054214 Jul 24 01:17:10.839636 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1010/1911] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:10.848818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ef793e6c-ff71-429b-9c7b-e8ed2921a2c9 req-74904a5c-c491-4a52-aa8c-6b4c18f9a8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8bab37-21be-406c-9066-85ba99e725c2", "name": "network-vif-deleted", "tag": "284e09b9-757e-49af-b049-18d56b72b9ae"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:10.861377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ef793e6c-ff71-429b-9c7b-e8ed2921a2c9 req-74904a5c-c491-4a52-aa8c-6b4c18f9a8aa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:10.862076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ef793e6c-ff71-429b-9c7b-e8ed2921a2c9 req-74904a5c-c491-4a52-aa8c-6b4c18f9a8aa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:10.882225 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ef793e6c-ff71-429b-9c7b-e8ed2921a2c9 req-74904a5c-c491-4a52-aa8c-6b4c18f9a8aa service nova] Creating event network-vif-deleted:284e09b9-757e-49af-b049-18d56b72b9ae for instance 3d8bab37-21be-406c-9066-85ba99e725c2 on n-h2-master-1 Jul 24 01:17:10.890133 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ef793e6c-ff71-429b-9c7b-e8ed2921a2c9 req-74904a5c-c491-4a52-aa8c-6b4c18f9a8aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048463 Jul 24 01:17:10.892198 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1011/1912] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:10.910978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:10.921018 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e586fb2-faba-4518-9562-b28378a77281 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.474376 Jul 24 01:17:10.925080 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 902/1913] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:10 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:11.328002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:11.328712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:11.336581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.338135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.342267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.343070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.390338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.391076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.391712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lazy-loading 'fault' on Instance uuid 3d8bab37-21be-406c-9066-85ba99e725c2 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:11.403235 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:11.404358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:11.420427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.420895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.427495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.428377 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.453423 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:11.519795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:11.534544 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8fce8ef4-5b5e-4a27-83ab-858304176fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 200 len: 1306 microversion: 2.1 time: 0.212228 Jul 24 01:17:11.536125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1012/1914] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:11 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 1306 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:11.786296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:11.787119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:11.787657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:11.795577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.796222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.797314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.797958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.815748 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8e32c055-86f5-40f6-94f4-087b928cf08e tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1324 microversion: 2.1 time: 0.419644 Jul 24 01:17:11.830053 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 903/1915] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:11 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:11.944701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:11.947536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:11.966126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.975725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:11.980928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:11.981991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.222953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:12.234796 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6a332df-3f3d-467f-b6db-1e23be8b01eb tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.452327 Jul 24 01:17:12.250855 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1013/1916] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:11 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:12.553888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:12.555251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:12.567380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.568451 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.569875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.571626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.598151 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 HTTP/1.1 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '3d8bab37-21be-406c-9066-85ba99e725c2'} Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:12.602510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:12.612513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:12.619539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98c22fb1-f515-4401-a311-0fa020667c5f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 404 len: 111 microversion: 2.1 time: 0.069941 Jul 24 01:17:12.620601 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1014/1917] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:12 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:12.630003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cfbe0cca-f45b-4377-b7f8-5a963ff2f04d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eab5bca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:12.709226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:12.720250 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9eea257e-6810-450b-8731-6af826a90715 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.783508 Jul 24 01:17:12.720937 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 904/1918] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:11 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:12.835108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:12.836125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:12.844093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.844705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:12.846429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:12.847207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.225505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:13.253387 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73ffdf55-2b22-46c4-8c98-de838ac254b9 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1521 microversion: 2.1 time: 0.422236 Jul 24 01:17:13.267126 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 905/1919] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:12 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:13.275242 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cfbe0cca-f45b-4377-b7f8-5a963ff2f04d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359" status: 202 len: 0 microversion: 2.1 time: 0.649263 Jul 24 01:17:13.276777 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1015/1920] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:12 2022] DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359 => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:13.282457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5b2a094e-3dc9-4966-a6c6-5ef88be035be req-4326c53b-bd71-4761-8ef7-89f309f6c1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84ebfcb-7902-494e-b349-e56b08e23a40", "tag": "9e0e13f8-d664-4cb2-81cf-d9a15f7d24eb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:13.305978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:13.307329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5b2a094e-3dc9-4966-a6c6-5ef88be035be req-4326c53b-bd71-4761-8ef7-89f309f6c1e4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.307788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5b2a094e-3dc9-4966-a6c6-5ef88be035be req-4326c53b-bd71-4761-8ef7-89f309f6c1e4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.310152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:13.317484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.318456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.319442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.326510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.334169 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5b2a094e-3dc9-4966-a6c6-5ef88be035be req-4326c53b-bd71-4761-8ef7-89f309f6c1e4 service nova] Creating event network-changed:9e0e13f8-d664-4cb2-81cf-d9a15f7d24eb for instance b84ebfcb-7902-494e-b349-e56b08e23a40 on n-h1-master-1 Jul 24 01:17:13.341950 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5b2a094e-3dc9-4966-a6c6-5ef88be035be req-4326c53b-bd71-4761-8ef7-89f309f6c1e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063716 Jul 24 01:17:13.342927 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1016/1921] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:13.348195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:13.348806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:13.370200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.370639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.371667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.372288 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.421307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:13.566248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e3b8141-96f5-4f9a-b586-8729418b0f4f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 204 len: 0 microversion: 2.1 time: 0.221333 Jul 24 01:17:13.570428 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1017/1922] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:13 2022] DELETE /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:13.581141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3f876aba-e6a0-493a-9264-25fe5ffb2d00 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eabbd4c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:13.731042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:13.740041 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bea9063b-d4aa-4ce2-8870-f69bde6bc4e6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.457884 Jul 24 01:17:13.745343 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 906/1923] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:13 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:13.750171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:13.750798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:13.762304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.763347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.765206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:13.765835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:13.949634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3f876aba-e6a0-493a-9264-25fe5ffb2d00 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96" status: 202 len: 0 microversion: 2.1 time: 0.376904 Jul 24 01:17:13.953636 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1018/1924] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:13 2022] DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:13.989237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:13.990675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:14.015393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.016413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.018310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.019152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.034063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:14.047834 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11d4975f-9f4d-4c7f-bf45-31e973a38abf tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1527 microversion: 2.1 time: 0.300469 Jul 24 01:17:14.048447 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 907/1925] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:13 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1527 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:14.064604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-41643272-2227-45e6-91b8-f07a68013fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'create', calling method: .version_select at 0x7f05eb03b4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1884011756", "description": "tempest-description-593582738"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:14.368303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:14.379108 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a9a20ad-24c1-4e9b-8621-aed35fc26fb4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1517 microversion: 2.1 time: 0.412647 Jul 24 01:17:14.390353 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1019/1926] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:13 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:14.454962 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-41643272-2227-45e6-91b8-f07a68013fb5 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.394672 Jul 24 01:17:14.455576 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 908/1927] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:17:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:14.470775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-92c9b09d-6cff-4b69-88c3-1c49a6a3073f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Action: 'update', calling method: .version_select at 0x7f05eabbd0d0>, body: {"security_group": {"name": "tempest-sg-hth-441306464", "description": "tempest-description-hth-1148138039"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:14.737776 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-92c9b09d-6cff-4b69-88c3-1c49a6a3073f tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/de54a132-3c43-4013-b457-cc81a72034e4" status: 200 len: 217 microversion: 2.1 time: 0.271550 Jul 24 01:17:14.739774 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1020/1928] 10.222.0.27 () {60 vars in 1289 bytes} [Sun Jul 24 01:17:14 2022] PUT /compute/v2.1/os-security-groups/de54a132-3c43-4013-b457-cc81a72034e4 => generated 217 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:14.752183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4436fa3f-310d-490a-9a40-b20e07299b86 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eaff63a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:14.760764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:14.761827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:14.769819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.770553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.771642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:14.772343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:14.836453 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4436fa3f-310d-490a-9a40-b20e07299b86 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/de54a132-3c43-4013-b457-cc81a72034e4" status: 200 len: 217 microversion: 2.1 time: 0.089752 Jul 24 01:17:14.838176 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 909/1929] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:17:14 2022] GET /compute/v2.1/os-security-groups/de54a132-3c43-4013-b457-cc81a72034e4 => generated 217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:14.855510 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7edf58dc-0d66-4549-bd76-029439c2cc9a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eafb0f70>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:14.981953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:14.996416 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-717523d2-bd2e-43c3-bf78-3e7c6772b5a5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.240580 Jul 24 01:17:14.997036 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1021/1930] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:14 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:15.067124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.068090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:15.076957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.078152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.079437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.080312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.258931 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7edf58dc-0d66-4549-bd76-029439c2cc9a tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/de54a132-3c43-4013-b457-cc81a72034e4" status: 202 len: 0 microversion: 2.1 time: 0.410267 Jul 24 01:17:15.259574 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 910/1931] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:14 2022] DELETE /compute/v2.1/os-security-groups/de54a132-3c43-4013-b457-cc81a72034e4 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:15.274146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.275727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:15.285023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.285810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.287031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.287646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.329767 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 HTTP/1.1 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '3d8bab37-21be-406c-9066-85ba99e725c2'} Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:15.349857 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.356089 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.361082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.362208 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3b718d9-2604-49cb-a2da-a986fb492196 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 404 len: 111 microversion: 2.1 time: 0.095366 Jul 24 01:17:15.363156 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 911/1932] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:15.373326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.374711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: 3d8bab37-21be-406c-9066-85ba99e725c2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:15.385321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.385995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.386988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.387627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.408182 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 HTTP/1.1 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '3d8bab37-21be-406c-9066-85ba99e725c2'} Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.410403 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Instance 3d8bab37-21be-406c-9066-85ba99e725c2 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-703315a7-194c-4db4-b50f-3ae6e4238ff8 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2" status: 404 len: 111 microversion: 2.1 time: 0.042449 Jul 24 01:17:15.418032 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 912/1933] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:15 2022] GET /compute/v2.1/servers/3d8bab37-21be-406c-9066-85ba99e725c2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:17:15.423239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.423583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:15.429831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:15.439502 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c347242-c1bb-41ce-a5a8-8ff10fcadde3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1527 microversion: 2.1 time: 0.376485 Jul 24 01:17:15.440254 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1022/1934] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:15 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:15.442752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.443223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.444055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:15.444499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:15.452494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48f30042-5321-40de-9b92-adaab843841d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eac25790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.576000 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-48f30042-5321-40de-9b92-adaab843841d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:15.576817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-48f30042-5321-40de-9b92-adaab843841d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group 30f30396-5b50-498a-9214-79330d5c7b96 not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:17:15.577655 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-48f30042-5321-40de-9b92-adaab843841d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist Jul 24 01:17:15.577655 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-4097b5b3-7006-468f-89ac-6fe6d74f3e5f'] Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48f30042-5321-40de-9b92-adaab843841d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96 HTTP/1.1 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: exception: Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-4097b5b3-7006-468f-89ac-6fe6d74f3e5f'] Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '30f30396-5b50-498a-9214-79330d5c7b96'} Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:15.579982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4097b5b3-7006-468f-89ac-6fe6d74f3e5f'] Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4097b5b3-7006-468f-89ac-6fe6d74f3e5f'] Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4097b5b3-7006-468f-89ac-6fe6d74f3e5f'] Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4097b5b3-7006-468f-89ac-6fe6d74f3e5f'] Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48f30042-5321-40de-9b92-adaab843841d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group 30f30396-5b50-498a-9214-79330d5c7b96 does not exist Jul 24 01:17:15.587346 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-4097b5b3-7006-468f-89ac-6fe6d74f3e5f'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.593877 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-48f30042-5321-40de-9b92-adaab843841d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96" status: 404 len: 194 microversion: 2.1 time: 0.148763 Jul 24 01:17:15.599224 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1023/1935] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/os-security-groups/30f30396-5b50-498a-9214-79330d5c7b96 => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:15.606041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a29e050c-fbb3-49b2-a116-9caefbc86175 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eabbdee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.690059 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-a29e050c-fbb3-49b2-a116-9caefbc86175 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:15.690806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-a29e050c-fbb3-49b2-a116-9caefbc86175 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group a02bc833-e293-4e4a-8a3d-64f6164a0359 not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:17:15.691571 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a29e050c-fbb3-49b2-a116-9caefbc86175 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist Jul 24 01:17:15.691571 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-47e44d02-b376-4efe-a36e-a192fdc1136e'] Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a29e050c-fbb3-49b2-a116-9caefbc86175 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359 HTTP/1.1 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: exception: Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-47e44d02-b376-4efe-a36e-a192fdc1136e'] Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a02bc833-e293-4e4a-8a3d-64f6164a0359'} Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:15.693651 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e44d02-b376-4efe-a36e-a192fdc1136e'] Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e44d02-b376-4efe-a36e-a192fdc1136e'] Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e44d02-b376-4efe-a36e-a192fdc1136e'] Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47e44d02-b376-4efe-a36e-a192fdc1136e'] Jul 24 01:17:15.699065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.702360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a29e050c-fbb3-49b2-a116-9caefbc86175 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group a02bc833-e293-4e4a-8a3d-64f6164a0359 does not exist Jul 24 01:17:15.702360 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-47e44d02-b376-4efe-a36e-a192fdc1136e'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.703639 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a29e050c-fbb3-49b2-a116-9caefbc86175 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359" status: 404 len: 194 microversion: 2.1 time: 0.102986 Jul 24 01:17:15.705273 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1024/1936] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/os-security-groups/a02bc833-e293-4e4a-8a3d-64f6164a0359 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:15.722640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3307e4c-947b-4109-9ac0-73881d164b25 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eaba6ca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.784403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:15.792970 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9264241-0680-43d6-8115-80a9966144d8 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1523 microversion: 2.1 time: 0.374827 Jul 24 01:17:15.807851 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 913/1937] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:15 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:15.814142 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-a3307e4c-947b-4109-9ac0-73881d164b25 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:15.814852 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-a3307e4c-947b-4109-9ac0-73881d164b25 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group dc91c59f-380d-4b6a-93d4-98c61649654e not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:17:15.816345 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a3307e4c-947b-4109-9ac0-73881d164b25 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:17:15.816345 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-e8c54212-9807-4f7b-a6d8-8a502cbe535a'] Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3307e4c-947b-4109-9ac0-73881d164b25 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e HTTP/1.1 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: exception: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-e8c54212-9807-4f7b-a6d8-8a502cbe535a'] Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'dc91c59f-380d-4b6a-93d4-98c61649654e'} Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:15.818956 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c54212-9807-4f7b-a6d8-8a502cbe535a'] Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c54212-9807-4f7b-a6d8-8a502cbe535a'] Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c54212-9807-4f7b-a6d8-8a502cbe535a'] Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c54212-9807-4f7b-a6d8-8a502cbe535a'] Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3307e4c-947b-4109-9ac0-73881d164b25 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group dc91c59f-380d-4b6a-93d4-98c61649654e does not exist Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-e8c54212-9807-4f7b-a6d8-8a502cbe535a'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.824549 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3307e4c-947b-4109-9ac0-73881d164b25 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e" status: 404 len: 194 microversion: 2.1 time: 0.109909 Jul 24 01:17:15.827481 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1025/1938] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/os-security-groups/dc91c59f-380d-4b6a-93d4-98c61649654e => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:15.835188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15a68e42-7ad1-4870-bf88-c495a8fe9862 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eafb08b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.887061 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-15a68e42-7ad1-4870-bf88-c495a8fe9862 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:15.888482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-15a68e42-7ad1-4870-bf88-c495a8fe9862 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:17:15.889221 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-15a68e42-7ad1-4870-bf88-c495a8fe9862 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:17:15.889221 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-72b6d7bc-5c99-4f16-95be-a78892499f85'] Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15a68e42-7ad1-4870-bf88-c495a8fe9862 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4 HTTP/1.1 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: exception: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-72b6d7bc-5c99-4f16-95be-a78892499f85'] Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '54fee49b-1242-4b2a-9c37-a91e75b24de4'} Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:15.891786 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72b6d7bc-5c99-4f16-95be-a78892499f85'] Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72b6d7bc-5c99-4f16-95be-a78892499f85'] Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72b6d7bc-5c99-4f16-95be-a78892499f85'] Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72b6d7bc-5c99-4f16-95be-a78892499f85'] Jul 24 01:17:15.896886 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.906884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15a68e42-7ad1-4870-bf88-c495a8fe9862 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group 54fee49b-1242-4b2a-9c37-a91e75b24de4 does not exist Jul 24 01:17:15.906884 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-72b6d7bc-5c99-4f16-95be-a78892499f85'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.906884 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15a68e42-7ad1-4870-bf88-c495a8fe9862 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4" status: 404 len: 194 microversion: 2.1 time: 0.076713 Jul 24 01:17:15.913818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4897113a-223b-4009-85e4-76da5ecc4532 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eac25670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.918113 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 914/1939] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/os-security-groups/54fee49b-1242-4b2a-9c37-a91e75b24de4 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:15.964088 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-4897113a-223b-4009-85e4-76da5ecc4532 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:15.964935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-4897113a-223b-4009-85e4-76da5ecc4532 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:17:15.965649 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4897113a-223b-4009-85e4-76da5ecc4532 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:17:15.965649 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f5384653-36b6-4972-8569-49acd0118b30'] Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4897113a-223b-4009-85e4-76da5ecc4532 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32 HTTP/1.1 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: exception: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f5384653-36b6-4972-8569-49acd0118b30'] Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '64f1f771-64ab-4c38-8434-9b2cb3d74c32'} Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:15.967780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5384653-36b6-4972-8569-49acd0118b30'] Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5384653-36b6-4972-8569-49acd0118b30'] Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5384653-36b6-4972-8569-49acd0118b30'] Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5384653-36b6-4972-8569-49acd0118b30'] Jul 24 01:17:15.973116 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:15.979261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4897113a-223b-4009-85e4-76da5ecc4532 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group 64f1f771-64ab-4c38-8434-9b2cb3d74c32 does not exist Jul 24 01:17:15.979261 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-f5384653-36b6-4972-8569-49acd0118b30'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:15.979639 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4897113a-223b-4009-85e4-76da5ecc4532 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32" status: 404 len: 194 microversion: 2.1 time: 0.069718 Jul 24 01:17:15.988626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-064e5fea-7e4e-4e05-9425-8777ef13c311 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eaf41670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:15.994201 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1026/1940] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/os-security-groups/64f1f771-64ab-4c38-8434-9b2cb3d74c32 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:16.015023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:16.016120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:16.030432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.030920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.031704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.032143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.047588 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-064e5fea-7e4e-4e05-9425-8777ef13c311 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:16.049477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.security_group_api [None req-064e5fea-7e4e-4e05-9425-8777ef13c311 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Neutron security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 not found {{(pid=119562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:17:16.052563 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-064e5fea-7e4e-4e05-9425-8777ef13c311 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:17:16.052563 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-dd0cd14b-72ea-4197-9d44-17090de0ffae'] Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-064e5fea-7e4e-4e05-9425-8777ef13c311 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4 HTTP/1.1 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: exception: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-dd0cd14b-72ea-4197-9d44-17090de0ffae'] Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9e50a6e8-63e0-4189-a103-9d9fafd36bf4'} Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:16.059023 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd0cd14b-72ea-4197-9d44-17090de0ffae'] Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd0cd14b-72ea-4197-9d44-17090de0ffae'] Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd0cd14b-72ea-4197-9d44-17090de0ffae'] Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd0cd14b-72ea-4197-9d44-17090de0ffae'] Jul 24 01:17:16.064353 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:16.068540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-064e5fea-7e4e-4e05-9425-8777ef13c311 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Security group 9e50a6e8-63e0-4189-a103-9d9fafd36bf4 does not exist Jul 24 01:17:16.068540 n-d-master-1 devstack@n-api.service[119562]: Neutron server returns request_ids: ['req-dd0cd14b-72ea-4197-9d44-17090de0ffae'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:16.070382 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-064e5fea-7e4e-4e05-9425-8777ef13c311 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4" status: 404 len: 194 microversion: 2.1 time: 0.081737 Jul 24 01:17:16.075560 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 915/1941] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:15 2022] DELETE /compute/v2.1/os-security-groups/9e50a6e8-63e0-4189-a103-9d9fafd36bf4 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:16.080986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:16.086786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:16.100794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.108192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.109383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.110748 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.199608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:16.393919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:16.407637 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45ea3167-7bed-4e39-9934-35c15952091f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.396400 Jul 24 01:17:16.409378 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1027/1942] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:16 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:16.432279 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56d6b2ac-96da-4085-83b1-5844d10f8d72 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 204 len: 0 microversion: 2.1 time: 0.353670 Jul 24 01:17:16.434342 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 916/1943] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:16 2022] DELETE /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:16.442901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:16.443791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:16.457638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.459288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:16.460205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:16.462059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.463730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.464181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.477599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.478476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.479760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.480371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.676091 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:16.711997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:16.722180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f816d875-ceb6-474c-b560-4eac9ba1a331 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1485 microversion: 2.1 time: 0.267965 Jul 24 01:17:16.738000 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 917/1944] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:16 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1485 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:16.738000 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-651869f9-3038-48e4-a847-8a6089e61b35 req-1673f6aa-8db5-4c09-99ac-0091c21fffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6efb0f8c-ab32-4040-9db4-312cb30e476d", "name": "network-vif-deleted", "tag": "0af9965a-a16f-4406-ac0a-2090b1d0b745"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:16.754576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-651869f9-3038-48e4-a847-8a6089e61b35 req-1673f6aa-8db5-4c09-99ac-0091c21fffb5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.755025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-651869f9-3038-48e4-a847-8a6089e61b35 req-1673f6aa-8db5-4c09-99ac-0091c21fffb5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.783149 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-651869f9-3038-48e4-a847-8a6089e61b35 req-1673f6aa-8db5-4c09-99ac-0091c21fffb5 service nova] Creating event network-vif-deleted:0af9965a-a16f-4406-ac0a-2090b1d0b745 for instance 6efb0f8c-ab32-4040-9db4-312cb30e476d on n-h1-master-1 Jul 24 01:17:16.789506 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-651869f9-3038-48e4-a847-8a6089e61b35 req-1673f6aa-8db5-4c09-99ac-0091c21fffb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058670 Jul 24 01:17:16.791567 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 918/1945] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:16.820947 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:16.822266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:16.832371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.833418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.834417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:16.835049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:16.954361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:16.974505 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a7ddedfb-ac20-431f-bf66-44095606f33b tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1647 microversion: 2.1 time: 0.535772 Jul 24 01:17:16.980614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1028/1946] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:16 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1647 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:17.071933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:17.083315 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59d0aa0e-ed3c-4a5a-ab0c-7280efe11dcc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1523 microversion: 2.1 time: 0.271076 Jul 24 01:17:17.085861 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 919/1947] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:16 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:17.430084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:17.431447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:17.451758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.452953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.453954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.454506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.736163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:17.745804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:17.746641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:17.749195 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fb644660-bc58-42ac-943a-89848d3761ce tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.325187 Jul 24 01:17:17.753533 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=36 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:17.762042 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1029/1948] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:17 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:17.768744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.769201 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.770018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.770632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.822567 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:17.823231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:17.823463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lazy-loading 'fault' on Instance uuid 6efb0f8c-ab32-4040-9db4-312cb30e476d {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:17.883761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da455c083744e7c814e8638483ffffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641ace3f76eb466ba57c3f42b8173978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:17.895353 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f016249-6894-47d7-8318-61030fd207ea tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 200 len: 1314 microversion: 2.1 time: 0.153066 Jul 24 01:17:17.896319 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 920/1949] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:17 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:17.999644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:18.000278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:18.019216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.019764 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.020603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.021044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.283839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-509489996", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:18.341485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:18.358284 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cb61f08c-3995-4c02-a782-511f12921548 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1647 microversion: 2.1 time: 0.364680 Jul 24 01:17:18.361880 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1030/1950] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:17 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1647 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:18.372679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:18.373305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:18.379620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.382456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:18.383265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.384737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.385199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.624028 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=36 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:18.658886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:18.669619 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2dfef81f-c476-4fa7-a62e-cda93eabd0b0 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1523 microversion: 2.1 time: 0.306679 Jul 24 01:17:18.671398 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1031/1951] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:18 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:18.678935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:18.679377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:18.679914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:18.680327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:18.681882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:18.691893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.692541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.693706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.694884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.713932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-746d3087-077f-4d67-bd73-d0364c4320cd req-b8b11ada-f892-46fe-8cba-00798c59b5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0158e48-08e8-45ed-8d5b-0b111804db53", "name": "network-vif-unplugged", "status": "completed", "tag": "e27ff98b-fed4-4f66-ae66-5f45d4f089aa"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:18.716871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:18.722848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:18.729175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-746d3087-077f-4d67-bd73-d0364c4320cd req-b8b11ada-f892-46fe-8cba-00798c59b5db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.730778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-746d3087-077f-4d67-bd73-d0364c4320cd req-b8b11ada-f892-46fe-8cba-00798c59b5db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.739715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:18.742454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:18.752748 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-746d3087-077f-4d67-bd73-d0364c4320cd req-b8b11ada-f892-46fe-8cba-00798c59b5db service nova] Creating event network-vif-unplugged:e27ff98b-fed4-4f66-ae66-5f45d4f089aa for instance f0158e48-08e8-45ed-8d5b-0b111804db53 on n-h2-master-1 Jul 24 01:17:18.761703 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-746d3087-077f-4d67-bd73-d0364c4320cd req-b8b11ada-f892-46fe-8cba-00798c59b5db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055465 Jul 24 01:17:18.762992 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1032/1952] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:18.768350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:18.769046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:18.776661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.777071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.778086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.778734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.810506 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f4339bc3-00e1-495e-bbae-c65b9759f539 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722853 Jul 24 01:17:18.814460 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:18.815767 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 921/1953] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:17:18.826614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c26e181d-bf1d-4042-94ad-d7b8b1d9c78d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:18.827359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c26e181d-bf1d-4042-94ad-d7b8b1d9c78d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:18.848696 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=90,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:18.935895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c26e181d-bf1d-4042-94ad-d7b8b1d9c78d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:18.948220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c26e181d-bf1d-4042-94ad-d7b8b1d9c78d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1216 microversion: 2.1 time: 0.126523 Jul 24 01:17:18.949142 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 922/1954] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:18 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1216 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:18.960364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:18.961257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 6efb0f8c-ab32-4040-9db4-312cb30e476d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:18.977252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.982024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:18.983112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:18.983770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.031679 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Instance 6efb0f8c-ab32-4040-9db4-312cb30e476d could not be found. Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d HTTP/1.1 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 6efb0f8c-ab32-4040-9db4-312cb30e476d could not be found. Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6efb0f8c-ab32-4040-9db4-312cb30e476d'} Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6efb0f8c-ab32-4040-9db4-312cb30e476d could not be found. Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6efb0f8c-ab32-4040-9db4-312cb30e476d could not be found. Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.033487 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6efb0f8c-ab32-4040-9db4-312cb30e476d could not be found. Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.040042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Instance 6efb0f8c-ab32-4040-9db4-312cb30e476d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:19.044061 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf17ea1c-895c-4a06-8f18-f2a008ccf07c tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d" status: 404 len: 111 microversion: 2.1 time: 0.089442 Jul 24 01:17:19.044690 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 923/1955] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:18 2022] GET /compute/v2.1/servers/6efb0f8c-ab32-4040-9db4-312cb30e476d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:19.056251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59844d79-4348-4ec7-a342-424ede7aee71 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '.version_select at 0x7f05eaf63af0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:19.091551 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-59844d79-4348-4ec7-a342-424ede7aee71 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Image not found. Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59844d79-4348-4ec7-a342-424ede7aee71 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c HTTP/1.1 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '765f241f-5cf7-43d5-a0f6-84b0a4d7d92c'} Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 765f241f-5cf7-43d5-a0f6-84b0a4d7d92c to delete Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 765f241f-5cf7-43d5-a0f6-84b0a4d7d92c could not be found. Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.093734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.099680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59844d79-4348-4ec7-a342-424ede7aee71 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:19.106341 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59844d79-4348-4ec7-a342-424ede7aee71 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c" status: 404 len: 62 microversion: 2.1 time: 0.046423 Jul 24 01:17:19.106701 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 924/1956] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:19 2022] DELETE /compute/v2.1/images/765f241f-5cf7-43d5-a0f6-84b0a4d7d92c => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:17:19.112249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:19.112775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:19.112901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:19.126205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7eba5761-4444-43a9-a414-418bbb0fdbe7 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.357655 Jul 24 01:17:19.144641 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1033/1957] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:18 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:19.151076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.152602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.153479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.153967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.172917 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 HTTP/1.1 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '818c7702-66f8-4672-b67b-5a05d9197c59'} Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:19.175092 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa87da3c-1bee-41ac-a5cb-9d07df70d5c2 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 404 len: 111 microversion: 2.1 time: 0.068685 Jul 24 01:17:19.180033 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 925/1958] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:19 2022] DELETE /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:19.186894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:19.187528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 818c7702-66f8-4672-b67b-5a05d9197c59] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:19.194157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.194610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.195703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.197206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.214828 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 HTTP/1.1 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '818c7702-66f8-4672-b67b-5a05d9197c59'} Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.217199 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Instance 818c7702-66f8-4672-b67b-5a05d9197c59 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:19.222992 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5b87d0a9-e045-473b-8eee-5646f53bee5f tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59" status: 404 len: 111 microversion: 2.1 time: 0.039192 Jul 24 01:17:19.226667 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1034/1959] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:19 2022] GET /compute/v2.1/servers/818c7702-66f8-4672-b67b-5a05d9197c59 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:19.232838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8497daa1-11ff-45a6-86a8-675f6ef49857 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '.version_select at 0x7f05eb562f70>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:19.258745 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8497daa1-11ff-45a6-86a8-675f6ef49857 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054236768" status: 202 len: 0 microversion: 2.1 time: 0.030578 Jul 24 01:17:19.261053 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 926/1960] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:17:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054236768 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:19.375527 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:19.377042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:19.389740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.391278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.393555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.394035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.551695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee3f1e6e5ba4185a4080a27d7c21702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f19f4a68ce46019ac8f50a275b2d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:19.560824 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97bffa2c-1eba-4167-8ba0-2e501cb19aaa tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 200 len: 1468 microversion: 2.1 time: 0.190168 Jul 24 01:17:19.566436 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1035/1961] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:19 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 1468 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:19.639489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2e805a26-9c2c-46ba-9e8c-0533fd29b428 req-443596fa-a90f-4d35-991c-c7888a527b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf89049-7c79-4806-a7b3-d93339198383", "name": "network-vif-deleted", "tag": "7694388d-3b85-4312-99b8-2dacc55207b7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:19.649260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2e805a26-9c2c-46ba-9e8c-0533fd29b428 req-443596fa-a90f-4d35-991c-c7888a527b74 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.650681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2e805a26-9c2c-46ba-9e8c-0533fd29b428 req-443596fa-a90f-4d35-991c-c7888a527b74 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.664982 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2e805a26-9c2c-46ba-9e8c-0533fd29b428 req-443596fa-a90f-4d35-991c-c7888a527b74 service nova] Creating event network-vif-deleted:7694388d-3b85-4312-99b8-2dacc55207b7 for instance ddf89049-7c79-4806-a7b3-d93339198383 on n-h1-master-1 Jul 24 01:17:19.672388 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2e805a26-9c2c-46ba-9e8c-0533fd29b428 req-443596fa-a90f-4d35-991c-c7888a527b74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037536 Jul 24 01:17:19.674083 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 927/1962] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:19.695758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:19.696390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:19.716599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.717247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.719112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.721593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:19.966711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:19.968224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:19.984813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:19.987863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:20.002157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:20.004621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:20.218647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:20.235246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:20.236288 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fd3eb10-a31c-4c46-bf8c-0fa4cb68f45b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1212 microversion: 2.1 time: 0.275493 Jul 24 01:17:20.240346 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 928/1963] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:19 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1212 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:20.251248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0488f9a8-f62a-465d-ab9a-dcf30aab25b9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1523 microversion: 2.1 time: 0.567226 Jul 24 01:17:20.254738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:20.255653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:20.262781 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1036/1964] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:19 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1523 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:20.270447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:20.273593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:20.276120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:20.278511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:20.430558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b48353cf-114f-4137-b358-da4757f294db tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eac25430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1220521520", "description": "tempest-description-476901030"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:21.215252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:21.230284 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-870797ad-5c47-4543-98b3-0277ab03c2ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.986921 Jul 24 01:17:21.232222 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 929/1965] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:20 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:21.246904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:21.251740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] [instance: ddf89049-7c79-4806-a7b3-d93339198383] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:21.264932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:21.268078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:21.269122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:21.271219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:21.301153 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] HTTP exception thrown: Instance ddf89049-7c79-4806-a7b3-d93339198383 could not be found. Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Request method failure captured: Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 HTTP/1.1 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J1S8juIwuJ2qG6fU9vvi46_I3lz2U5dQx1ojFvjv5nTKyhqrYkAX8hiEMR4MKpAcGLT4Fpg-9nNkGrfj8pMSthb6yC3mVA-Yd_VHu_RC67HqxtVySgHwCu-n6hisSQ04RZD3e03MAwVrxtCO76bwvNRSy-KkRIdoCBbNLzWDyYHkMA Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59f19f4a68ce46019ac8f50a275b2d3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59f19f4a68ce46019ac8f50a275b2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 59f19f4a68ce46019ac8f50a275b2d3d Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-887442890 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cee3f1e6e5ba4185a4080a27d7c21702 Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupsTestJSON-887442890-project Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ddf89049-7c79-4806-a7b3-d93339198383 could not be found. Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ddf89049-7c79-4806-a7b3-d93339198383'} Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf89049-7c79-4806-a7b3-d93339198383 could not be found. Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf89049-7c79-4806-a7b3-d93339198383 could not be found. Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:21.304351 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.310675 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:21.310675 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:21.310675 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:21.310675 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:21.310675 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:21.310675 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf89049-7c79-4806-a7b3-d93339198383 could not be found. Jul 24 01:17:21.310675 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.314515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Returning 404 to user: Instance ddf89049-7c79-4806-a7b3-d93339198383 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:21.317312 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a31b27cd-91c9-48e0-96a5-a45153aa7e9d tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383" status: 404 len: 111 microversion: 2.1 time: 0.083736 Jul 24 01:17:21.319396 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 930/1966] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:21 2022] GET /compute/v2.1/servers/ddf89049-7c79-4806-a7b3-d93339198383 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:21.331902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7b04ffaa-bbed-4d90-a8de-ba5ed5c92f0e req-10186b88-62a8-4750-8c2f-70d72cfe6eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84ebfcb-7902-494e-b349-e56b08e23a40", "name": "network-vif-plugged", "status": "completed", "tag": "9e0e13f8-d664-4cb2-81cf-d9a15f7d24eb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:21.354432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7b04ffaa-bbed-4d90-a8de-ba5ed5c92f0e req-10186b88-62a8-4750-8c2f-70d72cfe6eb6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:21.357543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7b04ffaa-bbed-4d90-a8de-ba5ed5c92f0e req-10186b88-62a8-4750-8c2f-70d72cfe6eb6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:21.385104 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b48353cf-114f-4137-b358-da4757f294db tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.119539 Jul 24 01:17:21.386666 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1037/1967] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:17:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:21.387138 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7b04ffaa-bbed-4d90-a8de-ba5ed5c92f0e req-10186b88-62a8-4750-8c2f-70d72cfe6eb6 service nova] Creating event network-vif-plugged:9e0e13f8-d664-4cb2-81cf-d9a15f7d24eb for instance b84ebfcb-7902-494e-b349-e56b08e23a40 on n-h1-master-1 Jul 24 01:17:21.392007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e911ada-18ce-459f-8d10-1bf10386f6f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '.version_select at 0x7f05eab5dc10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:21.398418 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7b04ffaa-bbed-4d90-a8de-ba5ed5c92f0e req-10186b88-62a8-4750-8c2f-70d72cfe6eb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077269 Jul 24 01:17:21.403368 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 931/1968] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:21.408874 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:21.409599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:21.434876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:21.436792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:21.438822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:21.439392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:21.444281 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5e911ada-18ce-459f-8d10-1bf10386f6f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Image not found. Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e911ada-18ce-459f-8d10-1bf10386f6f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/images/c45bd24a-d013-49cc-8f14-cfe42aa10753 HTTP/1.1 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c45bd24a-d013-49cc-8f14-cfe42aa10753'} Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c45bd24a-d013-49cc-8f14-cfe42aa10753 to delete Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c45bd24a-d013-49cc-8f14-cfe42aa10753 could not be found. Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:21.446396 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:17:21.452922 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:21.454822 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:21.457272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e911ada-18ce-459f-8d10-1bf10386f6f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:21.458575 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e911ada-18ce-459f-8d10-1bf10386f6f3 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/images/c45bd24a-d013-49cc-8f14-cfe42aa10753" status: 404 len: 62 microversion: 2.1 time: 0.070286 Jul 24 01:17:21.467490 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1038/1969] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:21 2022] DELETE /compute/v2.1/images/c45bd24a-d013-49cc-8f14-cfe42aa10753 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:17:21.474949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:21.480499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:21.507818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:21.508536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:21.510298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:21.510868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:21.623532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:21.644271 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-24119aae-0402-425a-9aff-c85abb8df3b2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1274 microversion: 2.1 time: 0.239495 Jul 24 01:17:21.646476 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 932/1970] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:21 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1274 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:21.651741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d39c024-d62c-4d6b-b126-a81ab58b0ab4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eafb0700>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:21.857584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:21.888744 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9953df21-d028-4c2a-8399-0a07a5b401f1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1523 microversion: 2.1 time: 0.419561 Jul 24 01:17:21.889342 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1039/1971] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:21 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:21.894837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c478193-57cb-403b-ad24-d4ea2b38a7b3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eab3ad30>, body: {"security_group_rule": {"parent_group_id": "e16e6050-eaa1-4067-973b-ab149d62bc0b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:22.039934 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d39c024-d62c-4d6b-b126-a81ab58b0ab4 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e0653d00-b9d9-45d1-b6ac-ee88acce313d" status: 202 len: 0 microversion: 2.1 time: 0.392069 Jul 24 01:17:22.041443 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 933/1972] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:21 2022] DELETE /compute/v2.1/os-security-groups/e0653d00-b9d9-45d1-b6ac-ee88acce313d => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:22.048293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:22.049097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:22.058854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.060510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:22.062084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.062939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:22.100950 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 HTTP/1.1 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '5a2cf16e-4b21-44e1-bb24-1a0a161bd395'} Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:22.104752 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.109950 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.113154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:22.135200 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0cb7f8f6-dbb2-4a6e-bb00-9865c6d26869 tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 404 len: 111 microversion: 2.1 time: 0.090907 Jul 24 01:17:22.139139 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 934/1973] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:22 2022] DELETE /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:22.147643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df83dad2-2cb7-4d51-8a46-a76d83b1d162 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] Calling method '.version_select at 0x7f05eafb0a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:22.208085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c478193-57cb-403b-ad24-d4ea2b38a7b3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.317440 Jul 24 01:17:22.210407 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1040/1974] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:22.219642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:22.220569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] [instance: 5a2cf16e-4b21-44e1-bb24-1a0a161bd395] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:22.232917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.241101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:22.241961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.242637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:22.293135 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] HTTP exception thrown: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Request method failure captured: Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 HTTP/1.1 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0xkt90AKZKnzuwyYJYiNlRgjI2apX2PkGW6ojevvDUkadXisiVExuCwRHky0uUcZzyjpOfWVaOoLu8kWD87O_DfHsnk_-qY3zdV4rKMEhNp1IJLCW5ZGhGFLYBPpAkjhrcMJto5h-gRZ50tOwHFRFdGK6VvOzgZ4ovZPyV3yF0yxo Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641ace3f76eb466ba57c3f42b8173978", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641ace3f76eb466ba57c3f42b8173978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 641ace3f76eb466ba57c3f42b8173978 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553 Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5da455c083744e7c814e8638483ffffe Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1233401553-project Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '5a2cf16e-4b21-44e1-bb24-1a0a161bd395'} Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.294768 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. Jul 24 01:17:22.301749 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.303430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] Returning 404 to user: Instance 5a2cf16e-4b21-44e1-bb24-1a0a161bd395 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:22.313194 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f84c62a1-0f00-4153-9715-458d8ff4c6cd tempest-ImagesOneServerNegativeTestJSON-1233401553 tempest-ImagesOneServerNegativeTestJSON-1233401553-project] 10.222.0.27 "GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395" status: 404 len: 111 microversion: 2.1 time: 0.101099 Jul 24 01:17:22.313838 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1041/1975] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:22 2022] GET /compute/v2.1/servers/5a2cf16e-4b21-44e1-bb24-1a0a161bd395 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:22.319605 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b28d8a-71f8-4ac9-a50b-ccebed1347d5 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eab64c10>, body: {"security_group_rule": {"parent_group_id": "e16e6050-eaa1-4067-973b-ab149d62bc0b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:22.450015 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c1b28d8a-71f8-4ac9-a50b-ccebed1347d5 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: This rule already exists in group e16e6050-eaa1-4067-973b-ab149d62bc0b Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b28d8a-71f8-4ac9-a50b-ccebed1347d5 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 138 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: {"security_group_rule": {"parent_group_id": "e16e6050-eaa1-4067-973b-ab149d62bc0b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: exception: This rule already exists in group e16e6050-eaa1-4067-973b-ab149d62bc0b Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e16e6050-eaa1-4067-973b-ab149d62bc0b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group e16e6050-eaa1-4067-973b-ab149d62bc0b Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group e16e6050-eaa1-4067-973b-ab149d62bc0b Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:22.452286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:22.457696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:22.457696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:22.457696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group e16e6050-eaa1-4067-973b-ab149d62bc0b Jul 24 01:17:22.457696 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:22.463755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b28d8a-71f8-4ac9-a50b-ccebed1347d5 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 400 to user: This rule already exists in group e16e6050-eaa1-4067-973b-ab149d62bc0b {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:22.465215 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c1b28d8a-71f8-4ac9-a50b-ccebed1347d5 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.150233 Jul 24 01:17:22.466016 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1042/1976] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:17:22.474076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:22.476144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:22.495502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.497383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:22.504445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.505358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:22.580109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-df83dad2-2cb7-4d51-8a46-a76d83b1d162 tempest-SecurityGroupsTestJSON-887442890 tempest-SecurityGroupsTestJSON-887442890-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f8ae1cba-0924-4183-9199-55794f9cc368" status: 202 len: 0 microversion: 2.1 time: 0.439157 Jul 24 01:17:22.581105 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 935/1977] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:22 2022] DELETE /compute/v2.1/os-security-groups/f8ae1cba-0924-4183-9199-55794f9cc368 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:22.590605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eab05b5d-2ca0-42a1-8f0a-ea23afa2f065 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Calling method '.version_select at 0x7f05eafb0ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:22.774688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:22.803316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30e278c6-8c03-4d37-ac60-7ef176b7abba tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1314 microversion: 2.1 time: 0.330719 Jul 24 01:17:22.803987 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1043/1978] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:22 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:22.838028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:22.839456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:22.856583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.859628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:22.860905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:22.861642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:23.057850 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eab05b5d-2ca0-42a1-8f0a-ea23afa2f065 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/aa82f11a-81bf-467e-b482-3082e498526e" status: 202 len: 0 microversion: 2.1 time: 0.475262 Jul 24 01:17:23.059525 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 936/1979] 10.222.0.27 () {58 vars in 1286 bytes} [Sun Jul 24 01:17:22 2022] DELETE /compute/v2.1/os-security-group-rules/aa82f11a-81bf-467e-b482-3082e498526e => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:23.067475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:23.069710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:23.083845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:23.084823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:23.086291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:23.087049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:23.135746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:23.148814 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-18408074-e976-4d89-9d06-f14d98bae29e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.322076 Jul 24 01:17:23.150585 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1044/1980] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:22 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:23.157777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f11ed6a2-c719-4711-83b2-84bbe1aeb7c6 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eac25c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1984491356", "description": "tempest-description-509611840"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:23.271892 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:23.283448 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e5172c7-adb9-4db8-bdbe-086023b21b46 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1523 microversion: 2.1 time: 0.222390 Jul 24 01:17:23.284308 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 937/1981] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:23 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:23.379075 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f11ed6a2-c719-4711-83b2-84bbe1aeb7c6 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.227007 Jul 24 01:17:23.381783 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1045/1982] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:23.392828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b75f655c-08ec-44ce-813a-31e8765cb992 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eafb0f70>, body: {"security_group_rule": {"parent_group_id": "3db1222b-e3c3-480c-9915-86e2e5348ce0", "ip_protocol": "tcp", "from_port": 873943825, "to_port": 22}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:23.424495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9ba9421e-b723-40bf-bfa3-880abbcd89da req-d7eadf3c-83f4-4880-8671-5f7b2d192c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0158e48-08e8-45ed-8d5b-0b111804db53", "name": "network-vif-plugged", "status": "completed", "tag": "e27ff98b-fed4-4f66-ae66-5f45d4f089aa"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:23.434723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9ba9421e-b723-40bf-bfa3-880abbcd89da req-d7eadf3c-83f4-4880-8671-5f7b2d192c02 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:23.435826 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9ba9421e-b723-40bf-bfa3-880abbcd89da req-d7eadf3c-83f4-4880-8671-5f7b2d192c02 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:23.454156 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9ba9421e-b723-40bf-bfa3-880abbcd89da req-d7eadf3c-83f4-4880-8671-5f7b2d192c02 service nova] Creating event network-vif-plugged:e27ff98b-fed4-4f66-ae66-5f45d4f089aa for instance f0158e48-08e8-45ed-8d5b-0b111804db53 on n-h2-master-1 Jul 24 01:17:23.455795 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-b75f655c-08ec-44ce-813a-31e8765cb992 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: Invalid port range 873943825:22. Former value cannot be greater than the later Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b75f655c-08ec-44ce-813a-31e8765cb992 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 145 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: {"security_group_rule": {"parent_group_id": "3db1222b-e3c3-480c-9915-86e2e5348ce0", "ip_protocol": "tcp", "from_port": 873943825, "to_port": 22}} Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid port range 873943825:22. Former value cannot be greater than the later Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3db1222b-e3c3-480c-9915-86e2e5348ce0', 'ip_protocol': 'tcp', 'from_port': 873943825, 'to_port': 22}}} Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 873943825:22. Former value cannot be greater than the later Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 873943825:22. Former value cannot be greater than the later Jul 24 01:17:23.457323 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 873943825:22. Former value cannot be greater than the later Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b75f655c-08ec-44ce-813a-31e8765cb992 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 400 to user: Invalid port range 873943825:22. Former value cannot be greater than the later {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b75f655c-08ec-44ce-813a-31e8765cb992 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.069950 Jul 24 01:17:23.463211 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 938/1983] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:17:23.464368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9ba9421e-b723-40bf-bfa3-880abbcd89da req-d7eadf3c-83f4-4880-8671-5f7b2d192c02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040432 Jul 24 01:17:23.465504 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1046/1984] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:23.471804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17e76da3-5fac-4de4-a800-8a82a8dc4d2b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eaff6940>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1984891721", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:23.473545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-17e76da3-5fac-4de4-a800-8a82a8dc4d2b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: Security group id should be uuid Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17e76da3-5fac-4de4-a800-8a82a8dc4d2b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 131 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1984891721", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: exception: Security group id should be uuid Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1984891721', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:23.475057 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:23.480706 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 24 01:17:23.480706 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.480706 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17e76da3-5fac-4de4-a800-8a82a8dc4d2b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 400 to user: Security group id should be uuid {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:23.480706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-17e76da3-5fac-4de4-a800-8a82a8dc4d2b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.008783 Jul 24 01:17:23.482684 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 939/1985] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:23.487815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9cdabf2c-df48-4874-b9d3-32a74b69fae3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eabbd8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-567382725", "description": "tempest-description-301371215"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:23.670817 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9cdabf2c-df48-4874-b9d3-32a74b69fae3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.187204 Jul 24 01:17:23.673612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1047/1986] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:23.686575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8c6c05e-0bf7-4562-aa1c-dc4e6c4bd6bb tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eb1f0040>, body: {"security_group_rule": {"parent_group_id": "d4a6fb90-5f0a-4ff6-a439-37c43d1d2bed", "ip_protocol": "tempest-999-29891565", "from_port": 22, "to_port": 22}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:23.736266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-e8c6c05e-0bf7-4562-aa1c-dc4e6c4bd6bb tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: Invalid IP protocol tempest-999-29891565. Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8c6c05e-0bf7-4562-aa1c-dc4e6c4bd6bb tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 155 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: {"security_group_rule": {"parent_group_id": "d4a6fb90-5f0a-4ff6-a439-37c43d1d2bed", "ip_protocol": "tempest-999-29891565", "from_port": 22, "to_port": 22}} Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid IP protocol tempest-999-29891565. Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd4a6fb90-5f0a-4ff6-a439-37c43d1d2bed', 'ip_protocol': 'tempest-999-29891565', 'from_port': 22, 'to_port': 22}}} Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-29891565. Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-29891565. Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.738116 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-29891565. Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8c6c05e-0bf7-4562-aa1c-dc4e6c4bd6bb tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 400 to user: Invalid IP protocol tempest-999-29891565. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:23.744100 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e8c6c05e-0bf7-4562-aa1c-dc4e6c4bd6bb tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.059165 Jul 24 01:17:23.747993 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 940/1987] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:23.751484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f0cb7f17-3b72-4d93-a441-62ffe674f0fc tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eab8ad30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-936708086", "description": "tempest-description-233024245"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:23.838448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:23.839506 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:23.850008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:23.850476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:23.851342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:23.852070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:23.959004 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f0cb7f17-3b72-4d93-a441-62ffe674f0fc tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.209663 Jul 24 01:17:23.969203 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1048/1988] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:23.979492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13e42b93-a014-4a9f-8543-299f26111c0a tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eac25940>, body: {"security_group_rule": {"parent_group_id": "5f446b9c-233a-493f-a1b0-317b95ac581d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:24.134285 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-13e42b93-a014-4a9f-8543-299f26111c0a tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 24 01:17:24.136185 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13e42b93-a014-4a9f-8543-299f26111c0a tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 138 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: {"security_group_rule": {"parent_group_id": "5f446b9c-233a-493f-a1b0-317b95ac581d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5f446b9c-233a-493f-a1b0-317b95ac581d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 24 01:17:24.136326 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13e42b93-a014-4a9f-8543-299f26111c0a tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13e42b93-a014-4a9f-8543-299f26111c0a tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.165465 Jul 24 01:17:24.139599 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1049/1989] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:17:24.156824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85288c0b-ac66-430f-8dc3-928ff85f910f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1502 microversion: 2.1 time: 0.339250 Jul 24 01:17:24.158362 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 941/1990] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:23 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:24.167660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a156482-2a75-4125-8c6f-6d0ce3067147 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eab64700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1005634881", "description": "tempest-description-417014328"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:24.168649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:24.169538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:24.176034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:24.176786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:24.178104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:24.178656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:24.522438 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a156482-2a75-4125-8c6f-6d0ce3067147 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.372830 Jul 24 01:17:24.532646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:24.533559 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1050/1991] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:17:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:24.538835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fb364b68-5a52-4b87-bc35-92833a062a94 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:24.544273 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b87c6b62-469d-431b-8e18-f28c0c50aafa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.380265 Jul 24 01:17:24.544919 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 942/1992] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:24 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:24.549723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:24.550571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:24.558331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:24.559813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb364b68-5a52-4b87-bc35-92833a062a94 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:24.560266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:24.561272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:24.561459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb364b68-5a52-4b87-bc35-92833a062a94 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:24.562084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:24.662209 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fb364b68-5a52-4b87-bc35-92833a062a94 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Going to try to stop instance {{(pid=119561) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:17:24.740831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:24.742604 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fb364b68-5a52-4b87-bc35-92833a062a94 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40/action" status: 202 len: 0 microversion: 2.1 time: 0.206926 Jul 24 01:17:24.744727 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1051/1993] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:17:24 2022] POST /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:24.750956 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72f83d8e-28b7-4fe5-b110-a732db661ebc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1523 microversion: 2.1 time: 0.204694 Jul 24 01:17:24.752962 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 943/1994] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:24 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:24.753242 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0099cd57-ed2b-491e-8f8d-2c0517635f8f tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eac30790>, body: {"security_group_rule": {"parent_group_id": "06ca6271-cae2-43d0-826e-1cc885b7dc9f", "ip_protocol": "tcp", "from_port": 22, "to_port": 594568083}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:24.757810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:24.758549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:24.781326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:24.781958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:24.782978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:24.784198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:24.847263 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-0099cd57-ed2b-491e-8f8d-2c0517635f8f tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: Invalid port range 22:594568083. Valid TCP ports should be between 1-65535 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0099cd57-ed2b-491e-8f8d-2c0517635f8f tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 145 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: {"security_group_rule": {"parent_group_id": "06ca6271-cae2-43d0-826e-1cc885b7dc9f", "ip_protocol": "tcp", "from_port": 22, "to_port": 594568083}} Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid port range 22:594568083. Valid TCP ports should be between 1-65535 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'security_group_rule': {'parent_group_id': '06ca6271-cae2-43d0-826e-1cc885b7dc9f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 594568083}}} Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:594568083. Valid TCP ports should be between 1-65535 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:594568083. Valid TCP ports should be between 1-65535 Jul 24 01:17:24.848979 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:594568083. Valid TCP ports should be between 1-65535 Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0099cd57-ed2b-491e-8f8d-2c0517635f8f tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 400 to user: Invalid port range 22:594568083. Valid TCP ports should be between 1-65535 {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:24.854047 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0099cd57-ed2b-491e-8f8d-2c0517635f8f tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.103693 Jul 24 01:17:24.858854 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1052/1995] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:24 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:17:24.867390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6831c7d5-a070-4e80-bd7f-d2943d58976b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Action: 'create', calling method: .version_select at 0x7f05eac640d0>, body: {"security_group_rule": {"parent_group_id": "1e7260f6-8a36-42d4-8a63-294f41cabacf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:24.903367 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-6831c7d5-a070-4e80-bd7f-d2943d58976b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:24.904124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-6831c7d5-a070-4e80-bd7f-d2943d58976b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Neutron security group 1e7260f6-8a36-42d4-8a63-294f41cabacf not found {{(pid=119561) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 24 01:17:24.904824 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6831c7d5-a070-4e80-bd7f-d2943d58976b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist Jul 24 01:17:24.904824 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-7eb117d9-1bcc-4928-8ffc-55cac3616d39'] Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6831c7d5-a070-4e80-bd7f-d2943d58976b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 138 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: {"security_group_rule": {"parent_group_id": "1e7260f6-8a36-42d4-8a63-294f41cabacf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: exception: Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-7eb117d9-1bcc-4928-8ffc-55cac3616d39'] Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1e7260f6-8a36-42d4-8a63-294f41cabacf', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:24.907298 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb117d9-1bcc-4928-8ffc-55cac3616d39'] Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb117d9-1bcc-4928-8ffc-55cac3616d39'] Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb117d9-1bcc-4928-8ffc-55cac3616d39'] Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb117d9-1bcc-4928-8ffc-55cac3616d39'] Jul 24 01:17:24.910560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:24.916728 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6831c7d5-a070-4e80-bd7f-d2943d58976b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 404 to user: Security group 1e7260f6-8a36-42d4-8a63-294f41cabacf does not exist Jul 24 01:17:24.916728 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-7eb117d9-1bcc-4928-8ffc-55cac3616d39'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:24.917613 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6831c7d5-a070-4e80-bd7f-d2943d58976b tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.057692 Jul 24 01:17:24.922337 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1053/1996] 10.222.0.27 () {60 vars in 1194 bytes} [Sun Jul 24 01:17:24 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:24.927414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-982340ff-9995-4e8b-842a-63b0361de6e3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Calling method '.version_select at 0x7f05eab7da60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:24.981817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:25.004812 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-512c8010-4c53-4c0e-a9ed-8319d2fa93e5 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.247270 Jul 24 01:17:25.007051 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-982340ff-9995-4e8b-842a-63b0361de6e3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:17:25.007769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-982340ff-9995-4e8b-842a-63b0361de6e3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Neutron security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 not found {{(pid=119561) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 24 01:17:25.008564 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-982340ff-9995-4e8b-842a-63b0361de6e3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] HTTP exception thrown: Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist Jul 24 01:17:25.008564 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-58e063ce-a18b-4b84-b3f2-20a1a56e4a82'] Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-982340ff-9995-4e8b-842a-63b0361de6e3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Request method failure captured: Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-security-group-rules/32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 HTTP/1.1 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2gKKTjQ4FsUtNygYkyfmvwV8z9N5H5ZGDZ5Kuhj2-PKgYoCcvmxEHZbH7xNi0DVwMv_RJlRDYqSb-twktPvGArrca-TlMCVK28GChKoOS1b3U-_XFnrhw7eJxVemjJpS_Et07noBAc-wJvF5-IjUJcw5QDcH4eSqm8_VgpPUe_-58 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf158623293e4d54b3201f00944210b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf158623293e4d54b3201f00944210b2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf158623293e4d54b3201f00944210b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bf158623293e4d54b3201f00944210b2 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 256fc6648338427d83aeb6b6c9697877 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: exception: Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-58e063ce-a18b-4b84-b3f2-20a1a56e4a82'] Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '32c2a4d8-e9da-40dc-a89f-cd84c1493ae3'} Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:17:25.011240 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58e063ce-a18b-4b84-b3f2-20a1a56e4a82'] Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58e063ce-a18b-4b84-b3f2-20a1a56e4a82'] Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58e063ce-a18b-4b84-b3f2-20a1a56e4a82'] Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58e063ce-a18b-4b84-b3f2-20a1a56e4a82'] Jul 24 01:17:25.014641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:25.016874 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-982340ff-9995-4e8b-842a-63b0361de6e3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Returning 404 to user: Security group rule 32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 does not exist Jul 24 01:17:25.016874 n-d-master-1 devstack@n-api.service[119561]: Neutron server returns request_ids: ['req-58e063ce-a18b-4b84-b3f2-20a1a56e4a82'] {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:25.017723 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-982340ff-9995-4e8b-842a-63b0361de6e3 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/32c2a4d8-e9da-40dc-a89f-cd84c1493ae3" status: 404 len: 199 microversion: 2.1 time: 0.094095 Jul 24 01:17:25.019167 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1054/1997] 10.222.0.27 () {58 vars in 1286 bytes} [Sun Jul 24 01:17:24 2022] DELETE /compute/v2.1/os-security-group-rules/32c2a4d8-e9da-40dc-a89f-cd84c1493ae3 => generated 199 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:17:25.019972 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 944/1998] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:24 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:25.038894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-957485f4-f0aa-4fd3-a5c3-453da9d45724 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Calling method '.version_select at 0x7f05eab5ddc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:25.088074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6bfa9c5a-6518-4ec5-add2-4647eb478261 req-2493a774-ddb1-4f03-ae1e-03a8ca19964b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98477c05-8901-4a3a-b18f-6a5923ce55be", "tag": "163c75d2-aa99-4bba-9669-3f08ef39dfc7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:25.112329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6bfa9c5a-6518-4ec5-add2-4647eb478261 req-2493a774-ddb1-4f03-ae1e-03a8ca19964b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:25.136260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6bfa9c5a-6518-4ec5-add2-4647eb478261 req-2493a774-ddb1-4f03-ae1e-03a8ca19964b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:25.178146 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6bfa9c5a-6518-4ec5-add2-4647eb478261 req-2493a774-ddb1-4f03-ae1e-03a8ca19964b service nova] Creating event network-changed:163c75d2-aa99-4bba-9669-3f08ef39dfc7 for instance 98477c05-8901-4a3a-b18f-6a5923ce55be on n-h1-master-1 Jul 24 01:17:25.199259 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6bfa9c5a-6518-4ec5-add2-4647eb478261 req-2493a774-ddb1-4f03-ae1e-03a8ca19964b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118448 Jul 24 01:17:25.210145 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 945/1999] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:25.337866 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-957485f4-f0aa-4fd3-a5c3-453da9d45724 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/06ca6271-cae2-43d0-826e-1cc885b7dc9f" status: 202 len: 0 microversion: 2.1 time: 0.309003 Jul 24 01:17:25.338946 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1055/2000] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:25 2022] DELETE /compute/v2.1/os-security-groups/06ca6271-cae2-43d0-826e-1cc885b7dc9f => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:25.349069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0a9d969f-ec4c-47fe-b173-4930ceaf2e24 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Calling method '.version_select at 0x7f05eafb0940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:25.564833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:25.566346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:25.585444 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:25.585941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:25.587680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:25.588281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:25.735249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0a9d969f-ec4c-47fe-b173-4930ceaf2e24 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5f446b9c-233a-493f-a1b0-317b95ac581d" status: 202 len: 0 microversion: 2.1 time: 0.391440 Jul 24 01:17:25.736525 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 946/2001] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:25 2022] DELETE /compute/v2.1/os-security-groups/5f446b9c-233a-493f-a1b0-317b95ac581d => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:25.746013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-563027df-4ac3-488b-bb99-4725b5af125a tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Calling method '.version_select at 0x7f05eafb0310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:26.055634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:26.074168 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63246e7e-1110-46f6-bb8a-d72741ee9a09 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.513025 Jul 24 01:17:26.077110 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1056/2002] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:25 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:26.093881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:26.094654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:26.112855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:26.114716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:26.115705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:26.116156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:26.321024 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-563027df-4ac3-488b-bb99-4725b5af125a tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d4a6fb90-5f0a-4ff6-a439-37c43d1d2bed" status: 202 len: 0 microversion: 2.1 time: 0.580280 Jul 24 01:17:26.322732 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 947/2003] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:25 2022] DELETE /compute/v2.1/os-security-groups/d4a6fb90-5f0a-4ff6-a439-37c43d1d2bed => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:26.329031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:26.331712 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:26.360316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:26.360981 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:26.361867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:26.362353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:26.543255 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:26.571467 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ad87cf6-b6d7-4cb7-860f-0af8a0b5b123 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1508 microversion: 2.1 time: 0.493079 Jul 24 01:17:26.576525 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1057/2004] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:26 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1508 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:26.590951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-96860d49-9388-4a1d-8777-a05223fe0662 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Calling method '.version_select at 0x7f05eab3a1f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:26.687544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:26.703918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c6573db9-e02c-4188-b69f-4cc49b9db623 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.379358 Jul 24 01:17:26.714756 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 948/2005] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:26 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:26.744559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:26.746176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:26.760027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:26.761054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:26.763742 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:26.764602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:27.057791 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-96860d49-9388-4a1d-8777-a05223fe0662 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3db1222b-e3c3-480c-9915-86e2e5348ce0" status: 202 len: 0 microversion: 2.1 time: 0.479729 Jul 24 01:17:27.058455 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1058/2006] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:26 2022] DELETE /compute/v2.1/os-security-groups/3db1222b-e3c3-480c-9915-86e2e5348ce0 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:27.068722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13a78109-0782-4e9e-8a54-abfe6829a143 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] Calling method '.version_select at 0x7f05eab3a670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:27.176166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:27.193305 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16eacc4a-3cc8-4b5b-a2fa-7cd135777203 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 200 len: 1508 microversion: 2.1 time: 0.474529 Jul 24 01:17:27.205546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 949/2007] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:26 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:27.211401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:27.212664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:27.225303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:27.226103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:27.227820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:27.228682 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:27.490960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:27.500688 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-decae3f9-ab2c-4055-a5bd-5882906bd4f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.305670 Jul 24 01:17:27.501623 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 950/2008] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:27 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:27.501749 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13a78109-0782-4e9e-8a54-abfe6829a143 tempest-SecurityGroupRulesNegativeTestJSON-1253638945 tempest-SecurityGroupRulesNegativeTestJSON-1253638945-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e16e6050-eaa1-4067-973b-ab149d62bc0b" status: 202 len: 0 microversion: 2.1 time: 0.438631 Jul 24 01:17:27.506363 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1059/2009] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:17:27 2022] DELETE /compute/v2.1/os-security-groups/e16e6050-eaa1-4067-973b-ab149d62bc0b => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:17:27.507163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:27.507810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:27.516393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:27.517104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:27.518143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:27.518784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:27.562605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:27.658386 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1bce80d5-c84d-40fe-9e63-f12d255d1392 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 204 len: 0 microversion: 2.1 time: 0.154984 Jul 24 01:17:27.662968 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 951/2010] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:27 2022] DELETE /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:27.726348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:27.727601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:27.739626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:27.741295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:27.744029 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:27.747568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:27.816403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1770067140", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "99bb338c-d9a7-432c-8774-bf59134c3ffb"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:27.887095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] validate_networks() for [('99bb338c-d9a7-432c-8774-bf59134c3ffb', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:28.299789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:28.327263 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-90d64630-c69b-4543-b1b9-75a96721cd27 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.606863 Jul 24 01:17:28.328065 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1060/2011] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:27 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:28.519706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:28.522525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:28.531909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:28.533602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:28.535622 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:28.537160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:28.705801 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:28.940862 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:29.064393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:29.076440 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-803e9757-df18-436d-8f24-39c40ec65338 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.561198 Jul 24 01:17:29.077714 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1061/2012] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:28 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:29.344902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:29.345910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:29.355078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:29.355654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:29.356659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:29.357168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:29.650704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:29.651344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:29.652003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:29.652554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:29.653295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:29.674423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:29.682081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:29.683221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:29.683806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:29.722460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Getting quotas for project faa16a8779184f18afc0118c7581b9b9. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:29.737048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Getting quotas for user 3428b2650a774c998b63ed06114872b0 and project faa16a8779184f18afc0118c7581b9b9. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:29.765194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:29.768714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:29.827286 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fe98f81f-12a9-41ae-b1ac-350c69d5cd3d tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018847 Jul 24 01:17:29.833737 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 952/2013] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:17:29.839140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76af8257-fb1a-4daf-9ed4-405bd54ca2c1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:29.840225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-76af8257-fb1a-4daf-9ed4-405bd54ca2c1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:29.949456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:29.959100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-76af8257-fb1a-4daf-9ed4-405bd54ca2c1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:29.963781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0591880d-2ea0-441f-8028-8444505fbd6f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.623349 Jul 24 01:17:29.969249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76af8257-fb1a-4daf-9ed4-405bd54ca2c1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1218 microversion: 2.1 time: 0.134031 Jul 24 01:17:29.973825 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1062/2014] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:29 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:29.982044 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 953/2015] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:29 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:30.095001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:30.095714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:30.109314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:30.109800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:30.110583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:30.111020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:30.749741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:30.768114 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d92d03a-29c4-4f39-ae25-caf8a65f9f65 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.673294 Jul 24 01:17:30.768936 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1063/2016] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:30 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:30.892470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-27dae0f0-a62f-4523-8519-eb1d861109e6 req-987bd120-6103-4afc-8694-25de53707309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0158e48-08e8-45ed-8d5b-0b111804db53", "name": "network-vif-deleted", "tag": "e27ff98b-fed4-4f66-ae66-5f45d4f089aa"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:30.917957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-27dae0f0-a62f-4523-8519-eb1d861109e6 req-987bd120-6103-4afc-8694-25de53707309 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:30.918457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-27dae0f0-a62f-4523-8519-eb1d861109e6 req-987bd120-6103-4afc-8694-25de53707309 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:30.934646 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-27dae0f0-a62f-4523-8519-eb1d861109e6 req-987bd120-6103-4afc-8694-25de53707309 service nova] Creating event network-vif-deleted:e27ff98b-fed4-4f66-ae66-5f45d4f089aa for instance f0158e48-08e8-45ed-8d5b-0b111804db53 on n-h2-master-1 Jul 24 01:17:30.940814 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-27dae0f0-a62f-4523-8519-eb1d861109e6 req-987bd120-6103-4afc-8694-25de53707309 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053069 Jul 24 01:17:30.945425 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 954/2017] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:30.984961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:30.985506 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:30.992207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:30.992709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:30.992868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:30.993169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:30.995775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:30.998537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:31.016507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:31.017180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:31.019692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:31.021885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:31.254895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:31.263775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-55e93fc1-bd01-4e23-ba81-06e0e08926d1 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1270 microversion: 2.1 time: 0.279223 Jul 24 01:17:31.268977 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 955/2018] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:30 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:31.508521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:31.518597 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a8b0ff2-629c-4fa9-98d0-324848f20bf1 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.542048 Jul 24 01:17:31.529519 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1064/2019] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:30 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:31.788693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:31.789209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:31.816047 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:31.816505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:31.817614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:31.818221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:32.275390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:32.286031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:32.286903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:32.297714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:32.298643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:32.301879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:32.302669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:32.324125 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd4eddce-0a31-4be6-bc60-be215562b225 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.543322 Jul 24 01:17:32.325535 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 956/2020] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:31 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:32.555082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:32.560585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:32.563638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:32.583487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:32.584047 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-928b6cd2-65fa-4e39-a15c-447e79a781b4 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1276 microversion: 2.1 time: 0.297927 Jul 24 01:17:32.584922 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1065/2021] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:32 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:32.585812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:32.587937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:32.588613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:32.922064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-22660c6b-fd44-432e-aac2-4efdf27f4a48 req-8e4c778a-651f-4f1e-b28c-c4e8a3b3d029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98477c05-8901-4a3a-b18f-6a5923ce55be", "name": "network-vif-plugged", "status": "completed", "tag": "163c75d2-aa99-4bba-9669-3f08ef39dfc7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:32.948344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-22660c6b-fd44-432e-aac2-4efdf27f4a48 req-8e4c778a-651f-4f1e-b28c-c4e8a3b3d029 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:32.949506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-22660c6b-fd44-432e-aac2-4efdf27f4a48 req-8e4c778a-651f-4f1e-b28c-c4e8a3b3d029 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:32.987017 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:33.023320 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-22660c6b-fd44-432e-aac2-4efdf27f4a48 req-8e4c778a-651f-4f1e-b28c-c4e8a3b3d029 service nova] Creating event network-vif-plugged:163c75d2-aa99-4bba-9669-3f08ef39dfc7 for instance 98477c05-8901-4a3a-b18f-6a5923ce55be on n-h1-master-1 Jul 24 01:17:33.044664 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-22660c6b-fd44-432e-aac2-4efdf27f4a48 req-8e4c778a-651f-4f1e-b28c-c4e8a3b3d029 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117231 Jul 24 01:17:33.045883 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1066/2022] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:33.318232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:33.329262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-959c6670-1d97-468f-b5d2-008c5924926d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.793993 Jul 24 01:17:33.340852 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 957/2023] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:32 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:33.350406 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:33.351373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:33.367496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:33.373422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:33.374504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:33.375120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:33.631971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:33.637651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:33.675389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:33.675858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:33.676691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:33.677134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:33.955239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:33.975089 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-220268e9-4650-4d09-8262-3eea843ec5ed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1316 microversion: 2.1 time: 0.628962 Jul 24 01:17:33.976092 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1067/2024] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:33 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:34.034153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:34.039810 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:34.067706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43c57cb2-5d35-4a5a-affb-0939673237db tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1318 microversion: 2.1 time: 0.463318 Jul 24 01:17:34.069402 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 958/2025] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:33 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:34.350161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:34.351629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:34.362843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:34.363699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:34.364525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:34.364963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:34.598266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7433162e-7ec5-4729-9cef-79f896ce237f req-387a0872-744e-4c5b-8cba-6dba60b6f3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06cf0e2e-9a04-437d-aad1-05eb7e2d90a5", "tag": "fae422eb-cabe-4f81-b66b-df0499fd1921"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:34.620307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7433162e-7ec5-4729-9cef-79f896ce237f req-387a0872-744e-4c5b-8cba-6dba60b6f3ba service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:34.622167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7433162e-7ec5-4729-9cef-79f896ce237f req-387a0872-744e-4c5b-8cba-6dba60b6f3ba service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:34.653054 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7433162e-7ec5-4729-9cef-79f896ce237f req-387a0872-744e-4c5b-8cba-6dba60b6f3ba service nova] Creating event network-changed:fae422eb-cabe-4f81-b66b-df0499fd1921 for instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 on n-h2-master-1 Jul 24 01:17:34.661915 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7433162e-7ec5-4729-9cef-79f896ce237f req-387a0872-744e-4c5b-8cba-6dba60b6f3ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068949 Jul 24 01:17:34.667410 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 959/2026] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:34.998261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:35.000945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:35.022602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:35.023525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:35.030670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:35.031143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:35.455133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:35.463008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:35.498350 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d678761-f538-48f7-aec6-e9800e44c953 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1465 microversion: 2.1 time: 0.507612 Jul 24 01:17:35.498956 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 960/2027] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:34 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1465 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:35.518984 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f5b6a4c5-111e-4990-85d3-211e10e2694c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 1.174010 Jul 24 01:17:35.524829 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1068/2028] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:34 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:35.525790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:35.526874 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:35.535110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:35.538222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:35.539431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:35.540501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:35.767832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9edbd39b-6070-4da9-95f9-b38200edb485 tempest-ListImagesTestJSON-1102052664 tempest-ListImagesTestJSON-1102052664-project] Calling method '.version_select at 0x7f05eab3aee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:35.824296 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9edbd39b-6070-4da9-95f9-b38200edb485 tempest-ListImagesTestJSON-1102052664 tempest-ListImagesTestJSON-1102052664-project] 10.222.0.27 "GET /compute/v2.1/images/9fcc346b-5e09-42b6-9557-a6eb28d96f08" status: 200 len: 784 microversion: 2.1 time: 0.297765 Jul 24 01:17:35.825211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1069/2029] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:35 2022] GET /compute/v2.1/images/9fcc346b-5e09-42b6-9557-a6eb28d96f08 => generated 784 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:35.866764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:35.882501 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1becc01c-11a2-4e67-83b4-e38ed5a4922a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1318 microversion: 2.1 time: 0.374335 Jul 24 01:17:35.882501 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 961/2030] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:35 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:35.887174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b0c1cea-df7f-4210-aafe-bf56ad38423c tempest-ListImagesTestJSON-1102052664 tempest-ListImagesTestJSON-1102052664-project] Calling method '.version_select at 0x7f05eaf3ea60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:36.026879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c897270b-31c9-4bcc-9b1e-ee018f98e0e1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:36.027901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c897270b-31c9-4bcc-9b1e-ee018f98e0e1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:36.031678 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:36.036921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c897270b-31c9-4bcc-9b1e-ee018f98e0e1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:36.037759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c897270b-31c9-4bcc-9b1e-ee018f98e0e1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:36.038702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c897270b-31c9-4bcc-9b1e-ee018f98e0e1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:36.039281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c897270b-31c9-4bcc-9b1e-ee018f98e0e1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:36.040867 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b0c1cea-df7f-4210-aafe-bf56ad38423c tempest-ListImagesTestJSON-1102052664 tempest-ListImagesTestJSON-1102052664-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.158904 Jul 24 01:17:36.041572 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 962/2031] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:35 2022] GET /compute/v2.1/images => generated 445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:36.054278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81c15eaa-9838-43f4-aa3c-c6121f9645bc tempest-ListImagesTestJSON-1102052664 tempest-ListImagesTestJSON-1102052664-project] Calling method '.version_select at 0x7f05eafb0160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:36.133886 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81c15eaa-9838-43f4-aa3c-c6121f9645bc tempest-ListImagesTestJSON-1102052664 tempest-ListImagesTestJSON-1102052664-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.084439 Jul 24 01:17:36.142135 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 963/2032] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:17:36 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:36.552766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:36.553403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:36.561400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:36.566414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:36.567367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:36.567842 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:36.685422 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c897270b-31c9-4bcc-9b1e-ee018f98e0e1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1616 microversion: 2.1 time: 0.858606 Jul 24 01:17:36.699283 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1070/2033] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:35 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1616 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:36.704954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9da33c00-ba08-48f9-be35-79aee18ed9da tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: .version_select at 0x7f05eac308b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1278270805", "policies": ["affinity"]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:36.725160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9da33c00-ba08-48f9-be35-79aee18ed9da tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:36.732227 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9da33c00-ba08-48f9-be35-79aee18ed9da tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:36.796773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9da33c00-ba08-48f9-be35-79aee18ed9da tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:36.804122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9da33c00-ba08-48f9-be35-79aee18ed9da tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:36.826269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9da33c00-ba08-48f9-be35-79aee18ed9da tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.125167 Jul 24 01:17:36.827225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1071/2034] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:17:36 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:36.857278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:36.869191 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f03fd279-4c1d-4fba-9f47-60414c32ec61 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.319506 Jul 24 01:17:36.870856 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 964/2035] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:36 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:36.896464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:36.897517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:36.905364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:36.906277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:36.907328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:36.908093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:36.984653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-8987176", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e0f753e6-2886-487e-9947-2b26d594dfe2"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:37.060059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:37.359240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:37.367665 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58fe618c-23af-4bfd-859e-f569935b172a tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1318 microversion: 2.1 time: 0.476281 Jul 24 01:17:37.377471 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1072/2036] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:36 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:37.652734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:37.653177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:37.653647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:37.654288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:37.654713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:37.735794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:37.736772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:37.737896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:37.738488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:37.763482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:37.770475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:37.798861 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:37.807686 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Going to run 2 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:37.810132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:37.857560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119562) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 24 01:17:37.887585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:37.888245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:37.901109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:37.902402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:37.902973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:37.904312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:37.906181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:37.914063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:38.014707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:38.022974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:38.040692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=9a0809a9-f990-4818-ba3e-4b027c1dda81,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:38.163031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:38.185556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:38.190646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:38.196660 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dfc47a50-e4c7-4d46-a587-5ebcaa021bc6 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.312528 Jul 24 01:17:38.198365 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1073/2037] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:37 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:38.259978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:38.268367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:38.384777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:38.385413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:38.400165 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1db0cd6a-a717-4541-8d6f-64ab2fd0f943 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.413400 Jul 24 01:17:38.402144 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 965/2038] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 1421 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 24 01:17:38.402837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:38.403300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:38.410673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:38.411218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:38.418459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:38.423714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:38.424417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Searching by: {'deleted': False, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:17:38.528008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:38.529366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:38.532525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:38.535337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:38.742905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:17:38.824287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:38.838429 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f6f17c8-2d44-4f94-9023-a6bad0fffafc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1318 microversion: 2.1 time: 0.457685 Jul 24 01:17:38.846696 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1074/2039] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:38 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:38.895142 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b2774541-2702-4eb5-85c0-fa1a3da4875b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 997 microversion: 2.1 time: 0.488034 Jul 24 01:17:38.895930 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 966/2040] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:17:38 2022] GET /compute/v2.1/servers => generated 997 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:38.907100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9549eafb-b9ba-45da-a2fd-53a342937920 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:38.907862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9549eafb-b9ba-45da-a2fd-53a342937920 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:39.015754 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9549eafb-b9ba-45da-a2fd-53a342937920 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:39.023482 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9549eafb-b9ba-45da-a2fd-53a342937920 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1216 microversion: 2.1 time: 0.120607 Jul 24 01:17:39.024084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1075/2041] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:38 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:39.215302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:39.216153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:39.229094 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:39.230822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:39.233294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:39.235755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:39.262248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e71ae88-89d4-4854-b830-ca33c68244cb tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Calling method '.version_select at 0x7f05eaf4ac10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:39.298397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e71ae88-89d4-4854-b830-ca33c68244cb tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:39.299031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e71ae88-89d4-4854-b830-ca33c68244cb tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:39.299916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e71ae88-89d4-4854-b830-ca33c68244cb tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:39.302078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e71ae88-89d4-4854-b830-ca33c68244cb tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:39.394283 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e71ae88-89d4-4854-b830-ca33c68244cb tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.300865 Jul 24 01:17:39.404340 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 967/2042] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:39.495637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-264378718", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:39.590654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:39.611207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:39.619474 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff2c420f-7b08-4c1e-85d7-43ca72d32bef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.408545 Jul 24 01:17:39.620640 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1076/2043] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:39 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:39.864982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:39.865787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:39.877638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:39.879281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:39.889155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:39.890857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:40.052458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Getting quotas for project a2eccf3ec34c4f978207110d7f2114d5. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:40.065816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Getting quotas for user a656fbb600454a9a9916116092a26b24 and project a2eccf3ec34c4f978207110d7f2114d5. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:40.098037 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Request method failure captured: Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 1751 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2yLxstuq9bzupsUA6HzjterVIm-S8x1dgo1PjxGjB3ri3Tv8-90xALO4GZG7RbIW2q_gQzcnwb5Boc2c1T413uZ_w6YdjyveXoENqFt2fAaGWo0gGfwkxvgKKc4_pRUQx8N7uqnlEnHgO5im3nqPwuC4ELWHglh41-AXdCkejabvc Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a2eccf3ec34c4f978207110d7f2114d5 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1707286249 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2eccf3ec34c4f978207110d7f2114d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2eccf3ec34c4f978207110d7f2114d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2eccf3ec34c4f978207110d7f2114d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2eccf3ec34c4f978207110d7f2114d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1707286249 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a2eccf3ec34c4f978207110d7f2114d5 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1707286249 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a656fbb600454a9a9916116092a26b24 Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-264378718", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:17:40.100339 n-d-master-1 devstack@n-api.service[119562]: exception: Maximum number of metadata items exceeds 128 Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-264378718', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:40.103726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:17:40.105940 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:40.114565 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f48a4b40-83ce-4161-953e-8e5029a09136 tempest-AbsoluteLimitsNegativeTestJSON-1707286249 tempest-AbsoluteLimitsNegativeTestJSON-1707286249-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.611073 Jul 24 01:17:40.116065 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 968/2044] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Jul 24 01:17:39 2022] POST /compute/v2.1/servers => generated 87 bytes in 625 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:17:40.128079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:40.131657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:40.155139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:40.155656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:40.156619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:40.156941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:40.322702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:40.335230 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-055c424e-99f2-41a1-b77a-a0b30a101a26 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1212 microversion: 2.1 time: 0.217141 Jul 24 01:17:40.335820 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 969/2045] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:40 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1212 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:40.348200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:40.363069 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c800f7f4-d83e-4686-a431-367860ab2ca9 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1318 microversion: 2.1 time: 0.502459 Jul 24 01:17:40.363998 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1077/2046] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:39 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:40.637643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:40.638616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:40.646627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:40.647403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:40.648411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:40.650434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:40.871204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:40.913469 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-842291cb-67ca-4161-a161-186d73a8abf4 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.280755 Jul 24 01:17:40.914858 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 970/2047] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:40 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:41.133638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c39f5dc5-3eec-4bfe-b2f5-b088eb31a009 req-7854001d-27a1-41de-ae84-49483a251afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf0e2e-9a04-437d-aad1-05eb7e2d90a5", "name": "network-vif-plugged", "status": "completed", "tag": "fae422eb-cabe-4f81-b66b-df0499fd1921"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:41.172399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c39f5dc5-3eec-4bfe-b2f5-b088eb31a009 req-7854001d-27a1-41de-ae84-49483a251afe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:41.173020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c39f5dc5-3eec-4bfe-b2f5-b088eb31a009 req-7854001d-27a1-41de-ae84-49483a251afe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:41.210204 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c39f5dc5-3eec-4bfe-b2f5-b088eb31a009 req-7854001d-27a1-41de-ae84-49483a251afe service nova] Creating event network-vif-plugged:fae422eb-cabe-4f81-b66b-df0499fd1921 for instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 on n-h2-master-1 Jul 24 01:17:41.219457 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c39f5dc5-3eec-4bfe-b2f5-b088eb31a009 req-7854001d-27a1-41de-ae84-49483a251afe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090273 Jul 24 01:17:41.222580 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1078/2048] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:41.362962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:41.364345 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:41.384625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:41.385096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:41.390929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:41.391805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:41.392648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:41.397148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:41.423543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:41.424339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:41.426514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:41.426952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:41.559514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:41.577081 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1aed67eb-427f-4bf8-8c60-7d3fb032b205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1286 microversion: 2.1 time: 0.224937 Jul 24 01:17:41.590715 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 971/2049] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:41 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:41.785169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:41.795496 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00a52f73-0784-44af-9899-3a78ee9e8019 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1318 microversion: 2.1 time: 0.414809 Jul 24 01:17:41.796248 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1079/2050] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:41 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:41.931419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:41.932319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:41.940638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:41.941088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:41.941906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:41.942509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:42.180861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:42.190371 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b367bcf-4a9e-4983-a2a5-519dfd058c3a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.263236 Jul 24 01:17:42.196159 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 972/2051] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:41 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:42.596490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:42.597279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:42.627792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:42.628592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:42.629875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:42.630507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:42.719550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:42.733451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ac49c47-2a41-4b7f-899f-673285ddba9e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1274 microversion: 2.1 time: 0.141639 Jul 24 01:17:42.744934 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1080/2052] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:42 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:42.814574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:42.815489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:42.835688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:42.836149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:42.851612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:42.854591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:43.221281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:43.223200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:43.228036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:43.239046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:43.239828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:43.240205 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92c5a105-be07-4f7b-b4cc-3b5e88dfffa5 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1318 microversion: 2.1 time: 0.430056 Jul 24 01:17:43.241043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:43.243903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:43.244467 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 973/2053] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:42 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:43.633580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:43.648078 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba45487b-49f8-420e-908a-9e719af18501 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.431257 Jul 24 01:17:43.650507 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1081/2054] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:43 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:43.754292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:43.755971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:43.768605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:43.769288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:43.771356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:43.772170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:43.963210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:43.989379 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8fda8188-1291-4bee-87dd-2ba996fa0ecd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1274 microversion: 2.1 time: 0.241288 Jul 24 01:17:43.995960 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 974/2055] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:43 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:44.268881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:44.270049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:44.286733 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:44.287565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:44.292544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:44.293978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:44.666944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:44.668115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:44.681001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:44.687958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:44.689112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:44.689695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:44.785736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:44.794786 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-75d35585-a574-4910-aa67-5182e0ee70cd tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1508 microversion: 2.1 time: 0.533903 Jul 24 01:17:44.807217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1082/2056] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:44 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1508 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:44.814627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:44.815524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:44.823782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:44.824440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:44.825916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:44.826511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:45.077044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:45.094253 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f7d6c90b-b9df-4403-8061-e8486e1032cd tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.431033 Jul 24 01:17:45.097125 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 975/2057] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:44 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:45.140117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:45.141323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:45.158019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:45.159032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:45.160899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:45.162751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:45.236472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:45.262634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33c00d1d-c8d2-4750-8355-3d2dc962a805 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1508 microversion: 2.1 time: 0.453707 Jul 24 01:17:45.263782 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1083/2058] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:44 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:45.282410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24c77ed7-ef2a-4991-891b-42da872e0fd7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:45.284688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24c77ed7-ef2a-4991-891b-42da872e0fd7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:45.307578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c77ed7-ef2a-4991-891b-42da872e0fd7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:45.317152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c77ed7-ef2a-4991-891b-42da872e0fd7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:45.318970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c77ed7-ef2a-4991-891b-42da872e0fd7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:45.319757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24c77ed7-ef2a-4991-891b-42da872e0fd7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:45.419888 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24c77ed7-ef2a-4991-891b-42da872e0fd7 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "PUT /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1080 microversion: 2.1 time: 0.137172 Jul 24 01:17:45.421183 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1084/2059] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:17:45 2022] PUT /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1080 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:45.443139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:45.444065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:45.452314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:45.453023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:45.454035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:45.454781 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.247276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:46.256507 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b78657b6-e643-4e45-8214-cd86c629a767 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 1.156188 Jul 24 01:17:46.259504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:46.262841 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 976/2060] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:45 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:46.277154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:46.277988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:46.289483 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0b434de3-190f-4287-80f9-1ce096dd6f3b tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1506 microversion: 2.1 time: 0.851036 Jul 24 01:17:46.291425 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1085/2061] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:45 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1506 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:46.317148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.319085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.320631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.327914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.334150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:46.334818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:46.391995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.395868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.403137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:46.404185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:46.496748 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:46.959314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:46.987210 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2cdf9b8e-62ff-44e8-a7cb-8c72900f8057 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1506 microversion: 2.1 time: 0.683950 Jul 24 01:17:46.988513 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1086/2062] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:46 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1506 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:47.003307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:47.009016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0ac77451-01a0-4d3e-b622-116d26927330 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:47.014146 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-afd693f4-9a64-40e7-a288-d758685101e0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.743558 Jul 24 01:17:47.016280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0ac77451-01a0-4d3e-b622-116d26927330 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:47.033607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ac77451-01a0-4d3e-b622-116d26927330 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.033866 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 977/2063] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:46 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:47.034612 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ac77451-01a0-4d3e-b622-116d26927330 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.036100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ac77451-01a0-4d3e-b622-116d26927330 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.036692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ac77451-01a0-4d3e-b622-116d26927330 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.252063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0ac77451-01a0-4d3e-b622-116d26927330 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "PUT /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1082 microversion: 2.1 time: 0.250086 Jul 24 01:17:47.279305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:47.280487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:47.287115 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1087/2064] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:17:47 2022] PUT /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1082 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:47.304512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.307571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.309835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.312138 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.325279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:47.329638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:47.370475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.371293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.372591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.373223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.832253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:47.858714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:47.860715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1916039-cc92-4053-8dcc-8df7da6b4fc8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.586236 Jul 24 01:17:47.863628 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 978/2065] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:47 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:47.879379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2324c95b-253c-477b-89ac-4e9b12bd2079 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1508 microversion: 2.1 time: 0.580328 Jul 24 01:17:47.880318 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1088/2066] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:47 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:47.896820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:47.898329 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:47.908324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.912554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:47.914482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:47.917713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.031968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:48.032842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:48.039763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.041148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.042359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.042974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.583178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:48.598771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:48.621021 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1afe361d-175c-4e56-9608-7a081d8ce9fa tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.593124 Jul 24 01:17:48.622040 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d1bf7944-38ea-4cd4-b1a4-557efe53ce28 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1508 microversion: 2.1 time: 0.729122 Jul 24 01:17:48.626300 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1089/2068] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:48 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:48.626518 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 979/2068] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:47 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1508 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:48.641110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:48.641620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:48.657922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.658378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.666801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.667685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.737293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:48.882524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:48.884558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:48.905434 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:48.907437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.908310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.909940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:48.910531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:48.976181 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-778ef5c5-a508-412d-8948-d33bb556036c tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 204 len: 0 microversion: 2.1 time: 0.338518 Jul 24 01:17:48.978068 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1090/2069] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:48 2022] DELETE /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:48.983169 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:48.998228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:48.999345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:49.014155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.017401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.022471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.023175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.024584 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:49.107172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:49.212074 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.api [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Instance is already in deleting state, ignoring this request Jul 24 01:17:49.213180 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bde5b90c-1d39-4083-9127-c5e5119e9bef tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 204 len: 0 microversion: 2.1 time: 0.226764 Jul 24 01:17:49.218156 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1091/2070] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:48 2022] DELETE /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:49.223362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:49.223986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:49.241467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.241959 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.242858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.243443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.358803 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:49.719520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:49.758761 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aabc77ed-4eb9-4641-a172-53523d71f3a8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.881759 Jul 24 01:17:49.761716 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 980/2071] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:48 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:49.772074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-558d6b4e-d93e-4dfa-be2b-0b6dad3cb7ae req-5ddefc17-808b-4dea-8af0-fd6115d68c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0809a9-f990-4818-ba3e-4b027c1dda81", "tag": "18746ce2-1d8b-4e13-ab0a-b5a99febfce4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:49.791033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-558d6b4e-d93e-4dfa-be2b-0b6dad3cb7ae req-5ddefc17-808b-4dea-8af0-fd6115d68c79 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.793545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-558d6b4e-d93e-4dfa-be2b-0b6dad3cb7ae req-5ddefc17-808b-4dea-8af0-fd6115d68c79 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.806598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:49.817493 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5dab3e1f-df9a-4977-a4a0-d63f9daeecfe tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1514 microversion: 2.1 time: 0.597358 Jul 24 01:17:49.817743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-558d6b4e-d93e-4dfa-be2b-0b6dad3cb7ae req-5ddefc17-808b-4dea-8af0-fd6115d68c79 service nova] Creating event network-changed:18746ce2-1d8b-4e13-ab0a-b5a99febfce4 for instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 on n-h2-master-1 Jul 24 01:17:49.828393 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-558d6b4e-d93e-4dfa-be2b-0b6dad3cb7ae req-5ddefc17-808b-4dea-8af0-fd6115d68c79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064855 Jul 24 01:17:49.829626 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1092/2072] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:49 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1514 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:49.830035 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 981/2073] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:49.834911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:49.837536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:49.869256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.869756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:49.870564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:49.871011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:50.251265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:50.271735 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22fc949c-1ce9-4d02-a817-82d710c20b0a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.440566 Jul 24 01:17:50.272891 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1093/2074] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:49 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:50.781256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:50.782118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:50.797037 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=36 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:50.803438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:50.804002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:50.804918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:50.807461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:50.835715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:50.837170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:50.851521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:50.852566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:50.853733 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:50.860808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:52.065136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:52.080627 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5670cb7-eeb5-46c2-ac80-a5afb43b7f4a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 1.307712 Jul 24 01:17:52.082300 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 982/2075] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:50 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:52.098517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:52.103744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:52.117501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:52.119316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:52.122934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:52.123484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:52.128988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:52.138981 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df82375e-047f-42c4-abd8-79d3c1c7c934 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1514 microversion: 2.1 time: 1.307101 Jul 24 01:17:52.139806 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1094/2076] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:50 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1514 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:52.145934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e7a704ca-15f7-4ae0-a39a-2567f4092aa8 req-2fcbfeb8-c4de-4ffc-8fe1-ddd2091f9b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2c47ab3-2f33-40d3-ac91-04f30aa6f66e", "tag": "ec327e9a-f2a5-4ffc-abca-57b29b8b83fe"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:52.155609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e7a704ca-15f7-4ae0-a39a-2567f4092aa8 req-2fcbfeb8-c4de-4ffc-8fe1-ddd2091f9b3c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:52.156291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e7a704ca-15f7-4ae0-a39a-2567f4092aa8 req-2fcbfeb8-c4de-4ffc-8fe1-ddd2091f9b3c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:52.170517 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e7a704ca-15f7-4ae0-a39a-2567f4092aa8 req-2fcbfeb8-c4de-4ffc-8fe1-ddd2091f9b3c service nova] Creating event network-changed:ec327e9a-f2a5-4ffc-abca-57b29b8b83fe for instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e on n-h2-master-1 Jul 24 01:17:52.179202 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e7a704ca-15f7-4ae0-a39a-2567f4092aa8 req-2fcbfeb8-c4de-4ffc-8fe1-ddd2091f9b3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036312 Jul 24 01:17:52.181715 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1095/2077] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:52.683425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:52.701943 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79158333-51a1-407b-a82d-c4fd1d75af7f tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.617057 Jul 24 01:17:52.704446 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 983/2078] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:52 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:52.893924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1679758606", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "73894204-895d-4dcd-86a2-8fc47e1860a8"}, {"uuid": "3d06f0c2-ecbe-4dad-9ce2-7af641cdd219"}, {"uuid": "73894204-895d-4dcd-86a2-8fc47e1860a8"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:52.966814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] validate_networks() for [('73894204-895d-4dcd-86a2-8fc47e1860a8', None, None, None, None, None), ('3d06f0c2-ecbe-4dad-9ce2-7af641cdd219', None, None, None, None, None), ('73894204-895d-4dcd-86a2-8fc47e1860a8', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:17:53.106766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:53.107395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:53.121327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:53.126221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:53.127468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:53.128128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:53.954950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:53.964819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c33854e-55c5-48f5-8a74-72447fa398d3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.868905 Jul 24 01:17:53.965417 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 984/2079] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:53 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:17:53.981849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:53.988716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:54.000006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:54.001032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:54.002076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:54.002710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:54.039129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:54.040433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:54.041066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lazy-loading 'fault' on Instance uuid 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:54.179503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:54.193483 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-05f65837-c675-4cac-960d-c4023844c5cc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1308 microversion: 2.1 time: 0.220189 Jul 24 01:17:54.199527 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 985/2080] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:53 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:54.226419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:54.233985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:54.256919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:54.258321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:54.259510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:54.260174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.056511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:55.065002 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72756a8e-a42e-474d-9c20-defcd4bd549e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1512 microversion: 2.1 time: 0.862462 Jul 24 01:17:55.065590 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 986/2081] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:54 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1512 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:55.070546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4b21ff44-a75a-43ff-8f3c-8c22b87ca817 req-754fc2b9-6b08-4b4d-abce-e2622b7fdc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf0e2e-9a04-437d-aad1-05eb7e2d90a5", "name": "network-vif-deleted", "tag": "fae422eb-cabe-4f81-b66b-df0499fd1921"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:55.081874 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4b21ff44-a75a-43ff-8f3c-8c22b87ca817 req-754fc2b9-6b08-4b4d-abce-e2622b7fdc36 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.082571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4b21ff44-a75a-43ff-8f3c-8c22b87ca817 req-754fc2b9-6b08-4b4d-abce-e2622b7fdc36 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.097997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4b21ff44-a75a-43ff-8f3c-8c22b87ca817 req-754fc2b9-6b08-4b4d-abce-e2622b7fdc36 service nova] Creating event network-vif-deleted:fae422eb-cabe-4f81-b66b-df0499fd1921 for instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 on n-h2-master-1 Jul 24 01:17:55.109209 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4b21ff44-a75a-43ff-8f3c-8c22b87ca817 req-754fc2b9-6b08-4b4d-abce-e2622b7fdc36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041608 Jul 24 01:17:55.111346 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 987/2082] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:55.121872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:55.140668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:55.166261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.169994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.171346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.172285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.720594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:55.729241 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1927958e-c6b2-4a75-8826-4ad3f2191ac3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.615826 Jul 24 01:17:55.730161 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 988/2083] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:55 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:55.735663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:55.736219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:55.751419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.751860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.752650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.774762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.834196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:55.834196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:55.834196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lazy-loading 'fault' on Instance uuid 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:55.962293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3428b2650a774c998b63ed06114872b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16a8779184f18afc0118c7581b9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:55.970355 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff9da6e7-c29a-4453-804c-73945a593317 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 200 len: 1308 microversion: 2.1 time: 0.238973 Jul 24 01:17:55.975419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 989/2084] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:55 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:56.033170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:56.034124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:56.041371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.042168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.043181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.044023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.844457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:17:56.864793 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a8c6c6e0-5568-4efd-9e83-b357cada79a3 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 2345 microversion: 2.25 time: 0.835273 Jul 24 01:17:56.866607 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 990/2085] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:17:56 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 2345 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:17:56.873299 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:56.874382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:56.896766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.897528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.900363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.900814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.932507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:17:56.935656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:17:56.936239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:17:56.936737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:17:56.937238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:17:56.949300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.949939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.950978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:56.951424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:56.972388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Getting quotas for project 90bf9b4eea0b4c43bbd2d44888e13f77. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:56.979913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Getting quotas for user b2c41e924f694c789952302d70e75efd and project 90bf9b4eea0b4c43bbd2d44888e13f77. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:56.997044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:17:56.999731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:17:57.028525 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:57.054243 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7992596e-aca0-4eac-af22-89dd17165c4a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.165839 Jul 24 01:17:57.055712 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1096/2086] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:17:57.061472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:57.063096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:57.070344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.070911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.071915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.072357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.545653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:57.554815 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f10e811-cf3d-4bad-a746-a4f320a62751 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.498203 Jul 24 01:17:57.568318 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1097/2087] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:57 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:57.576762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9590a73b-bfba-42fc-b7fb-c02e3902c9fb tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:57.582142 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:17:57.582142 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:17:57.583502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9590a73b-bfba-42fc-b7fb-c02e3902c9fb tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.583965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9590a73b-bfba-42fc-b7fb-c02e3902c9fb tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.584774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9590a73b-bfba-42fc-b7fb-c02e3902c9fb tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.592913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9590a73b-bfba-42fc-b7fb-c02e3902c9fb tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.684428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:57.686364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9590a73b-bfba-42fc-b7fb-c02e3902c9fb tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.116840 Jul 24 01:17:57.693357 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1098/2088] 10.222.0.27 () {60 vars in 1216 bytes} [Sun Jul 24 01:17:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:17:57.700263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:57.701231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:57.702486 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-838152f4-7917-4755-85be-8f73c1df4c9a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1489 microversion: 2.1 time: 0.832847 Jul 24 01:17:57.706076 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 991/2089] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:56 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1489 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:57.710797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.712285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.713264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.713888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.721600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18e6b91c-7ec0-4d9e-8430-ad81b2ad6e4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:57.722643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18e6b91c-7ec0-4d9e-8430-ad81b2ad6e4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:57.732110 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] HTTP exception thrown: Instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 could not be found. Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Request method failure captured: Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 HTTP/1.1 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0RUBX_NrT4yfzbFtSW6APDHAQvNVOWAMJDN87dDfkdA2Yo09ot4PuikJsgop3bh3XQxX41FeebEExcvnxGjVVyg-4JXB1nOixkoBcNgj7v5kPaG-nBWzDgmASHaPwRTNZNQ4PeskbzXS0e0He9G8hpb77T7kEkQMUnxyURq5BbpBM Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_faa16a8779184f18afc0118c7581b9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3428b2650a774c998b63ed06114872b0 Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 could not be found. Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '06cf0e2e-9a04-437d-aad1-05eb7e2d90a5'} Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 could not be found. Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 could not be found. Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:57.747706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:57.751580 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:57.751580 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:57.751580 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:57.751580 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:57.751580 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:57.751580 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 could not be found. Jul 24 01:17:57.751580 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:57.753249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Returning 404 to user: Instance 06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:57.754338 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69a4e9e0-1502-4c47-8279-65df68e2a514 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5" status: 404 len: 111 microversion: 2.1 time: 0.059690 Jul 24 01:17:57.755067 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1099/2090] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:57 2022] GET /compute/v2.1/servers/06cf0e2e-9a04-437d-aad1-05eb7e2d90a5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:57.904705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18e6b91c-7ec0-4d9e-8430-ad81b2ad6e4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:57.912547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18e6b91c-7ec0-4d9e-8430-ad81b2ad6e4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1213 microversion: 2.1 time: 0.204369 Jul 24 01:17:57.918472 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 992/2091] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:57 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:57.938972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:57.939522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:57.960083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.960534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:57.971546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:57.972146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.032942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-421814ac-b6ee-45e3-9c59-e75dd5d71a06 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Action: 'create', calling method: .version_select at 0x7f05eaafb3a0>, body: {"keypair": {"name": "tempest-keypair-1412003033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDL2Y1LbhYsOunsbyf/kaNbTsZEBAtAbeQmrwTxrNUSOy1ShPT77pVMn2rR1ju2E3mktu+z6ZIN62m+0vnLtJqcYP3tRV+uCYx5JxhQeWq5pI+W5lkA+V4+GZTr7NUXlzA=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:58.043035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:17:58.090462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-421814ac-b6ee-45e3-9c59-e75dd5d71a06 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Getting quotas for project 56e7d7a1fe6f443181cd70ef18a84c83. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:58.119268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-421814ac-b6ee-45e3-9c59-e75dd5d71a06 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Getting quotas for user 6f643b01bb934b4ebacc4548721dba25 and project 56e7d7a1fe6f443181cd70ef18a84c83. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:58.197956 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-421814ac-b6ee-45e3-9c59-e75dd5d71a06 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.438301 Jul 24 01:17:58.199320 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1100/2092] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:17:58.209175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.210895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.228914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.230690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.235184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.235665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.270529 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] HTTP exception thrown: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Request method failure captured: Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 HTTP/1.1 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0RUBX_NrT4yfzbFtSW6APDHAQvNVOWAMJDN87dDfkdA2Yo09ot4PuikJsgop3bh3XQxX41FeebEExcvnxGjVVyg-4JXB1nOixkoBcNgj7v5kPaG-nBWzDgmASHaPwRTNZNQ4PeskbzXS0e0He9G8hpb77T7kEkQMUnxyURq5BbpBM Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_faa16a8779184f18afc0118c7581b9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3428b2650a774c998b63ed06114872b0 Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f0158e48-08e8-45ed-8d5b-0b111804db53'} Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:58.272792 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.279588 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.282182 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Returning 404 to user: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:58.282378 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-613cf164-dbaf-4368-b7f9-84a5226ebb08 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 204 len: 0 microversion: 2.1 time: 0.362409 Jul 24 01:17:58.285924 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 993/2093] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:57 2022] DELETE /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:17:58.286811 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d89f90c2-9452-4f90-bcf3-6a89f0db4dea tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 404 len: 111 microversion: 2.1 time: 0.083025 Jul 24 01:17:58.287899 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1101/2094] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:58 2022] DELETE /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:58.298538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.299597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: f0158e48-08e8-45ed-8d5b-0b111804db53] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.302128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.304424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.309320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.310100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.311235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.311837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.323780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.324161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.328860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.330450 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] HTTP exception thrown: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.331149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Request method failure captured: Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 HTTP/1.1 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0RUBX_NrT4yfzbFtSW6APDHAQvNVOWAMJDN87dDfkdA2Yo09ot4PuikJsgop3bh3XQxX41FeebEExcvnxGjVVyg-4JXB1nOixkoBcNgj7v5kPaG-nBWzDgmASHaPwRTNZNQ4PeskbzXS0e0He9G8hpb77T7kEkQMUnxyURq5BbpBM Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_faa16a8779184f18afc0118c7581b9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3428b2650a774c998b63ed06114872b0 Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f0158e48-08e8-45ed-8d5b-0b111804db53'} Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.340015 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.345855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.345855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.345855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.345855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:58.345855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:58.345855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. Jul 24 01:17:58.345855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.347956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Returning 404 to user: Instance f0158e48-08e8-45ed-8d5b-0b111804db53 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:58.349288 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-81803934-e268-43d3-b354-f18f55768996 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53" status: 404 len: 111 microversion: 2.1 time: 0.056410 Jul 24 01:17:58.350636 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1102/2095] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:58 2022] GET /compute/v2.1/servers/f0158e48-08e8-45ed-8d5b-0b111804db53 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:58.359545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.360481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.394979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.396131 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.399072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.400420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.448661 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] HTTP exception thrown: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Request method failure captured: Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 HTTP/1.1 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0RUBX_NrT4yfzbFtSW6APDHAQvNVOWAMJDN87dDfkdA2Yo09ot4PuikJsgop3bh3XQxX41FeebEExcvnxGjVVyg-4JXB1nOixkoBcNgj7v5kPaG-nBWzDgmASHaPwRTNZNQ4PeskbzXS0e0He9G8hpb77T7kEkQMUnxyURq5BbpBM Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_faa16a8779184f18afc0118c7581b9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3428b2650a774c998b63ed06114872b0 Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: exception: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23'} Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:58.456232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.459464 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.463360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Returning 404 to user: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:58.468809 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3443ed65-3dff-499e-b830-28c62afa3ab3 tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 404 len: 111 microversion: 2.1 time: 0.113388 Jul 24 01:17:58.472914 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1103/2096] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:17:58 2022] DELETE /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:17:58.493152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.496799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] [instance: e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.515827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.517437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.521041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.521871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.569915 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] HTTP exception thrown: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Request method failure captured: Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 HTTP/1.1 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J0RUBX_NrT4yfzbFtSW6APDHAQvNVOWAMJDN87dDfkdA2Yo09ot4PuikJsgop3bh3XQxX41FeebEExcvnxGjVVyg-4JXB1nOixkoBcNgj7v5kPaG-nBWzDgmASHaPwRTNZNQ4PeskbzXS0e0He9G8hpb77T7kEkQMUnxyURq5BbpBM Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_faa16a8779184f18afc0118c7581b9b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa16a8779184f18afc0118c7581b9b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: faa16a8779184f18afc0118c7581b9b9 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-252624441 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3428b2650a774c998b63ed06114872b0 Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerDiskConfigTestJSON-252624441-project Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: exception: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23'} Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:17:58.573175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.577134 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:17:58.577134 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:17:58.577134 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:17:58.577134 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:17:58.577134 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:17:58.577134 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. Jul 24 01:17:58.577134 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:17:58.580119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] Returning 404 to user: Instance e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:17:58.581365 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa68bf01-aca9-4146-9188-298f3ba537bc tempest-ServerDiskConfigTestJSON-252624441 tempest-ServerDiskConfigTestJSON-252624441-project] 10.222.0.27 "GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23" status: 404 len: 111 microversion: 2.1 time: 0.106182 Jul 24 01:17:58.589017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1104/2097] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:58 2022] GET /compute/v2.1/servers/e0c5ee4c-fc59-4921-adcf-acfbd0fb3e23 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:58.594790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:58.599620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:58.613910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:58.626201 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-256531c2-6fd4-4bd6-957f-e6a995710e53 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1495 microversion: 2.1 time: 0.335730 Jul 24 01:17:58.636134 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 994/2098] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:58 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1495 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:58.641304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.642313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.643396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:58.649791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:58.980319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-924d6cd7-41b3-4928-82be-9b94ea2edc7a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Action: 'create', calling method: .version_select at 0x7f05eade8e50>, body: {"keypair": {"name": "tempest-keypair-158983956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcG1Hc8Q9xTOq8EQwS2U67MJEPbTUQFPjkXCqnufnJak582sTvrSmyhu8fNRVzkm2b4lcZLGWnpRQuq+TTGd2wdsr+cwi8nEj+pkGGQaIc2fSecfkz+elX3Dizzq5nlgQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:59.021031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-924d6cd7-41b3-4928-82be-9b94ea2edc7a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Getting quotas for project 97fbef19413a4054aa808c676248fd27. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:17:59.040600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-924d6cd7-41b3-4928-82be-9b94ea2edc7a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Getting quotas for user c6d333d036f74225bf1afd3d36d8e339 and project 97fbef19413a4054aa808c676248fd27. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:17:59.124136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:59.127103 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:59.144377 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9f7e1e1-df70-4de0-b702-08877334aefa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.550856 Jul 24 01:17:59.147589 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1105/2099] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:58 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:59.165214 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-924d6cd7-41b3-4928-82be-9b94ea2edc7a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.302774 Jul 24 01:17:59.167986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 995/2100] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:17:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:59.168299 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:59.168912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:59.197075 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:59.206387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:59.207452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:59.210263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:59.645156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:17:59.646231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:17:59.658706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:59.659497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:59.661470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:59.662380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:59.672715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:59.684009 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9e98beee-d6bb-4bc0-9a13-89a2049519fd tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1273 microversion: 2.1 time: 0.534370 Jul 24 01:17:59.684599 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1106/2101] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:59 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1273 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:17:59.851280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4350756f-0f0f-4596-ae23-e301d03ff3d4 req-5511b946-9744-49b8-8ccf-4a0c0d632767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c47ab3-2f33-40d3-ac91-04f30aa6f66e", "name": "network-vif-plugged", "status": "completed", "tag": "ec327e9a-f2a5-4ffc-abca-57b29b8b83fe"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:17:59.869520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4350756f-0f0f-4596-ae23-e301d03ff3d4 req-5511b946-9744-49b8-8ccf-4a0c0d632767 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:17:59.871913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4350756f-0f0f-4596-ae23-e301d03ff3d4 req-5511b946-9744-49b8-8ccf-4a0c0d632767 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:17:59.912109 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4350756f-0f0f-4596-ae23-e301d03ff3d4 req-5511b946-9744-49b8-8ccf-4a0c0d632767 service nova] Creating event network-vif-plugged:ec327e9a-f2a5-4ffc-abca-57b29b8b83fe for instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e on n-h2-master-1 Jul 24 01:17:59.938403 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4350756f-0f0f-4596-ae23-e301d03ff3d4 req-5511b946-9744-49b8-8ccf-4a0c0d632767 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090896 Jul 24 01:17:59.939750 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1107/2102] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:17:59.965335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:17:59.975212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1af10a5-5ff6-4e4c-ad9c-a691ddb7a362 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1495 microversion: 2.1 time: 0.335175 Jul 24 01:17:59.986050 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 996/2103] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:17:59 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1495 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:00.166064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:00.167385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:00.183829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.184752 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.188841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.189535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.653564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:00.666982 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5e83702-e83c-4a65-9a6d-f10b32ef2098 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.503426 Jul 24 01:18:00.667727 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1108/2104] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:00 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:00.701883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:00.702435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:00.719431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.720182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.721156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.721784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.775384 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:00.787593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6cf151d-72c1-4720-b5de-7a64cfab4552 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8274100a-d8e0-4c60-b5bb-e68e9c743711", "device": "/dev/xvdb"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:00.788963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6cf151d-72c1-4720-b5de-7a64cfab4552 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:00.796828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6cf151d-72c1-4720-b5de-7a64cfab4552 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.797292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6cf151d-72c1-4720-b5de-7a64cfab4552 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.798137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6cf151d-72c1-4720-b5de-7a64cfab4552 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:00.798581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6cf151d-72c1-4720-b5de-7a64cfab4552 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:00.952398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:00.968762 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-20a126f1-1e0d-421c-ad01-c4f30c5acab8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1271 microversion: 2.1 time: 0.270967 Jul 24 01:18:00.974137 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 997/2105] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:00 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:01.015891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:01.016715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:01.025467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.025948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.026814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.027256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.234352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:01.245307 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f043561c-fcd8-494b-af74-dda175ed5ac9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1453 microversion: 2.1 time: 0.249156 Jul 24 01:18:01.259638 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 998/2106] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:00 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1453 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:01.319601 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6cf151d-72c1-4720-b5de-7a64cfab4552 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "POST /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.536070 Jul 24 01:18:01.350120 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1109/2107] 10.222.0.27 () {62 vars in 1363 bytes} [Sun Jul 24 01:18:00 2022] POST /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:18:01.685233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:01.685915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:01.693463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.693888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.694684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.695126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.842079 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f1e0773f-02b1-4bad-a77e-af4992d50cde req-4062ad71-4fac-478a-a2fc-a7ebfb4ab62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84ebfcb-7902-494e-b349-e56b08e23a40", "name": "network-vif-deleted", "tag": "9e0e13f8-d664-4cb2-81cf-d9a15f7d24eb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:01.888812 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f1e0773f-02b1-4bad-a77e-af4992d50cde req-4062ad71-4fac-478a-a2fc-a7ebfb4ab62f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:01.889275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f1e0773f-02b1-4bad-a77e-af4992d50cde req-4062ad71-4fac-478a-a2fc-a7ebfb4ab62f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:01.924753 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f1e0773f-02b1-4bad-a77e-af4992d50cde req-4062ad71-4fac-478a-a2fc-a7ebfb4ab62f service nova] Creating event network-vif-deleted:9e0e13f8-d664-4cb2-81cf-d9a15f7d24eb for instance b84ebfcb-7902-494e-b349-e56b08e23a40 on n-h1-master-1 Jul 24 01:18:01.937393 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f1e0773f-02b1-4bad-a77e-af4992d50cde req-4062ad71-4fac-478a-a2fc-a7ebfb4ab62f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096019 Jul 24 01:18:01.950017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1110/2108] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:01.987966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:01.990208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:02.009840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.010555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.011514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.012114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.264959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:02.274733 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d8da6fa-baa8-4225-b452-be65969d884b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1271 microversion: 2.1 time: 0.291062 Jul 24 01:18:02.284094 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1111/2109] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:01 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:02.293162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:02.294300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:02.307481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.310058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.311141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.311838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.397804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:02.401569 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:02.402083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lazy-loading 'fault' on Instance uuid b84ebfcb-7902-494e-b349-e56b08e23a40 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:02.596692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:02.614808 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-795c6fae-d10f-47af-8f5c-0d82121a1b92 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1316 microversion: 2.1 time: 0.934458 Jul 24 01:18:02.621642 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 999/2110] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:01 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1316 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:02.717646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:02.726838 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-587164cf-3347-423a-80f1-82724836cd82 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 200 len: 1304 microversion: 2.1 time: 0.441045 Jul 24 01:18:02.747942 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1112/2111] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:02 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 1304 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:03.300948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:03.301577 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:03.318693 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.319146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.320021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.327544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.348215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d9cea154-7004-461e-aeef-958817670651 req-7cff0df7-4800-49fb-98b6-138031293312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0809a9-f990-4818-ba3e-4b027c1dda81", "name": "network-vif-plugged", "status": "completed", "tag": "18746ce2-1d8b-4e13-ab0a-b5a99febfce4"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:03.363363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d9cea154-7004-461e-aeef-958817670651 req-7cff0df7-4800-49fb-98b6-138031293312 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.373171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d9cea154-7004-461e-aeef-958817670651 req-7cff0df7-4800-49fb-98b6-138031293312 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.410781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d9cea154-7004-461e-aeef-958817670651 req-7cff0df7-4800-49fb-98b6-138031293312 service nova] Creating event network-vif-plugged:18746ce2-1d8b-4e13-ab0a-b5a99febfce4 for instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 on n-h2-master-1 Jul 24 01:18:03.432514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d9cea154-7004-461e-aeef-958817670651 req-7cff0df7-4800-49fb-98b6-138031293312 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088271 Jul 24 01:18:03.438018 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1113/2112] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:03.641212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:03.642921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:03.667470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.668637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.670576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:03.683839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:03.835424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:03.860632 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-87891033-f879-4788-b999-d9d7ff636f10 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1313 microversion: 2.1 time: 0.561177 Jul 24 01:18:03.861663 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1000/2113] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:03 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:04.094610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:04.095349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:04.110085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.110552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:04.111367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.111812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:04.143676 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 HTTP/1.1 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b84ebfcb-7902-494e-b349-e56b08e23a40'} Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:04.145543 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:04.150502 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:04.150502 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:04.150502 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:04.150502 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:04.150502 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:04.150502 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:04.150502 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:04.153101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:04.155455 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16071c4a-0742-4921-841a-bc14c254b0c8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 404 len: 111 microversion: 2.1 time: 0.291460 Jul 24 01:18:04.156035 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1001/2114] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:03 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 111 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:04.222512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:04.245031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1874075131", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "adf394c3-0407-4590-8c41-4e59f65f117d"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:04.254006 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2406073-1e30-44a0-8941-507aec9cddd6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1466 microversion: 2.1 time: 0.625163 Jul 24 01:18:04.270539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1114/2115] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:03 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1466 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:04.281403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:04.282187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:04.295758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.305027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:04.308009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:04.330593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:04.377649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] validate_networks() for [('adf394c3-0407-4590-8c41-4e59f65f117d', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:18:05.127541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:05.142119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-252dd5bf-2ac9-4f4e-a8ba-d17ac21bfa98 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 200 len: 1316 microversion: 2.1 time: 0.870258 Jul 24 01:18:05.144292 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1115/2116] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:04 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:05.173860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:05.175732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:05.197868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.198608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:05.209332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:05.210260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.333731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:06.345616 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-582b423b-31d8-48de-bb18-a04efbca32b5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1334 microversion: 2.1 time: 1.197597 Jul 24 01:18:06.357572 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1116/2117] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:05 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1334 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:06.358815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:18:06.359261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:18:06.359798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:18:06.360214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:18:06.360660 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:18:06.364907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1279547498", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7edf6167-6fa7-428e-be10-8a4289e1eeec"}], "security_groups": [{"name": "tempest-securitygroup--357667449"}], "key_name": "tempest-keypair-1412003033", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:06.391121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.391494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.392311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.392755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.500440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:06.516160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Getting quotas for user f3de9a749c874cfc8c34deffb1001a79 and project 8336a5a8ae294f77aba940d67364b0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:06.535735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:18:06.547106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:06.664213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] validate_networks() for [('7edf6167-6fa7-428e-be10-8a4289e1eeec', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:18:06.707162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03cf3e47-23ee-40f7-ac32-919b2b76e0f8 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.466126 Jul 24 01:18:06.707818 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1002/2118] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:18:06.736152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:06.736791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:06.753022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.753485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:06.754313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:06.754754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.480033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:07.516431 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a5cff9e-d0ad-4790-9e1c-ff6392891b18 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 200 len: 1466 microversion: 2.1 time: 0.791786 Jul 24 01:18:07.519567 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1003/2119] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:06 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 1466 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:07.531132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:07.535480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:07.565985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.569005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.570185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.571663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.636241 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:07.736457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:07.754611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88cd5209-a823-4bac-9efc-86810a431ac0 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1219 microversion: 2.1 time: 0.233052 Jul 24 01:18:07.767403 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1004/2120] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:07 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:07.784939 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:07.785571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:07.805376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.806132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:07.807107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:07.807557 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.149405 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:08.181090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:08.190504 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-daa82088-2bcf-4e62-819f-3a8277738a6d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.421859 Jul 24 01:18:08.191103 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1005/2121] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:07 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:08.212492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:08.217340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:08.218440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Searching by: {'reservation_id': 'r-f5e8qzh5', 'deleted': False, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:18:08.231012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.231470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.233477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.238619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.441114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Getting quotas for project 56e7d7a1fe6f443181cd70ef18a84c83. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:08.467207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Getting quotas for user 6f643b01bb934b4ebacc4548721dba25 and project 56e7d7a1fe6f443181cd70ef18a84c83. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:08.551502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:18:08.552170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:18:08.555176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:18:08.555768 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:18:08.563277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:18:08.565082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:18:08.595856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.600047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.601037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.601710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.656577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Getting quotas for project 56e7d7a1fe6f443181cd70ef18a84c83. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:08.668999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Getting quotas for user 6f643b01bb934b4ebacc4548721dba25 and project 56e7d7a1fe6f443181cd70ef18a84c83. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:08.707569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:18:08.710099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:08.783302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:08.796862 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed156985-07a1-42d9-9c5d-93f8be72ec05 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.437792 Jul 24 01:18:08.797794 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1117/2122] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:18:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:18:08.802812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.802812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.809841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:08.810787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:08.826350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.827083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:08.829478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:08.831264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:09.579615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:09.593880 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b1a4af67-dd63-47d3-9107-c369a5c1fb1e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1273 microversion: 2.1 time: 0.789348 Jul 24 01:18:09.594435 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1118/2123] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:08 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1273 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:09.611176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8010235-8ad1-48db-9199-a0b57ecfb784 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:09.611974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8010235-8ad1-48db-9199-a0b57ecfb784 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:10.037656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c8010235-8ad1-48db-9199-a0b57ecfb784 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:10.047591 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8010235-8ad1-48db-9199-a0b57ecfb784 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1278 microversion: 2.1 time: 0.449366 Jul 24 01:18:10.050063 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1119/2124] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:09 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1278 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:10.068197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:10.069053 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:10.076797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.081114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.082239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.084210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.155639 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6da20401-5e3b-4084-9fe0-066242267868 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-f5e8qzh5" status: 200 len: 2925 microversion: 2.1 time: 1.959699 Jul 24 01:18:10.156247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1006/2125] 10.222.0.27 () {58 vars in 1196 bytes} [Sun Jul 24 01:18:08 2022] GET /compute/v2.1/servers/detail?reservation_id=r-f5e8qzh5 => generated 2925 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:10.181102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7cc21a60-628b-4a47-aa54-51fdcc8b2a5d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:10.223278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.server_groups [None req-7cc21a60-628b-4a47-aa54-51fdcc8b2a5d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Querying cell 0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) for 2 instances {{(pid=119562) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 24 01:18:10.240913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7cc21a60-628b-4a47-aa54-51fdcc8b2a5d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.243968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7cc21a60-628b-4a47-aa54-51fdcc8b2a5d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.320151 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7cc21a60-628b-4a47-aa54-51fdcc8b2a5d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/e0f753e6-2886-487e-9947-2b26d594dfe2" status: 200 len: 266 microversion: 2.1 time: 0.149097 Jul 24 01:18:10.321350 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1007/2126] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:18:10 2022] GET /compute/v2.1/os-server-groups/e0f753e6-2886-487e-9947-2b26d594dfe2 => generated 266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:10.331698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a6d13a39-0e4c-41fc-9330-96736dc1b368 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:10.332664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a6d13a39-0e4c-41fc-9330-96736dc1b368 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:10.341160 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6d13a39-0e4c-41fc-9330-96736dc1b368 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.341919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6d13a39-0e4c-41fc-9330-96736dc1b368 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.342910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6d13a39-0e4c-41fc-9330-96736dc1b368 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.343670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6d13a39-0e4c-41fc-9330-96736dc1b368 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.933425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:10.945379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-96b389e8-f0d0-4c1d-b609-44856cecb921 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.890380 Jul 24 01:18:10.950556 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1120/2127] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:10 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:10.960106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:10.962094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:10.984436 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.986339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:10.988885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:10.990277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.196560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a6d13a39-0e4c-41fc-9330-96736dc1b368 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1617 microversion: 2.1 time: 0.868510 Jul 24 01:18:11.197365 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1008/2128] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:10 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1617 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:11.206771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:11.212770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:11.219436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.220355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.221313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.221983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.284877 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:11.294884 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f423d7a-7ab7-400a-9da4-d0fed1272947 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1273 microversion: 2.1 time: 0.343154 Jul 24 01:18:11.296076 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1121/2129] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:10 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1273 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:11.304071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9f0c29d0-5a17-47d5-8bff-a4e79cde693d req-efbc0a79-5077-42d7-b762-56ddb102ecfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "tag": "093fbcb8-07c8-486a-96f6-6f727c462f41"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:11.315390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f0c29d0-5a17-47d5-8bff-a4e79cde693d req-efbc0a79-5077-42d7-b762-56ddb102ecfb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.316974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f0c29d0-5a17-47d5-8bff-a4e79cde693d req-efbc0a79-5077-42d7-b762-56ddb102ecfb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.332896 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9f0c29d0-5a17-47d5-8bff-a4e79cde693d req-efbc0a79-5077-42d7-b762-56ddb102ecfb service nova] Creating event network-changed:093fbcb8-07c8-486a-96f6-6f727c462f41 for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:11.339815 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9f0c29d0-5a17-47d5-8bff-a4e79cde693d req-efbc0a79-5077-42d7-b762-56ddb102ecfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042501 Jul 24 01:18:11.341070 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1122/2130] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:11.347157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b8ddd877-f10d-4c7d-9084-85fc3d597bcb tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:11.348016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b8ddd877-f10d-4c7d-9084-85fc3d597bcb tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:11.356378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8ddd877-f10d-4c7d-9084-85fc3d597bcb tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.357245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8ddd877-f10d-4c7d-9084-85fc3d597bcb tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.358274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8ddd877-f10d-4c7d-9084-85fc3d597bcb tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.359058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8ddd877-f10d-4c7d-9084-85fc3d597bcb tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:11.678736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:11.702652 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1781f5b9-0f09-46f3-9ce0-f3efaf89ec59 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1336 microversion: 2.1 time: 0.501875 Jul 24 01:18:11.721543 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1009/2131] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:11 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1336 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:11.815343 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b8ddd877-f10d-4c7d-9084-85fc3d597bcb tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 200 len: 1617 microversion: 2.1 time: 0.472845 Jul 24 01:18:11.816770 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1123/2132] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:11 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 1617 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:11.840265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92893018-842c-437a-9dae-67b25c3de1bf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: .version_select at 0x7f05eb562280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-477553535", "policies": ["anti-affinity"]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:11.850142 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:11.884129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-92893018-842c-437a-9dae-67b25c3de1bf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:11.900702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-92893018-842c-437a-9dae-67b25c3de1bf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:11.970857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:11.971866 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:11.998048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:11.998980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.000254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.000809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.015813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-92893018-842c-437a-9dae-67b25c3de1bf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:12.030147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-92893018-842c-437a-9dae-67b25c3de1bf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:12.051085 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92893018-842c-437a-9dae-67b25c3de1bf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.217152 Jul 24 01:18:12.052227 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1010/2133] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:18:11 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:12.243818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-805660418", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "40bc247f-8d0f-4ae4-8eb8-8847c9a97e19"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:12.313998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:18:12.639176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:12.649188 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b60a406e-b92b-43f6-b5b3-2ca2b1123b89 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.685227 Jul 24 01:18:12.656690 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1124/2134] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:11 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:12.662130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:12.662950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:12.678521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.679244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.680529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:12.681123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:12.684371 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:13.247724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:13.262529 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fa6ea3aa-7d74-43aa-a275-050c63aeee54 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1315 microversion: 2.1 time: 0.604384 Jul 24 01:18:13.263288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1125/2135] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:12 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:13.277285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:13.278933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:13.280973 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:13.288096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:13.288715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:13.290373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:13.296515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:13.323255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:18:13.324280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:18:13.324951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:18:13.325555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:18:13.326950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:18:13.397204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:13.414279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:13.421229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:13.421954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:13.458601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:13.472429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:13.495442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Going to run 2 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:18:13.500348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:13.543686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:13.560471 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d7211e8-3e94-4f6e-a00a-610828f6a9c6 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1336 microversion: 2.1 time: 0.295068 Jul 24 01:18:13.576058 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1126/2136] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:13 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1336 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:13.591680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b7b92d2b-d916-4a5a-94a0-4f0c6ccade57 req-0f749a45-f8df-4f64-a69a-1d44324d94fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "tag": "0f69d451-6073-46e4-98bf-24a771236bac"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:13.621183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b7b92d2b-d916-4a5a-94a0-4f0c6ccade57 req-0f749a45-f8df-4f64-a69a-1d44324d94fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:13.621980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b7b92d2b-d916-4a5a-94a0-4f0c6ccade57 req-0f749a45-f8df-4f64-a69a-1d44324d94fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:13.667140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:13.669344 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b7b92d2b-d916-4a5a-94a0-4f0c6ccade57 req-0f749a45-f8df-4f64-a69a-1d44324d94fc service nova] Creating event network-changed:0f69d451-6073-46e4-98bf-24a771236bac for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:13.685053 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b7b92d2b-d916-4a5a-94a0-4f0c6ccade57 req-0f749a45-f8df-4f64-a69a-1d44324d94fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101604 Jul 24 01:18:13.687188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:13.688959 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1127/2137] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:13.709385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:13.712828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:13.726382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:13.731295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:13.732796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:13.734714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:13.768060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:13.781218 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:13.822588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=72e73367-e6d8-4941-a4e2-f5541bc62f03,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:13.982343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:13.994743 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:14.106340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:14.132507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'server_group_members'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:14.272078 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ceea17c3-18b6-4b7c-9e34-1e83863eb12c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.025046 Jul 24 01:18:14.275630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1011/2138] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:18:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 2038 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 24 01:18:14.286882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:14.293388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:14.308229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:14.308691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:14.311585 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:14.312068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:14.763579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:14.782027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a621f65-98b1-4510-91c1-8aa6655bc8f4 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 1.087350 Jul 24 01:18:14.796981 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1128/2139] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:13 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:14.803173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:14.808589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:14.812802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Searching by: {'deleted': False, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:18:14.834857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:14.835317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:14.836240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:14.837138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:14.973990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:18:15.056981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:15.078529 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a5b5cd30-c36a-4441-abb9-00760cb6d521 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1315 microversion: 2.1 time: 0.800579 Jul 24 01:18:15.099427 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1012/2140] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:14 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:15.099919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5770f797-aafa-4dcc-96c6-31c50ffb3e74 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1657 microversion: 2.1 time: 0.300963 Jul 24 01:18:15.103565 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1129/2141] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:18:14 2022] GET /compute/v2.1/servers => generated 1657 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:15.108884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:15.110484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:15.130809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-74a29aa5-0a2b-4bf5-89d1-d8b4da79e6f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:15.133042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-74a29aa5-0a2b-4bf5-89d1-d8b4da79e6f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:15.138504 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:15.159839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.161871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.163027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.163971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.561696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-74a29aa5-0a2b-4bf5-89d1-d8b4da79e6f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:15.572671 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-74a29aa5-0a2b-4bf5-89d1-d8b4da79e6f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1218 microversion: 2.1 time: 0.460739 Jul 24 01:18:15.573942 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1130/2142] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:15 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1218 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:15.590019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-800d06f9-d923-4aa2-9d75-743f1f122525 req-d10a8388-b1b9-4f18-a765-d97ad1a8f205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff263002-607e-42ae-a6b3-a7e20ee4085f", "tag": "c8f7003d-535f-4883-b65a-88155825db60"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:15.614360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-800d06f9-d923-4aa2-9d75-743f1f122525 req-d10a8388-b1b9-4f18-a765-d97ad1a8f205 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.615175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-800d06f9-d923-4aa2-9d75-743f1f122525 req-d10a8388-b1b9-4f18-a765-d97ad1a8f205 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.646133 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-800d06f9-d923-4aa2-9d75-743f1f122525 req-d10a8388-b1b9-4f18-a765-d97ad1a8f205 service nova] Creating event network-changed:c8f7003d-535f-4883-b65a-88155825db60 for instance ff263002-607e-42ae-a6b3-a7e20ee4085f on n-h1-master-1 Jul 24 01:18:15.658327 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-800d06f9-d923-4aa2-9d75-743f1f122525 req-d10a8388-b1b9-4f18-a765-d97ad1a8f205 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079567 Jul 24 01:18:15.659402 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1131/2143] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:15.801365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:15.802194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:15.820822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.821583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:15.827963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:15.828497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:16.646433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:16.669552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-81dc7dee-d8e0-4c9b-991a-13ca920c752f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.872451 Jul 24 01:18:16.683495 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1132/2144] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:15 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:16.687061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:16.687061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:16.708315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:16.709205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:16.713080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:16.714487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:16.755748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:16.771374 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6124a3b7-fc22-4c82-8296-09bbbb73308e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1403 microversion: 2.1 time: 1.667507 Jul 24 01:18:16.793836 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1013/2145] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:15 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1403 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:16.803718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:16.805281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:16.815101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:16.816061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:16.817181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:16.818979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:17.009455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:17.017392 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5e944ee-fe91-4a87-a54e-84f74e3f2639 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1270 microversion: 2.1 time: 0.221628 Jul 24 01:18:17.018019 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1014/2146] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:16 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:17.124350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-30bf4df6-5ddf-4f33-ab66-7ac043096cdc req-3b5d8291-2634-47dd-8680-81301d266436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "tag": "9260835a-6603-469a-96db-99ebebb155d4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:17.145864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-30bf4df6-5ddf-4f33-ab66-7ac043096cdc req-3b5d8291-2634-47dd-8680-81301d266436 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:17.146312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-30bf4df6-5ddf-4f33-ab66-7ac043096cdc req-3b5d8291-2634-47dd-8680-81301d266436 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:17.165512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-30bf4df6-5ddf-4f33-ab66-7ac043096cdc req-3b5d8291-2634-47dd-8680-81301d266436 service nova] Creating event network-changed:9260835a-6603-469a-96db-99ebebb155d4 for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:17.175388 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-30bf4df6-5ddf-4f33-ab66-7ac043096cdc req-3b5d8291-2634-47dd-8680-81301d266436 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055865 Jul 24 01:18:17.186095 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1015/2147] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:18:17.605700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:17.615706 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bd502bb-73c2-42ca-b70f-4607658e4702 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1315 microversion: 2.1 time: 0.936070 Jul 24 01:18:17.616680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:17.616826 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1133/2148] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:16 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:17.618357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:17.629259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:17.638472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:17.650642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:17.653072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:17.691265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:17.692187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:17.705474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:17.708732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:17.709801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:17.710407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.098703 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:18.111384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:18.122069 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-00a6ca31-e7b9-43dc-a6fc-71b2b8eb724e tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 2423 microversion: 2.25 time: 0.509889 Jul 24 01:18:18.123402 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1016/2149] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:17 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 2423 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:18.125533 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a45e2c9-5970-45b1-9f86-dd33efb8f074 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.438473 Jul 24 01:18:18.126150 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1134/2150] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:17 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:18.130147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:18.131145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:18.139160 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.139838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:18.140344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.140541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:18.141454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.142142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.152195 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:18.158641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.159113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.159925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.160403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.369199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:18.385158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ebf298f-743f-45b6-b03a-eacdce2a4205 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1276 microversion: 2.1 time: 0.255778 Jul 24 01:18:18.388071 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1135/2151] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:18 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:18.400478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:18.405251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:18.433272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.433752 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.434589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.435049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:18.526262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'flavor' on Instance uuid 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:18.548417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Going to try to live migrate instance to n-h1-master-1 {{(pid=119561) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:18:18.673324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:18.683005 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-67cf04cb-5762-4db5-88a6-1e1f574ae3e9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1403 microversion: 2.1 time: 0.557918 Jul 24 01:18:18.689647 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1017/2152] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:18 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1403 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:18.709317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-006b25c1-e0a9-4c8a-b522-24c391253691 req-49dfd1da-db3b-42af-a9ff-9efc01a481fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28d5f2d-e02d-490f-902d-b6d0cf94cb8d", "tag": "6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:18.744485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-006b25c1-e0a9-4c8a-b522-24c391253691 req-49dfd1da-db3b-42af-a9ff-9efc01a481fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:18.745007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-006b25c1-e0a9-4c8a-b522-24c391253691 req-49dfd1da-db3b-42af-a9ff-9efc01a481fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.272024 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-006b25c1-e0a9-4c8a-b522-24c391253691 req-49dfd1da-db3b-42af-a9ff-9efc01a481fa service nova] Creating event network-changed:6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da for instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d on n-h1-master-1 Jul 24 01:18:19.278421 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-006b25c1-e0a9-4c8a-b522-24c391253691 req-49dfd1da-db3b-42af-a9ff-9efc01a481fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.575981 Jul 24 01:18:19.280051 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1018/2153] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:19.295202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:19.296202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:19.306362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.307164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:19.308204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:19.308860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:20.232083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:20.260260 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4bc7102d-b8a5-4c10-94f5-15525cf420ab tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1315 microversion: 2.1 time: 0.978548 Jul 24 01:18:20.267154 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1019/2154] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:19 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1315 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:20.283829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:20.289003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:20.313252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:20.316194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:20.318878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:20.319648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:21.277927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-62dcfbc6-b82c-430b-9469-d8acb16e801c tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/action" status: 202 len: 0 microversion: 2.25 time: 2.888317 Jul 24 01:18:21.278925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1136/2155] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:18:18 2022] POST /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/action => generated 0 bytes in 2890 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:18:21.285430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:21.286170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:21.337784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:21.338253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:21.342869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:21.343583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.044531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:22.057334 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fd5d9e80-4846-4288-8bb6-69d3b9c0da67 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 1.788108 Jul 24 01:18:22.057974 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1020/2156] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:20 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:22.091303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:22.097648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:22.098162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:22.117516 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-253577bf-05de-431a-8ac6-a2a78de872fe tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1276 microversion: 2.1 time: 0.836903 Jul 24 01:18:22.118949 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1137/2157] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:21 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1276 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:22.127000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.127466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.128282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.138018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:22.139054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:22.139276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.163602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.172946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.174119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.174712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.644470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:22.655294 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf718ec5-3d46-4c34-b9cf-2f305f493e11 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1403 microversion: 2.1 time: 0.586445 Jul 24 01:18:22.668310 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1021/2158] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:22 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1403 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:22.675828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:22.677936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:22.688320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.689929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.691095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:22.691753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:22.743456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:22.783624 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-027a1e43-40fb-43aa-81bf-3cd8e7f7eea9 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1315 microversion: 2.1 time: 0.662323 Jul 24 01:18:22.794511 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1138/2159] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:22 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:22.991939 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:23.012314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:23.016453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:23.026068 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c2137fcf-7481-433f-a902-43ce7427630a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.356036 Jul 24 01:18:23.029896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ac5fac0d-f190-4754-ba86-f118551540b3 req-689eb098-cd1c-4873-ac3a-047972755553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff263002-607e-42ae-a6b3-a7e20ee4085f", "name": "network-vif-plugged", "status": "completed", "tag": "c8f7003d-535f-4883-b65a-88155825db60"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:23.042335 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1022/2160] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:22 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:23.050761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ac5fac0d-f190-4754-ba86-f118551540b3 req-689eb098-cd1c-4873-ac3a-047972755553 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.051547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ac5fac0d-f190-4754-ba86-f118551540b3 req-689eb098-cd1c-4873-ac3a-047972755553 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.076024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:23.076659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:23.081717 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ac5fac0d-f190-4754-ba86-f118551540b3 req-689eb098-cd1c-4873-ac3a-047972755553 service nova] Creating event network-vif-plugged:c8f7003d-535f-4883-b65a-88155825db60 for instance ff263002-607e-42ae-a6b3-a7e20ee4085f on n-h1-master-1 Jul 24 01:18:23.091637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.092671 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.094060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.094794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.096524 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ac5fac0d-f190-4754-ba86-f118551540b3 req-689eb098-cd1c-4873-ac3a-047972755553 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070674 Jul 24 01:18:23.099063 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1139/2161] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:18:23.139155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:23.140833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:23.164217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.165728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.166827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.167500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.450827 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:23.906439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:23.931941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:23.942950 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60508998-7366-4bea-a992-0a070d30c1c2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.809808 Jul 24 01:18:23.943414 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-024772d0-2c48-4095-a8df-2547278f238a tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.871294 Jul 24 01:18:23.944970 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1023/2162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:23 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:23.945814 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1140/2163] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:23 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:23.963465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:23.966224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:23.967690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:23.972267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:23.988968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.989431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:23.990280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:23.990793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.003840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.008761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.010575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.011993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.163286 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=44 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:24.517290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:24.528867 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b75f703-2e71-4c85-9d83-77e624d9af7b tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1403 microversion: 2.1 time: 0.574672 Jul 24 01:18:24.529459 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1024/2164] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:23 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1403 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:24.535032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:24.535888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:24.553229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.554006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.558587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.560533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.564773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:24.578803 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3605b314-87c3-4aa8-9cf4-840061f0a1ef tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1315 microversion: 2.1 time: 0.629094 Jul 24 01:18:24.582311 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1141/2165] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:23 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:24.920887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:24.937876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:24.947037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:24.949883 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc7023b3-d14d-4e3a-8d40-dd4a084e4042 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.418307 Jul 24 01:18:24.952969 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1025/2166] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:24 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:24.959245 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:24.963948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:24.964583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:24.978988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:24.979402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.982831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.983575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:24.984074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:24.984680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:24.999265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:25.002943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:25.003983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:25.006868 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:25.018587 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:25.570569 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:25.868691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:25.887108 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e78411ae-921a-48a2-a5a0-5cf4aa858e2b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.928754 Jul 24 01:18:25.888572 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1142/2167] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:24 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:25.893574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:25.894374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:25.908898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:25.917617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:25.923143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:25.925822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:25.926483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:25.933748 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76f2ac2a-6209-4f97-9509-c30c40790665 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.966057 Jul 24 01:18:25.939033 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1026/2168] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:24 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:25.947070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:25.951758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:25.964460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:25.965247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:25.967311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:25.968601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.158837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:26.182048 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f78aec9-b8fa-41b3-9cbb-43c03a2a4595 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1403 microversion: 2.1 time: 0.289448 Jul 24 01:18:26.183650 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1143/2169] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:25 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1403 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:26.188401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6f8090e1-3eb0-465e-a6e0-64bcb3ec1bc6 req-ca05a0d0-9266-468a-ae80-00fca61e6b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e73367-e6d8-4941-a4e2-f5541bc62f03", "tag": "5a95cb51-9367-4afa-8255-acadb5df2832"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:26.214957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6f8090e1-3eb0-465e-a6e0-64bcb3ec1bc6 req-ca05a0d0-9266-468a-ae80-00fca61e6b09 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.216365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6f8090e1-3eb0-465e-a6e0-64bcb3ec1bc6 req-ca05a0d0-9266-468a-ae80-00fca61e6b09 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.251160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6f8090e1-3eb0-465e-a6e0-64bcb3ec1bc6 req-ca05a0d0-9266-468a-ae80-00fca61e6b09 service nova] Creating event network-changed:5a95cb51-9367-4afa-8255-acadb5df2832 for instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 on n-h1-master-1 Jul 24 01:18:26.268153 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6f8090e1-3eb0-465e-a6e0-64bcb3ec1bc6 req-ca05a0d0-9266-468a-ae80-00fca61e6b09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079247 Jul 24 01:18:26.271013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1144/2170] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:26.287731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:26.288466 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:26.299858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:26.306163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.308855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.311126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c098da2-0bd5-499b-bdbb-f1e37341e97a tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1502 microversion: 2.1 time: 0.370370 Jul 24 01:18:26.312542 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1027/2171] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:25 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:26.318906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.319944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.330971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:26.332516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:26.348635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.350149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.354579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.356107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.404193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lazy-loading 'flavor' on Instance uuid ff263002-607e-42ae-a6b3-a7e20ee4085f {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:26.624174 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff354933-0719-4d75-8ce4-97e2b4cc6c20 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "POST /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f/action" status: 202 len: 0 microversion: 2.1 time: 0.294592 Jul 24 01:18:26.627020 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1028/2172] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:18:26 2022] POST /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:18:26.640336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:26.669082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:26.673053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:26.675765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:26.676784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:26.678695 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-633a3df1-a44c-4d6d-8937-be0c3bad0cb5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.406035 Jul 24 01:18:26.682258 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1145/2173] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:26 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:26.698193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.698887 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.699832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.700515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.905222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:26.906229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:26.916414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.917291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.919097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:26.920763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:26.983872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:26.992795 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8eac6d02-9292-4ebd-b734-768480e81460 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1510 microversion: 2.1 time: 0.361581 Jul 24 01:18:26.994603 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1029/2174] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:26 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:27.002452 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:27.003869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:27.013001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:27.014119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:27.015434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:27.016106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:27.356106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:27.365388 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-edf192a0-78d1-4f88-b1b5-2b5a82f96d40 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.464586 Jul 24 01:18:27.381947 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1146/2175] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:26 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:27.402224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:27.403249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:27.410185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:27.411068 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:27.412031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:27.412623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:27.532560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:27.546378 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9abf8ba2-63ea-4c00-8e71-7d9d8742faca tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.549535 Jul 24 01:18:27.547101 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1030/2176] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:26 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:27.566531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a97c2b3a-4010-4fe0-8489-d7f746b7856c req-3fd5b4c3-19bb-48da-8da9-6c7fae7da235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28d5f2d-e02d-490f-902d-b6d0cf94cb8d", "name": "network-vif-plugged", "status": "completed", "tag": "6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:27.597806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a97c2b3a-4010-4fe0-8489-d7f746b7856c req-3fd5b4c3-19bb-48da-8da9-6c7fae7da235 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:27.598262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a97c2b3a-4010-4fe0-8489-d7f746b7856c req-3fd5b4c3-19bb-48da-8da9-6c7fae7da235 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:27.632240 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a97c2b3a-4010-4fe0-8489-d7f746b7856c req-3fd5b4c3-19bb-48da-8da9-6c7fae7da235 service nova] Creating event network-vif-plugged:6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da for instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d on n-h1-master-1 Jul 24 01:18:27.647749 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a97c2b3a-4010-4fe0-8489-d7f746b7856c req-3fd5b4c3-19bb-48da-8da9-6c7fae7da235 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084711 Jul 24 01:18:27.648613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1031/2177] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:27.700407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:27.701127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:27.711938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:27.712342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:27.722255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:27.723130 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:27.778404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:27.802507 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-190e47f5-ae51-4a59-b306-10b9c92a920a tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1403 microversion: 2.1 time: 0.418317 Jul 24 01:18:27.804107 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1147/2178] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:27 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1403 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:28.021229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:28.028523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:28.044473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:28.077630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:28.081940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.084832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.086347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.089061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:28.090434 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-05fecd51-c0b5-487b-a7ec-a9b7fde1591d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.395232 Jul 24 01:18:28.091020 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1032/2179] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:27 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:28.091821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.384665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:28.386978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:28.393077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:28.433717 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f4d4289-d3a1-4258-be9e-9fea3d531b76 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1493 microversion: 2.1 time: 0.403732 Jul 24 01:18:28.437411 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1148/2180] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:28 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1493 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:28.439865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.443062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.446102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.446847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.450607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d27816cc-067d-4c7e-a4ec-40e336a7e743 req-ee9a0782-acfe-48d3-b40e-382c1007fa96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a", "tag": "a6fd7eb1-fcfc-43ec-adcd-600bf5808df7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:28.464972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d27816cc-067d-4c7e-a4ec-40e336a7e743 req-ee9a0782-acfe-48d3-b40e-382c1007fa96 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.467443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d27816cc-067d-4c7e-a4ec-40e336a7e743 req-ee9a0782-acfe-48d3-b40e-382c1007fa96 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.484113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d27816cc-067d-4c7e-a4ec-40e336a7e743 req-ee9a0782-acfe-48d3-b40e-382c1007fa96 service nova] Creating event network-changed:a6fd7eb1-fcfc-43ec-adcd-600bf5808df7 for instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a on n-h2-master-1 Jul 24 01:18:28.490794 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d27816cc-067d-4c7e-a4ec-40e336a7e743 req-ee9a0782-acfe-48d3-b40e-382c1007fa96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051673 Jul 24 01:18:28.493043 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1149/2181] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:28.495829 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:28.502215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:28.503074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:28.513969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.515817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.516897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.517811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.558757 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:18:28.761662 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4ca293bb-8161-415e-bf16-f7c2f331d05d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 204 len: 0 microversion: 2.1 time: 0.265909 Jul 24 01:18:28.762802 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1150/2182] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:28 2022] DELETE /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:18:28.779339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:28.780238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:28.792818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.794803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.798438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.798994 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.799685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:28.810068 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-472c060a-7563-4451-8e7a-fffce4fdb325 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.430335 Jul 24 01:18:28.811488 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1033/2183] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:28 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:28.817249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:28.818135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:28.825653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.826835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:28.827837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:28.843736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:29.095162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:29.108501 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a508eae5-5492-4e6f-8322-9bb5ace61fb7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.343318 Jul 24 01:18:29.111845 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1151/2184] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:28 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:29.123681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:29.135147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:29.151241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:29.153405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:29.155872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:29.160631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:29.245483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:29.257543 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-21929325-94fe-40e3-a309-8947a605de0e tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1499 microversion: 2.1 time: 0.441006 Jul 24 01:18:29.259684 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1034/2185] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:28 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1499 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:29.297588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:29.298833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:29.313712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:29.314560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:29.320933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:29.321783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:29.643244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:29.656688 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f0fe805-ac45-485e-a4d5-f56031acaf78 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1403 microversion: 2.1 time: 0.543013 Jul 24 01:18:29.658556 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1152/2186] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:29 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1403 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:29.694849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:29.719237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:29.720996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:29.723125 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0aba9c9d-1abf-4a99-aff1-def5a504fed9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.461414 Jul 24 01:18:29.735035 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1035/2187] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:29 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:29.829067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:29.830160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:29.855494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:29.856101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:29.857043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:29.859470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:30.146333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:30.147407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:30.164761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:30.171156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:30.172609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:30.174746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:30.190360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:30.202824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed8276df-ee43-4f17-9d9d-438a400b4176 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.378137 Jul 24 01:18:30.207700 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1036/2188] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:29 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:30.228013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:30.236086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:30.251624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:30.253880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:30.259221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:30.259935 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:30.277716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:18:30.645116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:30.657220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-235e1523-de1f-45c5-a6c7-b1bd5964d3f6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.448132 Jul 24 01:18:30.662646 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1037/2189] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:30 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:30.684249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:30.689051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:30.706195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:30.717251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:30.720511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:30.723878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:31.137601 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31146fef-51bf-417a-a9ad-bf0f03067eed tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 204 len: 0 microversion: 2.32 time: 1.362639 Jul 24 01:18:31.141101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1153/2190] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:18:29 2022] DELETE /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 0 bytes in 1368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:18:31.164564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:31.165601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:31.178532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:31.185941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:31.187055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:31.191048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:31.923387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:31.937526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:31.949091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68e2e889-ed14-4bd7-8442-2677a4b8169d tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1588 microversion: 2.1 time: 0.800360 Jul 24 01:18:31.951477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-12787352-f57f-42f2-bb0d-8ec8e2906ebf tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1499 microversion: 2.1 time: 1.286397 Jul 24 01:18:31.951962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1154/2191] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:31 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1588 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:31.965511 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1038/2192] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:30 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1499 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:31.974600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:31.975534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:31.979210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:31.979910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:31.991384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:31.995991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:31.996477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:31.997320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:31.998525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:31.998974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:31.999751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:32.003399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:32.586714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:32.589844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:32.606841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:32.608681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:32.609615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:32.611239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:32.612904 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58101975-4133-465d-8e77-95866f949193 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2956 microversion: 2.32 time: 0.646141 Jul 24 01:18:32.613532 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f2e6024-d76d-4795-adcf-b4c4f8c74e44 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.656801 Jul 24 01:18:32.627991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1155/2193] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:31 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:32.634052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:32.634612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:32.637392 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1039/2194] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:31 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2956 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:32.642575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:32.647636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:32.654780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:32.658001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:32.658694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:32.659107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:32.659230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:32.659648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:32.659943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:32.660393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:33.255974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:33.269806 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30b5cb9a-9708-4a8d-9caf-2e66f3e85dcf tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.638874 Jul 24 01:18:33.271375 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1156/2195] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:32 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:33.284248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a9453bd3-2afe-4d4b-b793-893e7d6286b4 req-91a8eb2b-3a78-448f-bb79-f4f3db31e5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff263002-607e-42ae-a6b3-a7e20ee4085f", "name": "network-vif-deleted", "tag": "c8f7003d-535f-4883-b65a-88155825db60"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:33.299508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:33.312828 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-19734123-aa03-4b15-8888-ef45acaedacd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.672664 Jul 24 01:18:33.314035 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1040/2196] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:32 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:33.324222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a9453bd3-2afe-4d4b-b793-893e7d6286b4 req-91a8eb2b-3a78-448f-bb79-f4f3db31e5c8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:33.324678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a9453bd3-2afe-4d4b-b793-893e7d6286b4 req-91a8eb2b-3a78-448f-bb79-f4f3db31e5c8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:33.334371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a64c90f-2624-4d8f-9067-cc5f2f2ab258 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:33.335104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a64c90f-2624-4d8f-9067-cc5f2f2ab258 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:33.346493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a64c90f-2624-4d8f-9067-cc5f2f2ab258 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:33.347027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a64c90f-2624-4d8f-9067-cc5f2f2ab258 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:33.348170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a64c90f-2624-4d8f-9067-cc5f2f2ab258 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:33.348682 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a64c90f-2624-4d8f-9067-cc5f2f2ab258 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:33.372911 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:33.420234 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a9453bd3-2afe-4d4b-b793-893e7d6286b4 req-91a8eb2b-3a78-448f-bb79-f4f3db31e5c8 service nova] Creating event network-vif-deleted:c8f7003d-535f-4883-b65a-88155825db60 for instance ff263002-607e-42ae-a6b3-a7e20ee4085f on n-h1-master-1 Jul 24 01:18:33.440007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a9453bd3-2afe-4d4b-b793-893e7d6286b4 req-91a8eb2b-3a78-448f-bb79-f4f3db31e5c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164830 Jul 24 01:18:33.440788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1157/2197] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:33.591271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3df9081-834b-4fbf-92a0-e5132dcfe99c tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Action: 'create', calling method: .version_select at 0x7f05eaa4f790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:33.618183 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a64c90f-2624-4d8f-9067-cc5f2f2ab258 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.294808 Jul 24 01:18:33.624995 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1041/2198] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:18:33 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:33.626194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:33.626829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:33.642323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:33.642794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:33.643729 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:33.644382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:33.650232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c3df9081-834b-4fbf-92a0-e5132dcfe99c tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Getting quotas for project 4325ec434a874304a31c9de29d4c1fbc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:33.665612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c3df9081-834b-4fbf-92a0-e5132dcfe99c tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Getting quotas for user 2a53625b6a1148aa8ae55575516d7b77 and project 4325ec434a874304a31c9de29d4c1fbc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:33.747781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:33.748294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:33.750920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lazy-loading 'fault' on Instance uuid ff263002-607e-42ae-a6b3-a7e20ee4085f {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:18:33.796352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c3df9081-834b-4fbf-92a0-e5132dcfe99c tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Getting quotas for project 4325ec434a874304a31c9de29d4c1fbc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:33.803494 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:33.806804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c3df9081-834b-4fbf-92a0-e5132dcfe99c tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Getting quotas for user 2a53625b6a1148aa8ae55575516d7b77 and project 4325ec434a874304a31c9de29d4c1fbc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:33.916715 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c3df9081-834b-4fbf-92a0-e5132dcfe99c tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.471496 Jul 24 01:18:33.920014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1158/2199] 10.222.0.27 () {62 vars in 1213 bytes} [Sun Jul 24 01:18:33 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:18:33.948900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:33.962716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3de9a749c874cfc8c34deffb1001a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336a5a8ae294f77aba940d67364b0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:33.963171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:33.991065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:33.993460 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e1284ea-2390-4d36-839b-7572da593139 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 200 len: 1305 microversion: 2.1 time: 0.364139 Jul 24 01:18:34.003852 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1042/2200] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:33 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 1305 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:34.015541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:34.016155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:34.016875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:34.029907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:34.035331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:34.040581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:34.041296 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:34.046850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:34.051222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:35.289056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.299032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.300625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.302215 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dea8acc-6cc7-41f0-90a8-4a4465b67936 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 1.380696 Jul 24 01:18:35.302805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1159/2201] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:33 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:35.323325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.325204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-252ac0f7-d87d-48e0-b690-444991cf7ddb tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:35.337930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.339565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:35.339565 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-21c15a9d-ee89-4ea9-ac18-59d1a132b492 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2956 microversion: 2.32 time: 1.342722 Jul 24 01:18:35.375871 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1043/2202] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:33 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2956 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:35.384063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:35.402446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:35.422071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-252ac0f7-d87d-48e0-b690-444991cf7ddb tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.117813 Jul 24 01:18:35.424096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:35.426073 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1160/2203] 10.222.0.27 () {60 vars in 1192 bytes} [Sun Jul 24 01:18:35 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:18:35.429447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:35.434306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:35.436801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:35.442894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:35.445273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:35.474702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:35.478729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:35.482621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:35.484139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.004322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:36.015329 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b8a35e02-89fe-487b-9e1a-987f8e227b73 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.587933 Jul 24 01:18:36.023465 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1161/2204] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:35 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:36.032641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.048185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:36.074529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.081399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.082475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.089115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.151115 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f HTTP/1.1 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ff263002-607e-42ae-a6b3-a7e20ee4085f'} Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.154722 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5d06167-b17b-4c9d-9389-2208c00ac93d tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 404 len: 111 microversion: 2.1 time: 0.129055 Jul 24 01:18:36.158800 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1162/2205] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:36 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:36.191424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7811b4d8-6410-4144-a1f6-1472e3bc073f tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.209692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:36.218910 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7811b4d8-6410-4144-a1f6-1472e3bc073f tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/8c41ed13-3a65-448d-92bc-36119ecb3854" status: 200 len: 235 microversion: 2.64 time: 0.061040 Jul 24 01:18:36.224243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-893f4a8b-06c8-4d4c-a6dc-d708de329c84 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.843686 Jul 24 01:18:36.224243 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1044/2206] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:35 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:36.229005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.237591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:36.250949 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1163/2207] 10.222.0.27 () {60 vars in 1303 bytes} [Sun Jul 24 01:18:36 2022] GET /compute/v2.1/os-server-groups/8c41ed13-3a65-448d-92bc-36119ecb3854 => generated 235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:18:36.257187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9651c298-351e-42cc-8cf2-0ba1483afa08 tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.258353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.261016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.265014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.266547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.331359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f HTTP/1.1 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ff263002-607e-42ae-a6b3-a7e20ee4085f'} Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:36.339717 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.343428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.347186 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9651c298-351e-42cc-8cf2-0ba1483afa08 tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/8c41ed13-3a65-448d-92bc-36119ecb3854" status: 204 len: 0 microversion: 2.64 time: 0.094933 Jul 24 01:18:36.352478 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1164/2208] 10.222.0.27 () {60 vars in 1306 bytes} [Sun Jul 24 01:18:36 2022] DELETE /compute/v2.1/os-server-groups/8c41ed13-3a65-448d-92bc-36119ecb3854 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:18:36.352651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:36.355987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.356435 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9774b2aa-284e-4f84-b562-0fa402725d0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 404 len: 111 microversion: 2.1 time: 0.128385 Jul 24 01:18:36.356697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:36.358976 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1045/2209] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:36 2022] DELETE /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:36.379451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73fb3e17-30c6-47a1-8d78-96e8fe0a7e4b tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.382917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.385139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.398768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.399501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.408048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-73fb3e17-30c6-47a1-8d78-96e8fe0a7e4b tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] HTTP exception thrown: Instance group 8c41ed13-3a65-448d-92bc-36119ecb3854 could not be found. Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73fb3e17-30c6-47a1-8d78-96e8fe0a7e4b tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Request method failure captured: Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-server-groups/8c41ed13-3a65-448d-92bc-36119ecb3854 HTTP/1.1 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J3osj3vmCSBVF-iscVW_godK_r7T0l6cxul16PRyjGcOUEdG25NOord6oNT7Y7K77Oeg8QLank3Lt5SQdOA0I2JEEgK02PZxbhqCqXUT9iSdNa4q-C-W7qVr2wseUf_FkekBVSu46GShBwjCMzCD7jGjpafYGy_ZW7xyraA63_3JO4 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.64 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 4325ec434a874304a31c9de29d4c1fbc Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerGroup264TestJSON-1981826877 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4325ec434a874304a31c9de29d4c1fbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4325ec434a874304a31c9de29d4c1fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4325ec434a874304a31c9de29d4c1fbc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4325ec434a874304a31c9de29d4c1fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerGroup264TestJSON-1981826877 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 4325ec434a874304a31c9de29d4c1fbc Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1981826877 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerGroup264TestJSON-1981826877-project Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 2a53625b6a1148aa8ae55575516d7b77 Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerGroup264TestJSON-1981826877-project Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: exception: Instance group 8c41ed13-3a65-448d-92bc-36119ecb3854 could not be found. Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8c41ed13-3a65-448d-92bc-36119ecb3854'} Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8c41ed13-3a65-448d-92bc-36119ecb3854 could not be found. Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8c41ed13-3a65-448d-92bc-36119ecb3854 could not be found. Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.419598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8c41ed13-3a65-448d-92bc-36119ecb3854 could not be found. Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73fb3e17-30c6-47a1-8d78-96e8fe0a7e4b tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] Returning 404 to user: Instance group 8c41ed13-3a65-448d-92bc-36119ecb3854 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73fb3e17-30c6-47a1-8d78-96e8fe0a7e4b tempest-ServerGroup264TestJSON-1981826877 tempest-ServerGroup264TestJSON-1981826877-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/8c41ed13-3a65-448d-92bc-36119ecb3854" status: 404 len: 117 microversion: 2.64 time: 0.058952 Jul 24 01:18:36.425597 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1046/2210] 10.222.0.27 () {60 vars in 1306 bytes} [Sun Jul 24 01:18:36 2022] DELETE /compute/v2.1/os-server-groups/8c41ed13-3a65-448d-92bc-36119ecb3854 => generated 117 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:18:36.433538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.434215 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: ff263002-607e-42ae-a6b3-a7e20ee4085f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:36.464246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.464720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.469536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.470046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.500492 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f HTTP/1.1 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ff263002-607e-42ae-a6b3-a7e20ee4085f'} Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:36.513843 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance ff263002-607e-42ae-a6b3-a7e20ee4085f could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac9ccc6f-4c08-414b-ba95-00a80d8e3425 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f" status: 404 len: 111 microversion: 2.1 time: 0.088511 Jul 24 01:18:36.520192 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1047/2211] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:36 2022] GET /compute/v2.1/servers/ff263002-607e-42ae-a6b3-a7e20ee4085f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:36.530733 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:36.535626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:36.569782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.570358 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:36.572072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:36.572549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.172591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.173689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.185624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.192966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.194439 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3edb4c7b-e8ef-4e28-b2ec-a283647c7074 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.845579 Jul 24 01:18:37.195306 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1165/2212] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:36 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:37.210793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:37.214507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:37.224838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.230762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.231105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.232274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.236589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.236782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.238029 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6bbc9994-39fd-4a81-9a3a-e7870877510a tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2956 microversion: 2.32 time: 0.719802 Jul 24 01:18:37.251258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1048/2213] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:36 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2956 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:37.267402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e6d70156-f969-4b57-b776-f15dd4fc72e7 req-301a643c-e358-4090-9376-c221eda63d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e73367-e6d8-4941-a4e2-f5541bc62f03", "name": "network-vif-plugged", "status": "completed", "tag": "5a95cb51-9367-4afa-8255-acadb5df2832"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:37.293443 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:37.305729 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e6d70156-f969-4b57-b776-f15dd4fc72e7 req-301a643c-e358-4090-9376-c221eda63d09 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 HTTP/1.1 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b84ebfcb-7902-494e-b349-e56b08e23a40'} Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:37.306319 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:37.309537 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:37.310197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e6d70156-f969-4b57-b776-f15dd4fc72e7 req-301a643c-e358-4090-9376-c221eda63d09 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.312445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:37.320851 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5420502d-db2a-40a2-8930-de5f9ac9e0ec tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 404 len: 111 microversion: 2.1 time: 0.113183 Jul 24 01:18:37.322241 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1166/2214] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:37 2022] DELETE /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:37.340369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:37.341425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:37.364531 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e6d70156-f969-4b57-b776-f15dd4fc72e7 req-301a643c-e358-4090-9376-c221eda63d09 service nova] Creating event network-vif-plugged:5a95cb51-9367-4afa-8255-acadb5df2832 for instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 on n-h1-master-1 Jul 24 01:18:37.365082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.367234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.368543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.369247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.381475 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e6d70156-f969-4b57-b776-f15dd4fc72e7 req-301a643c-e358-4090-9376-c221eda63d09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140162 Jul 24 01:18:37.387025 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1049/2215] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:37.404161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:37.404907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:37.424282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.424749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.425568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.426046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.903882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.922188 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ac55004-e9d6-482e-bf50-db1e69047292 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.533599 Jul 24 01:18:37.922811 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1050/2216] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:37 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:37.928161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:37.939673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:37.953068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.953529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.954543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:37.954996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:37.963592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:37.976931 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8cdf7145-cb5f-49a5-b9f5-8d2c5bd413d0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.652459 Jul 24 01:18:37.978510 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1167/2217] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:37 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:37.994922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:37.995683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b84ebfcb-7902-494e-b349-e56b08e23a40] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:38.015868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.016360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.017204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.017655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.065307 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 HTTP/1.1 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b84ebfcb-7902-494e-b349-e56b08e23a40'} Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:38.071616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.076214 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.076214 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:38.076214 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:38.076214 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:38.076214 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:38.076214 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. Jul 24 01:18:38.076214 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.080652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance b84ebfcb-7902-494e-b349-e56b08e23a40 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:38.081884 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7609156-c923-4fe1-82ab-d87942b7a179 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40" status: 404 len: 111 microversion: 2.1 time: 0.102090 Jul 24 01:18:38.086840 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1168/2218] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:37 2022] GET /compute/v2.1/servers/b84ebfcb-7902-494e-b349-e56b08e23a40 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:38.103090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c5629f4a-0a45-42e0-9e8f-67979136e599 req-c0fcc095-70bd-4baf-b5ff-39fdb8a2c00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28d5f2d-e02d-490f-902d-b6d0cf94cb8d", "tag": "6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:38.182374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c5629f4a-0a45-42e0-9e8f-67979136e599 req-c0fcc095-70bd-4baf-b5ff-39fdb8a2c00a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.186515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:38.187186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c5629f4a-0a45-42e0-9e8f-67979136e599 req-c0fcc095-70bd-4baf-b5ff-39fdb8a2c00a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.199012 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-639f7a18-c13a-43e3-ad2a-efe568e644b9 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1588 microversion: 2.1 time: 0.274378 Jul 24 01:18:38.202208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1051/2219] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:37 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1588 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:38.214294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:38.215080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:38.215708 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c5629f4a-0a45-42e0-9e8f-67979136e599 req-c0fcc095-70bd-4baf-b5ff-39fdb8a2c00a service nova] Creating event network-changed:6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da for instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d on n-h1-master-1 Jul 24 01:18:38.232952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.233830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.234818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.235428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.255953 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c5629f4a-0a45-42e0-9e8f-67979136e599 req-c0fcc095-70bd-4baf-b5ff-39fdb8a2c00a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165911 Jul 24 01:18:38.256617 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.257608 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1169/2220] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 HTTP/1.1 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: exception: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'fbcef7d1-f119-4018-9d80-58db946c1a64'} Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:38.266177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.270368 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.278139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:38.278359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:38.279418 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42403bd4-5be3-474d-bbbe-df6bc5226607 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 404 len: 111 microversion: 2.1 time: 0.075830 Jul 24 01:18:38.280643 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1052/2221] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:38 2022] DELETE /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:38.281326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:38.287501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:38.289224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:38.297616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.298696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.299713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.300404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.302551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.303396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.304725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.305884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.867896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:38.886126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:38.888382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:38.895490 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f9439f7-10c5-4a12-91c9-7cd96fe5bff8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.633218 Jul 24 01:18:38.896547 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1170/2222] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:38 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:38.912045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:38.913095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: fbcef7d1-f119-4018-9d80-58db946c1a64] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:38.925608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.932191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.935122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:38.935122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:38.976633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 HTTP/1.1 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: exception: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'fbcef7d1-f119-4018-9d80-58db946c1a64'} Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:38.980910 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:38.986384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance fbcef7d1-f119-4018-9d80-58db946c1a64 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:39.003127 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-666d591f-c997-4271-9a5b-3820071a83ff tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64" status: 404 len: 111 microversion: 2.1 time: 0.104836 Jul 24 01:18:39.006455 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1171/2223] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:38 2022] GET /compute/v2.1/servers/fbcef7d1-f119-4018-9d80-58db946c1a64 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:39.021895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:39.027960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:39.078894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:39.079379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:39.080492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:39.081276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:39.089259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:39.092895 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:39.112914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:39.136951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:39.138757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dfd58eda-6a89-4d2b-a7f5-ba4a5eb8fbc7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2935 microversion: 2.32 time: 0.856445 Jul 24 01:18:39.158828 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1053/2224] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:38 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2935 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:39.186372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:39.187376 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:39.200317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:39.214511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:39.217657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:39.225239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.240774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.252803 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33d6c797-e958-446c-b29d-268d0f24b8cc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 1.242620 Jul 24 01:18:40.258052 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1172/2225] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:39 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:40.263471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:40.264753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.270186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:40.273593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de61b18e-8fc4-4277-a293-1738dbee766e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 1.106713 Jul 24 01:18:40.278860 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1054/2226] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:39 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:40.289886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.290617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.291688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.293162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c7152f24-ab20-4767-9c20-08b8f382c0f3 req-e30aa615-482d-4702-b621-b4909e8f6f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-unplugged", "status": "completed", "tag": "a6840e15-03ea-4322-b29f-77952f504989"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-unplugged", "status": "completed", "tag": "46b2e1a2-faec-4cdb-bff2-afbecdb5159d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:40.293939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.326643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c7152f24-ab20-4767-9c20-08b8f382c0f3 req-e30aa615-482d-4702-b621-b4909e8f6f30 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.327115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c7152f24-ab20-4767-9c20-08b8f382c0f3 req-e30aa615-482d-4702-b621-b4909e8f6f30 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.328067 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 HTTP/1.1 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '4bc411e9-88ab-485f-b9f0-e1b452857f21'} Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:40.330140 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:40.333439 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16186909-0f77-4ba7-aed6-02be588edb0c tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 404 len: 111 microversion: 2.1 time: 0.072368 Jul 24 01:18:40.339129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1173/2227] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:40 2022] DELETE /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:40.345473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:40.346185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:40.355883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.356537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.357545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c7152f24-ab20-4767-9c20-08b8f382c0f3 req-e30aa615-482d-4702-b621-b4909e8f6f30 service nova] Creating event network-vif-unplugged:a6840e15-03ea-4322-b29f-77952f504989 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:40.358191 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c7152f24-ab20-4767-9c20-08b8f382c0f3 req-e30aa615-482d-4702-b621-b4909e8f6f30 service nova] Creating event network-vif-unplugged:46b2e1a2-faec-4cdb-bff2-afbecdb5159d for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:40.360120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.360586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.366647 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c7152f24-ab20-4767-9c20-08b8f382c0f3 req-e30aa615-482d-4702-b621-b4909e8f6f30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.086343 Jul 24 01:18:40.367726 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1055/2228] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:40.374977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:40.375702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:40.394389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.394847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.395652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.396091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.696024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.714122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.715912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.717224 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23ba243f-5f9e-4233-867c-39fc174bca3f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2914 microversion: 2.32 time: 0.348381 Jul 24 01:18:40.717881 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1056/2229] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:40 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2914 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:40.726950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:40.727578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 4bc411e9-88ab-485f-b9f0-e1b452857f21] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:40.747521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.747965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.748848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:40.749400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:40.770176 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 HTTP/1.1 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '4bc411e9-88ab-485f-b9f0-e1b452857f21'} Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.772113 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.777747 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.777747 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.777747 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.777747 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:40.777747 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:40.777747 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. Jul 24 01:18:40.777747 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.779856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance 4bc411e9-88ab-485f-b9f0-e1b452857f21 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:40.780941 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa9cc5c1-44ac-4d3e-86ec-a845e89c5455 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21" status: 404 len: 111 microversion: 2.1 time: 0.062179 Jul 24 01:18:40.781754 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1057/2230] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:40 2022] GET /compute/v2.1/servers/4bc411e9-88ab-485f-b9f0-e1b452857f21 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:40.792732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-911becae-867d-410a-9c55-e921ad794269 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:40.793641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-911becae-867d-410a-9c55-e921ad794269 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:40.800744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-911becae-867d-410a-9c55-e921ad794269 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-911becae-867d-410a-9c55-e921ad794269 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 HTTP/1.1 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '69f948b6-44df-4699-843e-a9cbf75935a6'} Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.802755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.806326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.806326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.806326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.806326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:40.806326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:40.806326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.806326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.808386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-911becae-867d-410a-9c55-e921ad794269 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:40.809505 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-911becae-867d-410a-9c55-e921ad794269 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6" status: 404 len: 111 microversion: 2.1 time: 0.022849 Jul 24 01:18:40.810541 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1058/2231] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:40 2022] DELETE /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:40.813627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.818489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce342ca1-dc96-4c47-8cb2-96b01c7f5096 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:40.819246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ce342ca1-dc96-4c47-8cb2-96b01c7f5096 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: 69f948b6-44df-4699-843e-a9cbf75935a6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:40.826811 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ce342ca1-dc96-4c47-8cb2-96b01c7f5096 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.827555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce342ca1-dc96-4c47-8cb2-96b01c7f5096 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 HTTP/1.1 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '69f948b6-44df-4699-843e-a9cbf75935a6'} Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:40.829127 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:40.832420 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:40.832420 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:40.832420 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:40.832420 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. Jul 24 01:18:40.832420 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:40.832694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:40.832694 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fcca0c64-81f3-4faa-9590-bdc25743600a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.492453 Jul 24 01:18:40.834970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce342ca1-dc96-4c47-8cb2-96b01c7f5096 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance 69f948b6-44df-4699-843e-a9cbf75935a6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:40.836554 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1174/2232] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:40 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:40.836872 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ce342ca1-dc96-4c47-8cb2-96b01c7f5096 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6" status: 404 len: 111 microversion: 2.1 time: 0.022153 Jul 24 01:18:40.837987 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1059/2233] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:40 2022] GET /compute/v2.1/servers/69f948b6-44df-4699-843e-a9cbf75935a6 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:41.067502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-61165316", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d7b33bde-6a7e-483d-95b7-ee27bdd50292"}], "security_groups": [{"name": "tempest-securitygroup--830668376"}], "key_name": "tempest-keypair-158983956", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "55b463ba-9644-4673-bb6e-2098b64b6d6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:41.287991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ae2e97b7-64ef-42bd-819b-52a0223b66ff req-9ba2b661-cc99-4f08-9e7f-f41f649289f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-deleted", "tag": "58bea69b-6e2f-4382-9914-db1f74f63054"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:41.301614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ae2e97b7-64ef-42bd-819b-52a0223b66ff req-9ba2b661-cc99-4f08-9e7f-f41f649289f9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:41.307423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ae2e97b7-64ef-42bd-819b-52a0223b66ff req-9ba2b661-cc99-4f08-9e7f-f41f649289f9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:41.330754 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ae2e97b7-64ef-42bd-819b-52a0223b66ff req-9ba2b661-cc99-4f08-9e7f-f41f649289f9 service nova] Creating event network-vif-deleted:58bea69b-6e2f-4382-9914-db1f74f63054 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:41.358626 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ae2e97b7-64ef-42bd-819b-52a0223b66ff req-9ba2b661-cc99-4f08-9e7f-f41f649289f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176707 Jul 24 01:18:41.359478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1060/2234] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:18:41.364817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:41.368002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:41.378464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:41.390650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:41.392312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:41.392924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:41.470754 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] validate_networks() for [('d7b33bde-6a7e-483d-95b7-ee27bdd50292', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:18:42.114528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:42.125562 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d13e6c73-3ade-4cb1-8570-00d520542aee tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.764601 Jul 24 01:18:42.127178 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1061/2235] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:41 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:42.138218 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:42.141899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:42.157940 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:42.159784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.160346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.161308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.161800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.555471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:42.568434 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1996487d-31c9-4bff-a91c-5db5d2589478 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.440001 Jul 24 01:18:42.570068 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1062/2236] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:42 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:42.588257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:42.589041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:42.596118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.596584 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.597398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.597872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.664331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Getting quotas for project 97fbef19413a4054aa808c676248fd27. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:42.686719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Getting quotas for user c6d333d036f74225bf1afd3d36d8e339 and project 97fbef19413a4054aa808c676248fd27. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:42.725388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:18:42.726957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:18:42.728216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:18:42.729205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:18:42.730131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:18:42.754474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.755439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.756498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:42.757843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:42.779856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Getting quotas for project 97fbef19413a4054aa808c676248fd27. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:42.786249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Getting quotas for user c6d333d036f74225bf1afd3d36d8e339 and project 97fbef19413a4054aa808c676248fd27. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:42.891410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:18:42.894976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='55b463ba-9644-4673-bb6e-2098b64b6d6a',volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:43.093653 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f435ce0-c9da-4ef8-878c-187668d67f78 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.033678 Jul 24 01:18:43.094746 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1175/2237] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:18:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:18:43.112224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:43.114890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:43.134741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.135932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.136755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.137248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.278539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:43.297878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:43.306116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:43.312151 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa7a8b88-b031-4fc9-a70c-53ebefc812ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2706 microversion: 2.32 time: 0.728628 Jul 24 01:18:43.325195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1063/2238] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:42 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2706 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:43.325195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-unplugged", "status": "completed", "tag": "7049bd24-a30d-473a-9ed1-ed88450f1b75"}, {"server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "name": "network-vif-plugged", "status": "completed", "tag": "093fbcb8-07c8-486a-96f6-6f727c462f41"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-unplugged", "status": "completed", "tag": "58bea69b-6e2f-4382-9914-db1f74f63054"}, {"server_uuid": "a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a", "name": "network-vif-plugged", "status": "completed", "tag": "a6fd7eb1-fcfc-43ec-adcd-600bf5808df7"}, {"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-unplugged", "status": "completed", "tag": "8ba56271-68b3-4ab7-af7d-56a02d80b307"}, {"server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "name": "network-vif-plugged", "status": "completed", "tag": "0f69d451-6073-46e4-98bf-24a771236bac"}, {"server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "name": "network-vif-plugged", "status": "completed", "tag": "9260835a-6603-469a-96db-99ebebb155d4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:43.351769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.352346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.375925 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Creating event network-vif-unplugged:7049bd24-a30d-473a-9ed1-ed88450f1b75 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:43.377014 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Creating event network-vif-plugged:093fbcb8-07c8-486a-96f6-6f727c462f41 for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:43.377791 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Creating event network-vif-unplugged:58bea69b-6e2f-4382-9914-db1f74f63054 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:43.378889 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Creating event network-vif-plugged:a6fd7eb1-fcfc-43ec-adcd-600bf5808df7 for instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a on n-h2-master-1 Jul 24 01:18:43.379674 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Creating event network-vif-unplugged:8ba56271-68b3-4ab7-af7d-56a02d80b307 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:43.380541 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Creating event network-vif-plugged:0f69d451-6073-46e4-98bf-24a771236bac for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:43.381248 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] Creating event network-vif-plugged:9260835a-6603-469a-96db-99ebebb155d4 for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:43.401491 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e7827c44-f2f1-4a95-8f9c-447dff09e97a req-1438b42f-999b-4919-939e-ce55bce1e4b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.086014 Jul 24 01:18:43.409219 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1064/2239] 10.222.0.27 () {64 vars in 1318 bytes} [Sun Jul 24 01:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:43.434263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f99cb4c5-81a8-4911-9ff8-0e90d57c39af tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:43.435312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f99cb4c5-81a8-4911-9ff8-0e90d57c39af tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:43.610006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:43.628661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:43.633507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:43.636857 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-479243f9-8eee-4840-9749-f9e18f3146bc tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.539027 Jul 24 01:18:43.638786 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1176/2240] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:43 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:43.650340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:43.654425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:43.670279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.671426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.672435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.674895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.677993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f99cb4c5-81a8-4911-9ff8-0e90d57c39af tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:43.702903 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f99cb4c5-81a8-4911-9ff8-0e90d57c39af tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1119 microversion: 2.1 time: 0.290708 Jul 24 01:18:43.707311 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1065/2241] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:43 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1119 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:43.727280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0571c827-7e3c-45ee-877a-d58ce6f8efea req-493a0cfe-b94c-4737-8cf6-86713dfe1821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-deleted", "tag": "7049bd24-a30d-473a-9ed1-ed88450f1b75"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:43.752134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0571c827-7e3c-45ee-877a-d58ce6f8efea req-493a0cfe-b94c-4737-8cf6-86713dfe1821 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.754332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0571c827-7e3c-45ee-877a-d58ce6f8efea req-493a0cfe-b94c-4737-8cf6-86713dfe1821 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.791655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0571c827-7e3c-45ee-877a-d58ce6f8efea req-493a0cfe-b94c-4737-8cf6-86713dfe1821 service nova] Creating event network-vif-deleted:7049bd24-a30d-473a-9ed1-ed88450f1b75 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:43.808545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0571c827-7e3c-45ee-877a-d58ce6f8efea req-493a0cfe-b94c-4737-8cf6-86713dfe1821 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096947 Jul 24 01:18:43.816974 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1066/2242] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:43.842969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:43.845700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:43.857435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.858230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:43.859846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:43.860511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:44.211796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:44.220583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-678f729f-45f4-4898-8572-1fa9bc5822f5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 0.579676 Jul 24 01:18:44.227156 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1177/2243] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:43 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:44.332776 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:44.333414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:44.343291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:44.343990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:44.345122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:44.345925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.154478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.170750 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d75a81c4-75c9-4902-94b1-d4d88ae0a603 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 1.349602 Jul 24 01:18:45.187652 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1067/2244] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:43 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:45.196723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-df6c8e72-4ff6-496d-8a98-b2f0059eedb6 req-c8eff683-cb40-48b6-b249-c4f72e8a21eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0", "name": "network-vif-unplugged", "status": "completed", "tag": "e51ff2a6-c9bc-4402-a926-4d10ea46461f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:45.221107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-df6c8e72-4ff6-496d-8a98-b2f0059eedb6 req-c8eff683-cb40-48b6-b249-c4f72e8a21eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.226079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-df6c8e72-4ff6-496d-8a98-b2f0059eedb6 req-c8eff683-cb40-48b6-b249-c4f72e8a21eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.257554 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-df6c8e72-4ff6-496d-8a98-b2f0059eedb6 req-c8eff683-cb40-48b6-b249-c4f72e8a21eb service nova] Creating event network-vif-unplugged:e51ff2a6-c9bc-4402-a926-4d10ea46461f for instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 on n-h2-master-1 Jul 24 01:18:45.268167 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-df6c8e72-4ff6-496d-8a98-b2f0059eedb6 req-c8eff683-cb40-48b6-b249-c4f72e8a21eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078414 Jul 24 01:18:45.269429 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1068/2245] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:45.278886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:45.280581 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:45.289953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.290706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.291860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.292471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.335175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.352040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.360982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.364065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1e70c06a-0078-497d-8416-e9160d28d9de tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2545 microversion: 2.32 time: 1.035139 Jul 24 01:18:45.366772 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1178/2246] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:44 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2545 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:45.381752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:45.384515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:45.400366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.401080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.402859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.405123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.696886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.721374 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3eb4bf35-d96f-4d7f-b9f4-f56ac4e3487c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1235 microversion: 2.1 time: 0.353250 Jul 24 01:18:45.737264 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1179/2247] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:45 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1235 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:45.755210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:45.756143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:45.778689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.783739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.784745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:45.785311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:45.965700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.980687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.989737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:45.993524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-45a0e962-5bb2-499f-b52b-b4ca3b71864b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.720010 Jul 24 01:18:46.006658 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1069/2248] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:45 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:46.019245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-eedfbb4e-a73c-4fea-b57e-bf1da89882f6 req-9b697383-9b32-4873-b98d-0388fd3bf4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-deleted", "tag": "46b2e1a2-faec-4cdb-bff2-afbecdb5159d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:46.047488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eedfbb4e-a73c-4fea-b57e-bf1da89882f6 req-9b697383-9b32-4873-b98d-0388fd3bf4dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.049736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eedfbb4e-a73c-4fea-b57e-bf1da89882f6 req-9b697383-9b32-4873-b98d-0388fd3bf4dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.089847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-eedfbb4e-a73c-4fea-b57e-bf1da89882f6 req-9b697383-9b32-4873-b98d-0388fd3bf4dd service nova] Creating event network-vif-deleted:46b2e1a2-faec-4cdb-bff2-afbecdb5159d for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:46.100007 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-eedfbb4e-a73c-4fea-b57e-bf1da89882f6 req-9b697383-9b32-4873-b98d-0388fd3bf4dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091563 Jul 24 01:18:46.102405 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1070/2249] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:46.190370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.191089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.208046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.208519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.216028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.216598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.752524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:46.773812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:46.787406 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-34b6e376-5776-4941-abe7-47d107c97c4e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1355 microversion: 2.1 time: 1.048247 Jul 24 01:18:46.789810 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1180/2250] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:45 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1355 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:46.791557 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7bad62f-a9cb-410b-9e7f-8636a995b8de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1318 microversion: 2.1 time: 0.605616 Jul 24 01:18:46.797796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.803247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.803469 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1071/2251] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:46 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:46.818093 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.820897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.827889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.830712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.834100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.834704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.835565 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.838286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.839740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.841999 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.880248 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 HTTP/1.1 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f5fc9a91-b438-478b-89bf-c5b70e390fd7'} Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:46.882608 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:46.887486 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:46.890112 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:46.892430 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5eba8803-585d-41db-9d47-a6405fd92278 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 404 len: 111 microversion: 2.1 time: 0.087704 Jul 24 01:18:46.894577 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1072/2252] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:46 2022] DELETE /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:46.911592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:46.912478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:46.923936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.924630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:46.926031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:46.927072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.634265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:47.656524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:47.658814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:47.660441 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9697dd90-539c-476e-8382-8a5f4afc9e6f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2384 microversion: 2.32 time: 0.869462 Jul 24 01:18:47.661250 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1181/2253] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:46 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2384 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:47.668522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:47.671700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: f5fc9a91-b438-478b-89bf-c5b70e390fd7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:47.686937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.687900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.688969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.689818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.723335 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 HTTP/1.1 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f5fc9a91-b438-478b-89bf-c5b70e390fd7'} Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:47.725364 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:47.731659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:47.731659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:47.731659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:47.731659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:47.731659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:47.731659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. Jul 24 01:18:47.731659 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:18:47.743734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance f5fc9a91-b438-478b-89bf-c5b70e390fd7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:47.744953 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5a7a2fb4-c520-4967-ad62-53b000a751db tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7" status: 404 len: 111 microversion: 2.1 time: 0.082514 Jul 24 01:18:47.745764 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1182/2254] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:47 2022] GET /compute/v2.1/servers/f5fc9a91-b438-478b-89bf-c5b70e390fd7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:47.752351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:47.753523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:47.766581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.767432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.768450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.769991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.843305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:47.854636 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a645acb6-b0ef-46be-889d-2d3eb9dab061 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.957505 Jul 24 01:18:47.859502 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1073/2255] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:46 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:47.872292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0f8ef188-7b03-43c3-9da8-a1d174db3401 req-45ea14ad-7251-4304-84b1-8a73c81c28f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0", "tag": "e51ff2a6-c9bc-4402-a926-4d10ea46461f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:47.899141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0f8ef188-7b03-43c3-9da8-a1d174db3401 req-45ea14ad-7251-4304-84b1-8a73c81c28f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.900951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0f8ef188-7b03-43c3-9da8-a1d174db3401 req-45ea14ad-7251-4304-84b1-8a73c81c28f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.931301 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0f8ef188-7b03-43c3-9da8-a1d174db3401 req-45ea14ad-7251-4304-84b1-8a73c81c28f1 service nova] Creating event network-changed:e51ff2a6-c9bc-4402-a926-4d10ea46461f for instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 on n-h2-master-1 Jul 24 01:18:47.943821 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0f8ef188-7b03-43c3-9da8-a1d174db3401 req-45ea14ad-7251-4304-84b1-8a73c81c28f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079872 Jul 24 01:18:47.945159 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1074/2256] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:47.959362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:47.961179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:47.980263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.980857 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:47.982945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:47.985455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.016597 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 HTTP/1.1 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9'} Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:48.025999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:48.030076 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-64b67a9d-478a-4059-9f2a-94e139232e47 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 404 len: 111 microversion: 2.1 time: 0.076871 Jul 24 01:18:48.031392 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1075/2257] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:47 2022] DELETE /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:48.045844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:48.046484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:48.062874 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.063344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.067961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.068431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.456934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:48.459566 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:48.479976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:48.483790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:48.499357 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f077cae3-6be6-460e-9524-8ffb66ef06ff tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.752303 Jul 24 01:18:48.510217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1183/2258] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:47 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:48.515804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:48.516715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:48.524035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.524673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.525893 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.526481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.796658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:48.813055 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04405f32-9ed6-446b-a91a-64766597781b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1804 microversion: 2.1 time: 0.777335 Jul 24 01:18:48.814251 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1076/2259] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:48 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1804 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:48.819428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:48.843007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] [instance: b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:48.862359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.863519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.864480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.865069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.899673 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] HTTP exception thrown: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Request method failure captured: Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 HTTP/1.1 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jyg30FXU3hps_5p_4kXOrRMhLUivldXZuxHfQ03Qq04wdYlW7i8EWiHlE2RUW9cvE_K8O9qMKpAE8sWu00Xof70ykc10TDelIUn3IOhgGRmMnujciqeKhQDbmtFtPwSQme16fhpSQQOEXld7Jlm5j0XYohy0cs3_bd7ZZPPMXX0C8Q Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8336a5a8ae294f77aba940d67364b0b8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8336a5a8ae294f77aba940d67364b0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8336a5a8ae294f77aba940d67364b0b8 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-232823985 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3de9a749c874cfc8c34deffb1001a79 Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-232823985-project Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9'} Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:48.904766 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.908735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:48.908735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:48.908735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:48.908735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:48.908735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:48.908735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. Jul 24 01:18:48.908735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:48.912472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] Returning 404 to user: Instance b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:48.918881 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1e4d9e5-06db-46b9-bf39-78d051c4ec36 tempest-DeleteServersTestJSON-232823985 tempest-DeleteServersTestJSON-232823985-project] 10.222.0.27 "GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9" status: 404 len: 111 microversion: 2.1 time: 0.102990 Jul 24 01:18:48.919922 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1077/2260] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:48 2022] GET /compute/v2.1/servers/b6dfdf7e-dbfd-4c3f-8167-c78bf01e92b9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:48.927887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-16f7d150-08d7-474e-ac02-a5b2f07b1760 req-6814aa0e-d530-4cc3-90c0-fce0824627fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-deleted", "tag": "a6840e15-03ea-4322-b29f-77952f504989"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:48.949719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-16f7d150-08d7-474e-ac02-a5b2f07b1760 req-6814aa0e-d530-4cc3-90c0-fce0824627fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:48.950267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-16f7d150-08d7-474e-ac02-a5b2f07b1760 req-6814aa0e-d530-4cc3-90c0-fce0824627fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:48.987259 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-16f7d150-08d7-474e-ac02-a5b2f07b1760 req-6814aa0e-d530-4cc3-90c0-fce0824627fe service nova] Creating event network-vif-deleted:a6840e15-03ea-4322-b29f-77952f504989 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:48.998692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:49.024655 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-adeb189c-d324-4a12-9e9d-3cd4e7a49b5f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1467 microversion: 2.1 time: 0.511172 Jul 24 01:18:49.027537 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-16f7d150-08d7-474e-ac02-a5b2f07b1760 req-6814aa0e-d530-4cc3-90c0-fce0824627fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106167 Jul 24 01:18:49.028006 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1184/2261] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:48 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1467 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:49.034380 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1078/2262] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:49.040547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:49.057298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:49.068688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.069545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.070552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.074208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.230718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:49.255945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:49.258705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:49.261092 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa3733c6-01a8-4901-b85d-743a3deda4e1 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 2029 microversion: 2.32 time: 0.224628 Jul 24 01:18:49.262006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1079/2263] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:49 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 2029 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:49.284353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-709c5a1c-6f3c-47b2-b383-b84ecfd0c756 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:49.285399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-709c5a1c-6f3c-47b2-b383-b84ecfd0c756 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:49.299584 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-709c5a1c-6f3c-47b2-b383-b84ecfd0c756 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.300216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-709c5a1c-6f3c-47b2-b383-b84ecfd0c756 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.303394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-709c5a1c-6f3c-47b2-b383-b84ecfd0c756 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.304009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-709c5a1c-6f3c-47b2-b383-b84ecfd0c756 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.363538 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-709c5a1c-6f3c-47b2-b383-b84ecfd0c756 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025/ips" status: 200 len: 217 microversion: 2.1 time: 0.100224 Jul 24 01:18:49.367852 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1080/2264] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:18:49 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025/ips => generated 217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:49.382283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:49.384624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:49.402192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-999f7800-5bc7-450e-9209-550336beac0a tempest-ExtensionsTest-216157659 tempest-ExtensionsTest-216157659-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:49.404002 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-999f7800-5bc7-450e-9209-550336beac0a tempest-ExtensionsTest-216157659 tempest-ExtensionsTest-216157659-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.374847 Jul 24 01:18:49.404905 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1185/2265] 10.222.0.27 () {58 vars in 1169 bytes} [Sun Jul 24 01:18:49 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:49.410282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:49.411522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.412220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.413309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.414014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.418872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:49.428373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.442815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:49.443800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:49.451173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.128722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.134462 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:50.138198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.146753 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-33249abd-4744-4f4d-a5fb-2a009e48d9ec tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.777648 Jul 24 01:18:50.147871 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1081/2266] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:49 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:50.155613 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a62ea21-330d-49c9-961a-9eeea6bb1029 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03" status: 200 len: 1468 microversion: 2.1 time: 0.749020 Jul 24 01:18:50.156697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1186/2267] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:49 2022] GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03 => generated 1468 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:50.162596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:50.164668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:50.166015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3341c8da-a645-40ac-927c-e792ab23cd92 tempest-ExtensionsTest-216157659 tempest-ExtensionsTest-216157659-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:50.172947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.173646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.174947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.175617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.186071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3341c8da-a645-40ac-927c-e792ab23cd92 tempest-ExtensionsTest-216157659 tempest-ExtensionsTest-216157659-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.026873 Jul 24 01:18:50.196341 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1187/2268] 10.222.0.27 () {58 vars in 1133 bytes} [Sun Jul 24 01:18:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:18:50.204943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:50.205849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:50.221059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:18:50.224447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.224977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.234014 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.234553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.347885 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94c2c1bb-004d-4add-a434-361138693c01 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 204 len: 0 microversion: 2.1 time: 0.188442 Jul 24 01:18:50.354133 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1082/2269] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:18:50 2022] DELETE /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:18:50.368941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-49ae2174-431c-47e4-b54a-bb473bfd64fd req-db37490b-4cb2-45e9-b12e-52b4a7bb4e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0", "tag": "0f8871bc-b137-4f62-b97e-054f036425fd"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:50.380163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-49ae2174-431c-47e4-b54a-bb473bfd64fd req-db37490b-4cb2-45e9-b12e-52b4a7bb4e33 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.380705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-49ae2174-431c-47e4-b54a-bb473bfd64fd req-db37490b-4cb2-45e9-b12e-52b4a7bb4e33 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.393306 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-49ae2174-431c-47e4-b54a-bb473bfd64fd req-db37490b-4cb2-45e9-b12e-52b4a7bb4e33 service nova] Creating event network-changed:0f8871bc-b137-4f62-b97e-054f036425fd for instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 on n-h1-master-1 Jul 24 01:18:50.399533 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-49ae2174-431c-47e4-b54a-bb473bfd64fd req-db37490b-4cb2-45e9-b12e-52b4a7bb4e33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043636 Jul 24 01:18:50.400256 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1083/2270] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:50.405174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:50.411975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.414158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Searching by: {'reservation_id': 'r-n44ulwna', 'deleted': False, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:18:50.422131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.423213 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.425924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.426635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.528984 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.538987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.547270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.548926 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b4fcd98-c4f0-4d72-ae2a-141104f894f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.351310 Jul 24 01:18:50.560691 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1188/2271] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:50 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:50.567306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:50.568264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:50.577372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.577872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.578655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.579093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.584745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:18:50.686895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.699075 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.699889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.754068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.763743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.765476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:50.766975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eb6504d8-0877-43ee-b4b2-85cc5fcaedd3 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.204928 Jul 24 01:18:50.768271 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1189/2272] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:50 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:50.773176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:50.774096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:50.780887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.781640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.782685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:50.783334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:50.980588 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f419f4d-5485-4f89-a5c5-dc44bb7cc6b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-n44ulwna" status: 200 len: 2928 microversion: 2.1 time: 0.579200 Jul 24 01:18:50.981814 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1084/2273] 10.222.0.27 () {58 vars in 1196 bytes} [Sun Jul 24 01:18:50 2022] GET /compute/v2.1/servers/detail?reservation_id=r-n44ulwna => generated 2928 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:50.998804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a7383b9f-d696-4e71-8684-01eb31bd438a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:51.014330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.server_groups [None req-a7383b9f-d696-4e71-8684-01eb31bd438a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Querying cell 0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) for 2 instances {{(pid=119562) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 24 01:18:51.015513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7383b9f-d696-4e71-8684-01eb31bd438a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.016206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7383b9f-d696-4e71-8684-01eb31bd438a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.041597 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a7383b9f-d696-4e71-8684-01eb31bd438a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/40bc247f-8d0f-4ae4-8eb8-8847c9a97e19" status: 200 len: 270 microversion: 2.1 time: 0.046503 Jul 24 01:18:51.048547 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1085/2274] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:18:50 2022] GET /compute/v2.1/os-server-groups/40bc247f-8d0f-4ae4-8eb8-8847c9a97e19 => generated 270 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:51.054508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d0ea46ac-d358-40bf-8110-8d61b2e8057e tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:51.055680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d0ea46ac-d358-40bf-8110-8d61b2e8057e tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:51.062454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0ea46ac-d358-40bf-8110-8d61b2e8057e tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.063253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0ea46ac-d358-40bf-8110-8d61b2e8057e tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.064274 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0ea46ac-d358-40bf-8110-8d61b2e8057e tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.065049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0ea46ac-d358-40bf-8110-8d61b2e8057e tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.149261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:51.159534 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25051654-ff9c-4cf5-98d0-c36bc1299013 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1810 microversion: 2.1 time: 0.389649 Jul 24 01:18:51.161706 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1190/2275] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:50 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1810 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:51.167268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6617d969-9193-4016-9e22-9cd09d910809 req-254c45cb-d162-4b4d-8eeb-4e096a06a8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1", "name": "network-vif-deleted", "tag": "8ba56271-68b3-4ab7-af7d-56a02d80b307"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:51.177554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6617d969-9193-4016-9e22-9cd09d910809 req-254c45cb-d162-4b4d-8eeb-4e096a06a8be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.178373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6617d969-9193-4016-9e22-9cd09d910809 req-254c45cb-d162-4b4d-8eeb-4e096a06a8be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.199940 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6617d969-9193-4016-9e22-9cd09d910809 req-254c45cb-d162-4b4d-8eeb-4e096a06a8be service nova] Creating event network-vif-deleted:8ba56271-68b3-4ab7-af7d-56a02d80b307 for instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 on n-h1-master-1 Jul 24 01:18:51.206436 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6617d969-9193-4016-9e22-9cd09d910809 req-254c45cb-d162-4b4d-8eeb-4e096a06a8be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043122 Jul 24 01:18:51.207862 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1191/2276] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:51.214702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:51.215747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:51.235157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.235960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.237583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.238370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.348652 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d0ea46ac-d358-40bf-8110-8d61b2e8057e tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03" status: 200 len: 1619 microversion: 2.1 time: 0.298089 Jul 24 01:18:51.363597 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1086/2277] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:51 2022] GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03 => generated 1619 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:51.370815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-daadafa4-0572-4c99-89eb-8a87f483c4c1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:51.371776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-daadafa4-0572-4c99-89eb-8a87f483c4c1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:51.398199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daadafa4-0572-4c99-89eb-8a87f483c4c1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.398980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daadafa4-0572-4c99-89eb-8a87f483c4c1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.399873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daadafa4-0572-4c99-89eb-8a87f483c4c1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.400476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-daadafa4-0572-4c99-89eb-8a87f483c4c1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.619241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:51.635527 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25cef222-3ad9-4385-85ba-7154dd803809 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.426218 Jul 24 01:18:51.637975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1192/2278] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:51 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:51.652290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:51.652943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:51.659091 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:51.659513 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-daadafa4-0572-4c99-89eb-8a87f483c4c1 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1618 microversion: 2.1 time: 0.293506 Jul 24 01:18:51.660354 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1087/2279] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:51 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1618 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:51.661601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.662219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.663715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.664163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.786090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:51.786621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:51.799505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.800080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.800872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:51.801312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:51.944444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:51.944970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:51.959383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:51.965171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:51.968534 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b46ed523-1468-4a4b-ad17-04793f62e1ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.186512 Jul 24 01:18:51.984367 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1088/2280] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:51 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:51.987946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:51.994056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:52.000773 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4053a19-5dcf-47c3-abaa-4d54372d0600 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.351268 Jul 24 01:18:52.002215 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1211081715", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "98477c05-8901-4a3a-b18f-6a5923ce55be"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:52.002697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1193/2281] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:51 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:52.073887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:18:52.180371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:52.181185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:52.195230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.198152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.199229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.200777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.628011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:52.639139 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ffd80b60-45a2-4cba-932f-f15c4d609110 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1810 microversion: 2.1 time: 0.463559 Jul 24 01:18:52.639977 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1194/2282] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:52 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1810 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:52.653437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:18:52.653907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:18:52.654384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:18:52.654804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:18:52.655227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:18:52.674316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.674772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.675597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.676043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.714388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:18:52.722251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:18:52.757625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:18:52.760066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:18:52.769133 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:52.796617 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=18 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:52.828642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81c1525e-b530-4a28-a3f0-ac3b33219f88 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Calling method '.version_select at 0x7f05eaa4f790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:52.854368 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d15635e-cf74-4894-88e9-9064aab09fa4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867575 Jul 24 01:18:52.855031 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1089/2283] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:18:52.866768 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:52.867967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:52.876411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.877108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.878077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:52.878602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:52.951479 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-81c1525e-b530-4a28-a3f0-ac3b33219f88 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493/defaults" status: 200 len: 371 microversion: 2.1 time: 0.310070 Jul 24 01:18:52.952381 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1195/2284] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:18:52 2022] GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493/defaults => generated 371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:52.962118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c73ca9f5-abe2-4256-818d-e31c319bdcad tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:52.966670 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c73ca9f5-abe2-4256-818d-e31c319bdcad tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:53.080034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c73ca9f5-abe2-4256-818d-e31c319bdcad tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:53.091192 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c73ca9f5-abe2-4256-818d-e31c319bdcad tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1217 microversion: 2.1 time: 0.135969 Jul 24 01:18:53.091728 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1196/2285] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:52 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:53.107165 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dd6ddfe6-1c25-4fde-8ac5-3b964850878c tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Calling method '.version_select at 0x7f05ea95a3a0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:53.284469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:53.295919 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e516722c-7223-4af4-a9a9-41c99ea34cb2 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.434762 Jul 24 01:18:53.301457 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dd6ddfe6-1c25-4fde-8ac5-3b964850878c tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493" status: 200 len: 371 microversion: 2.1 time: 0.204181 Jul 24 01:18:53.308139 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1090/2286] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:52 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:53.313730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:53.315776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:53.320999 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1197/2287] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:18:53 2022] GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493 => generated 371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:53.324214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.324676 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:53.325494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.325987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:53.355769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:53.356444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:53.388749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.392749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:53.394493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.394950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:53.581785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:53.598834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:53.600491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:53.605267 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-868453ad-098c-47d8-b41b-f54c19185f9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.295680 Jul 24 01:18:53.620523 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1091/2288] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:53 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:53.635555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7cb0b739-a69b-41f8-86d7-2df7c4fc3b36 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Calling method '.version_select at 0x7f05eb117c10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:53.774844 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7cb0b739-a69b-41f8-86d7-2df7c4fc3b36 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493/defaults" status: 200 len: 371 microversion: 2.1 time: 0.152195 Jul 24 01:18:53.775728 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1092/2289] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:18:53 2022] GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493/defaults => generated 371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:53.781441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-961106c4-10d0-43b4-89cb-65f9cbb57efa req-15aa5098-693a-4804-8168-c06f3dfc30db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "name": "network-vif-deleted", "tag": "9260835a-6603-469a-96db-99ebebb155d4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:53.794342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-961106c4-10d0-43b4-89cb-65f9cbb57efa req-15aa5098-693a-4804-8168-c06f3dfc30db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.794835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-961106c4-10d0-43b4-89cb-65f9cbb57efa req-15aa5098-693a-4804-8168-c06f3dfc30db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:53.839510 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-961106c4-10d0-43b4-89cb-65f9cbb57efa req-15aa5098-693a-4804-8168-c06f3dfc30db service nova] Creating event network-vif-deleted:9260835a-6603-469a-96db-99ebebb155d4 for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:53.857021 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-961106c4-10d0-43b4-89cb-65f9cbb57efa req-15aa5098-693a-4804-8168-c06f3dfc30db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079980 Jul 24 01:18:53.857656 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1093/2290] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:53.873138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:53.874535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:53.906768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.907253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:53.908385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:53.908933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.078700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.089995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.091912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.093598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df5f872a-57e3-42d1-b068-8a3e100b1045 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.754332 Jul 24 01:18:54.094444 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1198/2291] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:53 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:54.119561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38f42261-e136-4e4b-9952-01379b2951f4 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Calling method '.version_select at 0x7f05eab5dee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:54.274473 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38f42261-e136-4e4b-9952-01379b2951f4 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493" status: 200 len: 371 microversion: 2.1 time: 0.177571 Jul 24 01:18:54.275449 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1199/2292] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:18:54 2022] GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493 => generated 371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:54.284835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:54.288088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:54.299167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.299379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:54.299672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.301155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:54.301773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.315709 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2178952b-f3c2-42fb-adc6-dd9a23695ca0 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1676 microversion: 2.1 time: 0.452416 Jul 24 01:18:54.316638 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1094/2293] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:53 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1676 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:54.322823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-215163ec-9d02-442d-ade0-86563d50d1b3 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Calling method '.version_select at 0x7f05eb1b70d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:54.505044 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-215163ec-9d02-442d-ade0-86563d50d1b3 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493?user_id=b15f555fdc39478493fa58dc657fe83e" status: 200 len: 371 microversion: 2.1 time: 0.187012 Jul 24 01:18:54.508223 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1095/2294] 10.222.0.27 () {58 vars in 1322 bytes} [Sun Jul 24 01:18:54 2022] GET /compute/v2.1/os-quota-sets/ff091d0cae8c4b98a837398bc263c493?user_id=b15f555fdc39478493fa58dc657fe83e => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:54.514111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:54.517141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:54.525024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:54.527205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.528338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:54.528990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.685290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.696692 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be384b80-db23-4d82-8687-4d38ff6f1d60 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1269 microversion: 2.1 time: 0.419841 Jul 24 01:18:54.702060 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1200/2295] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:54 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1269 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:54.707267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:54.716657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:54.738280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:54.746707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.747780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:54.748449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.883178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.899078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.903800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:54.911156 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f9ffa21-d9bb-4190-bcf6-6ec5867cc51b tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.207696 Jul 24 01:18:54.917287 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1201/2296] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:54 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:54.926382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1d496be7-eca0-4b0d-9ad5-5ca8f147cb19 req-43ac1762-a60e-4e76-92cc-f18ba2d1d107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "name": "network-vif-unplugged", "status": "completed", "tag": "093fbcb8-07c8-486a-96f6-6f727c462f41"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:54.951792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1d496be7-eca0-4b0d-9ad5-5ca8f147cb19 req-43ac1762-a60e-4e76-92cc-f18ba2d1d107 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:54.952605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1d496be7-eca0-4b0d-9ad5-5ca8f147cb19 req-43ac1762-a60e-4e76-92cc-f18ba2d1d107 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:54.986814 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1d496be7-eca0-4b0d-9ad5-5ca8f147cb19 req-43ac1762-a60e-4e76-92cc-f18ba2d1d107 service nova] Creating event network-vif-unplugged:093fbcb8-07c8-486a-96f6-6f727c462f41 for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:54.996115 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1d496be7-eca0-4b0d-9ad5-5ca8f147cb19 req-43ac1762-a60e-4e76-92cc-f18ba2d1d107 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077159 Jul 24 01:18:55.002805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1202/2297] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:55.114551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:55.115084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:55.128754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.129279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.130333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.133287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.578045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:55.593261 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3d4dca3-8275-48d7-afcd-9760429ab0e4 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 1.083368 Jul 24 01:18:55.594854 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1096/2298] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:54 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:55.601467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:55.602164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:55.606454 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:55.614926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.618226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.622093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.622706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.767067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:55.778129 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5a9dd98-fe07-48a8-98e3-42a6c6203d09 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 200 len: 1613 microversion: 2.1 time: 0.181511 Jul 24 01:18:55.778936 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1097/2299] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:55 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 1613 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:55.790597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:55.798872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:55.802181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:55.804164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:55.806524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:55.811478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.812146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.813590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.813730 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef16e3cc-62dd-4636-b3b3-0e86b0b7ec4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.703804 Jul 24 01:18:55.814780 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1203/2300] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:55 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:55.814920 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.938685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:55.940362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:55.964804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.965515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:55.967741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:55.968582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.158160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:56.183908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:56.186893 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e848c386-0ad0-4b63-8c3a-ac2195b4f204 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1275 microversion: 2.1 time: 0.394092 Jul 24 01:18:56.193033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:56.194792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:56.196024 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64d13391-aa5c-4e27-99d1-93f63a9b1ab2 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.263833 Jul 24 01:18:56.198927 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1098/2301] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:55 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1275 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:56.205023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9929ff72-9b88-4d83-bc85-be32d226289a req-ffc9cf2d-7c39-4501-a883-17275186b26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "name": "network-vif-deleted", "tag": "0f69d451-6073-46e4-98bf-24a771236bac"}, {"server_uuid": "bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025", "name": "network-vif-deleted", "tag": "093fbcb8-07c8-486a-96f6-6f727c462f41"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:56.210103 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1204/2302] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:55 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:56.221252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9929ff72-9b88-4d83-bc85-be32d226289a req-ffc9cf2d-7c39-4501-a883-17275186b26e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.227907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9929ff72-9b88-4d83-bc85-be32d226289a req-ffc9cf2d-7c39-4501-a883-17275186b26e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.246594 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9929ff72-9b88-4d83-bc85-be32d226289a req-ffc9cf2d-7c39-4501-a883-17275186b26e service nova] Creating event network-vif-deleted:0f69d451-6073-46e4-98bf-24a771236bac for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:56.251703 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9929ff72-9b88-4d83-bc85-be32d226289a req-ffc9cf2d-7c39-4501-a883-17275186b26e service nova] Creating event network-vif-deleted:093fbcb8-07c8-486a-96f6-6f727c462f41 for instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 on n-h2-master-1 Jul 24 01:18:56.264613 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9929ff72-9b88-4d83-bc85-be32d226289a req-ffc9cf2d-7c39-4501-a883-17275186b26e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063781 Jul 24 01:18:56.266033 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1099/2303] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:56.610936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:56.611837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:56.621639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.630178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.633033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.636611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.801330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:56.802363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:56.814881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.827007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.829308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.829933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.863523 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] HTTP exception thrown: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Request method failure captured: Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 HTTP/1.1 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J27RdtZ3NDutdDW0_3grV7B_cMIJCBphabk0-LhmbhE2IQ5I1zDeI5bb_64tmq95YO4OPpUynqsXixfwkcC4FUdmVRWKwTXiJyKzekUNQEdc3NT0Tiz7IannEYHwyFIrqsxso7OSVf0Fjjxe7GCqIpLQJr0TpNmJrFwsa4umCg1Q-I Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90bf9b4eea0b4c43bbd2d44888e13f77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestMultiNic-2093168813 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b2c41e924f694c789952302d70e75efd Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: exception: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025'} Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:18:56.865562 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:18:56.869575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Returning 404 to user: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:18:56.870041 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f0b48d4-fe4f-4c7f-90bb-6e798ad1e18e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 404 len: 111 microversion: 2.1 time: 0.077301 Jul 24 01:18:56.870519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1100/2304] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:56 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:18:56.889092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:56.890016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:56.898284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.904568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.905597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:56.906235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:56.906462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:56.920634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e39a8a9-bd36-408e-8120-dd4dc2960e6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.313852 Jul 24 01:18:56.921139 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1205/2305] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:56 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:18:57.102938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0b12184a-da73-4578-8817-68ba2d5529e2 req-252b2f65-13da-464c-8882-3450d7d9ac8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0", "name": "network-vif-unplugged", "status": "completed", "tag": "e51ff2a6-c9bc-4402-a926-4d10ea46461f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:57.122248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0b12184a-da73-4578-8817-68ba2d5529e2 req-252b2f65-13da-464c-8882-3450d7d9ac8f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.126209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0b12184a-da73-4578-8817-68ba2d5529e2 req-252b2f65-13da-464c-8882-3450d7d9ac8f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.176486 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0b12184a-da73-4578-8817-68ba2d5529e2 req-252b2f65-13da-464c-8882-3450d7d9ac8f service nova] Creating event network-vif-unplugged:e51ff2a6-c9bc-4402-a926-4d10ea46461f for instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 on n-h2-master-1 Jul 24 01:18:57.187522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.187774 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0b12184a-da73-4578-8817-68ba2d5529e2 req-252b2f65-13da-464c-8882-3450d7d9ac8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092196 Jul 24 01:18:57.188605 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1206/2306] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:18:57.189933 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:57.199888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.201703 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.203115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-74215a93-ebd1-479e-b80c-0eabada3dcb9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.327114 Jul 24 01:18:57.204142 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1101/2307] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:56 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:57.219671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:57.220663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:57.221375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:57.222050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:57.230211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.230961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.231970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.232679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.237576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.238083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.238914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.239364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.371060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.387199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.388742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.389991 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80fab305-818e-472e-971f-ee775ed5aafc tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.173171 Jul 24 01:18:57.390885 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1102/2308] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:57 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:57.458579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:57.467631 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2489675b-d5ff-4430-9b1f-78fe33c8c3b5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.266376 Jul 24 01:18:57.468532 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1207/2309] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:57 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:57.939055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:57.939700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:57.952684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.953152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:57.954620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:57.956022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.200671 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.210177 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee5e351d-ad7d-4700-8d86-19e44e79d9e9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.276457 Jul 24 01:18:58.215545 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1103/2310] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:57 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:58.222081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:58.222952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:58.255232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.258873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.260851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.264651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.296022 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:58.412631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:58.414037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:58.437462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.438342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.463501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.466320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.485387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.496228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.498189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.499709 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-714e9e24-ecd8-496e-88e1-6e275865a5b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.281604 Jul 24 01:18:58.510807 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1208/2311] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:58 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:58.518179 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:58.534194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:58.545953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.546841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.547852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:58.548504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:58.702652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.722971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.739426 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.746277 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3082d9c6-9c22-467a-b4a5-0790060eef9f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.341423 Jul 24 01:18:58.749554 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1104/2312] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:58 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:18:58.921310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:58.930676 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5411f400-20ab-451c-8e9f-1094693366eb tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.416631 Jul 24 01:18:58.943563 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1209/2313] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:58 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:59.231661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:59.234808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:59.256157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.258978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.261652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.262304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.365112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4c6c5a86-4cf6-407b-8929-af05192d6abd req-e9d1ed60-af2e-4b4a-a2cb-7acd75077447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3", "tag": "9769857c-d14a-419e-b2a2-92d86048e84c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:18:59.398911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4c6c5a86-4cf6-407b-8929-af05192d6abd req-e9d1ed60-af2e-4b4a-a2cb-7acd75077447 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.400564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4c6c5a86-4cf6-407b-8929-af05192d6abd req-e9d1ed60-af2e-4b4a-a2cb-7acd75077447 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.427654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4c6c5a86-4cf6-407b-8929-af05192d6abd req-e9d1ed60-af2e-4b4a-a2cb-7acd75077447 service nova] Creating event network-changed:9769857c-d14a-419e-b2a2-92d86048e84c for instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 on n-h2-master-1 Jul 24 01:18:59.445128 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4c6c5a86-4cf6-407b-8929-af05192d6abd req-e9d1ed60-af2e-4b4a-a2cb-7acd75077447 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080981 Jul 24 01:18:59.445889 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1210/2314] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:18:59.521076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:59.521833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:59.551678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.553972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.554851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.561333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.706506 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:59.715681 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0153719-0cae-42b8-860a-324378af31b9 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.488754 Jul 24 01:18:59.724271 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1105/2315] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:59 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:18:59.773993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:59.778159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:18:59.796248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.796760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.797865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:18:59.799900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:18:59.945242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:59.967462 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:59.976636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:59.980994 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2767fc27-d1d7-4092-8f49-103e6f1d52c8 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.215469 Jul 24 01:18:59.983255 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1106/2316] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:59 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:18:59.995305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:18:59.998738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:18:59.999616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:00.012119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:00.013662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:00.014867 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d5b06254-4be2-409c-b7e0-fc289de4b461 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.498149 Jul 24 01:19:00.025754 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1211/2317] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:18:59 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:19:00.028616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:00.031198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:00.032656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:00.041442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:00.360865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:00.371928 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-05dd911b-914e-4666-a1ca-a1fb65494540 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.386101 Jul 24 01:19:00.374515 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1107/2318] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:18:59 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:00.740721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:00.742844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:00.757965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:00.758666 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:00.760472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:00.761067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.008293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:01.008940 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:01.021240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.021720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.023224 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.023826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.048098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.056525 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d8de07b-227b-4598-9a0a-c8fc702a6782 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.319745 Jul 24 01:19:01.061614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1212/2319] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:00 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:01.079905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:01.080825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:01.103365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.106715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.111169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.113461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.224549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.246020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.250343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.254166 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7fcdb520-bcb0-4be1-9911-d740f8a64ad9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.251855 Jul 24 01:19:01.269819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1108/2320] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:01 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:19:01.390607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:01.391449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:01.403410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.406142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.407965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.409003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:01.411730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:01.435293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.437109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.438582 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9673f92f-ffbe-463d-be94-6558a61c97a8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.375717 Jul 24 01:19:01.454434 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1213/2321] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:01 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:01.729760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:01.738197 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d5542c6-434d-4b44-a7d9-68df30dd6329 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.351696 Jul 24 01:19:01.752498 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1109/2322] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:01 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:02.077216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:02.078102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:02.092770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.094624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.096228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.098398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.275677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:02.276469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:02.294103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.294963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.296036 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.297599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.310923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:02.328863 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-488f76fa-676c-4c9b-84ff-b0595f52954f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1302 microversion: 2.1 time: 0.253577 Jul 24 01:19:02.331101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1214/2323] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:02 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1302 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:02.483801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:02.500240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:02.504436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:02.510897 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da52a959-0f51-4289-b609-2b1865192d71 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.239740 Jul 24 01:19:02.516399 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1110/2324] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:02 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:19:02.748800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:02.749621 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:02.757822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.758521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.759504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.760100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.767186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:02.768725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:02.772831 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:02.800118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.800774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:02.801728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:02.805979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.160555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.173735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.180454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.185420 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a4d4a584-d19f-4431-b8bd-73932cb455f8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.729557 Jul 24 01:19:03.187931 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1215/2325] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:02 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:03.256178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.269719 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-090907dc-46dd-4ea3-b083-c60a3aa7fdaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.517991 Jul 24 01:19:03.274448 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1111/2326] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:02 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:03.348977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:03.351678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:03.368194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.370088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.371241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.375026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.538981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:03.540158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:03.552053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.552522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.553352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:03.554513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:03.715148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.732192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.735220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.737760 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-211832e7-8fc8-499b-ba79-5649da29c6a9 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.205770 Jul 24 01:19:03.738637 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1112/2327] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:03 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:19:03.807718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:03.822595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d43b99d-272c-4fe5-9969-c1c97bf41778 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 0.474763 Jul 24 01:19:03.830540 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1216/2328] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:03 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:04.211644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:04.212510 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:04.221946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.223420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.224403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.224961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.311328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:04.315600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:04.329438 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:04.341964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.344051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.346121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.347684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.470135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:04.485193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:04.494383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:04.498801 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-06ba24fa-bd1f-4d4a-b72e-41bfd5da52b8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.295131 Jul 24 01:19:04.501021 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1113/2329] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:04 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:04.712398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:04.724865 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-81877df1-2b69-4cb7-8b27-c740238e6f8b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.437167 Jul 24 01:19:04.735185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1217/2330] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:04 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:04.758038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:04.758661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:04.764778 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=14 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:04.781467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.783379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.786327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.786757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.850534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:04.851161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:04.874673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.875133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.877663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:04.878132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:04.980745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:05.004790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:05.009515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:05.017395 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c89a872-4188-428d-9694-341502ddb57e tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.259311 Jul 24 01:19:05.019277 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1114/2331] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:04 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:05.291664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:05.306644 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-48f9e996-cab1-408f-990e-6b0ea8f8f40a tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 0.459902 Jul 24 01:19:05.307511 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1218/2332] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:04 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:05.518666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:05.519384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:05.524140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-709086673", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "89993322-4071-4987-8d48-b874af8e8185"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:05.531348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:05.535923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:05.538992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:05.539731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:05.622275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] validate_networks() for [('89993322-4071-4987-8d48-b874af8e8185', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:19:06.164928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:06.196644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:06.201940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:06.204995 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b6dc230-bd92-45c6-96d5-5da5dca906b4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 0.690723 Jul 24 01:19:06.223024 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1219/2333] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:05 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:06.228985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:06.245920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:06.268850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:06.269434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:06.270168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:06.270611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:06.715678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:06.727021 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c33d39f-5f4e-4862-88ff-a2d3dfbc227b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.502202 Jul 24 01:19:06.729740 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1220/2334] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:06 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:06.734681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1881883398", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "b0a6cfb9-dd89-4558-8da1-2e41b61fda2d"}, {"uuid": "b3462595-c739-44bb-b6e3-a22322a0324d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:06.898356 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] validate_networks() for [('b0a6cfb9-dd89-4558-8da1-2e41b61fda2d', None, None, None, None, None), ('b3462595-c739-44bb-b6e3-a22322a0324d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:19:06.907711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:19:06.908702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:19:06.909364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:19:06.910449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:19:06.911018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:19:06.942346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:06.949258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:06.950687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:06.951303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:06.999529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Getting quotas for project a2a0554a2bdf40009b895620212a11f1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:19:07.014818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Getting quotas for user bba4323f452d409eaf42a1d7d60df35c and project a2a0554a2bdf40009b895620212a11f1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:19:07.049237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:19:07.056175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:19:07.193372 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-083e4397-24e5-43c5-9dff-f5d4a4e49c0e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.170343 Jul 24 01:19:07.194585 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1115/2335] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:19:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:19:07.218369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:07.220395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:07.237363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:07.242185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:07.243808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:07.246789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:07.462536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:07.474968 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:07.482040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:07.488093 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bdcf9ce8-6e35-4ea7-9659-8e35e77c8603 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.277778 Jul 24 01:19:07.505813 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1116/2336] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:07 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:07.510767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:07.510884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:07.528320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:07.528994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:07.529983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:07.531957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:07.921303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:07.934637 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b739b57-7539-4e31-981e-d12e58784433 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 0.428658 Jul 24 01:19:07.947595 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1117/2337] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:07 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:07.961442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:07.963368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:07.979177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:07.981845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:07.982943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:07.985062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:09.081764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:09.112914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:09.123314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:09.133414 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ff7d154-4774-455b-ad03-6ca1d59b367c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1814 microversion: 2.25 time: 1.178714 Jul 24 01:19:09.135065 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1118/2338] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:07 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1814 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:09.152516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-964342501", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "89993322-4071-4987-8d48-b874af8e8185"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:09.195392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:19:09.196558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:19:09.197200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:19:09.197942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:19:09.198664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:19:09.218406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:09.221501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:09.222903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:09.226575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:09.241524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] validate_networks() for [('89993322-4071-4987-8d48-b874af8e8185', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:19:09.284082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Getting quotas for project 90bf9b4eea0b4c43bbd2d44888e13f77. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:19:09.296692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Getting quotas for user b2c41e924f694c789952302d70e75efd and project 90bf9b4eea0b4c43bbd2d44888e13f77. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:19:09.320064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:19:09.323703 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:19:09.456123 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c19287e8-d4bf-44ab-b541-d9326d252d9c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.725098 Jul 24 01:19:09.463500 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1221/2339] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:19:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:19:09.482655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:09.483539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:09.491565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:09.496360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:09.497299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:09.497685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:10.612163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:19:10.612766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:19:10.613367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:19:10.613969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:19:10.617988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:19:10.648070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:10.652552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:10.654427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:10.656314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:10.674321 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:10.738511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Getting quotas for project a2a0554a2bdf40009b895620212a11f1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:19:10.759586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Getting quotas for user bba4323f452d409eaf42a1d7d60df35c and project a2a0554a2bdf40009b895620212a11f1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:19:10.809070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:19:10.820515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:19:10.948566 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dc6fdf76-f282-4923-8062-bf650a1d9a82 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800284 Jul 24 01:19:10.949331 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1119/2340] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:19:10.971771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:10.973655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:10.977099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:10.985372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de933480-bb3b-4a6d-af67-5a090e219f54 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 1.515034 Jul 24 01:19:10.989720 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1222/2341] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:09 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:10.996989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.000738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.001948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.002416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.011475 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:11.012092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:11.063831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.064396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.065235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.065685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.287721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:11.309182 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:11.312013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:11.314894 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4affe5e6-f77c-45a5-bac2-3d198d5edcf7 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.350929 Jul 24 01:19:11.315634 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1120/2342] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:10 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:11.328248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:11.333093 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:11.369071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.371830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.373239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.374219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.558573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:11.578219 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-efffe94d-3fa5-440f-a25a-de815a9022c5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1273 microversion: 2.1 time: 0.258265 Jul 24 01:19:11.579189 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1121/2343] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:11 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:11.596127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:11.615405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:11.634881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.635393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.636211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:11.639271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:11.660273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:11.674547 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bdf80eb5-114e-432b-871c-49c71e5bce82 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 0.680500 Jul 24 01:19:11.679724 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1223/2344] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:10 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:12.018693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:12.030274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:12.033481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5718f994-a912-4650-8955-a9de3580df4e req-bc5a9d2f-2dbd-4cac-ad26-8167f6047645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3", "name": "network-vif-plugged", "status": "completed", "tag": "9769857c-d14a-419e-b2a2-92d86048e84c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:12.035561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:12.037455 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9102fbab-f3b2-46fd-a092-f347aba020cb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1804 microversion: 2.25 time: 0.455959 Jul 24 01:19:12.056082 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1122/2345] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:11 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1804 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:12.059699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5718f994-a912-4650-8955-a9de3580df4e req-bc5a9d2f-2dbd-4cac-ad26-8167f6047645 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.061890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5718f994-a912-4650-8955-a9de3580df4e req-bc5a9d2f-2dbd-4cac-ad26-8167f6047645 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:12.062237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-525464210", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "451", "networks": [{"uuid": "89993322-4071-4987-8d48-b874af8e8185"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:12.079666 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5718f994-a912-4650-8955-a9de3580df4e req-bc5a9d2f-2dbd-4cac-ad26-8167f6047645 service nova] Creating event network-vif-plugged:9769857c-d14a-419e-b2a2-92d86048e84c for instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 on n-h2-master-1 Jul 24 01:19:12.088759 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5718f994-a912-4650-8955-a9de3580df4e req-bc5a9d2f-2dbd-4cac-ad26-8167f6047645 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404640 Jul 24 01:19:12.090137 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1224/2346] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:12.098661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:12.099508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:12.109411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.110934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:12.112456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.112918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:12.201729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] validate_networks() for [('89993322-4071-4987-8d48-b874af8e8185', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:19:12.499455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:12.518108 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6c3be36-0785-4c5c-b818-6cd1600cfe84 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.422778 Jul 24 01:19:12.524376 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1225/2347] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:12 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:12.539518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fae2fc0-a29e-495e-8cba-ba05d12fa017 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '.version_select at 0x7f05eab5b670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:12.542836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fae2fc0-a29e-495e-8cba-ba05d12fa017 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.544873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fae2fc0-a29e-495e-8cba-ba05d12fa017 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:12.566079 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7fae2fc0-a29e-495e-8cba-ba05d12fa017 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.039187 Jul 24 01:19:12.567480 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1226/2348] 10.222.0.27 () {60 vars in 1183 bytes} [Sun Jul 24 01:19:12 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:12.591722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:12.595017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:12.613015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.622442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:12.627257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.627831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:12.787437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:12.790773 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:12.815660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:12.817260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:12.818594 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e53d152-d914-48b1-b83a-02dc9045799f tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.245849 Jul 24 01:19:12.837007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1227/2349] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:12 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:12.843626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:12.844245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:12.859988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.864874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:12.873918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:12.874767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.307809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:19:13.308933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:19:13.309197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:19:13.310208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:19:13.310838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:19:13.311415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:19:13.329208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.336251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.337439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.340402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.347112 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab4b6d6c-8478-464a-99fb-236a222da262 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 2423 microversion: 2.25 time: 0.507452 Jul 24 01:19:13.359736 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1228/2350] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:12 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 2423 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:13.366088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:13.367152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:13.376123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.376581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.377387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.378492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.423537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Getting quotas for project a2a0554a2bdf40009b895620212a11f1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:19:13.457952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:13.463840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Getting quotas for user bba4323f452d409eaf42a1d7d60df35c and project a2a0554a2bdf40009b895620212a11f1. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:19:13.470118 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-106fd04f-5029-44e8-807b-ebd9864781fb tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1271 microversion: 2.1 time: 0.109135 Jul 24 01:19:13.471782 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1229/2351] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:13 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:13.498828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:13.512581 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:19:13.512714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:13.515845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Searching by: {'deleted': False, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:13.527489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:19:13.531381 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.531901 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.532801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.533250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.591642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:13.663112 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b67f53d4-1224-46c2-b68d-b2990db29d34 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604572 Jul 24 01:19:13.665548 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7b1dc4a2-86ac-445f-aa68-622adc465551 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.192486 Jul 24 01:19:13.671931 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1123/2352] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:19:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:19:13.676009 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1230/2353] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:19:13 2022] GET /compute/v2.1/servers => generated 340 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:13.684573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:13.685599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:13.686490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:13.691377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:13.700280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.702453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.703560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.706964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.724123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.725976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:13.727007 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:13.727605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:14.000629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:19:14.035302 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aacc4402-aafe-4e79-ac75-9834033426c6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 2423 microversion: 2.25 time: 0.358033 Jul 24 01:19:14.043780 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1231/2354] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:13 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 2423 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:14.050395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:14.054612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:14.072793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:14.073258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:14.074688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:14.075185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:14.098951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.132109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc5fa71c-6220-454c-8f90-80dc06231584 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 0.440489 Jul 24 01:19:14.132910 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1124/2355] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:13 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:14.152753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0abd7ecf-c767-4384-9ece-0ea78350064a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:14.153518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0abd7ecf-c767-4384-9ece-0ea78350064a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:14.191735 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:14.354179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0abd7ecf-c767-4384-9ece-0ea78350064a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.364579 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0abd7ecf-c767-4384-9ece-0ea78350064a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1220 microversion: 2.1 time: 0.230564 Jul 24 01:19:14.390542 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1125/2356] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:14 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1220 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:14.390542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:14.417016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.418140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Searching by: {'deleted': False, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:14.435280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:14.435941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:14.439303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:14.439955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:14.497242 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.527111 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d5413348-16b5-4fce-9865-99e851f2669f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1317 microversion: 2.1 time: 0.481807 Jul 24 01:19:14.548824 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1232/2357] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:14 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:14.559856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:14.564948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:14.577063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:14.577841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:14.578814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:14.580025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:14.696816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:14.794315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.810820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.815385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.819703 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79700c29-1d7a-4413-85ec-508d79b07461 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.269292 Jul 24 01:19:14.837302 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1233/2358] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:14 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:14.867302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:14.884713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:14.885392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.053414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7c2b3fc2-e3d6-459e-9c84-d7e7a79eaf78 req-e89aab3e-82a5-4359-94b8-136e18daa8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6a825a-bdba-4424-86c5-4205d9a9e835", "tag": "c377a126-8b35-4637-9452-e5167f71e89c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:15.065523 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:15.071059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7c2b3fc2-e3d6-459e-9c84-d7e7a79eaf78 req-e89aab3e-82a5-4359-94b8-136e18daa8a4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.072140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7c2b3fc2-e3d6-459e-9c84-d7e7a79eaf78 req-e89aab3e-82a5-4359-94b8-136e18daa8a4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.117087 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7c2b3fc2-e3d6-459e-9c84-d7e7a79eaf78 req-e89aab3e-82a5-4359-94b8-136e18daa8a4 service nova] Creating event network-changed:c377a126-8b35-4637-9452-e5167f71e89c for instance fb6a825a-bdba-4424-86c5-4205d9a9e835 on n-h1-master-1 Jul 24 01:19:15.129936 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7c2b3fc2-e3d6-459e-9c84-d7e7a79eaf78 req-e89aab3e-82a5-4359-94b8-136e18daa8a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290761 Jul 24 01:19:15.137017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1234/2359] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:15.151331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:15.158037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:15.178830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.181238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.182603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.185087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.216751 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bcf05aad-8d4d-4f4d-8d2d-d52d2c7f622e tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.832296 Jul 24 01:19:15.217357 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1126/2360] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:19:14 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:15.222389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:15.223238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:15.250686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.251549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.252963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.255560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.436595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lazy-loading 'services' on Instance uuid 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:19:15.566460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:15.597034 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-214a5803-54a0-4b61-b64d-d2d17a12b845 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1313 microversion: 2.1 time: 0.377862 Jul 24 01:19:15.609897 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1127/2361] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:15 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:15.616678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:15.624655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:15.641144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.641731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.646391 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-18622a0e-f482-44bc-9a91-03afb50656de tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments/8274100a-d8e0-4c60-b5bb-e68e9c743711" status: 202 len: 0 microversion: 2.25 time: 0.507215 Jul 24 01:19:15.648673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.649142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.653134 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1235/2362] 10.222.0.27 () {60 vars in 1456 bytes} [Sun Jul 24 01:19:15 2022] DELETE /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments/8274100a-d8e0-4c60-b5bb-e68e9c743711 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:19:15.671832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78ceb7c3-3635-4b11-93ec-027cd0ff8777 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:15.729967 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78ceb7c3-3635-4b11-93ec-027cd0ff8777 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.073226 Jul 24 01:19:15.732421 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1236/2363] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:19:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:15.748125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:15.748898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:15.779971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.790472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:15.791634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:15.795715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.063988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:16.083343 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4fdd94be-b86a-4727-b0f2-ac1af4ea9a52 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1280 microversion: 2.1 time: 0.348983 Jul 24 01:19:16.086144 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1237/2364] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:15 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1280 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:16.097298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:16.097978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:16.122146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:16.129457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.130161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.131516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.133071 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d57ed3b-1202-422f-bef6-114ae5695f65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 0.521300 Jul 24 01:19:16.134203 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1128/2365] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:15 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:16.138586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.144873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9d24bbf8-8bca-4b43-be49-9f33917783fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:16.149471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9d24bbf8-8bca-4b43-be49-9f33917783fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:16.159871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d24bbf8-8bca-4b43-be49-9f33917783fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.166360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d24bbf8-8bca-4b43-be49-9f33917783fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.167576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d24bbf8-8bca-4b43-be49-9f33917783fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.170989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d24bbf8-8bca-4b43-be49-9f33917783fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.256736 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9d24bbf8-8bca-4b43-be49-9f33917783fd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119324 Jul 24 01:19:16.257612 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1129/2366] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:16 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:19:16.272289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:16.272986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:16.284687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.285149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.285983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.288297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.664047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:16.687229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:16.689819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:16.697321 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4342ced8-2756-405a-ac8b-3c5d735c2152 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.437389 Jul 24 01:19:16.708986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1130/2367] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:16 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:16.708986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:16.711841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:16.720405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.721288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.722343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.723012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.786694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:19:16.873369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:16.885873 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79483910-69bc-475d-a102-f0f4936b309c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1467 microversion: 2.1 time: 0.798553 Jul 24 01:19:16.890209 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1238/2368] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:16 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1467 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:16.897515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9fa6d748-8841-4232-8d59-5ea835ee5d0f req-07fa3390-32b6-4384-b23a-81e96d5585d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0", "name": "network-vif-plugged", "status": "completed", "tag": "0f8871bc-b137-4f62-b97e-054f036425fd"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:16.914580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9fa6d748-8841-4232-8d59-5ea835ee5d0f req-07fa3390-32b6-4384-b23a-81e96d5585d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:16.915214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9fa6d748-8841-4232-8d59-5ea835ee5d0f req-07fa3390-32b6-4384-b23a-81e96d5585d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:16.955579 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9fa6d748-8841-4232-8d59-5ea835ee5d0f req-07fa3390-32b6-4384-b23a-81e96d5585d7 service nova] Creating event network-vif-plugged:0f8871bc-b137-4f62-b97e-054f036425fd for instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 on n-h1-master-1 Jul 24 01:19:16.970611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9fa6d748-8841-4232-8d59-5ea835ee5d0f req-07fa3390-32b6-4384-b23a-81e96d5585d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078439 Jul 24 01:19:16.975826 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1239/2369] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:16.985415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:16.989030 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5414be1-18cc-4ec6-b463-42d9c5539ba2 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 204 len: 0 microversion: 2.1 time: 0.285007 Jul 24 01:19:16.990055 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1131/2370] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:19:16 2022] DELETE /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:19:16.993771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:17.007495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5018963f-631d-40f2-81e4-42bd46d53013 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:17.019476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5018963f-631d-40f2-81e4-42bd46d53013 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:17.020864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.021329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.026998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.028889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.031206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5018963f-631d-40f2-81e4-42bd46d53013 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.033047 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5018963f-631d-40f2-81e4-42bd46d53013 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.034881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5018963f-631d-40f2-81e4-42bd46d53013 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.036270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5018963f-631d-40f2-81e4-42bd46d53013 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.354743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5018963f-631d-40f2-81e4-42bd46d53013 tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1618 microversion: 2.1 time: 0.361665 Jul 24 01:19:17.362536 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1132/2371] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:16 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1618 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:17.369587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:17.378834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:17.399614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:17.401247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.401866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.403102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.404206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.410083 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9730fec2-9ddd-4498-9fd5-662b225f99d1 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1313 microversion: 2.1 time: 0.432629 Jul 24 01:19:17.414087 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1240/2372] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:16 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:17.427088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:17.428025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:17.442072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.442561 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.443385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.444063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.679854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:17.688008 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d543e0c3-d647-4c7b-9eed-518524fa145c tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1278 microversion: 2.1 time: 0.272483 Jul 24 01:19:17.697903 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1241/2373] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:17 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:17.702516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:17.703153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:17.717139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.717608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:17.718458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:17.718860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:18.141593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:18.144827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:18.151349 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f3e3b0d-2004-4cbf-89a5-d515a52113c5 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1713 microversion: 2.1 time: 0.787509 Jul 24 01:19:18.158106 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca94fea7-20dc-47ea-b760-673419f8cb10 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 0.462825 Jul 24 01:19:18.159431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1242/2374] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:17 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:18.169634 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1133/2375] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:17 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1713 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:18.173891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-04af8eeb-cfa8-4a16-9fa5-48513da0ffcb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:18.175153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-04af8eeb-cfa8-4a16-9fa5-48513da0ffcb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:18.185618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-241445303", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["98477c05-8901-4a3a-b18f-6a5923ce55be"]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:18.190927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-cfa8-4a16-9fa5-48513da0ffcb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:18.191647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-cfa8-4a16-9fa5-48513da0ffcb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:18.192800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-cfa8-4a16-9fa5-48513da0ffcb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:18.194327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-cfa8-4a16-9fa5-48513da0ffcb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:18.319935 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-04af8eeb-cfa8-4a16-9fa5-48513da0ffcb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.159154 Jul 24 01:19:18.320550 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1243/2376] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:18 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:19:18.326092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:19:18.347903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:18.349152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:18.368843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:18.372140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:18.373599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:18.374404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:18.596686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:18.618051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:18.626716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:18.636855 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05742134-28da-471c-beb4-61ab1133ede4 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.298088 Jul 24 01:19:18.638722 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1244/2377] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:18 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:18.645956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:18.655432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:18.675991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:18.679752 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:18.683135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:18.685532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:18.691261 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:18.976722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:18.990582 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-543b4858-2989-4f08-afe7-11b5d27529f8 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.350329 Jul 24 01:19:18.993352 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1245/2378] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:18 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:19.011413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:19.012528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:19.023220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.024104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:19.025128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.025823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:19.170565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:19:19.171663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:19:19.172843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:19:19.173622 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:19:19.174300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:19:19.181517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:19.212657 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6c680ec6-dd47-4e69-a494-f8a829e6b356 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1278 microversion: 2.1 time: 0.217892 Jul 24 01:19:19.215977 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1246/2379] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:18 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:19.229588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.235210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:19.236550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.237015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:19.238825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:19.245270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:19.258072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.264549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:19.269198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.270062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:19.299692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:19:19.324042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:19:19.340496 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:19.359325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:19:19.372025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:19:19.518172 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da5619e2-e784-4b41-922b-bdeae271abb2 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.347295 Jul 24 01:19:19.519636 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1134/2380] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:19:19.526778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:19.529222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:19.538662 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.539379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:19.540663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:19.541258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.208697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:20.232013 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6880690-be93-491b-9a3e-ffe87843a4ed tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1290 microversion: 2.1 time: 1.000964 Jul 24 01:19:20.233170 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1247/2381] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:19 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1290 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:20.245538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8b4f4409-75a3-4541-9a2b-75626c86581d req-a3346046-6412-4885-abbe-5079903ab1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9ce179-0702-488e-b661-358fcd697d70", "tag": "f912ad89-b201-4cfa-90d5-680cbb61a2a5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:20.259212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8b4f4409-75a3-4541-9a2b-75626c86581d req-a3346046-6412-4885-abbe-5079903ab1b7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:20.259882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8b4f4409-75a3-4541-9a2b-75626c86581d req-a3346046-6412-4885-abbe-5079903ab1b7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.277504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8b4f4409-75a3-4541-9a2b-75626c86581d req-a3346046-6412-4885-abbe-5079903ab1b7 service nova] Creating event network-changed:f912ad89-b201-4cfa-90d5-680cbb61a2a5 for instance 2c9ce179-0702-488e-b661-358fcd697d70 on n-h2-master-1 Jul 24 01:19:20.286801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8b4f4409-75a3-4541-9a2b-75626c86581d req-a3346046-6412-4885-abbe-5079903ab1b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050024 Jul 24 01:19:20.290318 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1248/2382] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:20.313746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-15b69411-f9ec-4e38-8fad-36346d4e7051 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:20.315536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-15b69411-f9ec-4e38-8fad-36346d4e7051 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:20.324447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b69411-f9ec-4e38-8fad-36346d4e7051 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:20.325492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b69411-f9ec-4e38-8fad-36346d4e7051 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.326647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b69411-f9ec-4e38-8fad-36346d4e7051 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:20.327425 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15b69411-f9ec-4e38-8fad-36346d4e7051 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.393417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-15b69411-f9ec-4e38-8fad-36346d4e7051 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100086 Jul 24 01:19:20.394885 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1249/2383] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:20 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:19:20.403848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:20.404883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:20.416680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:20.418379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.419950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:20.420678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.673922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:20.689616 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f69cf4f7-df29-4ed4-bd71-b6d80eeae89d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1220 microversion: 2.1 time: 0.291684 Jul 24 01:19:20.692125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1250/2384] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:20 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1220 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:20.710829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:20.713158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:20.729048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:20.730489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.732499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:20.734512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:20.954697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:20.975778 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8d660461-6475-4e70-abc9-fcb1bd8ac2ce tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1713 microversion: 2.1 time: 1.454223 Jul 24 01:19:20.976897 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1135/2385] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:19 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1713 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:20.982667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:20.984635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:20.994761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:21.004161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:21.005275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:21.005997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:21.032438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:21.040219 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:21.051985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:21.054014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f71f3d66b27b471d9772a0a01d3c89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa7eea7a04e8d83d2264c1638f8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:21.055557 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c1144a8-7d33-4ce6-bb09-b196613ee7ca tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 200 len: 1604 microversion: 2.32 time: 0.361864 Jul 24 01:19:21.070129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1251/2386] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:20 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 1604 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:21.083229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:21.102660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:21.121962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:21.121962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:21.121962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:21.121962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:22.719273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:22.719867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:22.728563 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-839017a8-b1d3-47ee-9471-05050bd212fc tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 1.750141 Jul 24 01:19:22.734093 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1136/2387] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:20 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:22.736285 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8b9e819-a857-418b-bcbf-ca2e9ceb53d0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1320 microversion: 2.1 time: 1.664504 Jul 24 01:19:22.737197 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1252/2388] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:21 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1320 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:22.744098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d22dfa3-22b3-4678-b1ad-ec3a3a2780ad tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:22.744545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:22.745080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3d22dfa3-22b3-4678-b1ad-ec3a3a2780ad tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:22.746482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:22.754392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:22.754601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d22dfa3-22b3-4678-b1ad-ec3a3a2780ad tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:22.755025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d22dfa3-22b3-4678-b1ad-ec3a3a2780ad tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:22.756671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d22dfa3-22b3-4678-b1ad-ec3a3a2780ad tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:22.757090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d22dfa3-22b3-4678-b1ad-ec3a3a2780ad tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:22.763126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:22.764128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:22.764672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:22.801386 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d22dfa3-22b3-4678-b1ad-ec3a3a2780ad tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062212 Jul 24 01:19:22.802354 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1253/2389] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:22 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:19:22.811848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:22.812766 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:22.827078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:22.828927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:22.830144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:22.830597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:22.977908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:22.992927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-065cc262-3a0b-4bd5-8128-8de03b650508 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1274 microversion: 2.1 time: 0.188498 Jul 24 01:19:22.994155 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1254/2390] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:22 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:23.000463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:23.002381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:23.010997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.012449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.013616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.014704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.142200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:23.155721 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f4c6788-e0b1-427f-b63b-5088e17e62c3 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1482 microversion: 2.1 time: 0.420221 Jul 24 01:19:23.158204 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1137/2391] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:22 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1482 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:23.165773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9c339884-c01c-4628-9e82-ab51f02dc76d req-57f8c0bb-d94e-4874-bbb8-4bda9d0fefac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6a825a-bdba-4424-86c5-4205d9a9e835", "name": "network-vif-plugged", "status": "completed", "tag": "c377a126-8b35-4637-9452-e5167f71e89c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:23.177439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9c339884-c01c-4628-9e82-ab51f02dc76d req-57f8c0bb-d94e-4874-bbb8-4bda9d0fefac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.179057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9c339884-c01c-4628-9e82-ab51f02dc76d req-57f8c0bb-d94e-4874-bbb8-4bda9d0fefac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.198015 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9c339884-c01c-4628-9e82-ab51f02dc76d req-57f8c0bb-d94e-4874-bbb8-4bda9d0fefac service nova] Creating event network-vif-plugged:c377a126-8b35-4637-9452-e5167f71e89c for instance fb6a825a-bdba-4424-86c5-4205d9a9e835 on n-h1-master-1 Jul 24 01:19:23.210067 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9c339884-c01c-4628-9e82-ab51f02dc76d req-57f8c0bb-d94e-4874-bbb8-4bda9d0fefac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049242 Jul 24 01:19:23.210997 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1138/2392] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:23.237271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:23.238241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:23.248364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.248828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.260683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.264161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.308450 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] HTTP exception thrown: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Request method failure captured: Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 HTTP/1.1 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jx3gLXY6h-aEX-WGxMNq5tsLsCEewfB2iN1JJD4QKo1BxsjM_GpmisPfKgahNPAaGRMKD3wAO4wmOOatRzW2jrNC7mZVZU5AwA0nIBlEe2dMh0ul1LjxkGifei3YWYeisURGcVhDvCtWmAgbfD48Ryd4HQxHEDADdP5z8FIXC8-nkI Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.32 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 651fa7eea7a04e8d83d2264c1638f8f2 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_651fa7eea7a04e8d83d2264c1638f8f2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 651fa7eea7a04e8d83d2264c1638f8f2 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TaggedBootDevicesTest-2024917720-project Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f71f3d66b27b471d9772a0a01d3c89ed Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TaggedBootDevicesTest-2024917720-project Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1'} Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:23.311239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Returning 404 to user: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:23.315764 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4a06e32c-e49b-4157-ac62-9dec28533799 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 404 len: 111 microversion: 2.32 time: 0.089679 Jul 24 01:19:23.321266 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1139/2393] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:23 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:19:23.328003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-3d3f7527-cb84-4781-bed9-04c7271a4837 req-cfdbe465-afe7-4b77-8789-caef6c2d3e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce86317c-d743-458d-98cf-f690f495fda8", "tag": "2b283023-5b88-4ca7-9484-4d97e9fa1eb9"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:23.340931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3d3f7527-cb84-4781-bed9-04c7271a4837 req-cfdbe465-afe7-4b77-8789-caef6c2d3e5c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.341613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3d3f7527-cb84-4781-bed9-04c7271a4837 req-cfdbe465-afe7-4b77-8789-caef6c2d3e5c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.356438 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-3d3f7527-cb84-4781-bed9-04c7271a4837 req-cfdbe465-afe7-4b77-8789-caef6c2d3e5c service nova] Creating event network-changed:2b283023-5b88-4ca7-9484-4d97e9fa1eb9 for instance ce86317c-d743-458d-98cf-f690f495fda8 on n-h2-master-1 Jul 24 01:19:23.364376 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-3d3f7527-cb84-4781-bed9-04c7271a4837 req-cfdbe465-afe7-4b77-8789-caef6c2d3e5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041608 Jul 24 01:19:23.367336 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1140/2394] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:23.387346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-264f7587-8e66-48f1-b777-75104eaba2d5 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:23.387953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-264f7587-8e66-48f1-b777-75104eaba2d5 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:23.397531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-264f7587-8e66-48f1-b777-75104eaba2d5 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.398028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-264f7587-8e66-48f1-b777-75104eaba2d5 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.399000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-264f7587-8e66-48f1-b777-75104eaba2d5 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.399593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-264f7587-8e66-48f1-b777-75104eaba2d5 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.565851 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:23.632752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:23.641827 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c1cfd50-e4e3-4f45-adfe-029db2042192 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1713 microversion: 2.1 time: 0.646294 Jul 24 01:19:23.652908 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1255/2395] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:22 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1713 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:23.660461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-55cbb6b9-5b30-4478-9775-0af110dc69f6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '.version_select at 0x7f05eab5b9d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:23.692549 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-55cbb6b9-5b30-4478-9775-0af110dc69f6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925913692" status: 204 len: 0 microversion: 2.32 time: 0.038200 Jul 24 01:19:23.707898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1256/2396] 10.222.0.27 () {60 vars in 1258 bytes} [Sun Jul 24 01:19:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925913692 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:19:23.745913 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-264f7587-8e66-48f1-b777-75104eaba2d5 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.374788 Jul 24 01:19:23.746518 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1141/2397] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:19:23 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0/os-interface => generated 285 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:23.754509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:23.755713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:23.760715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:23.761797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:23.767509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.767970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.770893 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.771347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.772627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.774350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:23.775763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:23.776426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.313269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:24.326608 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-297e45b1-ce49-4ec1-b32c-c767fa5d7191 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1320 microversion: 2.1 time: 0.577655 Jul 24 01:19:24.327381 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1257/2398] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:23 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1320 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:24.338255 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f49ff33a-0982-463d-8d60-17b04ae38adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:24.339239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f49ff33a-0982-463d-8d60-17b04ae38adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:24.352106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f49ff33a-0982-463d-8d60-17b04ae38adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:24.352570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f49ff33a-0982-463d-8d60-17b04ae38adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.353631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f49ff33a-0982-463d-8d60-17b04ae38adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:24.354097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f49ff33a-0982-463d-8d60-17b04ae38adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.444274 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f49ff33a-0982-463d-8d60-17b04ae38adf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112914 Jul 24 01:19:24.449056 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1258/2399] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:24 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:19:24.452356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:24.454807 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:24.458106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:24.460777 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f96b5aea-332e-444a-a06d-1fe6012b7fa3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.705148 Jul 24 01:19:24.461562 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1142/2400] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:23 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:24.468314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:24.468931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.470171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:24.470756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.480358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ee45acc3-4593-4267-a585-cf7b940d865b req-ea034087-67cc-455b-832e-9403744cd6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135", "tag": "dbcc0cc0-39bf-4907-b334-fd5e0430d2cd"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:24.509487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ee45acc3-4593-4267-a585-cf7b940d865b req-ea034087-67cc-455b-832e-9403744cd6ca service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:24.509974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ee45acc3-4593-4267-a585-cf7b940d865b req-ea034087-67cc-455b-832e-9403744cd6ca service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.531352 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ee45acc3-4593-4267-a585-cf7b940d865b req-ea034087-67cc-455b-832e-9403744cd6ca service nova] Creating event network-changed:dbcc0cc0-39bf-4907-b334-fd5e0430d2cd for instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 on n-h1-master-1 Jul 24 01:19:24.539992 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ee45acc3-4593-4267-a585-cf7b940d865b req-ea034087-67cc-455b-832e-9403744cd6ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075326 Jul 24 01:19:24.541558 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1143/2401] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:24.636158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:24.650489 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c262a70e-4c07-4afb-9a1d-38d2be4577de tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1274 microversion: 2.1 time: 0.196815 Jul 24 01:19:24.651160 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1259/2402] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:24 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:24.663429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:24.664722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:24.699387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:24.702288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.705230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:24.708692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:24.930231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f643b01bb934b4ebacc4548721dba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e7d7a1fe6f443181cd70ef18a84c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:24.943855 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c79f930c-1a28-4989-b166-065aa9892522 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 200 len: 1646 microversion: 2.1 time: 0.283923 Jul 24 01:19:24.945059 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1144/2403] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:24 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 1646 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:25.346374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:25.348142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:25.359025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:25.359946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:25.361044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:25.362698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:25.458179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e094c70-71dd-492d-96f3-258f372fb513 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:25.460838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6e094c70-71dd-492d-96f3-258f372fb513 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:25.492371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e094c70-71dd-492d-96f3-258f372fb513 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:25.493104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e094c70-71dd-492d-96f3-258f372fb513 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:25.494460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e094c70-71dd-492d-96f3-258f372fb513 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:25.495069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e094c70-71dd-492d-96f3-258f372fb513 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:25.604286 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e094c70-71dd-492d-96f3-258f372fb513 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151465 Jul 24 01:19:25.607422 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1145/2404] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:25 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:19:25.629900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:25.630471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:25.649828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:25.650292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:25.657057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:25.657525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:25.970726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:25.979922 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-59e41382-72a4-4dce-b78d-fa50f02b0db9 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1320 microversion: 2.1 time: 0.639874 Jul 24 01:19:25.986065 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1260/2405] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:25 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:25.992555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:25.996151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:26.008721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.012583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.013693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.016337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.186501 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:26.192494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:26.202276 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-99fef9de-0809-4474-9cb7-895acaead117 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1274 microversion: 2.1 time: 0.214768 Jul 24 01:19:26.211595 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1261/2406] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:25 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:26.211799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2343f880-7789-4577-a9ff-24f4ed6211ac tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.593221 Jul 24 01:19:26.211799 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1146/2407] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:25 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:26.215955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:26.216587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] [instance: d28d5f2d-e02d-490f-902d-b6d0cf94cb8d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:26.233659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.239958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.241796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.242247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.277112 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] HTTP exception thrown: Instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d could not be found. Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Request method failure captured: Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d HTTP/1.1 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J3FkQhJb1UCE_8OyMvsVQy7tlMMiBRNJYZz4jViS7ZK43IFZx_EShLMxC9MO-1S2vyrzW0qwDGdkqaQRKnJqUvNv7YqfMEquMfLJ3q2-6EBE2zVL0XoiJPlEh0mW_NBDa492ODf5v9YO9ywhRWQzhlklDhX3qa40dSOK6azZT4QbIA Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 56e7d7a1fe6f443181cd70ef18a84c83 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestManualDisk-1876172535 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56e7d7a1fe6f443181cd70ef18a84c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56e7d7a1fe6f443181cd70ef18a84c83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56e7d7a1fe6f443181cd70ef18a84c83", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56e7d7a1fe6f443181cd70ef18a84c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestManualDisk-1876172535 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 56e7d7a1fe6f443181cd70ef18a84c83 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestManualDisk-1876172535 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestManualDisk-1876172535-project Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 6f643b01bb934b4ebacc4548721dba25 Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestManualDisk-1876172535-project Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: exception: Instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d could not be found. Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'd28d5f2d-e02d-490f-902d-b6d0cf94cb8d'} Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d could not be found. Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d could not be found. Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:26.282619 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:26.286039 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:26.286039 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:26.286039 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:26.286039 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:26.286039 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:26.286039 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d could not be found. Jul 24 01:19:26.286039 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:26.290638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Returning 404 to user: Instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:26.293501 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4989d801-e2f2-4574-bdc9-b99473555862 tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d" status: 404 len: 111 microversion: 2.1 time: 0.088976 Jul 24 01:19:26.294424 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1262/2408] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:26 2022] GET /compute/v2.1/servers/d28d5f2d-e02d-490f-902d-b6d0cf94cb8d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:19:26.304152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fede37c6-117f-4723-92e3-14c375812efc tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] Calling method '.version_select at 0x7f05eb650d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:26.342126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fede37c6-117f-4723-92e3-14c375812efc tempest-ServersTestManualDisk-1876172535 tempest-ServersTestManualDisk-1876172535-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412003033" status: 202 len: 0 microversion: 2.1 time: 0.041809 Jul 24 01:19:26.344617 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1147/2409] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412003033 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:19:26.601080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3e074eeb-140b-4555-a29d-7846c50aa54d req-e31baa4b-2a6c-4c3d-a082-187c6e935c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28d5f2d-e02d-490f-902d-b6d0cf94cb8d", "name": "network-vif-deleted", "tag": "6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:26.617794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-616df5fd-aacc-4f8f-b808-65c549c88439 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:26.618652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-616df5fd-aacc-4f8f-b808-65c549c88439 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:26.624229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3e074eeb-140b-4555-a29d-7846c50aa54d req-e31baa4b-2a6c-4c3d-a082-187c6e935c21 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.624683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3e074eeb-140b-4555-a29d-7846c50aa54d req-e31baa4b-2a6c-4c3d-a082-187c6e935c21 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.641214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616df5fd-aacc-4f8f-b808-65c549c88439 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.641710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616df5fd-aacc-4f8f-b808-65c549c88439 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.642524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616df5fd-aacc-4f8f-b808-65c549c88439 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:26.642963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616df5fd-aacc-4f8f-b808-65c549c88439 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:26.669851 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3e074eeb-140b-4555-a29d-7846c50aa54d req-e31baa4b-2a6c-4c3d-a082-187c6e935c21 service nova] Creating event network-vif-deleted:6baaa596-9a78-4a27-bd3b-ac7cf4b1f6da for instance d28d5f2d-e02d-490f-902d-b6d0cf94cb8d on n-h1-master-1 Jul 24 01:19:26.691039 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3e074eeb-140b-4555-a29d-7846c50aa54d req-e31baa4b-2a6c-4c3d-a082-187c6e935c21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100866 Jul 24 01:19:26.692047 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1263/2410] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:26.713241 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-616df5fd-aacc-4f8f-b808-65c549c88439 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101041 Jul 24 01:19:26.720967 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1148/2411] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:26 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:19:27.003924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:27.004939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:27.019470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:27.023857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:27.024958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:27.025568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:27.220419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:27.222771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:27.239070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:27.239861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:27.254080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:27.257148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:28.438539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:28.444597 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:28.465277 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e7e31b1-ef2e-47af-b54e-9673b1c85e86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1320 microversion: 2.1 time: 1.463233 Jul 24 01:19:28.477383 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1264/2412] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:26 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1320 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:28.494646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:28.500071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:28.516077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:28.516467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:28.517312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:28.517816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:28.676765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:28.690087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3f4fe01-7ba0-4994-bc28-e74b5e93e033 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 1.474440 Jul 24 01:19:28.691002 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1149/2413] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:27 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:28.704067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c11ee493-2294-4011-b68d-c58417b0ff08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:28.705985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c11ee493-2294-4011-b68d-c58417b0ff08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:28.721376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c11ee493-2294-4011-b68d-c58417b0ff08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:28.727692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c11ee493-2294-4011-b68d-c58417b0ff08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:28.729338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c11ee493-2294-4011-b68d-c58417b0ff08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:28.730211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c11ee493-2294-4011-b68d-c58417b0ff08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:28.779503 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c11ee493-2294-4011-b68d-c58417b0ff08 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.085294 Jul 24 01:19:28.780395 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1150/2414] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:19:28 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:29.257711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:29.269026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:29.269866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:29.273429 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:29.283826 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c6b3cd1-5d17-4120-9843-bcc0a97cc5e2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.804598 Jul 24 01:19:29.284426 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1265/2415] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:28 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:29.293530 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:29.294276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:29.295297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:29.298731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:29.317956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8b6f6311-93e3-421c-8eea-bd112846aa43 req-8154451e-baac-49ef-a9dc-61ffb360870a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0", "tag": "0f8871bc-b137-4f62-b97e-054f036425fd"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:29.338919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8b6f6311-93e3-421c-8eea-bd112846aa43 req-8154451e-baac-49ef-a9dc-61ffb360870a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:29.339389 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8b6f6311-93e3-421c-8eea-bd112846aa43 req-8154451e-baac-49ef-a9dc-61ffb360870a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:29.348634 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=28 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:29.357526 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8b6f6311-93e3-421c-8eea-bd112846aa43 req-8154451e-baac-49ef-a9dc-61ffb360870a service nova] Creating event network-changed:0f8871bc-b137-4f62-b97e-054f036425fd for instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 on n-h1-master-1 Jul 24 01:19:29.387847 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8b6f6311-93e3-421c-8eea-bd112846aa43 req-8154451e-baac-49ef-a9dc-61ffb360870a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073598 Jul 24 01:19:29.388478 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1266/2416] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:19:29.494774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:29.496270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:29.514599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:29.515420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:29.516423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:29.517057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.407016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:30.426522 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d3225810-fc52-45e8-869b-8d6b66c015be tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1482 microversion: 2.1 time: 1.159473 Jul 24 01:19:30.442266 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1151/2417] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:29 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1482 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:30.463344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:30.466334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:30.490745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.492242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.493766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.494408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.799214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:30.822292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d7866df-fb0c-4192-9063-a8b064731401 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1320 microversion: 2.1 time: 1.332212 Jul 24 01:19:30.826617 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1267/2418] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:29 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1320 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:30.843671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:30.848001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:30.873628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.874291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:30.877482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:30.879984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:31.345453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:31.363239 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94bee1d4-2d91-44f8-8bb0-61e18c243569 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.903534 Jul 24 01:19:31.364559 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1152/2419] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:30 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:31.374082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-448fed53-0ec6-4359-80cb-834bda410bf0 req-f95c0a1e-b9df-4718-a2ac-db6a8149e3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9ce179-0702-488e-b661-358fcd697d70", "name": "network-vif-plugged", "status": "completed", "tag": "f912ad89-b201-4cfa-90d5-680cbb61a2a5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:31.409750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-448fed53-0ec6-4359-80cb-834bda410bf0 req-f95c0a1e-b9df-4718-a2ac-db6a8149e3d2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:31.410392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-448fed53-0ec6-4359-80cb-834bda410bf0 req-f95c0a1e-b9df-4718-a2ac-db6a8149e3d2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:31.431931 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-448fed53-0ec6-4359-80cb-834bda410bf0 req-f95c0a1e-b9df-4718-a2ac-db6a8149e3d2 service nova] Creating event network-vif-plugged:f912ad89-b201-4cfa-90d5-680cbb61a2a5 for instance 2c9ce179-0702-488e-b661-358fcd697d70 on n-h2-master-1 Jul 24 01:19:31.450933 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-448fed53-0ec6-4359-80cb-834bda410bf0 req-f95c0a1e-b9df-4718-a2ac-db6a8149e3d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081450 Jul 24 01:19:31.455057 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1153/2420] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:31.788494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a3d28a7d-3a43-49a6-b850-bd94d2a32117 req-6b0409b9-0dae-4c65-b584-858b84a6cdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce86317c-d743-458d-98cf-f690f495fda8", "tag": "200dc558-ef0e-4dc0-ba99-7403542d5068"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:31.804107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a3d28a7d-3a43-49a6-b850-bd94d2a32117 req-6b0409b9-0dae-4c65-b584-858b84a6cdb6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:31.805071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a3d28a7d-3a43-49a6-b850-bd94d2a32117 req-6b0409b9-0dae-4c65-b584-858b84a6cdb6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:31.819747 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a3d28a7d-3a43-49a6-b850-bd94d2a32117 req-6b0409b9-0dae-4c65-b584-858b84a6cdb6 service nova] Creating event network-changed:200dc558-ef0e-4dc0-ba99-7403542d5068 for instance ce86317c-d743-458d-98cf-f690f495fda8 on n-h2-master-1 Jul 24 01:19:31.828183 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a3d28a7d-3a43-49a6-b850-bd94d2a32117 req-6b0409b9-0dae-4c65-b584-858b84a6cdb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047549 Jul 24 01:19:31.829304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:31.829803 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1154/2421] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:19:31.842830 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e3e6dde-5765-4ea0-b69e-d8d7c723a24e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 1.014408 Jul 24 01:19:31.859229 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1268/2422] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:30 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:31.859416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:31.859416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:31.862228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:31.863562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:31.864680 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:31.867399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:32.384148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:32.384885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:32.401486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:32.401908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:32.402727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:32.405158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:32.668390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:32.679567 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd4f6404-9064-4a73-9aa3-160d6436e228 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1320 microversion: 2.1 time: 0.838649 Jul 24 01:19:32.680511 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1155/2423] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:31 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1320 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:32.867304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:32.868604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:32.887980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:32.889248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:32.891133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:32.892916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:33.141286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:33.154144 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-932be29a-0099-4af5-92ef-febf4322672e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.777016 Jul 24 01:19:33.155201 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1269/2424] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:32 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:33.280720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:33.292641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-088fb3dc-47a7-4bf6-8613-f01046848293 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.429525 Jul 24 01:19:33.298660 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1156/2425] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:32 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:33.436310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-37b27602-6053-43d1-bf36-61eb049b09b8 req-6bdfe37b-5995-4800-a7fe-3f9a94079e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd02606-019b-4095-a20b-1f03d30bf81f", "tag": "01d4a5e7-32f6-423b-b735-d0c97dd15b34"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:33.462964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-37b27602-6053-43d1-bf36-61eb049b09b8 req-6bdfe37b-5995-4800-a7fe-3f9a94079e17 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:33.463057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-37b27602-6053-43d1-bf36-61eb049b09b8 req-6bdfe37b-5995-4800-a7fe-3f9a94079e17 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:33.483304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-cd2b2db2-1f9f-4ec3-bf44-4b30d8752a2c req-ee46a103-9888-4484-9053-a7bb96accf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135", "name": "network-vif-plugged", "status": "completed", "tag": "dbcc0cc0-39bf-4907-b334-fd5e0430d2cd"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:33.518077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-cd2b2db2-1f9f-4ec3-bf44-4b30d8752a2c req-ee46a103-9888-4484-9053-a7bb96accf34 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:33.522340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-cd2b2db2-1f9f-4ec3-bf44-4b30d8752a2c req-ee46a103-9888-4484-9053-a7bb96accf34 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:33.548924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-37b27602-6053-43d1-bf36-61eb049b09b8 req-6bdfe37b-5995-4800-a7fe-3f9a94079e17 service nova] Creating event network-changed:01d4a5e7-32f6-423b-b735-d0c97dd15b34 for instance cbd02606-019b-4095-a20b-1f03d30bf81f on n-h2-master-1 Jul 24 01:19:33.569383 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-37b27602-6053-43d1-bf36-61eb049b09b8 req-6bdfe37b-5995-4800-a7fe-3f9a94079e17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136616 Jul 24 01:19:33.577064 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1270/2426] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:33.579916 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-cd2b2db2-1f9f-4ec3-bf44-4b30d8752a2c req-ee46a103-9888-4484-9053-a7bb96accf34 service nova] Creating event network-vif-plugged:dbcc0cc0-39bf-4907-b334-fd5e0430d2cd for instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 on n-h1-master-1 Jul 24 01:19:33.594711 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-cd2b2db2-1f9f-4ec3-bf44-4b30d8752a2c req-ee46a103-9888-4484-9053-a7bb96accf34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119150 Jul 24 01:19:33.598362 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1157/2427] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:33.700983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:33.701979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:33.739272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:33.739762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:33.740884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:33.741305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.200534 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:34.208136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:34.244360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:34.256472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.257112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.258322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.259072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.260357 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1703c1c1-8071-46de-adf6-a13efb11b83d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1320 microversion: 2.1 time: 0.567122 Jul 24 01:19:34.264285 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1271/2428] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:33 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:34.322655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:34.323466 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:34.339006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.339667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.340620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:34.341231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:34.709989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:34.731776 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2105a490-4004-443b-93a6-68be199bf9bc tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.556239 Jul 24 01:19:34.740723 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1158/2429] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:34 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:34.774228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:34.783317 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-327e7f68-905d-4f03-ae0e-ee84ca5d959e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.471394 Jul 24 01:19:34.783913 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1272/2430] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:34 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:35.281705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:35.283830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:35.298719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:35.309828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:35.311488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:35.312143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:35.372115 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:35.750626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:35.751246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:35.765096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:35.765576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:35.770787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:35.772793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:35.976187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:35.988990 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c212170-a85e-49ce-a37b-d1aed1a22992 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1511 microversion: 2.1 time: 0.709734 Jul 24 01:19:35.993366 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1159/2431] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:35 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1511 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:36.009846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:36.010829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:36.028343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.031347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.032509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.036549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.180468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:36.189231 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e26d2ee-b7df-41bc-bf42-9af18d7b0568 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.442453 Jul 24 01:19:36.190633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1273/2432] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:35 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:36.198069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:36.199099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:36.207700 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.208710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.210258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.211113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.892743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:36.916982 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-83cd934a-f9fe-4a51-a9c9-07af56189945 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1512 microversion: 2.1 time: 0.724080 Jul 24 01:19:36.919371 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1274/2433] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:36 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1512 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:36.945101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:36.950427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:36.970935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.971400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:36.983883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:36.986576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:36.990065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.019501 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c4e2c30-7144-4b66-a164-5123ec41d38e tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 1.012004 Jul 24 01:19:37.022997 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1160/2434] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:35 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:37.033345 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:37.035326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:37.059171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.059789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.060670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.061179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.087187 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] HTTP exception thrown: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Request method failure captured: Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 HTTP/1.1 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jx3gLXY6h-aEX-WGxMNq5tsLsCEewfB2iN1JJD4QKo1BxsjM_GpmisPfKgahNPAaGRMKD3wAO4wmOOatRzW2jrNC7mZVZU5AwA0nIBlEe2dMh0ul1LjxkGifei3YWYeisURGcVhDvCtWmAgbfD48Ryd4HQxHEDADdP5z8FIXC8-nkI Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.32 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 651fa7eea7a04e8d83d2264c1638f8f2 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_651fa7eea7a04e8d83d2264c1638f8f2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 651fa7eea7a04e8d83d2264c1638f8f2 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TaggedBootDevicesTest-2024917720-project Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f71f3d66b27b471d9772a0a01d3c89ed Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TaggedBootDevicesTest-2024917720-project Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1'} Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:37.090695 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.094722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.095589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Returning 404 to user: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:37.103250 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63b05b44-6543-4183-8b44-d8433ab192b6 tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 404 len: 111 microversion: 2.32 time: 0.072677 Jul 24 01:19:37.107954 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1161/2435] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:19:37 2022] DELETE /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:19:37.117795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:37.118872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] [instance: 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:37.129976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.132256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.138424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.139244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.163729 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] HTTP exception thrown: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Request method failure captured: Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 HTTP/1.1 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Jx3gLXY6h-aEX-WGxMNq5tsLsCEewfB2iN1JJD4QKo1BxsjM_GpmisPfKgahNPAaGRMKD3wAO4wmOOatRzW2jrNC7mZVZU5AwA0nIBlEe2dMh0ul1LjxkGifei3YWYeisURGcVhDvCtWmAgbfD48Ryd4HQxHEDADdP5z8FIXC8-nkI Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.32 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 651fa7eea7a04e8d83d2264c1638f8f2 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_651fa7eea7a04e8d83d2264c1638f8f2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/651fa7eea7a04e8d83d2264c1638f8f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 651fa7eea7a04e8d83d2264c1638f8f2 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2024917720 Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TaggedBootDevicesTest-2024917720-project Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f71f3d66b27b471d9772a0a01d3c89ed Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TaggedBootDevicesTest-2024917720-project Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1'} Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:37.166326 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] Returning 404 to user: Instance 7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:37.170724 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-424ec88c-4132-4a03-a66a-2096af375bef tempest-TaggedBootDevicesTest-2024917720 tempest-TaggedBootDevicesTest-2024917720-project] 10.222.0.27 "GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1" status: 404 len: 111 microversion: 2.32 time: 0.060534 Jul 24 01:19:37.171735 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1162/2436] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:37 2022] GET /compute/v2.1/servers/7cce5e6f-00dc-4a9f-b804-cd7e0dae17c1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:19:37.210951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:37.212159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:37.222616 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:37.228787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.229570 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.233484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.234766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.588257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:37.596951 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1164d112-a041-4307-9ed7-06fc00341f64 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1512 microversion: 2.1 time: 0.663019 Jul 24 01:19:37.607577 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1275/2437] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:36 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1512 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:37.624663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:37.626961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:37.632092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:37.632999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:37.642104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3e610993-0209-4d0e-87a3-a0931ba37b58 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.433555 Jul 24 01:19:37.653618 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1163/2438] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:37 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:37.681550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.683109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.689307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.689907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:37.817549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:37.973580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:37.994060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:37.998244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.040473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:38.042362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:38.067922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.070093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.074591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.076406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.503785 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff1ac843-cf83-4804-907b-df08e2278db2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.882934 Jul 24 01:19:38.504396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1276/2439] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:19:37 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:38.527505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:38.530594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:38.536438 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d2400dc0-d59a-453a-ae8a-55e87c149e4f tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.501104 Jul 24 01:19:38.537063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:38.537286 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1164/2440] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:38 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:38.539869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-709086673', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:38.548036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.550436 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.551507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.552044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.660036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:38.662675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:38.681945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.682490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.683381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.683803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:38.810789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:38.977784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:38.980467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:38.991627 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c291dd89-3995-41e3-8464-beb2168efe25 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.335562 Jul 24 01:19:38.993719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:38.996341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.003772 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1165/2441] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:38 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:39.201924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86d14ed5-af60-4b91-b210-2f2f935e8f9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-709086673" status: 200 len: 1515 microversion: 2.1 time: 0.676405 Jul 24 01:19:39.215484 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1277/2442] 10.222.0.27 () {58 vars in 1260 bytes} [Sun Jul 24 01:19:38 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-709086673 => generated 1515 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:39.222864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:39.230256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:39.232033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:39.242344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:39.243347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.244609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:39.245474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.480443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:39.555079 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:39.555985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:39.568653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:39.570795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.574134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:39.575039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.604208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:39.630544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:39.632506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:39.956820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:39.969160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63874ba7-ca53-4268-add0-2b1b3717aa8c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.419181 Jul 24 01:19:39.970028 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1278/2443] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:39 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:39.985180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3ccb17a0-b5c2-4901-9b39-fbb7ad1a9d37 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.768058 Jul 24 01:19:39.993706 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1166/2444] 10.222.0.27 () {58 vars in 1172 bytes} [Sun Jul 24 01:19:39 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:40.010143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:40.013746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.014234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.servers [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Removing options 'limit' from query {{(pid=119561) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 24 01:19:40.015005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:40.019165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:40.019921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:40.022754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.024034 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.025703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.026403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.026797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.026908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.028046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.028493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.135374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.147954 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:40.159190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.159453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.410584 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dbbe4748-ea8c-4a1d-a118-84bfed9678cb tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.408389 Jul 24 01:19:40.411928 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1279/2445] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 01:19:40 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:40.429534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:40.436470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.437133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:40.446974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.447788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.448834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.449510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.455009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.468028 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72b846f3-887c-4513-94cd-7beec6a9db7b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.461875 Jul 24 01:19:40.482180 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1167/2446] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:40 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:40.509600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:40.562512 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c6b7bd7-9484-476a-b333-6664530f61a6 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.135268 Jul 24 01:19:40.565805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1280/2447] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:19:40 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:40.577780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:40.583812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.584245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.servers [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Removing options 'limit' from query {{(pid=119562) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 24 01:19:40.587495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:40.605325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.608649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.612146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.612963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.679886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:40.726931 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79076634-56cf-418f-af61-7f3443387717 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.155515 Jul 24 01:19:40.728020 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1168/2448] 10.222.0.27 () {58 vars in 1149 bytes} [Sun Jul 24 01:19:40 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:40.738746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:40.744361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.745472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:40.754972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.758028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.759524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.760300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.793745 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:40.802929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:40.847778 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00281b8e-874a-4549-b9a5-231648169b86 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.112809 Jul 24 01:19:40.850882 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1281/2449] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:19:40 2022] GET /compute/v2.1/servers => generated 1009 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:40.863919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:40.870268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:40.871579 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:40.890168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.891261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.892940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:40.894097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:40.987443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:40.988423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:41.006441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.007124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.008164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.009344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.031574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:41.191725 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0388629a-dd9f-4d62-8333-3b15c87149ed tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.333375 Jul 24 01:19:41.192696 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1169/2450] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:19:40 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:19:41.208392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:41.213147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:41.213568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.servers [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Removing options 'limit' from query {{(pid=119562) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 24 01:19:41.219557 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:41.232337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.232860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.233827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.234596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.281001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:41.295113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7eff7ccf-3e2d-4d14-8fd7-4606cf56c0de tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.310966 Jul 24 01:19:41.296398 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1282/2451] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:40 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:41.327702 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76be53e1-60e8-4494-95c8-96e99c0f2af2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.121482 Jul 24 01:19:41.337199 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1170/2452] 10.222.0.27 () {58 vars in 1139 bytes} [Sun Jul 24 01:19:41 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:41.343586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:41.347846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:41.348539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-709086673', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:41.356040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.357044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.359388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.359931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.483181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:19:41.486462 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:41.487514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:41.532658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.537320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.542552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.546284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.589703 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-91477452-6707-40e7-9545-2b28a13b55c0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-709086673" status: 200 len: 345 microversion: 2.1 time: 0.250438 Jul 24 01:19:41.596584 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1283/2453] 10.222.0.27 () {58 vars in 1239 bytes} [Sun Jul 24 01:19:41 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-709086673 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:41.604187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f12ca7ea-39dc-4bbb-ad74-a2455109f10a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:41.612813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f12ca7ea-39dc-4bbb-ad74-a2455109f10a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.613333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f12ca7ea-39dc-4bbb-ad74-a2455109f10a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.642156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f12ca7ea-39dc-4bbb-ad74-a2455109f10a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Going to try to stop instance {{(pid=119561) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:19:41.721305 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f12ca7ea-39dc-4bbb-ad74-a2455109f10a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "POST /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835/action" status: 202 len: 0 microversion: 2.1 time: 0.121488 Jul 24 01:19:41.725459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1284/2454] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:19:41 2022] POST /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:19:41.767037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:41.770266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:41.780410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.780956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:41.781943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:41.782976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:42.139368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:42.156685 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c54d932e-7cee-4fde-a92c-86b72370498a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.674136 Jul 24 01:19:42.158895 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1171/2455] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:41 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:42.167015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c094b868-dc70-42bf-9b0b-d720ca102a2f req-80a6b542-387b-4880-9d8d-7f7ff2977ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce86317c-d743-458d-98cf-f690f495fda8", "name": "network-vif-plugged", "status": "completed", "tag": "200dc558-ef0e-4dc0-ba99-7403542d5068"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:42.185516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:42.201794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c094b868-dc70-42bf-9b0b-d720ca102a2f req-80a6b542-387b-4880-9d8d-7f7ff2977ca9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:42.201794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c094b868-dc70-42bf-9b0b-d720ca102a2f req-80a6b542-387b-4880-9d8d-7f7ff2977ca9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:42.203522 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1600ed1f-9b51-4922-aa51-8ff87009d511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.465359 Jul 24 01:19:42.204515 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1285/2456] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:41 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:42.226634 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c094b868-dc70-42bf-9b0b-d720ca102a2f req-80a6b542-387b-4880-9d8d-7f7ff2977ca9 service nova] Creating event network-vif-plugged:200dc558-ef0e-4dc0-ba99-7403542d5068 for instance ce86317c-d743-458d-98cf-f690f495fda8 on n-h2-master-1 Jul 24 01:19:42.235566 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c094b868-dc70-42bf-9b0b-d720ca102a2f req-80a6b542-387b-4880-9d8d-7f7ff2977ca9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074338 Jul 24 01:19:42.236378 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1172/2457] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:42.314093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:42.314849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:42.324841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:42.326417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:42.332053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:42.336022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:42.735827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:42.746003 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a327993-8706-424c-9f98-b0ebbf99a5b2 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.436790 Jul 24 01:19:42.756342 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1286/2458] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:42 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:43.177022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:43.177915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:43.193277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.194048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.197344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.198267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.220749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:43.221929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:43.236481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.241639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.245315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.245991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.692341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:43.706199 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf73e7a9-3265-4a33-9240-36afbca0772f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.489547 Jul 24 01:19:43.706828 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1287/2459] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:43 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:43.762897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:43.764250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:43.778031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.779963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.780935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:43.782424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:43.908597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:43.925601 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6febf8ca-62a3-4315-a7fe-0c8f772ed905 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.751291 Jul 24 01:19:43.928669 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1173/2460] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:43 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:44.086510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:44.100754 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8ead307-fd30-4914-b515-0fd50db1fdc5 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.341991 Jul 24 01:19:44.111069 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1288/2461] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:43 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:44.293162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a4e28022-edab-4887-abb2-0520f5c30590 req-4b98d790-c3a2-47cb-ab97-43d9983127b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce86317c-d743-458d-98cf-f690f495fda8", "name": "network-vif-plugged", "status": "completed", "tag": "2b283023-5b88-4ca7-9484-4d97e9fa1eb9"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:44.327914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a4e28022-edab-4887-abb2-0520f5c30590 req-4b98d790-c3a2-47cb-ab97-43d9983127b4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:44.328391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a4e28022-edab-4887-abb2-0520f5c30590 req-4b98d790-c3a2-47cb-ab97-43d9983127b4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:44.363751 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a4e28022-edab-4887-abb2-0520f5c30590 req-4b98d790-c3a2-47cb-ab97-43d9983127b4 service nova] Creating event network-vif-plugged:2b283023-5b88-4ca7-9484-4d97e9fa1eb9 for instance ce86317c-d743-458d-98cf-f690f495fda8 on n-h2-master-1 Jul 24 01:19:44.388586 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a4e28022-edab-4887-abb2-0520f5c30590 req-4b98d790-c3a2-47cb-ab97-43d9983127b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096121 Jul 24 01:19:44.390054 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1174/2462] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:44.725700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:44.727544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:44.749055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:44.751223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:44.753026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:44.753726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:44.947470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:44.948837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:44.968951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:44.969413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:44.972691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:44.975928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:45.089205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:45.104316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f633efb4-ffe5-47ac-8da9-e3b7e83614fe tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.381463 Jul 24 01:19:45.106572 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1289/2463] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:44 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:45.132824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:45.141847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:45.167826 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:45.172748 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:45.173625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:45.174111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:45.472772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:45.488349 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c7055a66-0c75-44e4-a657-a649983cc9b4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.547392 Jul 24 01:19:45.489489 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1175/2464] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:44 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:45.579471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:45.589960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-becb53ce-d286-41aa-8943-5fc3dd8a6123 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1334 microversion: 2.1 time: 0.467925 Jul 24 01:19:45.591179 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1290/2465] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:45 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1334 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:46.129319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:46.133708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:46.149758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.151938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.155228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.158368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.511086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:46.511841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:46.520001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:46.531624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.534012 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fafd0f34-019f-4222-979d-dbbc4487507f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.414247 Jul 24 01:19:46.534714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.535540 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1176/2466] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:46 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:46.542839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-be7a05d9-4863-457e-b538-64e70deed9bb req-60cdf97c-b48d-45ee-a081-c71a6bd0278b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd02606-019b-4095-a20b-1f03d30bf81f", "name": "network-vif-plugged", "status": "completed", "tag": "01d4a5e7-32f6-423b-b735-d0c97dd15b34"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:46.545920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.553519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.560092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-be7a05d9-4863-457e-b538-64e70deed9bb req-60cdf97c-b48d-45ee-a081-c71a6bd0278b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.561037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-be7a05d9-4863-457e-b538-64e70deed9bb req-60cdf97c-b48d-45ee-a081-c71a6bd0278b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.583167 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-be7a05d9-4863-457e-b538-64e70deed9bb req-60cdf97c-b48d-45ee-a081-c71a6bd0278b service nova] Creating event network-vif-plugged:01d4a5e7-32f6-423b-b735-d0c97dd15b34 for instance cbd02606-019b-4095-a20b-1f03d30bf81f on n-h2-master-1 Jul 24 01:19:46.591776 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-be7a05d9-4863-457e-b538-64e70deed9bb req-60cdf97c-b48d-45ee-a081-c71a6bd0278b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054092 Jul 24 01:19:46.593208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1177/2467] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:46.613337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:46.615903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:46.631675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.632513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.633992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:46.634594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:46.673342 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:47.191905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:47.227785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:47.243896 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-edc4cdb8-020f-4e52-8476-79fa3a72be58 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1671 microversion: 2.1 time: 0.637878 Jul 24 01:19:47.244939 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1178/2468] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:46 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1671 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:47.259703 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7eef5921-6fce-4bea-8140-1780c64a9113 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 0.755711 Jul 24 01:19:47.260575 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1291/2469] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:46 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:47.271396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f0bb530-f965-4b20-af60-831661968fed tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:47.272012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5f0bb530-f965-4b20-af60-831661968fed tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:47.279060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f0bb530-f965-4b20-af60-831661968fed tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.279603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f0bb530-f965-4b20-af60-831661968fed tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.280477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f0bb530-f965-4b20-af60-831661968fed tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.281199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f0bb530-f965-4b20-af60-831661968fed tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.313050 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5f0bb530-f965-4b20-af60-831661968fed tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8/ips" status: 200 len: 181 microversion: 2.1 time: 0.045747 Jul 24 01:19:47.319727 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1179/2470] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:19:47 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8/ips => generated 181 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:47.325714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:47.326568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:47.339632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.340383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.341788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.342529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.377731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:19:47.559941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:47.567018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:47.583188 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b12fde7a-8a6c-48d7-bdda-77f0e1ea8ca3 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 204 len: 0 microversion: 2.1 time: 0.261964 Jul 24 01:19:47.585770 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1292/2471] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:19:47 2022] DELETE /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:19:47.617790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.619107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.622788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:47.624531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:47.626263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.628968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.654661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.658307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:47.660644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:47.663884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:49.229482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:49.246745 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3880335e-e832-48cd-9ef8-38579ab68a7b tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1677 microversion: 2.1 time: 1.653992 Jul 24 01:19:49.247630 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1293/2472] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:47 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1677 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:49.268075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:49.269260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:49.283406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:49.287860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:49.290321 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:49.291539 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:49.355684 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:49.599492 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:49.711293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:49.723027 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b000ad6-84bf-431a-baaa-1f2bbf2f4dc1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 2.173184 Jul 24 01:19:49.733730 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1180/2473] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:47 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:50.126185 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:50.269938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:50.271363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:50.289136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:50.299760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:50.304083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:50.307769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:50.352356 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:50.364797 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-765e0fa6-f8fd-4988-82ce-59315b9e0b7a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1316 microversion: 2.1 time: 1.102718 Jul 24 01:19:50.378898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1294/2474] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:49 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1316 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:50.747091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:50.747984 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:50.772161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:50.773093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:50.775302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:50.776888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:50.791290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:50.806546 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3f6ff25-efe3-4746-a8fb-717813fb0908 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1677 microversion: 2.1 time: 0.539187 Jul 24 01:19:50.811772 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1181/2475] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:50 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1677 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:51.338704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:51.353491 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-970d7e56-5c87-4abf-8c83-7706b15cbab4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.610409 Jul 24 01:19:51.356581 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1295/2476] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:50 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:51.396670 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:51.397297 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:51.405575 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:51.413951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:51.414409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:51.415219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:51.415658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:51.828520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:51.830243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:51.833956 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:51.863251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:51.872637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:51.885106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:51.886663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:51.889569 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ca845233-d2a3-46bb-87e6-ba3526479b0a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1465 microversion: 2.1 time: 0.491338 Jul 24 01:19:51.890863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:51.894419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1182/2477] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:51 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1465 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:51.915135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d00ef42-e29f-4f27-a248-cfad2d2828dc tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:51.916870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d00ef42-e29f-4f27-a248-cfad2d2828dc tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:51.950528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d00ef42-e29f-4f27-a248-cfad2d2828dc tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:51.953990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d00ef42-e29f-4f27-a248-cfad2d2828dc tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:51.961855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d00ef42-e29f-4f27-a248-cfad2d2828dc tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:51.962618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d00ef42-e29f-4f27-a248-cfad2d2828dc tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:52.669877 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d00ef42-e29f-4f27-a248-cfad2d2828dc tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1616 microversion: 2.1 time: 0.757488 Jul 24 01:19:52.672093 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1183/2478] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:51 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1616 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:52.687640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-87b31a18-2179-4388-adc8-bfd90fb8d1f5 req-a820306b-c46d-412d-9d11-3efeeae7ea44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce86317c-d743-458d-98cf-f690f495fda8", "name": "network-vif-deleted", "tag": "2b283023-5b88-4ca7-9484-4d97e9fa1eb9"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:52.724118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-87b31a18-2179-4388-adc8-bfd90fb8d1f5 req-a820306b-c46d-412d-9d11-3efeeae7ea44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:52.725081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-87b31a18-2179-4388-adc8-bfd90fb8d1f5 req-a820306b-c46d-412d-9d11-3efeeae7ea44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:52.735059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:52.751657 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2fbdc351-0d72-4a87-a9b1-c15411755c36 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1656 microversion: 2.1 time: 0.927585 Jul 24 01:19:52.752269 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1296/2479] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:51 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1656 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:52.761977 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-87b31a18-2179-4388-adc8-bfd90fb8d1f5 req-a820306b-c46d-412d-9d11-3efeeae7ea44 service nova] Creating event network-vif-deleted:2b283023-5b88-4ca7-9484-4d97e9fa1eb9 for instance ce86317c-d743-458d-98cf-f690f495fda8 on n-h2-master-1 Jul 24 01:19:52.782495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-87b31a18-2179-4388-adc8-bfd90fb8d1f5 req-a820306b-c46d-412d-9d11-3efeeae7ea44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102197 Jul 24 01:19:52.783169 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1184/2480] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:52.784739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:52.786444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:52.815726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:52.818500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:52.825395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:52.826315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:52.944608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2016696035", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "98477c05-8901-4a3a-b18f-6a5923ce55be"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:53.052269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:19:53.648859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:53.662672 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-506cefe5-9db0-4159-a6e2-db76206be6a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.891506 Jul 24 01:19:53.664306 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1297/2481] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:52 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:53.678496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c4f0a180-c0b1-46e9-a88d-3ccd4dc6d595 req-ad1700e5-4bad-4ae0-be51-c3e7421ead5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce86317c-d743-458d-98cf-f690f495fda8", "name": "network-vif-unplugged", "status": "completed", "tag": "200dc558-ef0e-4dc0-ba99-7403542d5068"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:53.703836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c4f0a180-c0b1-46e9-a88d-3ccd4dc6d595 req-ad1700e5-4bad-4ae0-be51-c3e7421ead5e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:53.704307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c4f0a180-c0b1-46e9-a88d-3ccd4dc6d595 req-ad1700e5-4bad-4ae0-be51-c3e7421ead5e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:53.724520 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c4f0a180-c0b1-46e9-a88d-3ccd4dc6d595 req-ad1700e5-4bad-4ae0-be51-c3e7421ead5e service nova] Creating event network-vif-unplugged:200dc558-ef0e-4dc0-ba99-7403542d5068 for instance ce86317c-d743-458d-98cf-f690f495fda8 on n-h2-master-1 Jul 24 01:19:53.732189 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c4f0a180-c0b1-46e9-a88d-3ccd4dc6d595 req-ad1700e5-4bad-4ae0-be51-c3e7421ead5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065989 Jul 24 01:19:53.734815 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1298/2482] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:53.774359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:53.775271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:53.794188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:53.796641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:53.800541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:53.801426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:53.934588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:19:53.935076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:19:53.936088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:19:53.936667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:19:53.937278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:19:53.950869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:53.952277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:53.955770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:53.956708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:54.008793 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:19:54.016593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Getting quotas for user 7033c900a87241779c10097a9c494e7b and project 08cb5ce8c4354541b492eb8cc8f89c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:19:54.038635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:19:54.041340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:19:54.100113 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2f4cf4a2-9ccf-48e7-9be1-71c8951092cd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161095 Jul 24 01:19:54.101442 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1185/2483] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:19:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:19:54.385840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1955022739", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "38c347e9-3381-4775-bfe0-4243f525f4cb"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:54.431568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:54.452861 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1b22f17a-22a4-4224-94c9-003448eaca31 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1497 microversion: 2.1 time: 0.683801 Jul 24 01:19:54.462588 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1299/2484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:53 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1497 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:54.484915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c46a841d-b205-4dc6-ba77-36f0fc7208b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:54.486628 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c46a841d-b205-4dc6-ba77-36f0fc7208b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:54.574923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] validate_networks() for [('38c347e9-3381-4775-bfe0-4243f525f4cb', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:19:54.955259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c46a841d-b205-4dc6-ba77-36f0fc7208b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:54.962975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c46a841d-b205-4dc6-ba77-36f0fc7208b8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1217 microversion: 2.1 time: 0.504976 Jul 24 01:19:54.967461 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1300/2485] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:54 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1217 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:54.990300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:54.993034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:55.042067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:55.042988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:55.047731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:55.050666 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:55.631967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:55.642499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1af0609b-0075-4431-b4a9-3f3ddd68f063 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.673893 Jul 24 01:19:55.643102 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1301/2486] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:54 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:55.669898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f2b99605-fe10-4336-95d6-0ecb6b76e02a req-18eae780-4915-4387-ac3f-b5d59e2d333d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce86317c-d743-458d-98cf-f690f495fda8", "name": "network-vif-deleted", "tag": "200dc558-ef0e-4dc0-ba99-7403542d5068"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:19:55.691723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f2b99605-fe10-4336-95d6-0ecb6b76e02a req-18eae780-4915-4387-ac3f-b5d59e2d333d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:55.694843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f2b99605-fe10-4336-95d6-0ecb6b76e02a req-18eae780-4915-4387-ac3f-b5d59e2d333d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:55.725807 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f2b99605-fe10-4336-95d6-0ecb6b76e02a req-18eae780-4915-4387-ac3f-b5d59e2d333d service nova] Creating event network-vif-deleted:200dc558-ef0e-4dc0-ba99-7403542d5068 for instance ce86317c-d743-458d-98cf-f690f495fda8 on n-h2-master-1 Jul 24 01:19:55.736461 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f2b99605-fe10-4336-95d6-0ecb6b76e02a req-18eae780-4915-4387-ac3f-b5d59e2d333d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075473 Jul 24 01:19:55.748316 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1302/2487] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:19:55.762359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:55.763402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:55.776397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:55.781429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:55.782516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:55.783173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:55.852887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:55.854007 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:55.855001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lazy-loading 'fault' on Instance uuid ce86317c-d743-458d-98cf-f690f495fda8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:19:55.926287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c41e924f694c789952302d70e75efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bf9b4eea0b4c43bbd2d44888e13f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:55.937061 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a02a4188-8a56-464b-bfd2-2045177008ad tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 200 len: 1303 microversion: 2.1 time: 0.186584 Jul 24 01:19:55.953270 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1303/2488] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:55 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:55.984363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:55.985820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:56.000046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.000869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:56.002176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.002843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:56.197079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:19:56.197911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:19:56.198258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:19:56.198730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:19:56.199430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:19:56.235193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.235193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:56.242154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.242779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:56.288204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Getting quotas for project e5025d6267ba40509d642d51a559f217. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:19:56.303237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Getting quotas for user 3172ec09985048558fe0f3adf9c067fd and project e5025d6267ba40509d642d51a559f217. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:19:56.321897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:56.336603 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed1987be-7b50-42d9-8c52-6b2906c59ae5 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1277 microversion: 2.1 time: 0.355210 Jul 24 01:19:56.343599 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1304/2489] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:55 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1277 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:19:56.352028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:19:56.354495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:19:56.460862 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2498d6b0-21c9-4b61-8320-09f45f562124 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.358021 Jul 24 01:19:56.466111 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1186/2490] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:19:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:19:56.472438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68f30c98-96fc-4b4d-aae4-5e7d6b0b6cb1 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:56.473071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68f30c98-96fc-4b4d-aae4-5e7d6b0b6cb1 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:56.660575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:56.661419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:56.674390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.680070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:56.681083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.681642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:56.883101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68f30c98-96fc-4b4d-aae4-5e7d6b0b6cb1 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:56.904656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68f30c98-96fc-4b4d-aae4-5e7d6b0b6cb1 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:56.916330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68f30c98-96fc-4b4d-aae4-5e7d6b0b6cb1 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:56.916330 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68f30c98-96fc-4b4d-aae4-5e7d6b0b6cb1 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1259 microversion: 2.21 time: 0.446686 Jul 24 01:19:56.916330 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1305/2491] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:56 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1259 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:56.957793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:56.959944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:56.980374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.983117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:56.984723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:56.987403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:57.045975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] HTTP exception thrown: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Request method failure captured: Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 HTTP/1.1 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J27RdtZ3NDutdDW0_3grV7B_cMIJCBphabk0-LhmbhE2IQ5I1zDeI5bb_64tmq95YO4OPpUynqsXixfwkcC4FUdmVRWKwTXiJyKzekUNQEdc3NT0Tiz7IannEYHwyFIrqsxso7OSVf0Fjjxe7GCqIpLQJr0TpNmJrFwsa4umCg1Q-I Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90bf9b4eea0b4c43bbd2d44888e13f77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestMultiNic-2093168813 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b2c41e924f694c789952302d70e75efd Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ce86317c-d743-458d-98cf-f690f495fda8'} Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:19:57.051923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:57.055974 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:19:57.055974 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:19:57.055974 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:19:57.055974 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:19:57.055974 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:19:57.055974 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:19:57.055974 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:19:57.058251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Returning 404 to user: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:19:57.062800 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-505c526d-de20-402e-aec6-dd451f05dc03 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 404 len: 111 microversion: 2.1 time: 0.109915 Jul 24 01:19:57.063935 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1306/2492] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:56 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:19:57.354683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:57.355317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:57.370416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:57.375465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:57.376545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:57.377911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:57.526583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:57.541351 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cacc078a-e479-46ed-93e0-b6a2486b1335 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1275 microversion: 2.1 time: 0.187827 Jul 24 01:19:57.545814 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1307/2493] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:57 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:57.567069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:57.587664 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d9df3e91-8426-4572-bec4-ad412419c5da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1522 microversion: 2.1 time: 0.929847 Jul 24 01:19:57.591700 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1187/2494] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:56 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1522 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:57.934696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:57.935609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:57.955472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:57.961116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:57.965296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:57.966109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:58.263431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:58.278652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:58.283032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:58.284262 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2ee14ed-8632-4f38-8dc2-a4cc8207a0fc tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1311 microversion: 2.21 time: 0.353945 Jul 24 01:19:58.301847 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1308/2495] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:57 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:19:58.561009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:58.561710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:58.577237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:58.579531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:58.581618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:58.582785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:58.607152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:58.608070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:58.624724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:58.630802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:58.632224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:58.634394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:58.857717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:58.884631 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d95248c5-62c9-495d-9d85-db9866c1b5b9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1275 microversion: 2.1 time: 0.327737 Jul 24 01:19:58.887177 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1188/2496] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:58 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1275 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:59.322159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:59.323938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:59.333639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:59.334543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:59.336346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:59.338131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:59.752832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:59.796555 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de6ff48f-4fa6-42f9-9356-6c3c71a4a7d1 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1499 microversion: 2.1 time: 1.189941 Jul 24 01:19:59.799906 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1309/2497] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:58 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1499 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:19:59.852181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:59.871308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:59.886832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:59.890775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:59.891313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:19:59.899662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:19:59.905222 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-989f38b9-bb73-40e1-9dcb-467f5d3aa4f0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1317 microversion: 2.21 time: 0.589224 Jul 24 01:19:59.909143 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1189/2498] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:19:59 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1317 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:19:59.922337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:59.926422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:19:59.932775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:59.934095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:59.936780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:59.942890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:19:59.974670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:59.975154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:19:59.983309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:19:59.985969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:00.048114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:00.106290 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8075bfb-afba-4392-9fe4-987ad0020124 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.280350 Jul 24 01:20:00.107613 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1310/2499] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Jul 24 01:19:59 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:20:00.124653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca96a673-7705-485d-8669-8c43b2e1351f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:00.134663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca96a673-7705-485d-8669-8c43b2e1351f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:00.135382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca96a673-7705-485d-8669-8c43b2e1351f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:00.219541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ca96a673-7705-485d-8669-8c43b2e1351f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Going to try to start instance {{(pid=119561) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 01:20:00.326403 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca96a673-7705-485d-8669-8c43b2e1351f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "POST /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835/action" status: 202 len: 0 microversion: 2.1 time: 0.211563 Jul 24 01:20:00.332156 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1311/2500] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:20:00 2022] POST /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:20:00.341837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:00.342638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:00.359475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:00.360052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:00.363493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:00.363951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:01.385503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:01.403311 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38c4f8c9-ab2e-4faf-9c7a-659332d10f10 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1317 microversion: 2.1 time: 1.488784 Jul 24 01:20:01.406727 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1190/2501] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:19:59 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1317 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:01.423614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:01.425006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:01.444109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:01.445259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:01.446875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:01.448261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:01.746481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:01.761774 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f548429-c150-462f-b593-ce47b473e7da tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1508 microversion: 2.1 time: 1.426443 Jul 24 01:20:01.766051 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1312/2502] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:00 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1508 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:01.810822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:01.844253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:01.848403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:01.852144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c9daa57-1c63-434a-8051-d8df72994f62 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1317 microversion: 2.21 time: 0.438699 Jul 24 01:20:01.853086 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1191/2503] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:01 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:02.424178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:02.425124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:02.437559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:02.462144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:02.463605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:02.464279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:02.510404 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:02.782875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:02.785144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:02.807106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:02.807859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:02.809075 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:02.809713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:03.215192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:03.235835 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f962c92c-5f37-43f0-a643-c61b671fa066 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1317 microversion: 2.1 time: 0.815626 Jul 24 01:20:03.251989 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1313/2504] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:02 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:03.260241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:03.262534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:03.276641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:03.277107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:03.283364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:03.287116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:03.292527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:03.318855 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-12f267ba-6646-49ba-8f54-0d9cae8756c8 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1508 microversion: 2.1 time: 0.529623 Jul 24 01:20:03.334065 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1192/2505] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:02 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1508 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:03.700847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:03.716523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:03.728617 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:03.732633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2777e3ed-bb5d-428f-9b3d-71b599a5d58a tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1359 microversion: 2.21 time: 0.478549 Jul 24 01:20:03.734401 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1314/2506] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:03 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1359 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:04.146367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6623794b-9997-4b9d-ae2e-1aa67b89b87e req-75663a0a-ab5d-4bc1-bc53-7faea781f5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6e00c4-3042-4e8c-a0ca-0a65dec91661", "tag": "892738f1-2be0-4e7a-a405-fa33a4e2dae3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:04.166279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6623794b-9997-4b9d-ae2e-1aa67b89b87e req-75663a0a-ab5d-4bc1-bc53-7faea781f5e4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:04.166814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6623794b-9997-4b9d-ae2e-1aa67b89b87e req-75663a0a-ab5d-4bc1-bc53-7faea781f5e4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:04.221810 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6623794b-9997-4b9d-ae2e-1aa67b89b87e req-75663a0a-ab5d-4bc1-bc53-7faea781f5e4 service nova] Creating event network-changed:892738f1-2be0-4e7a-a405-fa33a4e2dae3 for instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 on n-h1-master-1 Jul 24 01:20:04.231971 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6623794b-9997-4b9d-ae2e-1aa67b89b87e req-75663a0a-ab5d-4bc1-bc53-7faea781f5e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095246 Jul 24 01:20:04.233332 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1193/2507] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:04.254614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:04.256334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:04.263199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:04.263661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:04.264472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:04.264917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:04.348194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:04.349367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:04.360799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:04.361746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:04.363225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:04.363867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:04.947477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:04.963489 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13b2b046-7185-45ed-923d-23fcb769191a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1317 microversion: 2.1 time: 0.712636 Jul 24 01:20:04.963977 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1315/2508] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:04 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:04.980474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:04.987827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:04.999413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:05.015158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ddbc68f-9c9e-4911-b80a-50d159278a7e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1512 microversion: 2.1 time: 0.675680 Jul 24 01:20:05.017201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.017658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:05.018475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.018913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:05.022034 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1194/2509] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:04 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:05.040150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2064102575", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c346cd37-8708-458f-a9ad-b2bb44b94ef1"}], "block_device_mapping_v2": [{"uuid": "f5534ef8-4302-435e-ae23-0425ce60acdc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:05.113399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] validate_networks() for [('c346cd37-8708-458f-a9ad-b2bb44b94ef1', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:20:05.762478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:05.777132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:05.778783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:05.779936 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a092168-43f0-4ee7-90be-2fb5a0023729 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1359 microversion: 2.21 time: 0.805237 Jul 24 01:20:05.794225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1316/2510] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:04 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1359 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:05.804275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:05.814048 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:05.815658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.servers [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Removing options 'limit' from query {{(pid=119561) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 24 01:20:05.819225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:05.822584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.823220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:05.825048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.825500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:05.835389 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4db14374-ccf5-455f-b46d-a7a28e7459ee tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.033973 Jul 24 01:20:05.845556 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1317/2511] 10.222.0.27 () {58 vars in 1139 bytes} [Sun Jul 24 01:20:05 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:20:05.864260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:05.866016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:05.873517 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.874151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:05.875071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.875618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:05.903772 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] HTTP exception thrown: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Request method failure captured: Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 HTTP/1.1 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J27RdtZ3NDutdDW0_3grV7B_cMIJCBphabk0-LhmbhE2IQ5I1zDeI5bb_64tmq95YO4OPpUynqsXixfwkcC4FUdmVRWKwTXiJyKzekUNQEdc3NT0Tiz7IannEYHwyFIrqsxso7OSVf0Fjjxe7GCqIpLQJr0TpNmJrFwsa4umCg1Q-I Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90bf9b4eea0b4c43bbd2d44888e13f77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b2c41e924f694c789952302d70e75efd Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ce86317c-d743-458d-98cf-f690f495fda8'} Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:05.928381 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:05.932246 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:05.932954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Returning 404 to user: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:05.934545 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32b8f820-0ecc-4c4b-9576-e722175b822c tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 404 len: 111 microversion: 2.1 time: 0.080814 Jul 24 01:20:05.935324 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1318/2512] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:05 2022] DELETE /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:05.945440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:05.946065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:05.954664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.955514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:05.956443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:05.968639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:06.258090 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:06.338206 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:06.436712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:06.450177 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-66b0d3c3-134c-4a89-a958-84e7fe9fff26 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1512 microversion: 2.1 time: 0.511923 Jul 24 01:20:06.451182 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1319/2513] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:05 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:06.459518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:06.460217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: ce86317c-d743-458d-98cf-f690f495fda8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:06.470374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:06.471684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:06.473187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:06.475070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:06.494772 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] HTTP exception thrown: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Request method failure captured: Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 HTTP/1.1 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J27RdtZ3NDutdDW0_3grV7B_cMIJCBphabk0-LhmbhE2IQ5I1zDeI5bb_64tmq95YO4OPpUynqsXixfwkcC4FUdmVRWKwTXiJyKzekUNQEdc3NT0Tiz7IannEYHwyFIrqsxso7OSVf0Fjjxe7GCqIpLQJr0TpNmJrFwsa4umCg1Q-I Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90bf9b4eea0b4c43bbd2d44888e13f77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b2c41e924f694c789952302d70e75efd Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ce86317c-d743-458d-98cf-f690f495fda8'} Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:06.496453 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Returning 404 to user: Instance ce86317c-d743-458d-98cf-f690f495fda8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9cd2ad03-6575-4d91-b6b3-8c956eeb2097 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8" status: 404 len: 111 microversion: 2.1 time: 0.045449 Jul 24 01:20:06.500085 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1320/2514] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:06 2022] GET /compute/v2.1/servers/ce86317c-d743-458d-98cf-f690f495fda8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:06.506119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:06.507042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:06.513897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:06.514454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:06.515343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:06.515843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:06.790109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:20:06.790662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:20:06.793380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:20:06.794279 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:20:06.794918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:20:06.833960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:06.835916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:06.840570 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:06.841612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:06.877441 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:06.888593 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:06.901869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:20:06.918198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Getting quotas for user 735a3f7d7e454f14a7a4ed229affd75b and project e6caac543f0e47e5908eb146739cddca. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:20:06.921791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:06.935423 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5521d1b4-383d-4f6a-aa14-e26fd366e8f1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1317 microversion: 2.1 time: 0.435363 Jul 24 01:20:06.936024 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1321/2515] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:06 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:06.941016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7c5d9b48-7bcb-487a-8820-3846021bb92b req-59ea1384-87c4-4d28-b38e-498339681764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04157fd-7c0d-4c17-b348-f86aa9a16f3d", "tag": "0dd2f1b4-f9cc-4d2d-bb23-43c1660d0dcc"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:06.972144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7c5d9b48-7bcb-487a-8820-3846021bb92b req-59ea1384-87c4-4d28-b38e-498339681764 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:06.972605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7c5d9b48-7bcb-487a-8820-3846021bb92b req-59ea1384-87c4-4d28-b38e-498339681764 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.002276 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7c5d9b48-7bcb-487a-8820-3846021bb92b req-59ea1384-87c4-4d28-b38e-498339681764 service nova] Creating event network-changed:0dd2f1b4-f9cc-4d2d-bb23-43c1660d0dcc for instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d on n-h2-master-1 Jul 24 01:20:07.012473 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7c5d9b48-7bcb-487a-8820-3846021bb92b req-59ea1384-87c4-4d28-b38e-498339681764 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073163 Jul 24 01:20:07.014184 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1322/2516] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:07.032096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:07.043020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:07.044185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Searching by: {'deleted': False, 'project_id': '97fbef19413a4054aa808c676248fd27'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:07.060984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.061457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.062320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.062945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.101488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:20:07.104009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5534ef8-4302-435e-ae23-0425ce60acdc',volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:20:07.138786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:07.202829 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1752a5ce-ac04-46fa-9500-e1f168fe8f6c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.180161 Jul 24 01:20:07.213246 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1323/2517] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:20:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:07.223100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:07.226966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:07.232733 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:07.245895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.246450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.247298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.249929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.354212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6dc2d21-ecd2-45ce-96cc-9a1bb8f00c72 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.318810 Jul 24 01:20:07.355110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1195/2518] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:20:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:20:07.383790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:07.384848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:07.396116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.396979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.398678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.399462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.417130 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] HTTP exception thrown: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Request method failure captured: Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 HTTP/1.1 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J27RdtZ3NDutdDW0_3grV7B_cMIJCBphabk0-LhmbhE2IQ5I1zDeI5bb_64tmq95YO4OPpUynqsXixfwkcC4FUdmVRWKwTXiJyKzekUNQEdc3NT0Tiz7IannEYHwyFIrqsxso7OSVf0Fjjxe7GCqIpLQJr0TpNmJrFwsa4umCg1Q-I Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90bf9b4eea0b4c43bbd2d44888e13f77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b2c41e924f694c789952302d70e75efd Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: exception: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025'} Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:07.419726 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:07.423284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Returning 404 to user: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:07.424002 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2039620d-d3d5-47aa-8d09-9f7230beb457 tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 404 len: 111 microversion: 2.1 time: 0.062353 Jul 24 01:20:07.429815 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1196/2519] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:07 2022] DELETE /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:07.432748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:07.433381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:07.442284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.443238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.444952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.445704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.735842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:07.749270 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be9767c3-1437-4a92-91d1-778bc9cb6e71 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1512 microversion: 2.1 time: 0.534506 Jul 24 01:20:07.751334 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1324/2520] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:07 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:07.762955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:07.769559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:07.771883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Searching by: {'deleted': False, 'project_id': '97fbef19413a4054aa808c676248fd27'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:07.780530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.781388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.782936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.783569 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.830198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:07.917034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:07.922047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:07.935965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:07.940716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:07.944704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:07.945178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:07.945414 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-74075ce9-7495-4199-9394-3c3a8ea17ac0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1359 microversion: 2.21 time: 0.518215 Jul 24 01:20:07.946224 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1197/2521] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:07 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1359 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:07.974652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d486b2bc-24a4-4852-8d07-002c1d5e47e0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:07.975716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d486b2bc-24a4-4852-8d07-002c1d5e47e0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:08.073155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d486b2bc-24a4-4852-8d07-002c1d5e47e0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:08.086860 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d486b2bc-24a4-4852-8d07-002c1d5e47e0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:08.090322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d486b2bc-24a4-4852-8d07-002c1d5e47e0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:08.094371 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d486b2bc-24a4-4852-8d07-002c1d5e47e0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1104 microversion: 2.25 time: 0.134643 Jul 24 01:20:08.095549 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1198/2522] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:07 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1104 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:08.110573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:08.111250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] [instance: bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:08.126874 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:08.132307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:08.133853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:08.135405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:08.185044 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] HTTP exception thrown: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Request method failure captured: Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 HTTP/1.1 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J27RdtZ3NDutdDW0_3grV7B_cMIJCBphabk0-LhmbhE2IQ5I1zDeI5bb_64tmq95YO4OPpUynqsXixfwkcC4FUdmVRWKwTXiJyKzekUNQEdc3NT0Tiz7IannEYHwyFIrqsxso7OSVf0Fjjxe7GCqIpLQJr0TpNmJrFwsa4umCg1Q-I Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90bf9b4eea0b4c43bbd2d44888e13f77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90bf9b4eea0b4c43bbd2d44888e13f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 90bf9b4eea0b4c43bbd2d44888e13f77 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestMultiNic-2093168813 Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b2c41e924f694c789952302d70e75efd Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestMultiNic-2093168813-project Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: exception: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025'} Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:08.187417 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] Returning 404 to user: Instance bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:08.192607 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3c5da36-a112-48dd-b16e-aec2af3c657d tempest-ServersTestMultiNic-2093168813 tempest-ServersTestMultiNic-2093168813-project] 10.222.0.27 "GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025" status: 404 len: 111 microversion: 2.1 time: 0.094040 Jul 24 01:20:08.195808 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1199/2523] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:08 2022] GET /compute/v2.1/servers/bc489a75-9ac7-4ed7-8b0d-6a21e1aa6025 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:08.203208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:08.209349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:08.225647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:08.226848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:08.229100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:08.231917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:08.695742 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71e68ff1-e0a9-4aa0-965c-b4a22d986dfe tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.941949 Jul 24 01:20:08.696645 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1325/2524] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:20:07 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:08.720063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:08.721226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:08.732070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:08.732990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:08.734178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:08.734818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:08.773920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:08.777728 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:08.785447 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6b102a8f-db1c-49a6-b5b1-519407899cd5 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1511 microversion: 2.1 time: 0.588109 Jul 24 01:20:08.787764 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1200/2525] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:08 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:08.794102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f382668-b239-45f0-86ac-257e822d5c5c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:08.805236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f382668-b239-45f0-86ac-257e822d5c5c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016119 Jul 24 01:20:08.806124 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1201/2526] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:20:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:08.811995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:08.818465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:08.819811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:09.139021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.139375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.140581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.141497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.226952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:09.242073 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e3fb04b1-b2de-4803-9e7d-c41fbe98645f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1317 microversion: 2.1 time: 0.536262 Jul 24 01:20:09.242782 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1326/2527] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:08 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:09.248141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:09.248767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:09.257994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:09.266658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.267121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.267919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.268362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.350784 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bcaa54c8-567d-451d-b7d0-96cdc69c9673 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.543324 Jul 24 01:20:09.358504 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1202/2528] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Jul 24 01:20:08 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:09.364711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:09.365592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:09.378778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.379226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.380976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.381615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.679807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:09.693303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:09.699900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:09.701230 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a6138e44-4071-4792-bdeb-b1264cb4d9ea tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1251 microversion: 2.25 time: 0.341407 Jul 24 01:20:09.702094 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1203/2529] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:09 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1251 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:09.715722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:09.717979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:09.746973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.747586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.748501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.748878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.798622 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:09.948633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f811299-e0ec-4a7e-8acd-0cc9089edf65 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 204 len: 0 microversion: 2.1 time: 0.244841 Jul 24 01:20:09.951723 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1204/2530] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:09 2022] DELETE /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:09.970703 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:09.972541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:09.988725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.990890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:09.992006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:09.992782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:10.368034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:10.379027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:10.386903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:10.388448 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a287d6dd-91ad-41f2-aded-bc82bd849b93 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1359 microversion: 2.21 time: 1.144568 Jul 24 01:20:10.389639 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1327/2531] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:09 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1359 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:10.396297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:10.397288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:10.404050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:10.404867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:10.406169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:10.406985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:11.090358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:11.102398 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf3a38b1-7b77-4c47-ab4a-ad9ae8a51b8d tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1512 microversion: 2.1 time: 1.145148 Jul 24 01:20:11.103980 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1205/2532] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:09 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1512 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:11.109288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:11.110186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:11.120030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:11.125148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:11.132988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:11.133967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:11.388616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:11.423544 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4e83f271-3af7-43bb-a8bc-243cf554be25 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1607 microversion: 2.1 time: 1.032098 Jul 24 01:20:11.424645 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1328/2533] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:10 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1607 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:11.464290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:11.465470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:11.496839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:11.498268 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:11.500574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:11.501647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:11.739632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:11.749439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:11.757333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:11.764165 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-42868794-dd77-497a-a234-9e93c6d4f0b0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1251 microversion: 2.25 time: 0.315445 Jul 24 01:20:11.770529 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1329/2534] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:11 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1251 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:11.776298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:11.788040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:11.808718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:11.822731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:11.824321 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:11.825323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:12.078614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:12.091602 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c81cb301-945b-4f2a-a570-e864f1ce6d4f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1317 microversion: 2.1 time: 0.981963 Jul 24 01:20:12.093264 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1206/2535] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:11 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1317 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:12.109735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:12.110828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:12.125612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:12.126291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:12.127333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:12.127978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:12.965968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:12.981290 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a2cbf55-1efe-4001-acef-7641da54fa12 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1512 microversion: 2.1 time: 1.209264 Jul 24 01:20:12.993922 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1330/2536] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:11 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1512 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:12.999361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:13.000254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:13.008213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.008673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:13.009473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.009937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:13.101863 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:13.137983 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:13.140812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:13.142324 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-800dcf82-c730-4e40-8a0e-a169cb108237 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1359 microversion: 2.21 time: 1.047566 Jul 24 01:20:13.159608 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1207/2537] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:12 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1359 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:13.167120 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:13.168110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:13.176754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.177420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:13.178355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.178710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:13.399444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:13.428034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:13.434459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:13.442055 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-32d2e578-9161-456c-9acf-8c9fd04a7e15 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1251 microversion: 2.25 time: 0.277382 Jul 24 01:20:13.447292 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1208/2538] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:13 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1251 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:13.458172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:13.468151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:13.494379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.495576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:13.502058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:13.503549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:14.146264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:14.158568 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e10ea547-29b0-4363-8607-9ab2501c3e24 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1607 microversion: 2.1 time: 1.163134 Jul 24 01:20:14.159440 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1331/2539] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:12 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1607 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:14.168056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9dbf3fc0-ae12-4f41-bc2c-abce24d1c4fd req-41645743-fd85-46bb-b507-505667dc6dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6e00c4-3042-4e8c-a0ca-0a65dec91661", "name": "network-vif-plugged", "status": "completed", "tag": "892738f1-2be0-4e7a-a405-fa33a4e2dae3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:14.189374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9dbf3fc0-ae12-4f41-bc2c-abce24d1c4fd req-41645743-fd85-46bb-b507-505667dc6dc9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:14.190579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9dbf3fc0-ae12-4f41-bc2c-abce24d1c4fd req-41645743-fd85-46bb-b507-505667dc6dc9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:14.208545 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:14.211140 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9dbf3fc0-ae12-4f41-bc2c-abce24d1c4fd req-41645743-fd85-46bb-b507-505667dc6dc9 service nova] Creating event network-vif-plugged:892738f1-2be0-4e7a-a405-fa33a4e2dae3 for instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 on n-h1-master-1 Jul 24 01:20:14.221311 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9dbf3fc0-ae12-4f41-bc2c-abce24d1c4fd req-41645743-fd85-46bb-b507-505667dc6dc9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059055 Jul 24 01:20:14.226670 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1332/2540] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:14.254993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:14.257263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:14.282839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:14.283565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:14.288804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:14.289319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:15.164939 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:15.184273 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c4e04bb-1db2-4489-b2f5-4d600c27b759 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1511 microversion: 2.1 time: 1.735134 Jul 24 01:20:15.193084 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1209/2541] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:13 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1511 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:15.207827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:15.216117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:15.244702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:15.248785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:15.254085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:15.256307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.033409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.047030 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba4e919a-ea52-4274-95cb-d3a5bf5fe11e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1317 microversion: 2.1 time: 1.818608 Jul 24 01:20:16.052256 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1333/2542] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:14 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1317 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:16.068531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:16.075493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:16.091138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.092350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.096095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.100918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.389427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.406779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.408884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.412093 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-82989e3c-596b-4fed-88e9-973f1b33762f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1359 microversion: 2.21 time: 1.216643 Jul 24 01:20:16.413656 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1210/2543] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:15 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1359 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:16.420363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:16.421156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:16.430454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.431261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.432689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.433291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.637945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.653243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c2d7cd2e-2e33-470f-ba68-15c2789b0f0d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1540 microversion: 2.1 time: 0.237700 Jul 24 01:20:16.656763 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1211/2544] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:16 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1540 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:16.665007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:16.679962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.681549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:16.697164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.701844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.704195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.704789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.798756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:16.869733 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.890671 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:16.891182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:16.962259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.976930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.978516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:16.980120 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c28eabcc-b2ac-4ce5-8d84-13c76fa09ac6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1293 microversion: 2.25 time: 0.926497 Jul 24 01:20:16.990327 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1334/2545] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:16 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1293 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:16.990327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-12c485a4-ab34-446e-b11c-01c994ffdc16 req-f2ef01aa-7b21-47a5-87cb-0be6fcec434e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04157fd-7c0d-4c17-b348-f86aa9a16f3d", "name": "network-vif-plugged", "status": "completed", "tag": "0dd2f1b4-f9cc-4d2d-bb23-43c1660d0dcc"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:16.999428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-12c485a4-ab34-446e-b11c-01c994ffdc16 req-f2ef01aa-7b21-47a5-87cb-0be6fcec434e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:17.000154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-12c485a4-ab34-446e-b11c-01c994ffdc16 req-f2ef01aa-7b21-47a5-87cb-0be6fcec434e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:17.019085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-12c485a4-ab34-446e-b11c-01c994ffdc16 req-f2ef01aa-7b21-47a5-87cb-0be6fcec434e service nova] Creating event network-vif-plugged:0dd2f1b4-f9cc-4d2d-bb23-43c1660d0dcc for instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d on n-h2-master-1 Jul 24 01:20:17.031799 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-12c485a4-ab34-446e-b11c-01c994ffdc16 req-f2ef01aa-7b21-47a5-87cb-0be6fcec434e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048482 Jul 24 01:20:17.032840 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1335/2546] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:17.070856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:17.073045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:17.084025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:17.084853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:17.085944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:17.086638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:17.792680 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:17.905347 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:18.368028 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c77666e6-3b79-411f-a562-c933a5369d75 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.708925 Jul 24 01:20:18.368666 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1212/2547] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:20:16 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:18.376903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:18.378466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:18.403794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.406147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:18.408437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.410212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:18.538999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:18.566066 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14f9a52c-7106-4770-8d74-ed08bc5fd598 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1467 microversion: 2.1 time: 1.488393 Jul 24 01:20:18.571788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1336/2548] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:17 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1467 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:18.591403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:18.592050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:18.620783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.623246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:18.626780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.628583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:18.900960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:18.908678 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dad69081-e2d8-4025-81e5-2e16fb82a34c tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1250 microversion: 2.1 time: 0.335475 Jul 24 01:20:18.914538 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1337/2549] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:18 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1250 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:18.943744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:18.948144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:18.967090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.968855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:18.976398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:18.979049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.630176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.638927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.640461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.657869 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad83767f-fada-4721-84f1-a704250afc26 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1359 microversion: 2.21 time: 1.271201 Jul 24 01:20:19.658884 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1213/2550] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:18 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1359 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:19.664159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:19.668099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.668708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:19.687168 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.699364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.700910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:19.702122 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a9b474c4-862e-4fb7-a9ce-c5da16807c7e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.783443 Jul 24 01:20:19.710461 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1338/2551] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:18 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:19.721343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6e0e6bd9-f1fb-403e-9aae-d7005492473f req-7210985a-9637-4110-baa9-24eaeb255910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0", "name": "network-vif-deleted", "tag": "0f8871bc-b137-4f62-b97e-054f036425fd"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:19.755370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e0e6bd9-f1fb-403e-9aae-d7005492473f req-7210985a-9637-4110-baa9-24eaeb255910 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:19.755819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e0e6bd9-f1fb-403e-9aae-d7005492473f req-7210985a-9637-4110-baa9-24eaeb255910 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.781741 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6e0e6bd9-f1fb-403e-9aae-d7005492473f req-7210985a-9637-4110-baa9-24eaeb255910 service nova] Creating event network-vif-deleted:0f8871bc-b137-4f62-b97e-054f036425fd for instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 on n-h1-master-1 Jul 24 01:20:19.799132 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6e0e6bd9-f1fb-403e-9aae-d7005492473f req-7210985a-9637-4110-baa9-24eaeb255910 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082264 Jul 24 01:20:19.800143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1339/2552] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:19.806400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f4af821-d7cd-42ea-af54-89ffec49de3b tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:19.807121 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f4af821-d7cd-42ea-af54-89ffec49de3b tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:19.833376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4af821-d7cd-42ea-af54-89ffec49de3b tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:19.834038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4af821-d7cd-42ea-af54-89ffec49de3b tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.834852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4af821-d7cd-42ea-af54-89ffec49de3b tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:19.842835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4af821-d7cd-42ea-af54-89ffec49de3b tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.860557 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:19.866381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.869526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:19.870943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:19.959309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:20.036698 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7bf1adbf-8d87-4af7-9c19-55d9f74e6fcc tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.360117 Jul 24 01:20:20.039516 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1214/2553] 10.222.0.27 () {58 vars in 1149 bytes} [Sun Jul 24 01:20:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:20.050243 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:20.051605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:20.070245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.073467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.076102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.076721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.114292 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:20.380622 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:20.391834 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-626d477e-7b6d-4b30-855b-e44567bfa219 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1250 microversion: 2.1 time: 0.350904 Jul 24 01:20:20.393989 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1215/2554] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:20 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1250 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:20.402270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:20.412949 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:20.413966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:20.420988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.421655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.423404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.424016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.536067 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f4af821-d7cd-42ea-af54-89ffec49de3b tempest-ServersOnMultiNodesTest-2086316382 tempest-ServersOnMultiNodesTest-2086316382-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1618 microversion: 2.1 time: 0.731645 Jul 24 01:20:20.536729 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1340/2555] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:19 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1618 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:20.620832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:20.781142 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eeb7250d-c8b5-4614-95da-440d6ff38a29 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.385880 Jul 24 01:20:20.790350 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1216/2556] 10.222.0.27 () {58 vars in 1211 bytes} [Sun Jul 24 01:20:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:20.809731 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:20.811502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:20.843855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.844450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.845704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.846395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.863018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5674b83-24d4-4333-aab6-72c9974d7f14 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2041694220", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:20.866704 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c5674b83-24d4-4333-aab6-72c9974d7f14 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] HTTP exception thrown: min_count must be <= max_count Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5674b83-24d4-4333-aab6-72c9974d7f14 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Request method failure captured: Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 184 Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J5UXvtYGGWwul71TpR0pQLg3GsM00aV5xTD9FnC9dp_Y9rEGm8dpSyFJZD0AhO-7WnxpJRJVcl2TVXZi-Sape-7clXPI7p0YshRSkSCjjGxRhy7T65yo736AUy927-P_aV1K4cFYyq0WWy_zxsWs4y7dHGBtKX-mHT9UueNikAARzQ Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc7258055b514ebe9ff24d33f1915e7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4f49f16f91654ff99ac19029e4fe228a Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2041694220", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: exception: min_count must be <= max_count Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2041694220', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 24 01:20:20.868468 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:20.875206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5674b83-24d4-4333-aab6-72c9974d7f14 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Returning 400 to user: min_count must be <= max_count {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:20.878075 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5674b83-24d4-4333-aab6-72c9974d7f14 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.327876 Jul 24 01:20:20.881301 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1341/2557] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:20:20 2022] POST /compute/v2.1/servers => generated 74 bytes in 333 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:20.887048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:20.893052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:20.902551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:20.916676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.917146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:20.917972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:20.918423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:21.043978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dc6ebe4d-a304-40e0-8516-ec243195dba0 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 204 len: 0 microversion: 2.1 time: 0.251852 Jul 24 01:20:21.044957 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1217/2558] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:20 2022] DELETE /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:21.052415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:21.053497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:21.062900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:21.063639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:21.064668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:21.065345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:21.640891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.650278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.651814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.653309 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-892ef89f-c5d0-41cc-9d6e-c87e9aa5cb04 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.606773 Jul 24 01:20:21.666070 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1218/2559] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:21 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:21.671968 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:21.680097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.681229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:21.687969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:21.688423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:21.690050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:21.690677 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:21.713009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.726810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.729755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:21.733518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-996ab759-ae9d-473d-bf6c-e4bdc8912a0f tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1551 microversion: 2.21 time: 0.848734 Jul 24 01:20:21.747349 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1342/2560] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:20 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1551 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:21.752862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64910f00-65d9-4414-88d5-12c514b0a677 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1822268333", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "max_count": 0}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64910f00-65d9-4414-88d5-12c514b0a677 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Request method failure captured: Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 168 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J5UXvtYGGWwul71TpR0pQLg3GsM00aV5xTD9FnC9dp_Y9rEGm8dpSyFJZD0AhO-7WnxpJRJVcl2TVXZi-Sape-7clXPI7p0YshRSkSCjjGxRhy7T65yo736AUy927-P_aV1K4cFYyq0WWy_zxsWs4y7dHGBtKX-mHT9UueNikAARzQ Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc7258055b514ebe9ff24d33f1915e7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4f49f16f91654ff99ac19029e4fe228a Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1822268333", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "max_count": 0}} Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1822268333', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'max_count': 0}}} Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 0 Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:20:21.777051 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64910f00-65d9-4414-88d5-12c514b0a677 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64910f00-65d9-4414-88d5-12c514b0a677 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031324 Jul 24 01:20:21.780936 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1343/2561] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:20:21 2022] POST /compute/v2.1/servers => generated 130 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:21.790427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:21.794437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:21.812494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:21.812946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:21.813756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:21.814203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:21.866393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:22.010428 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eb8e2a20-e421-4755-a859-a07637d42cc2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.343038 Jul 24 01:20:22.016239 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1219/2562] 10.222.0.27 () {58 vars in 1195 bytes} [Sun Jul 24 01:20:21 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:22.017611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:22.018461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:22.028519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.029177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.030182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.030781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.159043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:22.175237 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-404f2fba-996d-40a7-9b1d-df0039075c7f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1250 microversion: 2.1 time: 0.162533 Jul 24 01:20:22.176854 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1220/2563] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:22 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1250 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:22.187290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:22.187413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:22.211354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.211720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.217808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.218281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.253780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:22.268626 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d0de9fe1-b22b-4b4d-8232-60ed2a53405f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1473 microversion: 2.1 time: 0.481842 Jul 24 01:20:22.274084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1344/2564] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:21 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1473 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:22.286426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-12c08c88-5371-434d-908d-e65578ca09af tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-889351777", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "max_count": 2.5}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-12c08c88-5371-434d-908d-e65578ca09af tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Request method failure captured: Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 169 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J5UXvtYGGWwul71TpR0pQLg3GsM00aV5xTD9FnC9dp_Y9rEGm8dpSyFJZD0AhO-7WnxpJRJVcl2TVXZi-Sape-7clXPI7p0YshRSkSCjjGxRhy7T65yo736AUy927-P_aV1K4cFYyq0WWy_zxsWs4y7dHGBtKX-mHT9UueNikAARzQ Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc7258055b514ebe9ff24d33f1915e7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4f49f16f91654ff99ac19029e4fe228a Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-889351777", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "max_count": 2.5}} Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-889351777', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'max_count': 2.5}}} Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 2.5 Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:20:22.291378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.295905 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.300713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-12c08c88-5371-434d-908d-e65578ca09af tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:22.306724 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-12c08c88-5371-434d-908d-e65578ca09af tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031139 Jul 24 01:20:22.306891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:22.308165 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1345/2565] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:20:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:22.315350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e7b47d57-da81-4e8e-b168-b42c98af60e2 req-3f0651bb-9da0-4f0c-9c24-abaa806bd87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8dfe4b-e495-4584-8cd0-c145836e91cd", "tag": "48eb2f36-64bc-4409-b71f-33a2f59d753f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:22.341241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e7b47d57-da81-4e8e-b168-b42c98af60e2 req-3f0651bb-9da0-4f0c-9c24-abaa806bd87c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.342133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e7b47d57-da81-4e8e-b168-b42c98af60e2 req-3f0651bb-9da0-4f0c-9c24-abaa806bd87c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.383996 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e7b47d57-da81-4e8e-b168-b42c98af60e2 req-3f0651bb-9da0-4f0c-9c24-abaa806bd87c service nova] Creating event network-changed:48eb2f36-64bc-4409-b71f-33a2f59d753f for instance ef8dfe4b-e495-4584-8cd0-c145836e91cd on n-h1-master-1 Jul 24 01:20:22.397849 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e7b47d57-da81-4e8e-b168-b42c98af60e2 req-3f0651bb-9da0-4f0c-9c24-abaa806bd87c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087979 Jul 24 01:20:22.400310 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1346/2566] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:22.407281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:22.414753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:22.415820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'name': '-709086673', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:22.429370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.430323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.431333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.432027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.540527 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:22.565710 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c2631a5-716a-4440-a671-3d88c1b8d0e3 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 204 len: 0 microversion: 2.21 time: 0.385795 Jul 24 01:20:22.567974 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1221/2567] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:20:22 2022] DELETE /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:20:22.576032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13dfa234-d015-415f-88c9-2c3d2bf180e5 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-138956649", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 0}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13dfa234-d015-415f-88c9-2c3d2bf180e5 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Request method failure captured: Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 167 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J5UXvtYGGWwul71TpR0pQLg3GsM00aV5xTD9FnC9dp_Y9rEGm8dpSyFJZD0AhO-7WnxpJRJVcl2TVXZi-Sape-7clXPI7p0YshRSkSCjjGxRhy7T65yo736AUy927-P_aV1K4cFYyq0WWy_zxsWs4y7dHGBtKX-mHT9UueNikAARzQ Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc7258055b514ebe9ff24d33f1915e7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4f49f16f91654ff99ac19029e4fe228a Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-138956649", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 0}} Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-138956649', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'min_count': 0}}} Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 0 Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:20:22.579459 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 24 01:20:22.585141 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.587912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13dfa234-d015-415f-88c9-2c3d2bf180e5 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:22.588978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13dfa234-d015-415f-88c9-2c3d2bf180e5 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019348 Jul 24 01:20:22.589778 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1222/2568] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:20:22 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:22.599020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:22.616337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:22.631753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.638096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.639392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.641457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.647529 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea757962-2236-4bdb-84a7-ba9eab144c9e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-709086673" status: 200 len: 345 microversion: 2.1 time: 0.245770 Jul 24 01:20:22.657648 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1347/2569] 10.222.0.27 () {58 vars in 1155 bytes} [Sun Jul 24 01:20:22 2022] GET /compute/v2.1/servers?name=-709086673 => generated 345 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:22.663981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:22.681846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:22.682474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:22.691113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.691570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.693009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:22.693455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:22.845219 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:22.945626 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-65ddb9ec-5ebf-456a-a135-8d3bb475123e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.286211 Jul 24 01:20:22.946931 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1348/2570] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Jul 24 01:20:22 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:22.962092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05aab6fd-292a-4149-9269-3187c9a54494 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2072191103", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 2.5}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05aab6fd-292a-4149-9269-3187c9a54494 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Request method failure captured: Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 170 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J5UXvtYGGWwul71TpR0pQLg3GsM00aV5xTD9FnC9dp_Y9rEGm8dpSyFJZD0AhO-7WnxpJRJVcl2TVXZi-Sape-7clXPI7p0YshRSkSCjjGxRhy7T65yo736AUy927-P_aV1K4cFYyq0WWy_zxsWs4y7dHGBtKX-mHT9UueNikAARzQ Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc7258055b514ebe9ff24d33f1915e7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc7258055b514ebe9ff24d33f1915e7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: bc7258055b514ebe9ff24d33f1915e7d Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1297706317 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4f49f16f91654ff99ac19029e4fe228a Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1297706317-project Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2072191103", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 2.5}} Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2072191103', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'min_count': 2.5}}} Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 2.5 Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:20:22.966241 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 24 01:20:22.972120 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:22.975302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05aab6fd-292a-4149-9269-3187c9a54494 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:22.976575 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05aab6fd-292a-4149-9269-3187c9a54494 tempest-MultipleCreateNegativeTestJSON-1297706317 tempest-MultipleCreateNegativeTestJSON-1297706317-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027822 Jul 24 01:20:22.978795 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1349/2571] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:20:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:22.992227 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:22.995545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:23.023329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.024172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.029153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.030324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.610852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.637470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.642578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.644043 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ef25922-b684-42c5-8f12-7f35f711c7bb tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1557 microversion: 2.21 time: 1.052997 Jul 24 01:20:23.660340 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1223/2572] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:22 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1557 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:23.670690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:23.681811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.683640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-70908667', 'deleted': False, 'project_id': 'a2a0554a2bdf40009b895620212a11f1'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:20:23.700309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.701329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.702505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.704939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.778157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.792332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.793941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:23.795104 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e0fe3f14-494c-40a1-a2bc-7a45b502321b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.814000 Jul 24 01:20:23.795674 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1350/2573] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:22 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:23.835278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:23.835936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:23.865574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.866066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.867066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:23.867516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:23.907955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:20:23.994065 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-473176bc-9016-4d00-a5df-d09d991e2f36 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-70908667" status: 200 len: 345 microversion: 2.1 time: 0.333221 Jul 24 01:20:24.017237 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1224/2574] 10.222.0.27 () {58 vars in 1225 bytes} [Sun Jul 24 01:20:23 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-70908667 => generated 345 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:24.023478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:24.036600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:24.038116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:24.039206 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac244fa1-ac73-49d8-970d-5ec6fe90ddcf tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1250 microversion: 2.1 time: 0.216477 Jul 24 01:20:24.046709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.048826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.049434 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1351/2575] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:23 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1250 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:24.050569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.052038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.055162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:24.059903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:24.072976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.073699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.074679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.080110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.135813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:24.266731 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31188e9c-cc86-4475-9433-9f9e1198b107 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 204 len: 0 microversion: 2.1 time: 0.215238 Jul 24 01:20:24.268777 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1352/2576] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:24 2022] DELETE /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:24.280900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:24.281857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:24.289240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.289534 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.290462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.291011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.296828 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:24.852221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:24.867444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-93abcee1-47b2-4819-b3b5-f18fe5553165 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1473 microversion: 2.1 time: 0.847138 Jul 24 01:20:24.868289 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1225/2577] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:24 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1473 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:24.873100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:24.886961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:24.894826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.895610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:24.896577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:24.897178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.321983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.330745 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-edd23018-3795-4ec1-b6ab-70e35d320fa2 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1517 microversion: 2.1 time: 1.057577 Jul 24 01:20:25.342344 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1353/2578] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:24 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1517 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:25.356260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:25.357237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:25.367647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.368375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.371511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.372195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.588730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.599542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.605624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.608480 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fcc68369-c70e-4dd4-8e91-f2b194352bd4 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1557 microversion: 2.21 time: 0.739012 Jul 24 01:20:25.614910 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1226/2579] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:24 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1557 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:25.629956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:25.630987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:25.647867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.648737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.649665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.650229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.782816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.803170 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbf64430-b9a6-41f4-8e11-41684955359d tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1250 microversion: 2.1 time: 0.186598 Jul 24 01:20:25.803600 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1227/2580] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:25 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1250 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:25.808548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-317cdd78-2ba5-43c5-8796-76b0df1e497e req-a4ca7bf9-ba06-4a32-9727-50548f462915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6e00c4-3042-4e8c-a0ca-0a65dec91661", "name": "network-vif-deleted", "tag": "892738f1-2be0-4e7a-a405-fa33a4e2dae3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:25.830290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-317cdd78-2ba5-43c5-8796-76b0df1e497e req-a4ca7bf9-ba06-4a32-9727-50548f462915 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.831086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-317cdd78-2ba5-43c5-8796-76b0df1e497e req-a4ca7bf9-ba06-4a32-9727-50548f462915 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.853153 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-317cdd78-2ba5-43c5-8796-76b0df1e497e req-a4ca7bf9-ba06-4a32-9727-50548f462915 service nova] Creating event network-vif-deleted:892738f1-2be0-4e7a-a405-fa33a4e2dae3 for instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 on n-h1-master-1 Jul 24 01:20:25.872431 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-317cdd78-2ba5-43c5-8796-76b0df1e497e req-a4ca7bf9-ba06-4a32-9727-50548f462915 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067338 Jul 24 01:20:25.873395 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1228/2581] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:25.886918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:25.887837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:25.902560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.903357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.904344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.915243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.948706 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:25.963432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.967582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:25.968294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:25.970048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lazy-loading 'fault' on Instance uuid ec6e00c4-3042-4e8c-a0ca-0a65dec91661 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:25.974007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.974834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:25.975978 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5842bf12-dddd-4851-975f-57d541cb6ab2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.632328 Jul 24 01:20:25.976555 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1354/2582] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:25 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:26.043489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b0f86aec-cd08-474f-bf42-8ceca49e56d1 req-8fce1fd7-9644-4ac4-a241-4a2b6e561f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04157fd-7c0d-4c17-b348-f86aa9a16f3d", "name": "network-vif-deleted", "tag": "0dd2f1b4-f9cc-4d2d-bb23-43c1660d0dcc"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:26.061883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b0f86aec-cd08-474f-bf42-8ceca49e56d1 req-8fce1fd7-9644-4ac4-a241-4a2b6e561f20 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.062527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b0f86aec-cd08-474f-bf42-8ceca49e56d1 req-8fce1fd7-9644-4ac4-a241-4a2b6e561f20 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.097760 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b0f86aec-cd08-474f-bf42-8ceca49e56d1 req-8fce1fd7-9644-4ac4-a241-4a2b6e561f20 service nova] Creating event network-vif-deleted:0dd2f1b4-f9cc-4d2d-bb23-43c1660d0dcc for instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d on n-h2-master-1 Jul 24 01:20:26.111599 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b0f86aec-cd08-474f-bf42-8ceca49e56d1 req-8fce1fd7-9644-4ac4-a241-4a2b6e561f20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066094 Jul 24 01:20:26.118790 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1355/2583] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:26.360917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:26.361966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:26.376036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.380182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.381300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.391186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.419252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:26.438495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-332d8bf0-4e5b-485c-9d57-77a5dedb2f01 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 200 len: 1307 microversion: 2.1 time: 0.549429 Jul 24 01:20:26.443141 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1229/2584] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:25 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 1307 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:26.634751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:26.636288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:26.658324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.659513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.666313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.670317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.811939 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:26.839630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:26.840589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:26.841839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lazy-loading 'fault' on Instance uuid b04157fd-7c0d-4c17-b348-f86aa9a16f3d {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:26.869185 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:27.086019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:27.106070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:27.112530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3172ec09985048558fe0f3adf9c067fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5025d6267ba40509d642d51a559f217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:27.127978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1c4024e-317e-4510-bf4a-dfa9ba29be85 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 200 len: 1349 microversion: 2.21 time: 0.486539 Jul 24 01:20:27.130027 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1230/2585] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:26 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 1349 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:20:27.147551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:27.158517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:27.165386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.165889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.168476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.170731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.244044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.244508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.244975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lazy-loading 'fault' on Instance uuid 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:27.402404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d333d036f74225bf1afd3d36d8e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fbef19413a4054aa808c676248fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:27.413703 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0aae481f-aaa4-4bba-acf5-4813126c8188 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 200 len: 1209 microversion: 2.1 time: 0.279263 Jul 24 01:20:27.421562 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1231/2586] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:27 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 1209 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:27.428764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:27.430370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:27.448303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.451059 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.453016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.453899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.825979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:27.838901 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78fc55c3-fc4a-4f2c-8b86-911c7d48026f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1517 microversion: 2.1 time: 1.482547 Jul 24 01:20:27.842108 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1356/2587] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:26 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1517 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:27.852155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:27.865961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: ec6e00c4-3042-4e8c-a0ca-0a65dec91661] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:27.879707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.883013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.883873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.884320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.924382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 could not be found. Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 HTTP/1.1 Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 could not be found. Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ec6e00c4-3042-4e8c-a0ca-0a65dec91661'} Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 could not be found. Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 could not be found. Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:27.932609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:27.936727 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:27.936727 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:27.936727 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:27.936727 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:27.936727 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:27.936727 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 could not be found. Jul 24 01:20:27.936727 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:27.939366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance ec6e00c4-3042-4e8c-a0ca-0a65dec91661 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:27.940595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6681f86c-2c74-4a15-99ae-feac9d4ec7f4 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661" status: 404 len: 111 microversion: 2.1 time: 0.097094 Jul 24 01:20:27.941857 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1357/2588] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:27 2022] GET /compute/v2.1/servers/ec6e00c4-3042-4e8c-a0ca-0a65dec91661 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:27.955473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:27.956565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:27.966198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.967407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:27.968551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:27.969284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.009489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:28.188046 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d32aa16e-bbec-4921-90ce-91b3a72b421d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 204 len: 0 microversion: 2.1 time: 0.235835 Jul 24 01:20:28.190539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1358/2589] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:27 2022] DELETE /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:28.212961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:28.217237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:28.239761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.249465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.252693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.255178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.299787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.302243 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] HTTP exception thrown: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Request method failure captured: Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d HTTP/1.1 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J45ZPOO1XVbMX3InaL922MNhnk_UBVS8lLuDq9Yi39blT0O-p8DNEzyoulW8sYq1K1Wr7Zfg021Uj2GiOt5dJQ2Tn1660jjcjxnMczsGxccXt7WJ-OCnLvaozD7XoIlB339rB0_WUejN7fNUWi2hoIe5888SaoEFBtK4FnmMeVsGZY Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.21 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e5025d6267ba40509d642d51a559f217 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5025d6267ba40509d642d51a559f217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5025d6267ba40509d642d51a559f217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5025d6267ba40509d642d51a559f217", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5025d6267ba40509d642d51a559f217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e5025d6267ba40509d642d51a559f217 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-InstanceActionsV221TestJSON-1391231516-project Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3172ec09985048558fe0f3adf9c067fd Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-InstanceActionsV221TestJSON-1391231516-project Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b04157fd-7c0d-4c17-b348-f86aa9a16f3d'} Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:28.305505 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:28.309868 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:28.310463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.310762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.311866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3ca7dc7c-8e83-4f25-9fd7-f6cafcac7377 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.894352 Jul 24 01:20:28.312424 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1232/2590] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:27 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:28.312743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Returning 404 to user: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:28.316389 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-57136ff1-d8e6-44c5-86ff-8b32fd1027cf tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 404 len: 111 microversion: 2.21 time: 0.123005 Jul 24 01:20:28.320548 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1359/2591] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:28 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:28.331622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:28.332488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:28.347431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.348035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.349155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.350601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.783559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:28.794635 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b8c55d53-18c1-46bc-b7e6-eeded2fc4faf tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1471 microversion: 2.1 time: 0.474741 Jul 24 01:20:28.795225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1360/2592] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:28 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1471 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:28.802266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2bb9f892-8e41-470d-8c6a-945b192cdfc0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '.version_select at 0x7f05eae5c310>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:28.802861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2bb9f892-8e41-470d-8c6a-945b192cdfc0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:28.807632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1350900403", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": "none"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:28.829113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bb9f892-8e41-470d-8c6a-945b192cdfc0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.829688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bb9f892-8e41-470d-8c6a-945b192cdfc0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.842736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bb9f892-8e41-470d-8c6a-945b192cdfc0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.843202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bb9f892-8e41-470d-8c6a-945b192cdfc0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.876088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:20:28.887854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:20:28.888585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:20:28.891525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:20:28.892189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:20:28.911194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.911905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.913005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:28.915221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:28.980514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Getting quotas for project 4bf80756586b48a7a320b87480fdbcc8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:20:28.989205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Getting quotas for user 11411d69fb4747e783fae09aa58d1a5e and project 4bf80756586b48a7a320b87480fdbcc8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:20:29.017269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2bb9f892-8e41-470d-8c6a-945b192cdfc0 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.220940 Jul 24 01:20:29.017983 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1361/2593] 10.222.0.27 () {60 vars in 1336 bytes} [Sun Jul 24 01:20:28 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d/os-instance-actions => generated 611 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:20:29.024990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.024990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] [instance: 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.036815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.037274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.038101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.038537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.040809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:20:29.043513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:20:29.089237 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] HTTP exception thrown: Instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 could not be found. Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Request method failure captured: Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 HTTP/1.1 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J3GGdzLJ53ONvP4awIqIfSSLafUmlpOgqH3ZUEcNMArRrq0sWZVUluY_zO5m6emqW8o8HgcxdZKFMDdbbUo9Cw75gCP_V_abUDWdDh17QC_VqO0K2lAK-sd6D1sxRuObEh4MPtZfP1J4ncCXNbhmSCd5ssHA5ETedcafKfD_kmiFec Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 97fbef19413a4054aa808c676248fd27 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestBootFromVolume-1956708865 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/97fbef19413a4054aa808c676248fd27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/97fbef19413a4054aa808c676248fd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_97fbef19413a4054aa808c676248fd27", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/97fbef19413a4054aa808c676248fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestBootFromVolume-1956708865 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 97fbef19413a4054aa808c676248fd27 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1956708865 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestBootFromVolume-1956708865-project Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c6d333d036f74225bf1afd3d36d8e339 Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestBootFromVolume-1956708865-project Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 could not be found. Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0'} Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 could not be found. Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 could not be found. Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.090755 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 could not be found. Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Returning 404 to user: Instance 9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:29.094920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c8969eb-8b2f-4c3d-a151-82078fd19f35 tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0" status: 404 len: 111 microversion: 2.1 time: 0.073255 Jul 24 01:20:29.113786 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1362/2594] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/9d9ea9c5-f1bd-462d-98dd-0f1f6e9fb4d0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:29.133546 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-271346c3-1a90-487a-a606-76d7931f29a4 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.807354 Jul 24 01:20:29.134655 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1233/2595] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:20:29.141264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-62d24ddc-6fd9-4c6f-b99e-2e18bc48b591 req-d901975a-baf0-4f64-8ada-431f7398965f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135", "name": "network-vif-deleted", "tag": "dbcc0cc0-39bf-4907-b334-fd5e0430d2cd"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:29.142448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.143411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.164266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.164872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.167083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.167685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.173350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-62d24ddc-6fd9-4c6f-b99e-2e18bc48b591 req-d901975a-baf0-4f64-8ada-431f7398965f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.174163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-62d24ddc-6fd9-4c6f-b99e-2e18bc48b591 req-d901975a-baf0-4f64-8ada-431f7398965f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.214888 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-62d24ddc-6fd9-4c6f-b99e-2e18bc48b591 req-d901975a-baf0-4f64-8ada-431f7398965f service nova] Creating event network-vif-deleted:dbcc0cc0-39bf-4907-b334-fd5e0430d2cd for instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 on n-h1-master-1 Jul 24 01:20:29.226117 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-62d24ddc-6fd9-4c6f-b99e-2e18bc48b591 req-d901975a-baf0-4f64-8ada-431f7398965f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114673 Jul 24 01:20:29.226728 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1363/2596] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:29.247018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.249904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.266692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.270796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.278855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.279473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.290690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.290890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.293742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lazy-loading 'fault' on Instance uuid f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:29.345065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] HTTP exception thrown: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Request method failure captured: Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d HTTP/1.1 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J45ZPOO1XVbMX3InaL922MNhnk_UBVS8lLuDq9Yi39blT0O-p8DNEzyoulW8sYq1K1Wr7Zfg021Uj2GiOt5dJQ2Tn1660jjcjxnMczsGxccXt7WJ-OCnLvaozD7XoIlB339rB0_WUejN7fNUWi2hoIe5888SaoEFBtK4FnmMeVsGZY Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.21 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e5025d6267ba40509d642d51a559f217 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5025d6267ba40509d642d51a559f217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5025d6267ba40509d642d51a559f217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5025d6267ba40509d642d51a559f217", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5025d6267ba40509d642d51a559f217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e5025d6267ba40509d642d51a559f217 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-InstanceActionsV221TestJSON-1391231516-project Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3172ec09985048558fe0f3adf9c067fd Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-InstanceActionsV221TestJSON-1391231516-project Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b04157fd-7c0d-4c17-b348-f86aa9a16f3d'} Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:29.347894 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.352146 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.357376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Returning 404 to user: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:29.357376 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e4b4ebc3-58a2-4d98-bf11-7807fb6544c6 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 404 len: 111 microversion: 2.21 time: 0.123382 Jul 24 01:20:29.357376 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1364/2597] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:20:29 2022] DELETE /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:29.368165 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-09b800b8-fb36-4ea9-b4a2-e092f1d9ca9f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] Calling method '.version_select at 0x7f05eadbd3a0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.428928 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-09b800b8-fb36-4ea9-b4a2-e092f1d9ca9f tempest-ServersTestBootFromVolume-1956708865 tempest-ServersTestBootFromVolume-1956708865-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158983956" status: 202 len: 0 microversion: 2.1 time: 0.071838 Jul 24 01:20:29.429845 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1365/2598] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158983956 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:20:29.436660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c718e071-b6c3-4dd2-844a-ded428ce3ec0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.437216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c718e071-b6c3-4dd2-844a-ded428ce3ec0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.488999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:29.500609 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff83cf91-e6d8-4c5b-8e39-0ebba5048477 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 200 len: 1310 microversion: 2.1 time: 0.362414 Jul 24 01:20:29.501619 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1234/2599] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 1310 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:29.512937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.513566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.531986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.532570 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.534808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.535428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.811841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c718e071-b6c3-4dd2-844a-ded428ce3ec0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:29.821731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c718e071-b6c3-4dd2-844a-ded428ce3ec0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:29.825215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c718e071-b6c3-4dd2-844a-ded428ce3ec0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:29.829455 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c718e071-b6c3-4dd2-844a-ded428ce3ec0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1281 microversion: 2.47 time: 0.398376 Jul 24 01:20:29.832918 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1366/2600] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1281 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:29.851792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.861661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] [instance: b04157fd-7c0d-4c17-b348-f86aa9a16f3d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.878551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.879728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.880871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.885859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.922345 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] HTTP exception thrown: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Request method failure captured: Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d HTTP/1.1 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J45ZPOO1XVbMX3InaL922MNhnk_UBVS8lLuDq9Yi39blT0O-p8DNEzyoulW8sYq1K1Wr7Zfg021Uj2GiOt5dJQ2Tn1660jjcjxnMczsGxccXt7WJ-OCnLvaozD7XoIlB339rB0_WUejN7fNUWi2hoIe5888SaoEFBtK4FnmMeVsGZY Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.21 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e5025d6267ba40509d642d51a559f217 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5025d6267ba40509d642d51a559f217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5025d6267ba40509d642d51a559f217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5025d6267ba40509d642d51a559f217", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5025d6267ba40509d642d51a559f217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e5025d6267ba40509d642d51a559f217 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1391231516 Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-InstanceActionsV221TestJSON-1391231516-project Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3172ec09985048558fe0f3adf9c067fd Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-InstanceActionsV221TestJSON-1391231516-project Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b04157fd-7c0d-4c17-b348-f86aa9a16f3d'} Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.928218 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. Jul 24 01:20:29.931878 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:29.934663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] Returning 404 to user: Instance b04157fd-7c0d-4c17-b348-f86aa9a16f3d could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:29.935782 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6c6fd4f9-8799-4275-b5eb-c1f9e8fde6d8 tempest-InstanceActionsV221TestJSON-1391231516 tempest-InstanceActionsV221TestJSON-1391231516-project] 10.222.0.27 "GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d" status: 404 len: 111 microversion: 2.21 time: 0.088615 Jul 24 01:20:29.940559 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1367/2601] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/b04157fd-7c0d-4c17-b348-f86aa9a16f3d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:29.946901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:29.947814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:29.970178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.970837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:29.986309 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:29.986996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.676305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:30.689689 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eea5972d-edcc-4d8f-9934-b54a86d4c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1471 microversion: 2.1 time: 0.747681 Jul 24 01:20:30.691125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1368/2602] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1471 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:30.699831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:30.700702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:30.711978 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:30.715057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.716233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.718405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.719865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.725972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:30.738406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:30.746277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:30.746516 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] HTTP exception thrown: Instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 could not be found. Jul 24 01:20:30.747840 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7554cfd7-2b71-4d20-b307-edea262e0be7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 1.245135 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Request method failure captured: Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 HTTP/1.1 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J4IfBDw4AdQaTQalWwZ8reVqyLlFVzeupTZu3Hk6cRzYDJS-X8WgBtreuAvzALPv_qcPReY1GSiw1NTzhUs1L-oCmDaCxT-uohNrICVekzx_wKu0DZxXNtOKvGiRsMPLHoWK73rPziKYp86Dtf73JXh_GUCOZICZ02pvq5lA3BpFRk Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a2a0554a2bdf40009b895620212a11f1 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2a0554a2bdf40009b895620212a11f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a2a0554a2bdf40009b895620212a11f1 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServerFiltersTestJSON-1472673467-project Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bba4323f452d409eaf42a1d7d60df35c Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServerFiltersTestJSON-1472673467-project Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 could not be found. Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135'} Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 could not be found. Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 could not be found. Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:30.748249 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:30.753551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:30.753551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:30.753551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:30.753551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:30.753551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:30.753551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 could not be found. Jul 24 01:20:30.753551 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:30.755722 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1235/2603] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:29 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:30.758784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Returning 404 to user: Instance f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:30.759854 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a45c6409-25c5-4e46-b1b5-88f8d069582f tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135" status: 404 len: 111 microversion: 2.1 time: 0.067412 Jul 24 01:20:30.760925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1369/2604] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:30 2022] GET /compute/v2.1/servers/f3febeac-0ea2-4ac9-a5d6-ea5aaf7af135 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:30.769365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:30.770660 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:30.778969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.779900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.784040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.785062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.829418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:30.851972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:30.853301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:30.865483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.866051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:30.866903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:30.867398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.006433 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b72dc86-99a4-4e3c-9fb5-64b68d912c1e tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 204 len: 0 microversion: 2.1 time: 0.240944 Jul 24 01:20:31.011547 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1236/2605] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:30 2022] DELETE /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:31.024564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:31.026802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:31.047726 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.049179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.054080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.055832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.741765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:31.768491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:31.774103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:31.776172 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03e20493-7c7c-4cf7-ad62-726dd130477b tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1341 microversion: 2.47 time: 0.928626 Jul 24 01:20:31.790529 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1370/2606] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:30 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1341 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:31.796270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:31.798198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:31.813159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.814095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:31.817114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:31.818520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.206421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:32.237349 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-acf44799-59d3-483f-8857-28acd25d1ddd tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1518 microversion: 2.1 time: 1.224234 Jul 24 01:20:32.241178 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1237/2607] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:31 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1518 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:32.262606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:32.267221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:32.299871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.302975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.313010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.315342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.467409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:32.485223 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-04ee521d-2cb8-45d3-b44c-fd7c9fe956ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1471 microversion: 2.1 time: 0.689279 Jul 24 01:20:32.500398 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1371/2608] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:31 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:32.536268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-259008ad-0f91-405c-8d7d-f248c875a817 req-8dae1365-2987-44e9-bd9f-e26e30116475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd02606-019b-4095-a20b-1f03d30bf81f", "name": "network-vif-deleted", "tag": "01d4a5e7-32f6-423b-b735-d0c97dd15b34"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:32.559035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-259008ad-0f91-405c-8d7d-f248c875a817 req-8dae1365-2987-44e9-bd9f-e26e30116475 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.566021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-259008ad-0f91-405c-8d7d-f248c875a817 req-8dae1365-2987-44e9-bd9f-e26e30116475 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.602239 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-259008ad-0f91-405c-8d7d-f248c875a817 req-8dae1365-2987-44e9-bd9f-e26e30116475 service nova] Creating event network-vif-deleted:01d4a5e7-32f6-423b-b735-d0c97dd15b34 for instance cbd02606-019b-4095-a20b-1f03d30bf81f on n-h2-master-1 Jul 24 01:20:32.622424 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-259008ad-0f91-405c-8d7d-f248c875a817 req-8dae1365-2987-44e9-bd9f-e26e30116475 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117171 Jul 24 01:20:32.624011 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1372/2609] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:32.793370 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:32.797906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:32.798641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:32.811513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.814624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.815826 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:32.816494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:32.984968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.000433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.002015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.003196 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-09fe6777-593f-44af-9af2-5ca985ff8b52 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1339 microversion: 2.47 time: 0.210820 Jul 24 01:20:33.005579 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1373/2610] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:32 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1339 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:20:33.073834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.095927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.099614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.102008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d19dc69-13a9-45c3-ace5-4566943b218c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.855525 Jul 24 01:20:33.116144 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1238/2611] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:32 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:33.258294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:33.258928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:33.270639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.275958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.279038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.280938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.506433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:33.507339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:33.527464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.528294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.529479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.530168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.586871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:33.587558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:33.593042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lazy-loading 'fault' on Instance uuid cbd02606-019b-4095-a20b-1f03d30bf81f {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:33.600733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.613072 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e81f6f4-bc7f-45ab-b470-3d0632f1c132 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1518 microversion: 2.1 time: 0.358753 Jul 24 01:20:33.614250 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1374/2612] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:33 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1518 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:33.736606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:33.751632 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01a20b2e-471c-49ff-b308-34d9fe71b9c8 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1306 microversion: 2.1 time: 0.249638 Jul 24 01:20:33.764317 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1239/2613] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:33 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1306 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:34.022816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:34.023444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:34.032022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.032492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.033287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.033756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.129442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:34.131385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:34.149201 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.151982 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.153041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.159384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.250599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:34.267738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:34.271316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:34.275386 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b2d6024b-b245-4c08-98f9-20d66337f031 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1339 microversion: 2.47 time: 0.256759 Jul 24 01:20:34.277426 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1375/2614] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:34 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1339 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:34.634092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:34.639985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:34.641171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:34.662902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:34.665135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:34.667249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1dee32ec-5a24-4550-954f-60d5b6849c62 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.544641 Jul 24 01:20:34.679139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.679139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.679139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.679139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.680918 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1240/2615] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:34 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:34.688896 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:34.771503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:34.773032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:34.786050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.788853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.790631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.793483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.880119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:34.880726 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:34.891547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lazy-loading 'fault' on Instance uuid cbd02606-019b-4095-a20b-1f03d30bf81f {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:34.976962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:34.987059 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88e4ccec-9504-4a4c-b2da-5c770623e2a9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 200 len: 1306 microversion: 2.1 time: 0.220835 Jul 24 01:20:34.987652 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1241/2616] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:34 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 1306 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:35.089054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d41c7eef-6719-4662-a050-5f5c0cc25d46 req-f1e9ac7b-6eae-49fb-b791-ad521f3b1a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9ce179-0702-488e-b661-358fcd697d70", "name": "network-vif-unplugged", "status": "completed", "tag": "f912ad89-b201-4cfa-90d5-680cbb61a2a5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:35.099387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d41c7eef-6719-4662-a050-5f5c0cc25d46 req-f1e9ac7b-6eae-49fb-b791-ad521f3b1a5e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:35.110715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d41c7eef-6719-4662-a050-5f5c0cc25d46 req-f1e9ac7b-6eae-49fb-b791-ad521f3b1a5e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:35.140105 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d41c7eef-6719-4662-a050-5f5c0cc25d46 req-f1e9ac7b-6eae-49fb-b791-ad521f3b1a5e service nova] Creating event network-vif-unplugged:f912ad89-b201-4cfa-90d5-680cbb61a2a5 for instance 2c9ce179-0702-488e-b661-358fcd697d70 on n-h2-master-1 Jul 24 01:20:35.157032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d41c7eef-6719-4662-a050-5f5c0cc25d46 req-f1e9ac7b-6eae-49fb-b791-ad521f3b1a5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071306 Jul 24 01:20:35.158331 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1242/2617] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:20:35.201582 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:35.217791 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a58dccd3-1d50-48a4-91cb-7e72169f2511 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1518 microversion: 2.1 time: 0.590028 Jul 24 01:20:35.227536 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1376/2618] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:34 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1518 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:35.296839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:35.297803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:35.307856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:35.314324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:35.315357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:35.315958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:35.583867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:35.592451 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:35.606540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:35.611439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:35.619622 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6a68947d-f2e8-4d5d-b018-7f5230231153 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1339 microversion: 2.47 time: 0.327138 Jul 24 01:20:35.623164 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1243/2619] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:35 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1339 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:35.686620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:35.688029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:35.704170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:35.721705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:35.724059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:35.724680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.005002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:36.005649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: cbd02606-019b-4095-a20b-1f03d30bf81f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:36.023960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.033150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.036023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.036585 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.093168 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance cbd02606-019b-4095-a20b-1f03d30bf81f could not be found. Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f HTTP/1.1 Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: exception: Instance cbd02606-019b-4095-a20b-1f03d30bf81f could not be found. Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'cbd02606-019b-4095-a20b-1f03d30bf81f'} Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd02606-019b-4095-a20b-1f03d30bf81f could not be found. Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd02606-019b-4095-a20b-1f03d30bf81f could not be found. Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:36.097300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:36.102807 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:36.102807 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:36.102807 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:36.102807 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:36.102807 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:36.102807 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd02606-019b-4095-a20b-1f03d30bf81f could not be found. Jul 24 01:20:36.102807 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:36.106858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance cbd02606-019b-4095-a20b-1f03d30bf81f could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:36.111215 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a6b69ac-3c43-4022-b532-29545dfd452e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f" status: 404 len: 111 microversion: 2.1 time: 0.110611 Jul 24 01:20:36.115348 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1244/2620] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:35 2022] GET /compute/v2.1/servers/cbd02606-019b-4095-a20b-1f03d30bf81f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:20:36.121550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:36.130639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:36.145743 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.148112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.149360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.152453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.229237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:36.392961 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b5508da-285d-40a1-a047-f656e29658b1 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 204 len: 0 microversion: 2.1 time: 0.266877 Jul 24 01:20:36.394921 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1245/2621] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:36 2022] DELETE /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:36.403074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:36.404171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:36.427355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.427814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.428626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.429066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.444341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:36.462796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:36.467601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:36.468801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4fa6e1e-e199-40a2-9580-d9d99b540e6a tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.786741 Jul 24 01:20:36.475320 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1377/2622] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:35 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:36.494068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:36.494826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:36.518082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.518552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:36.519348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:36.519885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:37.716248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:37.725768 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8841fbce-3c37-4cc6-b1d9-53eb0f61a169 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1518 microversion: 2.1 time: 1.328897 Jul 24 01:20:37.738153 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1246/2623] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:36 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1518 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:37.749514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:37.750299 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:37.787082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:37.788774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:37.791813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:37.793307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:37.890727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:37.900269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9bb63476-a1ce-445e-b182-e366d57a8099 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1473 microversion: 2.1 time: 1.423803 Jul 24 01:20:37.905145 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1378/2624] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:36 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1473 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:37.919241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-69067486-5286-4c2c-9b60-cdc5ce656263 req-1ec6ee83-3c32-46d7-ba66-829ce063c524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8dfe4b-e495-4584-8cd0-c145836e91cd", "name": "network-vif-plugged", "status": "completed", "tag": "48eb2f36-64bc-4409-b71f-33a2f59d753f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:37.938374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-69067486-5286-4c2c-9b60-cdc5ce656263 req-1ec6ee83-3c32-46d7-ba66-829ce063c524 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:37.939924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-69067486-5286-4c2c-9b60-cdc5ce656263 req-1ec6ee83-3c32-46d7-ba66-829ce063c524 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:37.954343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:37.967472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:37.968461 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-69067486-5286-4c2c-9b60-cdc5ce656263 req-1ec6ee83-3c32-46d7-ba66-829ce063c524 service nova] Creating event network-vif-plugged:48eb2f36-64bc-4409-b71f-33a2f59d753f for instance ef8dfe4b-e495-4584-8cd0-c145836e91cd on n-h1-master-1 Jul 24 01:20:37.971449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:37.972679 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff7fad6f-3fb8-4003-8c2f-ed19a01936c9 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1339 microversion: 2.47 time: 0.240133 Jul 24 01:20:37.982436 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1247/2625] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:37 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:37.991443 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-69067486-5286-4c2c-9b60-cdc5ce656263 req-1ec6ee83-3c32-46d7-ba66-829ce063c524 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080747 Jul 24 01:20:37.991443 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1379/2626] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:38.043845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:38.044664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:38.093193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:38.095172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.096085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:38.096809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.310211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] Calling method '.version_select at 0x7f05eb05d0d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:38.316111 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:20:38.316111 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:20:38.319383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:38.320808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.361547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:38.362182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.399337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:38.403411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.418715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59ec35c1-3d8d-45c7-b8d7-abbacd0fc84f tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461 tempest-PortsAdminExtendedAttrsIpV6TestJSON-902303461-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.421464 Jul 24 01:20:38.431946 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1248/2627] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:20:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:38.746054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:38.747320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:38.770300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:38.770772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.771841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:38.772666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:38.952595 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=16 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.034325 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.052174 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.082508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.091279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.093176 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b971f33-4f9b-4a3c-9d21-5971f451d1c1 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 1.089108 Jul 24 01:20:39.094157 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1380/2628] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:37 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:39.102334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:39.103316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:39.112468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:39.113855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:39.115158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:39.115805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:39.647309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.658744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-529564d2-84fb-47ac-8399-2f9896dcd7a4 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 200 len: 1518 microversion: 2.1 time: 0.916843 Jul 24 01:20:39.659344 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1249/2629] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:38 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 1518 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:39.677957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:39.679178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:39.697947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:39.698716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:39.699948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:39.702684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:39.819962 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.890514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.902993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.907598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.911497 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3e33dc41-1528-4c8c-b7fd-1669b2768291 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1360 microversion: 2.47 time: 0.247833 Jul 24 01:20:39.918933 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1250/2630] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:39 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1360 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:39.929524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:39.933639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0cb44d68-a845-406a-9d21-6d27179612dc req-c85f46df-176b-4f58-856d-33787cafd8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9ce179-0702-488e-b661-358fcd697d70", "name": "network-vif-deleted", "tag": "f912ad89-b201-4cfa-90d5-680cbb61a2a5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:39.942000 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4eba91f8-978e-4b90-848a-f1f5ade718b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1473 microversion: 2.1 time: 0.845914 Jul 24 01:20:39.950284 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1381/2631] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:39 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1473 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:39.961650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63f9d459-d46d-4227-b206-605f28a41ce7 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1804796224"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:39.971491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0cb44d68-a845-406a-9d21-6d27179612dc req-c85f46df-176b-4f58-856d-33787cafd8f8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:39.972237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0cb44d68-a845-406a-9d21-6d27179612dc req-c85f46df-176b-4f58-856d-33787cafd8f8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:39.973555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63f9d459-d46d-4227-b206-605f28a41ce7 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:39.999308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63f9d459-d46d-4227-b206-605f28a41ce7 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.002686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63f9d459-d46d-4227-b206-605f28a41ce7 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.012936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0cb44d68-a845-406a-9d21-6d27179612dc req-c85f46df-176b-4f58-856d-33787cafd8f8 service nova] Creating event network-vif-deleted:f912ad89-b201-4cfa-90d5-680cbb61a2a5 for instance 2c9ce179-0702-488e-b661-358fcd697d70 on n-h2-master-1 Jul 24 01:20:40.014312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63f9d459-d46d-4227-b206-605f28a41ce7 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.016265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63f9d459-d46d-4227-b206-605f28a41ce7 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.044398 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0cb44d68-a845-406a-9d21-6d27179612dc req-c85f46df-176b-4f58-856d-33787cafd8f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123794 Jul 24 01:20:40.048224 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1251/2632] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:40.113249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.114439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:40.138725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.139253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.140092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.140548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.668811 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63f9d459-d46d-4227-b206-605f28a41ce7 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "POST /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8/action" status: 202 len: 52 microversion: 2.47 time: 0.716681 Jul 24 01:20:40.669833 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1382/2633] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:20:39 2022] POST /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8/action => generated 52 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:20:40.686160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.694027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: 2c9ce179-0702-488e-b661-358fcd697d70] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:40.700795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.701911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.703027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.703617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.721905 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] HTTP exception thrown: Instance 2c9ce179-0702-488e-b661-358fcd697d70 could not be found. Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Request method failure captured: Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 HTTP/1.1 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J4IfBDw4AdQaTQalWwZ8reVqyLlFVzeupTZu3Hk6cRzYDJS-X8WgBtreuAvzALPv_qcPReY1GSiw1NTzhUs1L-oCmDaCxT-uohNrICVekzx_wKu0DZxXNtOKvGiRsMPLHoWK73rPziKYp86Dtf73JXh_GUCOZICZ02pvq5lA3BpFRk Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a2a0554a2bdf40009b895620212a11f1 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2a0554a2bdf40009b895620212a11f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a2a0554a2bdf40009b895620212a11f1 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServerFiltersTestJSON-1472673467-project Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bba4323f452d409eaf42a1d7d60df35c Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServerFiltersTestJSON-1472673467-project Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 2c9ce179-0702-488e-b661-358fcd697d70 could not be found. Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '2c9ce179-0702-488e-b661-358fcd697d70'} Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9ce179-0702-488e-b661-358fcd697d70 could not be found. Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9ce179-0702-488e-b661-358fcd697d70 could not be found. Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:40.724592 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.729379 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:40.729379 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:40.729379 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:40.729379 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:40.729379 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:40.729379 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9ce179-0702-488e-b661-358fcd697d70 could not be found. Jul 24 01:20:40.729379 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:40.730924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Returning 404 to user: Instance 2c9ce179-0702-488e-b661-358fcd697d70 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:40.731991 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-51569323-c7a7-4a22-94cd-2629a3b5fd8a tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70" status: 404 len: 111 microversion: 2.1 time: 0.060123 Jul 24 01:20:40.733077 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1383/2634] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:40 2022] GET /compute/v2.1/servers/2c9ce179-0702-488e-b661-358fcd697d70 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:40.741961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.742843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:40.759535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.760232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.761340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.762151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.797266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:40.950421 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fb19d6be-129e-40dd-b18d-a96abb613257 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 204 len: 0 microversion: 2.47 time: 0.215413 Jul 24 01:20:40.951545 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1384/2635] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:20:40 2022] DELETE /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:20:40.960333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:40.961380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:40.969698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.970579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.971562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:40.972202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:40.990197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.016363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.016834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:41.018045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.022642 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a60f8f7c-8334-4ee0-8bf7-38d887f71fbf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1281 microversion: 2.25 time: 0.913968 Jul 24 01:20:41.025712 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1252/2636] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:40 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1281 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:41.038135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:41.041951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:41.058014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.058722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.059762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.060403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.144010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de165cdc-2319-410f-8d4e-b32b56976d48 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 204 len: 0 microversion: 2.1 time: 0.190531 Jul 24 01:20:41.152276 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1385/2637] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:40 2022] DELETE /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:41.164116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:41.166017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:41.181406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.184587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.186124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.186590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.259305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.259970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.262618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lazy-loading 'fault' on Instance uuid d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:41.290827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.304141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.309782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.312069 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-439457e6-feda-4f5f-aa9f-80058f4f7fbb tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1366 microversion: 2.47 time: 0.285362 Jul 24 01:20:41.325953 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1253/2638] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:41 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:41.334008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-81cd2a92-abc3-4058-9acf-0240b583b60f req-a78eeecb-d23a-401e-aa7e-6bd30a6e4b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3", "name": "network-vif-deleted", "tag": "9769857c-d14a-419e-b2a2-92d86048e84c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:41.344435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-81cd2a92-abc3-4058-9acf-0240b583b60f req-a78eeecb-d23a-401e-aa7e-6bd30a6e4b28 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.345191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-81cd2a92-abc3-4058-9acf-0240b583b60f req-a78eeecb-d23a-401e-aa7e-6bd30a6e4b28 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.358974 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-81cd2a92-abc3-4058-9acf-0240b583b60f req-a78eeecb-d23a-401e-aa7e-6bd30a6e4b28 service nova] Creating event network-vif-deleted:9769857c-d14a-419e-b2a2-92d86048e84c for instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 on n-h2-master-1 Jul 24 01:20:41.365266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-81cd2a92-abc3-4058-9acf-0240b583b60f req-a78eeecb-d23a-401e-aa7e-6bd30a6e4b28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036993 Jul 24 01:20:41.366822 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1254/2639] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:41.373239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:41.374199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:41.382599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.383475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.384481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:41.385147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:41.536094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.545255 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6dcf5813-fd4a-42a6-a377-405dfdc03798 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 200 len: 1307 microversion: 2.1 time: 0.392930 Jul 24 01:20:41.551258 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1386/2640] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:41 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 1307 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:41.850752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:41.868475 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-46990607-c10f-4d58-998b-6327d0000927 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1518 microversion: 2.1 time: 0.497563 Jul 24 01:20:41.869379 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1255/2641] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:41 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1518 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:42.043338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:42.044345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:42.057404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.068890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.070004 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.072264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.334600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:42.336087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:42.358674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.359134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.359938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.360377 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.437522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.447820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.460850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.462988 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3253dc9d-b3dc-4c64-882c-8501b2deaa01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1477 microversion: 2.25 time: 0.424336 Jul 24 01:20:42.479548 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1387/2642] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:42 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:42.582917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.593016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.608172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:42.624344 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-481b10cd-0b85-4cf1-b359-067ef9af1b13 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1366 microversion: 2.47 time: 0.290697 Jul 24 01:20:42.625385 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1256/2643] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:42 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:42.659199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:42.661075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:42.704759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.715591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.717165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.720149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.772769 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 could not be found. Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 HTTP/1.1 Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: exception: Instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 could not be found. Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd32a0723-b11a-4c4a-9a6a-47acdf3bbdd3'} Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 could not be found. Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 could not be found. Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:42.779628 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 could not be found. Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:42.783800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:42.788735 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9f228c39-00f6-4148-ac70-8958f99d641d tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3" status: 404 len: 111 microversion: 2.1 time: 0.160491 Jul 24 01:20:42.790143 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1257/2644] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:42 2022] GET /compute/v2.1/servers/d32a0723-b11a-4c4a-9a6a-47acdf3bbdd3 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:42.801317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:42.805538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:42.832773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.839581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.842205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:42.853320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:42.948794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:43.116354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:43.117027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:43.131870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:43.132331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:43.133135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:43.133576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:43.158314 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-84ccfcd5-c04a-42a5-928c-655f36ae898e tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03" status: 204 len: 0 microversion: 2.1 time: 0.361106 Jul 24 01:20:43.161439 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1258/2645] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:42 2022] DELETE /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:43.180650 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:43.188859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:43.202750 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:43.219207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:43.219722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:43.223272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:43.223834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.548465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:44.556067 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:44.564248 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5de03836-7946-421b-b5ea-e4fea3e537e0 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1518 microversion: 2.1 time: 1.400274 Jul 24 01:20:44.565751 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1259/2646] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:43 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1518 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:44.591360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:44.594159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:44.625391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.626555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.627408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.629457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.696742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:44.837368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid ef8dfe4b-e495-4584-8cd0-c145836e91cd {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:44.862292 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-66752a2c-5de8-4a9b-9f3d-b4e8c8c7832f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 204 len: 0 microversion: 2.1 time: 0.292382 Jul 24 01:20:44.868578 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1260/2647] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:44 2022] DELETE /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:44.868791 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:44.873205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8e944ac8-c20c-4897-a98f-3ed432dee6e6 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1970 microversion: 2.25 time: 2.391444 Jul 24 01:20:44.874336 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1388/2648] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:42 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1970 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:44.876824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:44.877788 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:44.880230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:44.881011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:44.885116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.885819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.886866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.887634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.890309 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.890960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:44.891936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:44.892675 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.095424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.107516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.114619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.115899 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6780d889-c054-4743-8929-ca1b38fd3780 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1366 microversion: 2.47 time: 0.245389 Jul 24 01:20:45.116712 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1261/2649] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:44 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:45.128373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:45.136957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:45.146984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.148349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.148349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.149196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.512450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.524570 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cafaae82-37e3-4093-8d5d-d641ee38ddaa tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03" status: 200 len: 1474 microversion: 2.1 time: 0.645514 Jul 24 01:20:45.524902 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1389/2650] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:44 2022] GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03 => generated 1474 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:45.584307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:45.584935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:45.591349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.592145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.593115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.593747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.730571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid ef8dfe4b-e495-4584-8cd0-c145836e91cd {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:45.749362 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8c90e154-f320-49be-ad08-23135946d023 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1970 microversion: 2.25 time: 0.631757 Jul 24 01:20:45.750554 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1262/2651] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:45 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1970 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:45.770053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a169555-345d-420d-85ae-924ff1b04871 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:45.771877 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:20:45.771877 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:20:45.774095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a169555-345d-420d-85ae-924ff1b04871 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.775141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a169555-345d-420d-85ae-924ff1b04871 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.778372 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a169555-345d-420d-85ae-924ff1b04871 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.779334 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a169555-345d-420d-85ae-924ff1b04871 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.830196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4a169555-345d-420d-85ae-924ff1b04871 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.064841 Jul 24 01:20:45.830847 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1263/2652] 10.222.0.27 () {60 vars in 1216 bytes} [Sun Jul 24 01:20:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:20:45.843625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:45.845137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:45.851903 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.853057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.854354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:45.854869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:45.926204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba4323f452d409eaf42a1d7d60df35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0554a2bdf40009b895620212a11f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:45.944495 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b420fb8a-6f87-4ca1-8f5e-2e078d551669 tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 200 len: 1476 microversion: 2.1 time: 0.365567 Jul 24 01:20:45.946005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'flavor' on Instance uuid ef8dfe4b-e495-4584-8cd0-c145836e91cd {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:45.961948 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1390/2653] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:45 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:45.967513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Going to try to live migrate instance to n-h2-master-1 {{(pid=119562) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:20:46.146347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:46.147076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:46.165478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:46.170384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:46.174709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:46.179320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:46.460200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:46.496502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:46.502642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:46.503425 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b3df92b9-4bab-4f9b-a9e1-f3f75d0952e0 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1366 microversion: 2.47 time: 0.363162 Jul 24 01:20:46.505178 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1391/2654] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:46 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:46.515392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cb92acd0-4a8d-4952-88b0-22443ba0e2aa req-1393df83-1d73-4824-8b29-8ef88e8064aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6a825a-bdba-4424-86c5-4205d9a9e835", "name": "network-vif-deleted", "tag": "c377a126-8b35-4637-9452-e5167f71e89c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:46.546807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cb92acd0-4a8d-4952-88b0-22443ba0e2aa req-1393df83-1d73-4824-8b29-8ef88e8064aa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:46.547267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cb92acd0-4a8d-4952-88b0-22443ba0e2aa req-1393df83-1d73-4824-8b29-8ef88e8064aa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:46.568804 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cb92acd0-4a8d-4952-88b0-22443ba0e2aa req-1393df83-1d73-4824-8b29-8ef88e8064aa service nova] Creating event network-vif-deleted:c377a126-8b35-4637-9452-e5167f71e89c for instance fb6a825a-bdba-4424-86c5-4205d9a9e835 on n-h1-master-1 Jul 24 01:20:46.579171 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cb92acd0-4a8d-4952-88b0-22443ba0e2aa req-1393df83-1d73-4824-8b29-8ef88e8064aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072118 Jul 24 01:20:46.579839 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1392/2655] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:46.588982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:46.594144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:46.621510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:46.624026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:46.625154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:46.626692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:47.540251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:47.554163 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea89c3be-9920-4658-9ab5-717f8a592084 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03" status: 200 len: 1474 microversion: 2.1 time: 0.973015 Jul 24 01:20:47.557019 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1393/2656] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:46 2022] GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03 => generated 1474 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:47.572682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:47.574285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] [instance: fb6a825a-bdba-4424-86c5-4205d9a9e835] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:47.592772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:47.595088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:47.598595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:47.600402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:47.645632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] HTTP exception thrown: Instance fb6a825a-bdba-4424-86c5-4205d9a9e835 could not be found. Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Request method failure captured: Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 HTTP/1.1 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J4IfBDw4AdQaTQalWwZ8reVqyLlFVzeupTZu3Hk6cRzYDJS-X8WgBtreuAvzALPv_qcPReY1GSiw1NTzhUs1L-oCmDaCxT-uohNrICVekzx_wKu0DZxXNtOKvGiRsMPLHoWK73rPziKYp86Dtf73JXh_GUCOZICZ02pvq5lA3BpFRk Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a2a0554a2bdf40009b895620212a11f1 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2a0554a2bdf40009b895620212a11f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2a0554a2bdf40009b895620212a11f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a2a0554a2bdf40009b895620212a11f1 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1472673467 Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServerFiltersTestJSON-1472673467-project Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bba4323f452d409eaf42a1d7d60df35c Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServerFiltersTestJSON-1472673467-project Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: exception: Instance fb6a825a-bdba-4424-86c5-4205d9a9e835 could not be found. Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'fb6a825a-bdba-4424-86c5-4205d9a9e835'} Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6a825a-bdba-4424-86c5-4205d9a9e835 could not be found. Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6a825a-bdba-4424-86c5-4205d9a9e835 could not be found. Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:47.651017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6a825a-bdba-4424-86c5-4205d9a9e835 could not be found. Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] Returning 404 to user: Instance fb6a825a-bdba-4424-86c5-4205d9a9e835 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:47.656155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1e7d7033-9a93-4ad6-b0a9-55f4bc15bd3b tempest-ListServerFiltersTestJSON-1472673467 tempest-ListServerFiltersTestJSON-1472673467-project] 10.222.0.27 "GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835" status: 404 len: 111 microversion: 2.1 time: 0.095282 Jul 24 01:20:47.657857 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1394/2657] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:47 2022] GET /compute/v2.1/servers/fb6a825a-bdba-4424-86c5-4205d9a9e835 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:47.669247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:47.672540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:47.694835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:47.695363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:47.697358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:47.697838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:47.797375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:47.802354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:47.803008 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lazy-loading 'fault' on Instance uuid d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:47.938560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:47.958342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:47.961130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11411d69fb4747e783fae09aa58d1a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf80756586b48a7a320b87480fdbcc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:47.965462 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f8357d2-fcca-4fcc-931a-2d4705f635bf tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 200 len: 1371 microversion: 2.47 time: 0.306006 Jul 24 01:20:47.967231 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1395/2658] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:47 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:48.574924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:48.576239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 72e73367-e6d8-4941-a4e2-f5541bc62f03] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:48.590319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:48.592353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:48.593437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:48.594957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:48.662885 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 could not be found. Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03 HTTP/1.1 Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 could not be found. Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '72e73367-e6d8-4941-a4e2-f5541bc62f03'} Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 could not be found. Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 could not be found. Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:48.672867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:48.680459 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:48.680459 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:48.680459 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:48.680459 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:48.680459 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:48.680459 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 could not be found. Jul 24 01:20:48.680459 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:48.684514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:48.686643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c87caedc-6cbb-4b59-bcaa-6c0dfc2f053f tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03" status: 404 len: 111 microversion: 2.1 time: 0.116079 Jul 24 01:20:48.689777 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1396/2659] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:48 2022] GET /compute/v2.1/servers/72e73367-e6d8-4941-a4e2-f5541bc62f03 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:20:48.702363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fd6bfaf3-b8e0-4edb-9a59-1ea66fe89fd2 req-5f27c879-4c27-4657-8107-18483d746f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e73367-e6d8-4941-a4e2-f5541bc62f03", "name": "network-vif-deleted", "tag": "5a95cb51-9367-4afa-8255-acadb5df2832"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:48.728079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fd6bfaf3-b8e0-4edb-9a59-1ea66fe89fd2 req-5f27c879-4c27-4657-8107-18483d746f3c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:48.728960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fd6bfaf3-b8e0-4edb-9a59-1ea66fe89fd2 req-5f27c879-4c27-4657-8107-18483d746f3c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:48.746126 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fd6bfaf3-b8e0-4edb-9a59-1ea66fe89fd2 req-5f27c879-4c27-4657-8107-18483d746f3c service nova] Creating event network-vif-deleted:5a95cb51-9367-4afa-8255-acadb5df2832 for instance 72e73367-e6d8-4941-a4e2-f5541bc62f03 on n-h1-master-1 Jul 24 01:20:48.751792 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fd6bfaf3-b8e0-4edb-9a59-1ea66fe89fd2 req-5f27c879-4c27-4657-8107-18483d746f3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060525 Jul 24 01:20:48.753013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1397/2660] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:48.760382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:48.761550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:48.771347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:48.772226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:48.773164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:48.773655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:49.147142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:49.163169 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1bb06535-937f-44d7-933f-1c6763b566ef tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1473 microversion: 2.1 time: 0.407213 Jul 24 01:20:49.173663 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1398/2661] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:48 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:49.186333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:49.189026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] [instance: d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:49.199147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:49.199615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:49.200803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:49.201000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:49.226320 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] HTTP exception thrown: Instance d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 could not be found. Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Request method failure captured: Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 HTTP/1.1 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J5cgTHljV2RdoZoUbkbYMBttfwu5E8cW3FwXuq4v0ULtvQpx3aoq2_al4_CEc2xSXXdNq6VyczaRUKjV3mVLYlCs7qpEtHjKnCjijKgaN026i_ueFLC-6Ro--JEXLe85UxD_d357RuW5Ev-utPu5u9_blbaMmFf52srhOy9R-tSuxY Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.47 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 4bf80756586b48a7a320b87480fdbcc8 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAaction247Test-1655513959 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bf80756586b48a7a320b87480fdbcc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bf80756586b48a7a320b87480fdbcc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bf80756586b48a7a320b87480fdbcc8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bf80756586b48a7a320b87480fdbcc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAaction247Test-1655513959 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 4bf80756586b48a7a320b87480fdbcc8 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAaction247Test-1655513959 Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAaction247Test-1655513959-project Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 11411d69fb4747e783fae09aa58d1a5e Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAaction247Test-1655513959-project Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: exception: Instance d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 could not be found. Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'd311db2c-8ac7-4af0-ab4a-f4d24c7e69f8'} Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 could not be found. Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 could not be found. Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:49.228022 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 could not be found. Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] Returning 404 to user: Instance d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:49.231968 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d3b7e5f3-c75f-4e55-894d-ed7ff5077ec1 tempest-ServersAaction247Test-1655513959 tempest-ServersAaction247Test-1655513959-project] 10.222.0.27 "GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8" status: 404 len: 111 microversion: 2.47 time: 0.050856 Jul 24 01:20:49.233742 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1399/2662] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:49 2022] GET /compute/v2.1/servers/d311db2c-8ac7-4af0-ab4a-f4d24c7e69f8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:20:49.788791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-65553aae-135e-46fa-af9e-ecc08b18a2e8 req-009f2a12-b202-4f00-a149-95c7761d1162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a", "name": "network-vif-deleted", "tag": "a6fd7eb1-fcfc-43ec-adcd-600bf5808df7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:49.813336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-65553aae-135e-46fa-af9e-ecc08b18a2e8 req-009f2a12-b202-4f00-a149-95c7761d1162 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:49.814235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-65553aae-135e-46fa-af9e-ecc08b18a2e8 req-009f2a12-b202-4f00-a149-95c7761d1162 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:49.844383 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-65553aae-135e-46fa-af9e-ecc08b18a2e8 req-009f2a12-b202-4f00-a149-95c7761d1162 service nova] Creating event network-vif-deleted:a6fd7eb1-fcfc-43ec-adcd-600bf5808df7 for instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a on n-h2-master-1 Jul 24 01:20:49.855881 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-65553aae-135e-46fa-af9e-ecc08b18a2e8 req-009f2a12-b202-4f00-a149-95c7761d1162 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073050 Jul 24 01:20:49.860659 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1400/2663] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:20:50.182119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:50.182763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:50.212670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:50.213123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:50.213963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:50.214404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:50.268516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:50.268988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:50.270039 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lazy-loading 'fault' on Instance uuid a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:20:50.399855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:50.411660 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87993236-d4cf-4dcb-9a87-f46afff29f96 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 200 len: 1308 microversion: 2.1 time: 0.234061 Jul 24 01:20:50.412247 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1401/2664] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:50 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:51.381936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9318315e-6a23-4006-9db4-6598adb63902 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd/action" status: 202 len: 0 microversion: 2.25 time: 5.542968 Jul 24 01:20:51.384120 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1264/2665] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:20:45 2022] POST /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd/action => generated 0 bytes in 5546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:20:51.392538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:51.393430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.410432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.412186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.413936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.415801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.431497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:51.432577 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.460855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.461397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.468452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.469019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.503070 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a could not be found. Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a HTTP/1.1 Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: exception: Instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a could not be found. Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a'} Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a could not be found. Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a could not be found. Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:51.505795 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a could not be found. Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:51.512815 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-030bdac4-bac7-4b72-9baa-845ba07aaba6 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a" status: 404 len: 111 microversion: 2.1 time: 0.086953 Jul 24 01:20:51.513843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1265/2666] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:51 2022] GET /compute/v2.1/servers/a65ff5b6-f6b3-494c-9fb4-72bf9c97ce1a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:51.525138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5995d0a4-4bec-42ff-9f1a-1a8e0d8c3500 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:51.587968 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5995d0a4-4bec-42ff-9f1a-1a8e0d8c3500 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/40bc247f-8d0f-4ae4-8eb8-8847c9a97e19" status: 204 len: 0 microversion: 2.1 time: 0.071447 Jul 24 01:20:51.589592 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1266/2667] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:20:51 2022] DELETE /compute/v2.1/os-server-groups/40bc247f-8d0f-4ae4-8eb8-8847c9a97e19 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:51.601366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:51.602346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.616820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.617898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.618744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.619230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.659388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:51.804781 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-afce9e8c-20ac-400e-b85d-49f6120cf277 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 204 len: 0 microversion: 2.1 time: 0.209908 Jul 24 01:20:51.805925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1267/2668] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:51 2022] DELETE /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:51.820786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:51.822081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:51.829904 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.831881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.833363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:51.834544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:51.884209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:20:52.080352 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-93323e52-7fcc-4943-a185-8cd0f4ff7f6a tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 204 len: 0 microversion: 2.1 time: 0.268444 Jul 24 01:20:52.086781 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1268/2669] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:51 2022] DELETE /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:52.105270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:52.106717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:52.146658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:52.147839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:52.149447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:52.150399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:52.345482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.363940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.365488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.366720 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-014d1ce5-966d-4bf6-ae46-3a9ee987c88b tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.978213 Jul 24 01:20:52.368397 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1402/2670] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:51 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:52.486300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:52.494962 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-485c14ba-2acd-46cd-a1ed-792888263075 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 200 len: 1472 microversion: 2.1 time: 0.403723 Jul 24 01:20:52.506714 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1269/2671] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:52 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:53.385564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:53.386531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:53.396623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:53.398055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:53.402477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:53.402946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:53.513580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:53.515155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:53.532973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:53.533350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:53.536508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:53.537968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:53.980436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:53.992021 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:53.995015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:54.000030 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b679df0-64ba-4291-aa11-8bf3c1a6383c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.617166 Jul 24 01:20:54.001620 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1403/2672] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:53 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:54.095867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:54.105812 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4cafd623-0c94-41f4-99db-90d8e9c05288 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 200 len: 1472 microversion: 2.1 time: 0.596982 Jul 24 01:20:54.123831 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1270/2673] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:53 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 1472 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:55.035636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:55.041977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:55.052762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.058106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.062493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.063653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.129663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:55.130317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:55.141801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.142918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.144712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:55.145564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:55.179814 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:55.790895 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:55.977324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:55.991317 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79cf1b18-d137-4ef2-92bc-f1ba7fc7ff12 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 200 len: 1472 microversion: 2.1 time: 0.867043 Jul 24 01:20:56.001390 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1271/2674] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:55 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 1472 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:20:56.067128 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:56.117649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:56.128123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:56.131146 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aaccc075-4714-4c92-b596-3be422026891 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 1.112299 Jul 24 01:20:56.144343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1404/2675] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:55 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:20:57.009334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:57.011817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:57.038383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:57.038884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:57.040006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:57.040428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:57.152177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:57.153000 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:57.189017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:57.190429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:57.193327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:57.196296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:57.340966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:57.356078 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-854142da-9ed8-49b4-91a2-c4b2dcd658a3 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 200 len: 1430 microversion: 2.1 time: 0.350226 Jul 24 01:20:57.358056 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1272/2676] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:57 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 1430 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:57.369441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8bf4aa33-1635-46ec-8cc4-9be05de85135 req-d792e664-17b5-4694-aed9-85e2107ebc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0809a9-f990-4818-ba3e-4b027c1dda81", "name": "network-vif-deleted", "tag": "18746ce2-1d8b-4e13-ab0a-b5a99febfce4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:57.387482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8bf4aa33-1635-46ec-8cc4-9be05de85135 req-d792e664-17b5-4694-aed9-85e2107ebc9a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:57.394477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8bf4aa33-1635-46ec-8cc4-9be05de85135 req-d792e664-17b5-4694-aed9-85e2107ebc9a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:57.431398 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8bf4aa33-1635-46ec-8cc4-9be05de85135 req-d792e664-17b5-4694-aed9-85e2107ebc9a service nova] Creating event network-vif-deleted:18746ce2-1d8b-4e13-ab0a-b5a99febfce4 for instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 on n-h2-master-1 Jul 24 01:20:57.444836 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8bf4aa33-1635-46ec-8cc4-9be05de85135 req-d792e664-17b5-4694-aed9-85e2107ebc9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083423 Jul 24 01:20:57.446177 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1273/2677] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:58.374516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:58.375278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 9a0809a9-f990-4818-ba3e-4b027c1dda81] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:58.391017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.398497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.399702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.400340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.432200 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 could not be found. Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 HTTP/1.1 Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 could not be found. Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9a0809a9-f990-4818-ba3e-4b027c1dda81'} Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 could not be found. Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 could not be found. Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:58.447722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:58.451772 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:58.451772 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:58.451772 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:58.451772 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:58.451772 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:58.451772 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 could not be found. Jul 24 01:20:58.451772 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:58.453924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance 9a0809a9-f990-4818-ba3e-4b027c1dda81 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:58.454909 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-32622457-e500-47bd-8abf-778c171146b7 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81" status: 404 len: 111 microversion: 2.1 time: 0.084754 Jul 24 01:20:58.457851 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1274/2678] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:58 2022] GET /compute/v2.1/servers/9a0809a9-f990-4818-ba3e-4b027c1dda81 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:20:58.477031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:58.482854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:58.508730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.510476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.514475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.515750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.758757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.772967 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9182a4c9-eb86-40ff-b0e1-9d28a60069ab tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 200 len: 1430 microversion: 2.1 time: 0.309224 Jul 24 01:20:58.777200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1275/2679] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:58 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 1430 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:20:58.795148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-fc0717c5-baa1-4cb4-bf9a-57ebe49ad8c4 req-66c21c51-2033-40ae-a3fa-b808680334e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c47ab3-2f33-40d3-ac91-04f30aa6f66e", "name": "network-vif-deleted", "tag": "ec327e9a-f2a5-4ffc-abca-57b29b8b83fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:20:58.816128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fc0717c5-baa1-4cb4-bf9a-57ebe49ad8c4 req-66c21c51-2033-40ae-a3fa-b808680334e0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:58.816645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fc0717c5-baa1-4cb4-bf9a-57ebe49ad8c4 req-66c21c51-2033-40ae-a3fa-b808680334e0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:58.847285 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-fc0717c5-baa1-4cb4-bf9a-57ebe49ad8c4 req-66c21c51-2033-40ae-a3fa-b808680334e0 service nova] Creating event network-vif-deleted:ec327e9a-f2a5-4ffc-abca-57b29b8b83fe for instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e on n-h2-master-1 Jul 24 01:20:58.861836 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-fc0717c5-baa1-4cb4-bf9a-57ebe49ad8c4 req-66c21c51-2033-40ae-a3fa-b808680334e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081576 Jul 24 01:20:58.862794 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1276/2680] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:20:58.899634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.914397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.924045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:20:58.926318 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e522c70-2c7b-427d-88ab-b6c2f734d336 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 1.778921 Jul 24 01:20:58.927396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1405/2681] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:57 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:20:59.793107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:59.793914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: c2c47ab3-2f33-40d3-ac91-04f30aa6f66e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:59.815053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.816366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.817364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.818000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.846094 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e could not be found. Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e HTTP/1.1 Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e could not be found. Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c2c47ab3-2f33-40d3-ac91-04f30aa6f66e'} Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e could not be found. Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e could not be found. Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:20:59.850230 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e could not be found. Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance c2c47ab3-2f33-40d3-ac91-04f30aa6f66e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:20:59.855100 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3bb4eba9-5ce2-4e80-8ba9-94bbb2611a07 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e" status: 404 len: 111 microversion: 2.1 time: 0.062944 Jul 24 01:20:59.857810 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1277/2682] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:20:59 2022] GET /compute/v2.1/servers/c2c47ab3-2f33-40d3-ac91-04f30aa6f66e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:59.863545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5dd5bf87-e22b-4788-a34c-45cf0d74f52b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:59.919933 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5dd5bf87-e22b-4788-a34c-45cf0d74f52b tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/e0f753e6-2886-487e-9947-2b26d594dfe2" status: 204 len: 0 microversion: 2.1 time: 0.060049 Jul 24 01:20:59.922864 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1406/2683] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:20:59 2022] DELETE /compute/v2.1/os-server-groups/e0f753e6-2886-487e-9947-2b26d594dfe2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:20:59.931365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:59.932164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:59.946862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.947562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:20:59.948353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:20:59.948991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.951860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.952500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.965266 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:59.970615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.973369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:20:59.976373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:20:59.979565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:00.023855 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:21:00.191888 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e75ab161-4669-4f4e-b82a-af30e842dbcd tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 204 len: 0 microversion: 2.1 time: 0.258132 Jul 24 01:21:00.195527 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1278/2684] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:20:59 2022] DELETE /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:21:00.217012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:00.218223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:00.235780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:00.236678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:00.239229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:00.241877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:00.465853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.483207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.484732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.489198 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b08f955-86c1-4cac-a622-51f5c739a78d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.548350 Jul 24 01:21:00.490892 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1407/2685] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:20:59 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:00.655782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:00.670353 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-955ceecf-62a5-4130-b1b6-fd1912836eed tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1471 microversion: 2.1 time: 0.467760 Jul 24 01:21:00.687001 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1279/2686] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:00 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1471 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:01.512093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:01.513139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:01.532864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.533627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:01.537286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.538032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:01.688252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:01.688970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:01.703867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.704343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:01.710154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:01.713924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:02.272121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:02.317005 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c97acb6e-5915-4534-b223-15410a46e7df tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1471 microversion: 2.1 time: 0.632777 Jul 24 01:21:02.335218 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1280/2687] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:01 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:02.367068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:02.388293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:02.394557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:02.407875 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8a6f311-d52f-4915-b883-cb6191826800 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.901213 Jul 24 01:21:02.413467 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1408/2688] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:01 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:03.353534 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:03.354453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:03.368355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:03.371889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:03.373004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:03.376968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:03.432391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:03.433234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:03.470173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:03.477137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:03.482039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:03.483431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:03.994501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:04.009030 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f260c417-3474-4f10-a661-981b6631a24c tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1429 microversion: 2.1 time: 0.659459 Jul 24 01:21:04.025793 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1281/2689] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:03 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1429 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:05.032072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:05.033315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:05.071490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:05.072085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:05.073191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:05.080672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:05.700675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:05.718865 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e5206eb-b2f8-4f53-86f2-6adde0ddceb9 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1429 microversion: 2.1 time: 0.688118 Jul 24 01:21:05.720202 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1282/2690] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:05 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1429 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:05.848749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-df788251-7a65-40bc-adb0-49cd67ea32b3 req-403cc22e-ab85-40f9-a151-39005d5495bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98477c05-8901-4a3a-b18f-6a5923ce55be", "name": "network-vif-deleted", "tag": "163c75d2-aa99-4bba-9669-3f08ef39dfc7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:05.874030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-df788251-7a65-40bc-adb0-49cd67ea32b3 req-403cc22e-ab85-40f9-a151-39005d5495bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:05.874838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-df788251-7a65-40bc-adb0-49cd67ea32b3 req-403cc22e-ab85-40f9-a151-39005d5495bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:05.939420 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-df788251-7a65-40bc-adb0-49cd67ea32b3 req-403cc22e-ab85-40f9-a151-39005d5495bc service nova] Creating event network-vif-deleted:163c75d2-aa99-4bba-9669-3f08ef39dfc7 for instance 98477c05-8901-4a3a-b18f-6a5923ce55be on n-h1-master-1 Jul 24 01:21:05.957009 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-df788251-7a65-40bc-adb0-49cd67ea32b3 req-403cc22e-ab85-40f9-a151-39005d5495bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112757 Jul 24 01:21:05.967543 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1283/2691] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:21:06.047490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:06.052799 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:06.080445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:06.084285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:06.090055 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88c92c3b-b1ed-4d49-99bf-a17b59696e91 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 2.662749 Jul 24 01:21:06.114080 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1409/2692] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:03 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 2688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:06.740453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:06.741216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:06.785871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:06.787415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:06.797466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:06.798495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:06.995579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:06.996035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:06.996499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lazy-loading 'fault' on Instance uuid 98477c05-8901-4a3a-b18f-6a5923ce55be {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:21:07.119829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:07.123802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:07.164003 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:07.170716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:07.172015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:07.173353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:07.287411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033c900a87241779c10097a9c494e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cb5ce8c4354541b492eb8cc8f89c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:07.300935 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b2a0ea28-0d41-4aac-b588-d3aff387c354 tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 200 len: 1306 microversion: 2.1 time: 0.566611 Jul 24 01:21:07.306692 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1284/2693] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:06 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 1306 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:07.815385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:07.835211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:07.851178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:07.859291 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a58f313-7fbd-4b1a-a1ae-5f8e3291ffac tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.744063 Jul 24 01:21:07.862029 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1410/2694] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:07 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:08.324239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:08.324924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] [instance: 98477c05-8901-4a3a-b18f-6a5923ce55be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:08.340902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:08.351180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:08.355042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:08.355510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:08.401532 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] HTTP exception thrown: Instance 98477c05-8901-4a3a-b18f-6a5923ce55be could not be found. Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Request method failure captured: Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be HTTP/1.1 Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J2cn5eixjJcGFp-HXbpYiX9i7iwAmJ1RCdLEbgoAAPIeD48s8zH4RXnEyC2lFNjXpmRljWkcGsjxwdNL2KNkLQ7wTxDmheITb0L5cAUNkE84M0LU6PEcgOI4-PLtFfSF_30bvkl5raWOfaelCfQB_ul4xDKMYOTh4C0vZcYmQ6VPbg Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cb5ce8c4354541b492eb8cc8f89c3b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cb5ce8c4354541b492eb8cc8f89c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 08cb5ce8c4354541b492eb8cc8f89c3b Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1113482198 Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 7033c900a87241779c10097a9c494e7b Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersOnMultiNodesTest-1113482198-project Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 98477c05-8901-4a3a-b18f-6a5923ce55be could not be found. Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '98477c05-8901-4a3a-b18f-6a5923ce55be'} Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98477c05-8901-4a3a-b18f-6a5923ce55be could not be found. Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98477c05-8901-4a3a-b18f-6a5923ce55be could not be found. Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:21:08.403915 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:08.407918 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:08.407918 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:21:08.407918 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:21:08.407918 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:21:08.407918 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:21:08.407918 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98477c05-8901-4a3a-b18f-6a5923ce55be could not be found. Jul 24 01:21:08.407918 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:08.415723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] Returning 404 to user: Instance 98477c05-8901-4a3a-b18f-6a5923ce55be could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:21:08.417495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a340ee62-0559-46f1-bdc4-71e19c2297ff tempest-ServersOnMultiNodesTest-1113482198 tempest-ServersOnMultiNodesTest-1113482198-project] 10.222.0.27 "GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be" status: 404 len: 111 microversion: 2.1 time: 0.097793 Jul 24 01:21:08.418624 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1285/2695] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:08 2022] GET /compute/v2.1/servers/98477c05-8901-4a3a-b18f-6a5923ce55be => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:21:08.879032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:08.879975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:08.901120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:08.909022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:08.910433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:08.910904 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:09.451809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1268777380", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e34802f7-fdd1-4e80-a47c-86bd2e961523"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:09.566997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] validate_networks() for [('e34802f7-fdd1-4e80-a47c-86bd2e961523', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:21:10.665179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:10.679184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:10.683890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:10.685498 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1a47207e-4e14-46ed-862b-f37c7b80c6e2 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 1.811791 Jul 24 01:21:10.686685 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1286/2696] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:08 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:11.704938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:11.705567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:11.729097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:11.729940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:11.733292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:11.733785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:14.221042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:21:14.222825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:21:14.223601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:21:14.224033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:21:14.225553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:21:14.247535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:14.250223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:14.253584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:14.260879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:14.335720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Getting quotas for project a0fe7868ac524f4498b1dadc33efae7b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:21:14.383779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Getting quotas for user 59d8758357384418aeca2b24f1e8bd12 and project a0fe7868ac524f4498b1dadc33efae7b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:21:14.443452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Going to run 3 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:21:14.452013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:21:14.656518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=cea0cfe2-d5df-4e92-ac00-6f64011e8b0e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:21:14.789078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=60483b9c-5e82-4da2-a0f3-a851c1007a7f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:21:14.837171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:14.851137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:14.855732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:14.861760 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ba38078-23f6-46d4-8c6d-1824472d27bd tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 3.161386 Jul 24 01:21:14.874189 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1287/2697] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:11 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 3173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:15.009719 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [22a8e29a-6f87-43f1-a848-a48f068275f2] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 01:21:15.506461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-45751045", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "5d0a3bd0-ba69-4c35-8efe-1bce89b31b8c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:15.533837 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.617518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] validate_networks() for [('5d0a3bd0-ba69-4c35-8efe-1bce89b31b8c', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:21:16.023359 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [22a8e29a-6f87-43f1-a848-a48f068275f2] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42152. Jul 24 01:21:16.076108 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ec80e44-6ed7-4119-99b2-c7c4a30efa08 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.390481 Jul 24 01:21:16.082717 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1411/2698] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:21:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 7411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:21:16.104030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:16.115693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:16.163109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:16.163575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:16.177228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:16.180637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.542465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.560444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.565014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.568698 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-26aebca6-7ca8-47a0-9118-77cb1a32d383 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 1.482631 Jul 24 01:21:17.570189 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1412/2699] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:16 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:17.584777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:17.599465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:17.602980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:21:17.679825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:17.680851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.683261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:17.686084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.746019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Listed batch of 1 results from cell out of 997 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:21:17.822402 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a0bb7a6-7f53-4a35-bfe5-d916f38a89fe tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.249643 Jul 24 01:21:17.826713 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1413/2700] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:21:17 2022] GET /compute/v2.1/servers => generated 1018 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:17.840430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9a89019e-4c5c-432a-aaae-c56afad170c4 req-e91acc2c-196d-49fa-b438-8c271a8b34bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8dfe4b-e495-4584-8cd0-c145836e91cd", "name": "network-vif-unplugged", "status": "completed", "tag": "48eb2f36-64bc-4409-b71f-33a2f59d753f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:17.865789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9a89019e-4c5c-432a-aaae-c56afad170c4 req-e91acc2c-196d-49fa-b438-8c271a8b34bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:17.867525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9a89019e-4c5c-432a-aaae-c56afad170c4 req-e91acc2c-196d-49fa-b438-8c271a8b34bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:17.912065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9a89019e-4c5c-432a-aaae-c56afad170c4 req-e91acc2c-196d-49fa-b438-8c271a8b34bf service nova] Creating event network-vif-unplugged:48eb2f36-64bc-4409-b71f-33a2f59d753f for instance ef8dfe4b-e495-4584-8cd0-c145836e91cd on n-h1-master-1 Jul 24 01:21:17.928390 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9a89019e-4c5c-432a-aaae-c56afad170c4 req-e91acc2c-196d-49fa-b438-8c271a8b34bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100127 Jul 24 01:21:17.931334 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1414/2701] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:18.491921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf4f5a32-5671-4322-a03c-010ba126f369 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:18.493764 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:21:18.493764 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:21:18.496351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4f5a32-5671-4322-a03c-010ba126f369 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.496943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4f5a32-5671-4322-a03c-010ba126f369 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:18.497614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4f5a32-5671-4322-a03c-010ba126f369 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.498927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4f5a32-5671-4322-a03c-010ba126f369 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:18.649722 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf4f5a32-5671-4322-a03c-010ba126f369 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.716940 Jul 24 01:21:18.650387 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1415/2702] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:21:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:18.672732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:18.673486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:18.702939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.708129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:18.712105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.712767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:18.752144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:21:18.754252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:21:18.754799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:21:18.755208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:21:18.755649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:21:18.797323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.797882 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:18.802897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:18.803815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:18.902925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Getting quotas for project e19e03d9bbe8415198317f7c2c001ac3. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:21:18.921162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Getting quotas for user e19b156b5c8f4f30af95d21c57091ec5 and project e19e03d9bbe8415198317f7c2c001ac3. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:21:18.977751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:21:18.994409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:21:19.102407 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-871edd21-086d-43e3-854c-d13094371f35 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.226302 Jul 24 01:21:19.103200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1288/2703] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:21:19.110538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:19.111041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:19.120822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.121215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.122106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.122720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.174229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:19.193486 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b9ebd6b-b9f9-44e3-b033-b15972ac625e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1227 microversion: 2.1 time: 0.529933 Jul 24 01:21:19.199545 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1416/2704] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:18 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1227 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:19.235362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4479aba5-2c44-43c2-ab1d-bd22f5ad573b tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:19.240740 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:21:19.240740 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:21:19.244974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4479aba5-2c44-43c2-ab1d-bd22f5ad573b tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.245503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4479aba5-2c44-43c2-ab1d-bd22f5ad573b tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.246435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4479aba5-2c44-43c2-ab1d-bd22f5ad573b tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.249815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4479aba5-2c44-43c2-ab1d-bd22f5ad573b tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.340954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4479aba5-2c44-43c2-ab1d-bd22f5ad573b tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.139974 Jul 24 01:21:19.342273 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1417/2705] 10.222.0.27 () {58 vars in 1171 bytes} [Sun Jul 24 01:21:19 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:19.356638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a6f24ca-d4de-4512-a1b3-eff5456311d8 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:19.358597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a6f24ca-d4de-4512-a1b3-eff5456311d8 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:19.717465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a6f24ca-d4de-4512-a1b3-eff5456311d8 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:19.732934 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a6f24ca-d4de-4512-a1b3-eff5456311d8 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1215 microversion: 2.1 time: 0.388464 Jul 24 01:21:19.733840 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1418/2706] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:19 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:19.757994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9357ceca-f61c-4002-8067-f277d0351d8e tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:19.768072 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:21:19.768072 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:21:19.770820 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9357ceca-f61c-4002-8067-f277d0351d8e tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.771290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9357ceca-f61c-4002-8067-f277d0351d8e tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.772128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9357ceca-f61c-4002-8067-f277d0351d8e tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.772575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9357ceca-f61c-4002-8067-f277d0351d8e tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.845816 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9357ceca-f61c-4002-8067-f277d0351d8e tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097593 Jul 24 01:21:19.857337 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1419/2707] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:21:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:19.866703 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-28fdc8d5-b05d-4b71-a63a-9364572d2bf6 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:19.875329 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:21:19.875329 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:21:19.876924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28fdc8d5-b05d-4b71-a63a-9364572d2bf6 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.881095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28fdc8d5-b05d-4b71-a63a-9364572d2bf6 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.882538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28fdc8d5-b05d-4b71-a63a-9364572d2bf6 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:19.883267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28fdc8d5-b05d-4b71-a63a-9364572d2bf6 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:19.969767 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-28fdc8d5-b05d-4b71-a63a-9364572d2bf6 tempest-ServicesAdminTestJSON-1651348340 tempest-ServicesAdminTestJSON-1651348340-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.110999 Jul 24 01:21:19.974831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1420/2708] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:21:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:19.998844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b0db6c0e-e747-4f1b-994f-b54bbbca475f req-8c7bd191-3e4e-42b4-9d20-13ed991a5be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8dfe4b-e495-4584-8cd0-c145836e91cd", "tag": "48eb2f36-64bc-4409-b71f-33a2f59d753f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:20.041217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b0db6c0e-e747-4f1b-994f-b54bbbca475f req-8c7bd191-3e4e-42b4-9d20-13ed991a5be0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:20.046329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b0db6c0e-e747-4f1b-994f-b54bbbca475f req-8c7bd191-3e4e-42b4-9d20-13ed991a5be0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:20.079948 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b0db6c0e-e747-4f1b-994f-b54bbbca475f req-8c7bd191-3e4e-42b4-9d20-13ed991a5be0 service nova] Creating event network-changed:48eb2f36-64bc-4409-b71f-33a2f59d753f for instance ef8dfe4b-e495-4584-8cd0-c145836e91cd on n-h1-master-1 Jul 24 01:21:20.116651 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b0db6c0e-e747-4f1b-994f-b54bbbca475f req-8c7bd191-3e4e-42b4-9d20-13ed991a5be0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137487 Jul 24 01:21:20.139222 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1421/2709] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:20.222010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:20.224371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:20.256480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:20.260020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:20.263915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:20.267571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:21.683918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:21.698582 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-410df531-84d3-41c3-adc8-7c0c79af0dcb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1219 microversion: 2.1 time: 1.480322 Jul 24 01:21:21.711909 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1422/2710] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:20 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1219 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:21.725756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:21.726847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:21.755615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:21.756158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:21.757109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:21.757766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:21.965132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:21.979826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:21.981319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:21.992706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ba67bbd-24f0-4506-9cd7-5322d15efb4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 2.887949 Jul 24 01:21:21.997456 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1289/2711] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:19 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 2894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:22.397263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:22.410969 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31867757-1427-427b-9f8d-077bc95e1239 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1267 microversion: 2.1 time: 0.697338 Jul 24 01:21:22.411909 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1423/2712] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:21 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1267 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:22.629803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] Calling method '.version_select at 0x7f05eb133310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:22.631373 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:21:22.631373 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:21:22.633292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:22.634055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:22.707263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:22.709629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:22.720804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:22.722860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:22.735296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:22.736127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:22.737922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:22.738636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:22.765257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:22.765817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:22.786009 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:22.787983 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-604eb6db-c397-49fd-986d-6e77e2be61fa tempest-PortsAdminExtendedAttrsTestJSON-240008102 tempest-PortsAdminExtendedAttrsTestJSON-240008102-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.788498 Jul 24 01:21:22.801609 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1290/2713] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:21:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:23.017185 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:23.017965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:23.037901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:23.038687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:23.039193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:23.039649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:23.363936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:23.381395 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f881cf1-17c2-401d-9011-cab987615e8a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1281 microversion: 2.1 time: 0.659596 Jul 24 01:21:23.382288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1424/2714] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:22 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1281 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:23.439212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:23.439212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:23.455208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:23.456382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:23.457383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:23.457907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:24.379271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:24.402899 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e28c35a-c89c-453f-b2aa-cba0a4f78e85 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1273 microversion: 2.1 time: 0.959898 Jul 24 01:21:24.405994 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1425/2715] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:23 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1273 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:24.427778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:24.432650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:24.452256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:24.457796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:24.461177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:24.461734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:24.733276 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:24.743613 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4ac1a8e6-ea5a-4536-8562-03a814a851a1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1281 microversion: 2.1 time: 0.334071 Jul 24 01:21:24.750683 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1426/2716] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:24 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1281 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:24.925936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:24.938280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:24.952019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:24.953693 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7701ef55-095c-4e23-a4af-55dfb3109093 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 1.941275 Jul 24 01:21:24.954889 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1291/2717] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:23 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:25.047063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-75123945", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "14dab60c-8e5d-4fef-81c9-bb4db0eb258e"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:25.152750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] validate_networks() for [('14dab60c-8e5d-4fef-81c9-bb4db0eb258e', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:21:25.421700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:25.422485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:25.432671 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:25.433146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:25.443102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:25.443817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:26.195576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:26.208109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6b244b22-5d03-4ce8-b82f-3837e188a836 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1273 microversion: 2.1 time: 0.790814 Jul 24 01:21:26.216493 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1292/2718] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:25 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1273 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:26.235757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:26.241268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:26.253575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:26.259409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:26.260744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:26.262888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:26.633375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:26.651559 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2fd21df7-cd7b-498e-9302-0bc7d7ca689b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1281 microversion: 2.1 time: 0.430867 Jul 24 01:21:26.667121 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1293/2719] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:26 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1281 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:26.684202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:26.685099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:26.702653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:26.703417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:26.708337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:26.709220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:27.780775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:27.803421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:27.814397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:27.819337 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9cb0cd5-e51d-4999-98de-44ae4b5d7c5c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 1.148444 Jul 24 01:21:27.820042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1294/2720] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:26 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:27.830507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ac6c701d-32c4-42c8-80ff-1dfcf32dc0b0 req-cbfa1661-d325-4120-b4d8-fa1a77eb6126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8dfe4b-e495-4584-8cd0-c145836e91cd", "name": "network-vif-unplugged", "status": "completed", "tag": "48eb2f36-64bc-4409-b71f-33a2f59d753f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:27.866911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ac6c701d-32c4-42c8-80ff-1dfcf32dc0b0 req-cbfa1661-d325-4120-b4d8-fa1a77eb6126 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:27.867828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ac6c701d-32c4-42c8-80ff-1dfcf32dc0b0 req-cbfa1661-d325-4120-b4d8-fa1a77eb6126 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:27.890185 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ac6c701d-32c4-42c8-80ff-1dfcf32dc0b0 req-cbfa1661-d325-4120-b4d8-fa1a77eb6126 service nova] Creating event network-vif-unplugged:48eb2f36-64bc-4409-b71f-33a2f59d753f for instance ef8dfe4b-e495-4584-8cd0-c145836e91cd on n-h1-master-1 Jul 24 01:21:27.907936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ac6c701d-32c4-42c8-80ff-1dfcf32dc0b0 req-cbfa1661-d325-4120-b4d8-fa1a77eb6126 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085099 Jul 24 01:21:27.913963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1295/2721] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:27.946712 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:27.955508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:27.986010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:27.988009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:27.989384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:27.992897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:28.621501 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:21:28.622045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:21:28.622444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:21:28.622864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:21:28.629953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:21:28.669384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:28.671756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:28.674084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:28.675244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:28.737427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Getting quotas for project dfd38af4d6e2417b9b73b03ee795328f. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:21:28.754500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Getting quotas for user 5a34b91b8c3d4fe3a42e0ceffa767726 and project dfd38af4d6e2417b9b73b03ee795328f. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:21:28.782628 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Going to run 2 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:21:28.787496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: a0fd2d54-e205-4d81-a201-b680dcc54d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:21:28.859937 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:28.866396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=a0fd2d54-e205-4d81-a201-b680dcc54d1e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:21:28.954241 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:28.965567 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a258bcef-6059-4bf0-94e5-e878eef368c6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.213328 Jul 24 01:21:28.967125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1427/2722] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:21:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 4216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:21:29.005880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:29.007779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:29.046497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:29.051797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:29.054167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:29.054744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:29.232629 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:29.261471 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-35ca8857-ecc0-4d87-b5a3-62f907983716 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 1.336517 Jul 24 01:21:29.262340 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1296/2723] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:27 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:29.282422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:29.302008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:29.321251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:29.323240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:29.325454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:29.327998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:30.187807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:30.208931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:30.212146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:30.215955 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d2beb79-af8a-42cc-8271-40804fbb02ed tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.946835 Jul 24 01:21:30.245584 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1297/2724] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:29 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:30.290283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:30.294141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:30.295776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Searching by: {'deleted': False, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:21:30.333635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:30.335680 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:30.337005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:30.341154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:30.382037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:21:30.425845 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ddf8cb7-30d4-4c2b-9bc6-2e24976e457b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.156492 Jul 24 01:21:30.432198 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1298/2725] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:21:30 2022] GET /compute/v2.1/servers => generated 673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:30.584713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:30.597517 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69005dad-caba-452c-add4-9185d6ab669b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 1.628245 Jul 24 01:21:30.607659 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1428/2726] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:28 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:30.607659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:30.608197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:30.614752 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=15 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:30.632424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:30.632882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:30.635601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:30.636076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:30.697619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-638112153", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:30.820701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] validate_networks() for [('0e557ce4-7ca3-450c-bdac-fc87df3a754c', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:21:32.721247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:32.732172 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a73e35c-5574-4d82-b7e5-32324507bce7 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 2.130358 Jul 24 01:21:32.732765 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1429/2727] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:30 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:32.750107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:32.750988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:32.765831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:32.769920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:32.771214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:32.771847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:33.500140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:33.512039 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6edd92c4-bcf9-47d8-afc8-d4fa8226c6a6 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1276 microversion: 2.1 time: 0.776085 Jul 24 01:21:33.515673 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1430/2728] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:32 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1276 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:33.528840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3250a71d-0b89-4902-8096-5ae6a81eeedc req-0f49a325-4adf-45d6-92ed-3d749de89f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea0cfe2-d5df-4e92-ac00-6f64011e8b0e", "tag": "6d73d4f9-b30e-48fd-95db-4799e60f7e50"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:33.560471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3250a71d-0b89-4902-8096-5ae6a81eeedc req-0f49a325-4adf-45d6-92ed-3d749de89f4e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:33.561209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3250a71d-0b89-4902-8096-5ae6a81eeedc req-0f49a325-4adf-45d6-92ed-3d749de89f4e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:33.584256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3250a71d-0b89-4902-8096-5ae6a81eeedc req-0f49a325-4adf-45d6-92ed-3d749de89f4e service nova] Creating event network-changed:6d73d4f9-b30e-48fd-95db-4799e60f7e50 for instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e on n-h2-master-1 Jul 24 01:21:33.594391 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3250a71d-0b89-4902-8096-5ae6a81eeedc req-0f49a325-4adf-45d6-92ed-3d749de89f4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077396 Jul 24 01:21:33.595656 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1431/2729] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:33.603930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:33.605980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:33.646071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:33.646594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:33.647410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:33.647870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.301578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:34.316221 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:34.317940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:34.319167 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68e4f9ec-2f63-4ce7-91ac-e76e241e8c80 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.721795 Jul 24 01:21:34.319757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1432/2730] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:33 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:34.335974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:34.342435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:34.358038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.364981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.369783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.370575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.375690 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:34.523177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:21:34.523682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:21:34.524374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:21:34.526254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:21:34.526254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:21:34.547996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.548366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.552463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.553219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.607581 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Getting quotas for project 6b725b9f1812465f8a350e1a68e067a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:21:34.626599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Getting quotas for user 1dda9fc0670f4e11ad4d8089bf1687c3 and project 6b725b9f1812465f8a350e1a68e067a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:21:34.646938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:21:34.649801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:21:34.759980 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b8ceec2-6de3-48dc-bbf6-b5f377ebdcbd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.326312 Jul 24 01:21:34.760971 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1299/2731] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:21:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:21:34.773306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:34.774811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:34.792489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.793154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.803338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.804166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.890944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:34.926005 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6559346-e5b2-4a32-9a02-194f4313e294 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.592832 Jul 24 01:21:34.939506 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1433/2732] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:34 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:34.960975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:34.961724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:34.978750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.983323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:34.987493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:34.988391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:35.422634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:35.439200 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d96d9bd-1376-4232-9b63-296337d53086 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1276 microversion: 2.1 time: 0.494490 Jul 24 01:21:35.448338 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1434/2733] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:34 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1276 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:35.463418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-dc469f60-8269-48f7-9545-dae545a54fec req-a0bc532d-8c8c-4705-a71d-89339c453ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60483b9c-5e82-4da2-a0f3-a851c1007a7f", "tag": "c9f52d4e-682d-4b4d-9b32-cb149bbcd934"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:35.481470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dc469f60-8269-48f7-9545-dae545a54fec req-a0bc532d-8c8c-4705-a71d-89339c453ad1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:35.482709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dc469f60-8269-48f7-9545-dae545a54fec req-a0bc532d-8c8c-4705-a71d-89339c453ad1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:35.504839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-dc469f60-8269-48f7-9545-dae545a54fec req-a0bc532d-8c8c-4705-a71d-89339c453ad1 service nova] Creating event network-changed:c9f52d4e-682d-4b4d-9b32-cb149bbcd934 for instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f on n-h1-master-1 Jul 24 01:21:35.513369 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-dc469f60-8269-48f7-9545-dae545a54fec req-a0bc532d-8c8c-4705-a71d-89339c453ad1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062288 Jul 24 01:21:35.514680 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1435/2734] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:35.523115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87110f39-e809-43bd-a02a-997e004e83f0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:35.525322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87110f39-e809-43bd-a02a-997e004e83f0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:36.073098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87110f39-e809-43bd-a02a-997e004e83f0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:36.088915 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87110f39-e809-43bd-a02a-997e004e83f0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1213 microversion: 2.1 time: 0.565835 Jul 24 01:21:36.090904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1436/2735] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:35 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1213 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:36.106380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:36.107321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:36.124212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:36.140644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:36.144592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:36.153331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:36.180699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:36.194222 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11dacd4a-8751-40ef-a8e6-f470cb74b157 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 1.431341 Jul 24 01:21:36.196261 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1300/2736] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:34 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:36.215065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-80dc10a8-2e50-426d-ac06-268d5fdeed7d req-6e56353a-d340-4c41-bba9-240d8c699780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f881ec-70c2-4065-86be-8f9723814487", "tag": "f62ac16b-5573-4158-9804-4338746e802e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:36.247582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-80dc10a8-2e50-426d-ac06-268d5fdeed7d req-6e56353a-d340-4c41-bba9-240d8c699780 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:36.248032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-80dc10a8-2e50-426d-ac06-268d5fdeed7d req-6e56353a-d340-4c41-bba9-240d8c699780 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:36.275086 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-80dc10a8-2e50-426d-ac06-268d5fdeed7d req-6e56353a-d340-4c41-bba9-240d8c699780 service nova] Creating event network-changed:f62ac16b-5573-4158-9804-4338746e802e for instance 74f881ec-70c2-4065-86be-8f9723814487 on n-h2-master-1 Jul 24 01:21:36.291739 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-80dc10a8-2e50-426d-ac06-268d5fdeed7d req-6e56353a-d340-4c41-bba9-240d8c699780 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094362 Jul 24 01:21:36.292789 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1301/2737] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:36.298221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:36.299556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:36.312885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:36.313413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:36.314619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:36.315243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:36.603414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:36.621018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:36.626443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:36.629747 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-549a184b-f6a2-4e74-b082-4a44433eb4be tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.535284 Jul 24 01:21:36.633437 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1437/2738] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:36 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:36.650173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:36.651185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:36.671083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:36.671645 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:36.672543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:36.673202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:36.709442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:36.743496 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac04fe90-ece7-48d1-92d8-1901855c36eb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.443799 Jul 24 01:21:36.759671 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1302/2739] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:36 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:37.090356 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:37.101856 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-234f3aa1-b964-495e-9289-3378966d7d6e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.466736 Jul 24 01:21:37.105551 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1438/2740] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:36 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:37.114595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:37.117145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:37.131448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.134155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.135351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.136823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.215173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:37.216187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:37.225817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.226632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.227692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.228430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.302651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:37.316912 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8c42723-414d-488c-a21a-34b0fc5c59a9 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1271 microversion: 2.1 time: 0.212811 Jul 24 01:21:37.317527 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1303/2741] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:37 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:37.594660 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-3141aa9c-64fc-4702-b3b5-ef6185ff1631 req-cdede0c7-f879-45d0-841f-1d39d8b67c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa264a8-83c1-46dc-8de6-bf64dcede9a7", "tag": "325ed0c2-03a5-4623-a64b-82a805a46deb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:37.629883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3141aa9c-64fc-4702-b3b5-ef6185ff1631 req-cdede0c7-f879-45d0-841f-1d39d8b67c5b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.648850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3141aa9c-64fc-4702-b3b5-ef6185ff1631 req-cdede0c7-f879-45d0-841f-1d39d8b67c5b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.697711 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-3141aa9c-64fc-4702-b3b5-ef6185ff1631 req-cdede0c7-f879-45d0-841f-1d39d8b67c5b service nova] Creating event network-changed:325ed0c2-03a5-4623-a64b-82a805a46deb for instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 on n-h2-master-1 Jul 24 01:21:37.717051 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-3141aa9c-64fc-4702-b3b5-ef6185ff1631 req-cdede0c7-f879-45d0-841f-1d39d8b67c5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127119 Jul 24 01:21:37.717572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:37.718669 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1304/2742] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:37.733266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:37.734516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:37.754269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eb28f02c-5bb4-4698-9b66-4a61bfd9cb48 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 0.543953 Jul 24 01:21:37.766478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.767512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.769998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.770875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.778272 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1439/2743] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:37 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:37.804397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:37.805036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:37.828486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.828982 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:37.829845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:37.830358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:38.214315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:38.224292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8d60f62-21bb-4962-a7f3-1902cbda8ac1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.444610 Jul 24 01:21:38.233073 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1440/2744] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:37 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:38.243109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:38.247188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:38.248074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:38.254810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:38.256449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:38.265339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-276d6ec2-b1dc-4ea8-bb7d-80f8b4c23b42 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.537571 Jul 24 01:21:38.267075 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:38.268359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:38.277291 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1305/2745] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:37 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:38.278741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:38.279405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:38.334960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:38.336189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:38.346647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:38.347344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:38.348324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:38.348922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:38.503938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:38.520535 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a92a0d0f-b453-4367-98b6-0c37412aa9c6 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1271 microversion: 2.1 time: 0.190298 Jul 24 01:21:38.521551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1306/2746] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:38 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:38.672937 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:38.687890 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31c83941-bc2b-4359-8643-d15af95a8b28 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.449684 Jul 24 01:21:38.688606 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1441/2747] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:38 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:38.774278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:38.775051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:38.793496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:38.795823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:38.800329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:38.801860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.116277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:39.129333 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42fb55fb-a46b-4bcb-86d8-1bda29d61d05 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 0.360863 Jul 24 01:21:39.140455 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1307/2748] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:38 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:39.247632 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:39.259322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:39.260177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:39.268486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.269588 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.270877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.271740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.287284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:39.288221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:39.304294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.305144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.308146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.309375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.601550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:39.610160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-462b883c-b240-4853-9def-73368de2259b tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.363799 Jul 24 01:21:39.614649 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1442/2749] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:39 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:39.633982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:39.635358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:39.651618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.652086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.652885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.653333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.718950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:39.740942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:39.748517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:39.773354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da745e36-644a-4c41-aac3-610ed250d712 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.487448 Jul 24 01:21:39.777792 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1308/2750] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:39 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:39.789944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:39.790399 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:39.791853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:39.806152 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8f04252-1a72-4749-b427-47e7464c10a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1271 microversion: 2.1 time: 0.182726 Jul 24 01:21:39.806754 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1443/2751] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:39 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:39.811880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.812628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:39.813626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:39.814274 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.112481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:40.119038 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:40.131630 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-081c86af-d851-417a-83ac-cb3148dcd2cb tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.350401 Jul 24 01:21:40.132497 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1309/2752] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:39 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:40.150910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:40.151882 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:40.159440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.160175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.161198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.161838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.287081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-badffb75-556d-44dc-afb8-8f7a8fd77f49 req-7e98cd67-66de-4a0d-b942-0be8246f2b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60483b9c-5e82-4da2-a0f3-a851c1007a7f", "name": "network-vif-plugged", "status": "completed", "tag": "c9f52d4e-682d-4b4d-9b32-cb149bbcd934"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:40.314264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-badffb75-556d-44dc-afb8-8f7a8fd77f49 req-7e98cd67-66de-4a0d-b942-0be8246f2b9b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.319560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-badffb75-556d-44dc-afb8-8f7a8fd77f49 req-7e98cd67-66de-4a0d-b942-0be8246f2b9b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.349616 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-badffb75-556d-44dc-afb8-8f7a8fd77f49 req-7e98cd67-66de-4a0d-b942-0be8246f2b9b service nova] Creating event network-vif-plugged:c9f52d4e-682d-4b4d-9b32-cb149bbcd934 for instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f on n-h1-master-1 Jul 24 01:21:40.360679 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-badffb75-556d-44dc-afb8-8f7a8fd77f49 req-7e98cd67-66de-4a0d-b942-0be8246f2b9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079858 Jul 24 01:21:40.364161 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1310/2753] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:21:40.590274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:40.599453 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6f68d85c-e2c5-41d0-b037-460f9dbac2b1 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 0.452852 Jul 24 01:21:40.602776 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1444/2754] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:40 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:40.635736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:40.637078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:40.648593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.649463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.650633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.651404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.795414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:40.796040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:40.804334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.805301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.806593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.807260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.963721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:40.973616 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2201cb1e-e889-48e7-b7a2-3b58b93ef7ae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.345892 Jul 24 01:21:40.975798 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1311/2755] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:40 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:40.982085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:40.982970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:40.991491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.994157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:40.995143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:40.996756 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:41.020858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:41.029869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:41.032559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:41.034344 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd2ff060-6587-45b4-b305-81edd99bb3c4 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1487 microversion: 2.25 time: 0.243261 Jul 24 01:21:41.035367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1445/2756] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:40 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1487 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:41.079746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:41.098001 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dcf85673-8a63-4163-80ea-291331f00217 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1271 microversion: 2.1 time: 0.120863 Jul 24 01:21:41.099264 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1312/2757] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:40 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:41.149067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:41.150009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:41.158978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:41.160047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:41.161003 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:41.161636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:41.344435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:41.367090 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e7315d35-9bce-49b4-b5a6-4c19d7d40fd5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.221793 Jul 24 01:21:41.367694 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1446/2758] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:41 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:41.626526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:41.633654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:41.642214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:41.644019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:41.645592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:41.646390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:41.900922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:41.912838 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6418ecac-a560-4ae1-b602-fc17a84ff546 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 0.297087 Jul 24 01:21:41.914646 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1313/2759] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:41 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:41.992351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:41.993883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:42.000926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.001705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:42.003656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.004274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:42.054981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:42.057199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:42.066779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.067864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:42.068876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.069817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:42.737325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:42.740677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:42.749586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:42.751184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:42.753149 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08e5512b-9a66-4fc9-bddb-7e18bb20b864 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1477 microversion: 2.25 time: 0.703500 Jul 24 01:21:42.766041 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1314/2760] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:42 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1477 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:42.770127 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5745c66a-8313-4d92-8c7d-7090b77b9428 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.781515 Jul 24 01:21:42.779130 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1447/2761] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:41 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:42.780373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:42.781852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:42.787310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:42.788952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:42.789404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.790104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:42.791065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.791675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:42.810684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.811470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:42.812400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:42.815307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.100792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:43.108899 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8aaa1d95-1b1a-4b07-83fc-07673607034c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.341381 Jul 24 01:21:43.118020 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1315/2762] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:42 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:43.151688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d0508ca6-5e29-4afb-bfbf-b1b77ac17d61 req-c2e8e112-cf23-41f5-8d26-dab0029f4e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea0cfe2-d5df-4e92-ac00-6f64011e8b0e", "name": "network-vif-plugged", "status": "completed", "tag": "6d73d4f9-b30e-48fd-95db-4799e60f7e50"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:43.171911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:43.179540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d0508ca6-5e29-4afb-bfbf-b1b77ac17d61 req-c2e8e112-cf23-41f5-8d26-dab0029f4e24 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.181853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d0508ca6-5e29-4afb-bfbf-b1b77ac17d61 req-c2e8e112-cf23-41f5-8d26-dab0029f4e24 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.183331 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e61c8251-3ba9-471f-a64b-f4332e94ad35 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.409120 Jul 24 01:21:43.186182 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1448/2763] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:42 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:43.193013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ec2c7569-3d2e-4254-988d-e05e8a9eb5e6 req-9d1301fa-a515-464d-825c-15282749d6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdfe158e-15a5-4227-aba3-c039b49e30ea", "tag": "fd9495d6-86c7-402f-967e-b718a6ef43ec"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:43.225449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ec2c7569-3d2e-4254-988d-e05e8a9eb5e6 req-9d1301fa-a515-464d-825c-15282749d6c3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.226974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ec2c7569-3d2e-4254-988d-e05e8a9eb5e6 req-9d1301fa-a515-464d-825c-15282749d6c3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.235732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d0508ca6-5e29-4afb-bfbf-b1b77ac17d61 req-c2e8e112-cf23-41f5-8d26-dab0029f4e24 service nova] Creating event network-vif-plugged:6d73d4f9-b30e-48fd-95db-4799e60f7e50 for instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e on n-h2-master-1 Jul 24 01:21:43.250261 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ec2c7569-3d2e-4254-988d-e05e8a9eb5e6 req-9d1301fa-a515-464d-825c-15282749d6c3 service nova] Creating event network-changed:fd9495d6-86c7-402f-967e-b718a6ef43ec for instance bdfe158e-15a5-4227-aba3-c039b49e30ea on n-h1-master-1 Jul 24 01:21:43.254847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d0508ca6-5e29-4afb-bfbf-b1b77ac17d61 req-c2e8e112-cf23-41f5-8d26-dab0029f4e24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130824 Jul 24 01:21:43.259266 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ec2c7569-3d2e-4254-988d-e05e8a9eb5e6 req-9d1301fa-a515-464d-825c-15282749d6c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068827 Jul 24 01:21:43.259456 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1316/2764] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:43.261546 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1449/2765] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:43.278425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75507d47-b6b2-45a9-af43-cb63917f1a13 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '.version_select at 0x7f05eadcf4c0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:43.286775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:43.287610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75507d47-b6b2-45a9-af43-cb63917f1a13 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.288079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75507d47-b6b2-45a9-af43-cb63917f1a13 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.288357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:43.309753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.310455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.318420 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75507d47-b6b2-45a9-af43-cb63917f1a13 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.055460 Jul 24 01:21:43.322461 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1317/2766] 10.222.0.27 () {60 vars in 1183 bytes} [Sun Jul 24 01:21:43 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:43.342558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.345373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.346768 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:43.347915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:43.355660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.356418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.357443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.357967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.694789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] Lazy-loading 'services' on Instance uuid ef8dfe4b-e495-4584-8cd0-c145836e91cd {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:21:43.732559 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3615b2dc-8edf-4561-9d14-45d95a2362d8 tempest-LiveAutoBlockMigrationV225Test-917544469 tempest-LiveAutoBlockMigrationV225Test-917544469-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1970 microversion: 2.25 time: 0.391649 Jul 24 01:21:43.744370 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1318/2767] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:43 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1970 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:43.772593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:43.773116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:43.780835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.781875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.782889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.788675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.822474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:21:43.952656 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d0f2827-0f5a-4d42-8581-a422c0ff5caa tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 204 len: 0 microversion: 2.25 time: 0.186843 Jul 24 01:21:43.953320 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1319/2768] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:21:43 2022] DELETE /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:21:43.968224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:43.973272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:43.988086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.993089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:43.994256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:43.994888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:44.001198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:44.020381 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-700bde49-41a9-40a1-a9b0-e2a53dadfd9b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 0.757014 Jul 24 01:21:44.029960 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1450/2769] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:43 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:44.035660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:44.036277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:44.052027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:44.052562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:44.053547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:44.054105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:44.421937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:44.432756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fcad362f-6a0e-4ee6-8fda-fa2c20164c71 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.474548 Jul 24 01:21:44.453400 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1320/2770] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:43 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:44.458457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:44.459094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:44.462234 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:44.475485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:44.475949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:44.476760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:44.477393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:44.495186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:44.507045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:44.510644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:44.516552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20faa709-692e-4229-82d3-02626e703a5e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1483 microversion: 2.25 time: 0.485322 Jul 24 01:21:44.517555 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1451/2771] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:44 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1483 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:44.525057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:44.534218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:44.552324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:44.553286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:44.554303 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:44.556001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:44.568601 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:44.589751 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:44.639760 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:44.936348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:44.960451 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-827007eb-dbe7-49b6-a80d-cd8d6ea7b8ed tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.505803 Jul 24 01:21:44.961071 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1321/2772] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:44 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:45.007033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:45.021717 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f79e1e4a-037f-437f-98f5-ab8093c2fcab tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.502244 Jul 24 01:21:45.022835 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1452/2773] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:44 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:45.037740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:45.038397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:45.059672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.062769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:45.067479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.068222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:45.278108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-44389d72-379b-40c2-93e4-f8e7fc72481a req-6156e500-05fb-4428-acda-4eb66075943b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa264a8-83c1-46dc-8de6-bf64dcede9a7", "name": "network-vif-plugged", "status": "completed", "tag": "325ed0c2-03a5-4623-a64b-82a805a46deb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:45.291491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-44389d72-379b-40c2-93e4-f8e7fc72481a req-6156e500-05fb-4428-acda-4eb66075943b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.292213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-44389d72-379b-40c2-93e4-f8e7fc72481a req-6156e500-05fb-4428-acda-4eb66075943b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:45.313105 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-44389d72-379b-40c2-93e4-f8e7fc72481a req-6156e500-05fb-4428-acda-4eb66075943b service nova] Creating event network-vif-plugged:325ed0c2-03a5-4623-a64b-82a805a46deb for instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 on n-h2-master-1 Jul 24 01:21:45.322771 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-44389d72-379b-40c2-93e4-f8e7fc72481a req-6156e500-05fb-4428-acda-4eb66075943b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047835 Jul 24 01:21:45.324111 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1453/2774] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:21:45.332358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8f4c1ae7-8193-4b12-bf4d-b04afb5f1b79 req-6a806f67-08c9-4e32-8356-0b93e221d097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fd2d54-e205-4d81-a201-b680dcc54d1e", "tag": "0f54fc26-8969-43c0-b5ea-9e63ce7c94dc"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:45.350093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8f4c1ae7-8193-4b12-bf4d-b04afb5f1b79 req-6a806f67-08c9-4e32-8356-0b93e221d097 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.350855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8f4c1ae7-8193-4b12-bf4d-b04afb5f1b79 req-6a806f67-08c9-4e32-8356-0b93e221d097 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:45.375998 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8f4c1ae7-8193-4b12-bf4d-b04afb5f1b79 req-6a806f67-08c9-4e32-8356-0b93e221d097 service nova] Creating event network-changed:0f54fc26-8969-43c0-b5ea-9e63ce7c94dc for instance a0fd2d54-e205-4d81-a201-b680dcc54d1e on n-h1-master-1 Jul 24 01:21:45.385636 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8f4c1ae7-8193-4b12-bf4d-b04afb5f1b79 req-6a806f67-08c9-4e32-8356-0b93e221d097 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059822 Jul 24 01:21:45.387461 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1454/2775] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:45.425213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:45.436446 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-811012f9-e25c-400e-aa48-2dc71209176f tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 0.402751 Jul 24 01:21:45.449708 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1322/2776] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:45 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:45.450877 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:45.451626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:45.469703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.470392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:45.472453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.473613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:45.538651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:45.539697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:45.551238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.557894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:45.559063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:45.562739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:46.078059 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=16 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:46.183898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:46.197781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05ac8846-b909-404d-bfc6-99bbfcadd051 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.750924 Jul 24 01:21:46.198398 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1455/2777] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:45 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:46.211059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:46.212043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:46.226041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:46.226477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:46.229842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:46.230237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:46.301948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:46.313167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:46.317032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:46.322648 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-49918d81-2092-40e3-b278-feee230c9fe8 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1483 microversion: 2.25 time: 0.791515 Jul 24 01:21:46.323251 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1323/2778] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:45 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1483 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:46.337634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:46.338906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:46.356642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:46.357394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:46.358229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:46.365199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:46.819504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:46.830781 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59d3709e-37b7-4b73-9c22-d89b32a91796 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.505662 Jul 24 01:21:46.831827 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1324/2779] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:46 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:46.842929 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:46.843813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:46.859779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:46.863305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:46.863879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:46.865254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:46.865737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:46.876033 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de9962c7-bfba-4947-b8e4-321d9dd98466 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.676187 Jul 24 01:21:46.878948 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1456/2780] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:46 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:47.215584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:47.217160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:47.224357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.225238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.226408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.227110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.277252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:47.288929 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2163dde1-e17d-49f3-ba3c-e4c0112b25f4 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1315 microversion: 2.1 time: 0.449883 Jul 24 01:21:47.302904 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1325/2781] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:46 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:47.308443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f999f833-2f98-453e-ae4f-c1bf2b2852d9 req-84d08d1d-f9ca-46de-8852-369659b846b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8dfe4b-e495-4584-8cd0-c145836e91cd", "name": "network-vif-deleted", "tag": "48eb2f36-64bc-4409-b71f-33a2f59d753f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:47.323782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f999f833-2f98-453e-ae4f-c1bf2b2852d9 req-84d08d1d-f9ca-46de-8852-369659b846b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.324675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f999f833-2f98-453e-ae4f-c1bf2b2852d9 req-84d08d1d-f9ca-46de-8852-369659b846b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.356454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f999f833-2f98-453e-ae4f-c1bf2b2852d9 req-84d08d1d-f9ca-46de-8852-369659b846b8 service nova] Creating event network-vif-deleted:48eb2f36-64bc-4409-b71f-33a2f59d753f for instance ef8dfe4b-e495-4584-8cd0-c145836e91cd on n-h2-master-1 Jul 24 01:21:47.373440 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f999f833-2f98-453e-ae4f-c1bf2b2852d9 req-84d08d1d-f9ca-46de-8852-369659b846b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068658 Jul 24 01:21:47.374364 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1326/2782] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:47.381116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:47.382548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:47.390104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.390827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.391823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.393153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.398154 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:47.556525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:47.593308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:47.604348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:47.609239 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-655e29c0-7888-4d72-a28d-cfb3ff1f7054 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1441 microversion: 2.25 time: 0.233623 Jul 24 01:21:47.609890 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1327/2783] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:47 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1441 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:47.702617 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:47.714169 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b2770244-b5d9-4b48-a285-415b5db9fe63 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.502482 Jul 24 01:21:47.721764 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1457/2784] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:47 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:47.852117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:47.853552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:47.886740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.887428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.888448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.889052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.897278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:47.898278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:47.906252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.907030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:47.908704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:47.909368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:48.663841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:48.681373 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-764dd962-034d-4358-96fb-84ebbe6007d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.835835 Jul 24 01:21:48.684976 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1328/2785] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:47 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:48.706155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d10a42f2-3884-4742-a84d-7aa51924f2c1 req-b9f7bbb3-6b1a-4a98-a16d-c3dfef363039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfe158e-15a5-4227-aba3-c039b49e30ea", "name": "network-vif-plugged", "status": "completed", "tag": "fd9495d6-86c7-402f-967e-b718a6ef43ec"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:48.738961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:48.755484 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9bde0ca4-d261-4206-987e-0acc0fa95557 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.863489 Jul 24 01:21:48.764649 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1458/2786] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:47 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:48.770514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:48.770927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d10a42f2-3884-4742-a84d-7aa51924f2c1 req-b9f7bbb3-6b1a-4a98-a16d-c3dfef363039 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:48.771374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d10a42f2-3884-4742-a84d-7aa51924f2c1 req-b9f7bbb3-6b1a-4a98-a16d-c3dfef363039 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:48.771821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:48.778863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:48.779585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:48.780617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:48.781604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:48.805080 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d10a42f2-3884-4742-a84d-7aa51924f2c1 req-b9f7bbb3-6b1a-4a98-a16d-c3dfef363039 service nova] Creating event network-vif-plugged:fd9495d6-86c7-402f-967e-b718a6ef43ec for instance bdfe158e-15a5-4227-aba3-c039b49e30ea on n-h1-master-1 Jul 24 01:21:48.827752 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d10a42f2-3884-4742-a84d-7aa51924f2c1 req-b9f7bbb3-6b1a-4a98-a16d-c3dfef363039 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135694 Jul 24 01:21:48.828939 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1329/2787] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:48.839195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:48.840342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:48.855069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:48.855720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:48.858088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:48.858539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.054169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:49.069448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:49.071018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:49.072202 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9cf65a75-fc33-445a-9ecd-ce78b415ef95 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1266 microversion: 2.25 time: 0.241181 Jul 24 01:21:49.072770 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1330/2788] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:48 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:49.086145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:49.088346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:49.101380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.113339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.114367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.116196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.316558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:49.331319 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f47a19b5-0803-4626-b87b-8f98b7e4de5b tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1504 microversion: 2.1 time: 0.565546 Jul 24 01:21:49.335144 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1459/2789] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:48 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:49.345072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-10260e0e-d312-4210-840c-58ab44802201 req-67d276e0-6156-4db3-82e6-e157ce892fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e666f0e4-280e-48ba-9527-1c05662d761e", "tag": "772d8297-76c5-4bac-8bde-dfa18ec8ecbc"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:49.365699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-10260e0e-d312-4210-840c-58ab44802201 req-67d276e0-6156-4db3-82e6-e157ce892fa0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.370600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-10260e0e-d312-4210-840c-58ab44802201 req-67d276e0-6156-4db3-82e6-e157ce892fa0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.388103 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-10260e0e-d312-4210-840c-58ab44802201 req-67d276e0-6156-4db3-82e6-e157ce892fa0 service nova] Creating event network-changed:772d8297-76c5-4bac-8bde-dfa18ec8ecbc for instance e666f0e4-280e-48ba-9527-1c05662d761e on n-h2-master-1 Jul 24 01:21:49.406864 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-10260e0e-d312-4210-840c-58ab44802201 req-67d276e0-6156-4db3-82e6-e157ce892fa0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069729 Jul 24 01:21:49.407938 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1460/2790] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:49.414704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c2aa1b4c-6549-4103-8059-9d3df934bd61 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:49.415589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c2aa1b4c-6549-4103-8059-9d3df934bd61 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:49.422659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2aa1b4c-6549-4103-8059-9d3df934bd61 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.423469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2aa1b4c-6549-4103-8059-9d3df934bd61 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.424887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2aa1b4c-6549-4103-8059-9d3df934bd61 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.425855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2aa1b4c-6549-4103-8059-9d3df934bd61 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.459568 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c2aa1b4c-6549-4103-8059-9d3df934bd61 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7/ips" status: 200 len: 109 microversion: 2.1 time: 0.049324 Jul 24 01:21:49.461079 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1461/2791] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:21:49 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7/ips => generated 109 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:49.477333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89ccd627-4329-42d0-ade9-13255cedcd94 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:49.479332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89ccd627-4329-42d0-ade9-13255cedcd94 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:49.495427 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ccd627-4329-42d0-ade9-13255cedcd94 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.498203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ccd627-4329-42d0-ade9-13255cedcd94 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.503493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ccd627-4329-42d0-ade9-13255cedcd94 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.504150 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89ccd627-4329-42d0-ade9-13255cedcd94 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.562464 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89ccd627-4329-42d0-ade9-13255cedcd94 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7/ips" status: 200 len: 109 microversion: 2.1 time: 0.090832 Jul 24 01:21:49.565507 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1462/2792] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:21:49 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7/ips => generated 109 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:49.575724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40d60a73-4419-4f80-a164-fb598e77e0a2 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:49.578534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40d60a73-4419-4f80-a164-fb598e77e0a2 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:49.593833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40d60a73-4419-4f80-a164-fb598e77e0a2 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.594669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40d60a73-4419-4f80-a164-fb598e77e0a2 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.598981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40d60a73-4419-4f80-a164-fb598e77e0a2 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.599668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40d60a73-4419-4f80-a164-fb598e77e0a2 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.642863 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:49.649254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40d60a73-4419-4f80-a164-fb598e77e0a2 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7/ips/tempest-ServerAddressesTestJSON-344401171-network" status: 200 len: 94 microversion: 2.1 time: 0.077635 Jul 24 01:21:49.656336 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1463/2793] 10.222.0.27 () {58 vars in 1397 bytes} [Sun Jul 24 01:21:49 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7/ips/tempest-ServerAddressesTestJSON-344401171-network => generated 94 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:21:49.667970 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4936d619-f69a-43bf-9692-440bdd63c5d9 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.587241 Jul 24 01:21:49.668847 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1331/2794] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:49 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:49.670713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:49.675013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:49.685415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.686254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.687306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.693185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.707147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:49.707828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:49.721262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.721753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.723228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.726191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.752446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:21:49.930419 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69081c65-343f-4bc3-ba34-92c06e135f1d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 204 len: 0 microversion: 2.1 time: 0.267195 Jul 24 01:21:49.931025 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1464/2795] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:21:49 2022] DELETE /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:21:49.936464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:49.943250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:49.955681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.956408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:49.957373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:49.967254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:50.207978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:50.216176 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-31629521-333e-48e4-98ac-38d52c2c21d4 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1318 microversion: 2.1 time: 0.518437 Jul 24 01:21:50.222015 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1332/2796] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:49 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:50.232859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:50.233985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:50.251231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:50.251803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:50.252720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:50.253371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:50.305028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:50.328568 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67dadf3d-21d2-45f9-943b-d3fe71fa4389 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.393901 Jul 24 01:21:50.330705 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1465/2797] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:49 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:50.339304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:50.340171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:50.351561 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:50.352530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:50.353986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:50.355073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:50.452919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:50.469367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:50.472655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:50.473927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-688256c6-895b-4758-bc26-2d5cb1ba6ed3 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1266 microversion: 2.25 time: 0.141797 Jul 24 01:21:50.476712 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1466/2798] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:50 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:50.489860 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:50.497647 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-66f541f1-14a3-4d62-a851-55da748abf04 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1510 microversion: 2.1 time: 0.274256 Jul 24 01:21:50.498593 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1333/2799] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:50 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:50.685412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:50.685975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:50.696523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:50.697335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:50.700175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:50.700846 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:50.963324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e35ba7f8-e3ff-441a-8f6d-9f79803e9829 req-a6630412-59b3-47c3-99ce-56accafe832c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f881ec-70c2-4065-86be-8f9723814487", "name": "network-vif-plugged", "status": "completed", "tag": "f62ac16b-5573-4158-9804-4338746e802e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:50.966364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:50.977034 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4d10593-2f1c-4d79-ad54-1216539e6bae tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.295369 Jul 24 01:21:50.977637 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1467/2800] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:50 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:50.980641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e35ba7f8-e3ff-441a-8f6d-9f79803e9829 req-a6630412-59b3-47c3-99ce-56accafe832c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:50.981273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e35ba7f8-e3ff-441a-8f6d-9f79803e9829 req-a6630412-59b3-47c3-99ce-56accafe832c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.001346 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e35ba7f8-e3ff-441a-8f6d-9f79803e9829 req-a6630412-59b3-47c3-99ce-56accafe832c service nova] Creating event network-vif-plugged:f62ac16b-5573-4158-9804-4338746e802e for instance 74f881ec-70c2-4065-86be-8f9723814487 on n-h2-master-1 Jul 24 01:21:51.023033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e35ba7f8-e3ff-441a-8f6d-9f79803e9829 req-a6630412-59b3-47c3-99ce-56accafe832c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063207 Jul 24 01:21:51.024229 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1334/2801] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:51.238627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:51.239269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:51.246200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.246665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.247619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.248080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.346772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:51.348054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:51.356048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.356749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.357736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.358345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.485726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:51.499803 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-73386bd1-869b-4ac0-8c30-fa53b10d2c48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 200 len: 1505 microversion: 2.1 time: 0.265913 Jul 24 01:21:51.502561 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1468/2802] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:51 2022] GET /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:51.512445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:51.520411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:51.537019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.537487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.541831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.542484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.669330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:51.685010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:51.689351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:51.698864 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bba2fc7-0f6f-4dae-a0b0-e7752fa07d01 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1266 microversion: 2.25 time: 0.186945 Jul 24 01:21:51.700042 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1469/2803] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:51 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:51.709348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:51.710249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:51.725265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.729257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.730824 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.731557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.742787 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:51.786299 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:51.796428 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0fba2f4b-e9d9-4018-b4ec-bdc473d3e273 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.454625 Jul 24 01:21:51.798455 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1335/2804] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:51 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:51.805258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:51.806126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: a0fd2d54-e205-4d81-a201-b680dcc54d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:51.813287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.814579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:51.815723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:51.816333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:52.580951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:52.602727 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a16b63b4-1a61-47d9-bc7a-2d69913e425c tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1510 microversion: 2.1 time: 0.900899 Jul 24 01:21:52.605644 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1470/2805] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:51 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1510 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:52.618283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:52.620754 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:52.625286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:52.635214 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-277adfdd-72a5-489e-b3e3-b334a3cb8e48 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e" status: 200 len: 1318 microversion: 2.1 time: 0.826855 Jul 24 01:21:52.635888 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1336/2806] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:51 2022] GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:52.647243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:52.648873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:52.654111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:52.655976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:52.718887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:52.719754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:52.733913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:52.735167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:52.737325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:52.738759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:52.903421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:52.917384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:52.924153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:52.927205 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42d9b5fd-91c0-4dd1-8459-4cc9e4e4029e tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1266 microversion: 2.25 time: 0.213171 Jul 24 01:21:52.940468 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1337/2807] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:52 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:21:52.952629 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:52.959484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:52.971622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:52.974978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:52.975881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:52.978268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:53.233848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:53.246964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef734271-8f48-4683-b5df-bfbc40697345 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.637328 Jul 24 01:21:53.247784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1471/2808] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:52 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:53.476004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:53.493935 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-362131b2-b11c-442c-8ae7-255f81e79f98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.549149 Jul 24 01:21:53.500043 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1338/2809] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:52 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:53.630412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:53.632110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:53.671197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:53.671828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: a0fd2d54-e205-4d81-a201-b680dcc54d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:53.710324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:53.710769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:53.714002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:53.714495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:53.716229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:53.718356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:53.722870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:53.723329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:53.945921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:53.955216 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae484cb3-9231-4a5c-8e8d-498c9d7d6311 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1468 microversion: 2.1 time: 0.334861 Jul 24 01:21:53.969567 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1472/2810] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:53 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1468 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:53.979827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:53.980452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:54.058294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.059152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.069849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.078319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.403362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:54.419547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:54.424375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:54.428011 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6615aed4-2608-42e9-b320-8582340210bf tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1266 microversion: 2.25 time: 0.457081 Jul 24 01:21:54.429763 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1473/2811] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:53 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:54.430061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:54.444636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a0c31354-4391-41db-90c1-1e82c1c98a43 req-45944a0f-eb6e-4817-891d-d8f28628990b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd2d54-e205-4d81-a201-b680dcc54d1e", "name": "network-vif-plugged", "status": "completed", "tag": "0f54fc26-8969-43c0-b5ea-9e63ce7c94dc"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:54.447304 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e340344-fc71-4718-b734-c26b67e1aeaf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e" status: 200 len: 1318 microversion: 2.1 time: 0.797623 Jul 24 01:21:54.449947 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1339/2812] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:53 2022] GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:54.473210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a792e793-dcf5-4f0e-b1a3-295585569e6b req-29619da7-1407-487c-8a9c-2bbab624d7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa264a8-83c1-46dc-8de6-bf64dcede9a7", "name": "network-vif-deleted", "tag": "325ed0c2-03a5-4623-a64b-82a805a46deb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:54.479809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a0c31354-4391-41db-90c1-1e82c1c98a43 req-45944a0f-eb6e-4817-891d-d8f28628990b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.480563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a0c31354-4391-41db-90c1-1e82c1c98a43 req-45944a0f-eb6e-4817-891d-d8f28628990b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.505653 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a0c31354-4391-41db-90c1-1e82c1c98a43 req-45944a0f-eb6e-4817-891d-d8f28628990b service nova] Creating event network-vif-plugged:0f54fc26-8969-43c0-b5ea-9e63ce7c94dc for instance a0fd2d54-e205-4d81-a201-b680dcc54d1e on n-h1-master-1 Jul 24 01:21:54.509778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a792e793-dcf5-4f0e-b1a3-295585569e6b req-29619da7-1407-487c-8a9c-2bbab624d7fd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.510289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a792e793-dcf5-4f0e-b1a3-295585569e6b req-29619da7-1407-487c-8a9c-2bbab624d7fd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.516893 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a0c31354-4391-41db-90c1-1e82c1c98a43 req-45944a0f-eb6e-4817-891d-d8f28628990b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084265 Jul 24 01:21:54.531557 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1474/2813] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:54.538020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:54.538994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:54.551320 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:54.555205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.558302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.559355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.560391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.576688 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a792e793-dcf5-4f0e-b1a3-295585569e6b req-29619da7-1407-487c-8a9c-2bbab624d7fd service nova] Creating event network-vif-deleted:325ed0c2-03a5-4623-a64b-82a805a46deb for instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 on n-h2-master-1 Jul 24 01:21:54.590588 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a792e793-dcf5-4f0e-b1a3-295585569e6b req-29619da7-1407-487c-8a9c-2bbab624d7fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135868 Jul 24 01:21:54.596482 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1340/2814] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:21:54.607986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:54.608723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:54.629903 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.630537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.633059 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.633380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.912618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:54.927389 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7500a5f3-a80f-4948-a472-5879edf0bc81 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1323 microversion: 2.1 time: 0.394288 Jul 24 01:21:54.929363 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1475/2815] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:54 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:54.973480 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:54.974553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:54.976976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:54.981610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.982453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.983703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:54.984333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:54.985521 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-adc0fbfa-5401-44d6-91f6-55c63c1beeb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.384273 Jul 24 01:21:54.992445 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1341/2816] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:54 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:55.178607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e19b156b5c8f4f30af95d21c57091ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19e03d9bbe8415198317f7c2c001ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:55.190149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-91be3e72-b5b5-4838-a3c3-89e55f1d6c13 tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 200 len: 1468 microversion: 2.1 time: 0.218674 Jul 24 01:21:55.193476 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1476/2817] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:54 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 1468 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:55.447449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:55.448086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:55.459897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:55.468678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:55.469312 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: a0fd2d54-e205-4d81-a201-b680dcc54d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:55.478058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:55.483555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:55.484030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:55.490352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:55.490809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:55.491612 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:55.492169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:55.604123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:55.608268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:55.608542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lazy-loading 'fault' on Instance uuid ef8dfe4b-e495-4584-8cd0-c145836e91cd {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:21:56.127388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:56.163316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:56.171116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:56.172373 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3cb26d46-31c9-4346-9671-251d9b9e3943 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 200 len: 1194 microversion: 2.25 time: 0.729791 Jul 24 01:21:56.188887 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1342/2818] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:55 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 1194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:21:56.206042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:56.206690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:56.228150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:56.235254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:56.236672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:56.237318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:56.486313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:56.511076 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-162a728d-9036-499b-a294-30f8c9efe20b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e" status: 200 len: 1318 microversion: 2.1 time: 1.046376 Jul 24 01:21:56.512968 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1477/2819] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:55 2022] GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e => generated 1318 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:56.527745 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:56.531772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:56.570550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:56.571999 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:56.575099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:56.577725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.240511 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:57.250050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:57.251209 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c6d71d9-0188-4a48-9d63-4df50c09edb7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.737142 Jul 24 01:21:57.252366 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1478/2820] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:56 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:57.260488 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8f1cc806-1644-4722-8e20-a4469b55f459 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 200 len: 1516 microversion: 2.1 time: 1.069729 Jul 24 01:21:57.276128 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:57.276748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] [instance: 1fa264a8-83c1-46dc-8de6-bf64dcede9a7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:57.285945 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1343/2821] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:56 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 1516 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:57.289403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.293307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.297340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.298044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.303278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:57.304194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: ef8dfe4b-e495-4584-8cd0-c145836e91cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:57.312423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.313170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.314203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.314812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.328838 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] HTTP exception thrown: Instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 could not be found. Jul 24 01:21:57.330789 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] HTTP exception thrown: Instance ef8dfe4b-e495-4584-8cd0-c145836e91cd could not be found. Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Request method failure captured: Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 HTTP/1.1 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6HeKNkvmgZwSSD5ZFSVyksWW_9AH8dIzYYYciials0GiKPvlk16DNI1DzZHxPzx17aVGukdtd-IbVdG7DMW4T8chFZD_GFwHL0k9fQLq0uXqIVB8WjSIJvVehFDPQ5pTJ8D5lEsxTEUnXpvgGimAd0FJmcNUw7paRU4mdqJKOnnwg Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e19e03d9bbe8415198317f7c2c001ac3 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerAddressesTestJSON-1216087768 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e19e03d9bbe8415198317f7c2c001ac3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e19e03d9bbe8415198317f7c2c001ac3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e19e03d9bbe8415198317f7c2c001ac3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e19e03d9bbe8415198317f7c2c001ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerAddressesTestJSON-1216087768 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e19e03d9bbe8415198317f7c2c001ac3 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1216087768 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerAddressesTestJSON-1216087768-project Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: e19b156b5c8f4f30af95d21c57091ec5 Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerAddressesTestJSON-1216087768-project Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 could not be found. Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '1fa264a8-83c1-46dc-8de6-bf64dcede9a7'} Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 could not be found. Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 could not be found. Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:21:57.330926 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 could not be found. Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] Returning 404 to user: Instance 1fa264a8-83c1-46dc-8de6-bf64dcede9a7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:21:57.335705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-855bad2c-089d-4038-830f-3eb9cda7253d tempest-ServerAddressesTestJSON-1216087768 tempest-ServerAddressesTestJSON-1216087768-project] 10.222.0.27 "GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7" status: 404 len: 111 microversion: 2.1 time: 0.061739 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Request method failure captured: Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd HTTP/1.1 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JzGaCWJQTmFGkMDDZ5nycua3iLtF1niMyijANOX-syC6mhqPU3TZ7dtA87qM0mDn6qt0oSu4EMC2ckmSHhYBy7P3JO2WpQEbQDHvoAgxTC4lWTRE0fAItFHRDZTNe4L4bFroEb8ZbL9CCzTbVe_4xF1kM257EqC_En1GpTOHC8os_I Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.25 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6caac543f0e47e5908eb146739cddca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 735a3f7d7e454f14a7a4ed229affd75b Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ef8dfe4b-e495-4584-8cd0-c145836e91cd could not be found. Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ef8dfe4b-e495-4584-8cd0-c145836e91cd'} Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8dfe4b-e495-4584-8cd0-c145836e91cd could not be found. Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8dfe4b-e495-4584-8cd0-c145836e91cd could not be found. Jul 24 01:21:57.342997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8dfe4b-e495-4584-8cd0-c145836e91cd could not be found. Jul 24 01:21:57.347621 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:21:57.348150 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1479/2822] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:57 2022] GET /compute/v2.1/servers/1fa264a8-83c1-46dc-8de6-bf64dcede9a7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:21:57.349660 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Returning 404 to user: Instance ef8dfe4b-e495-4584-8cd0-c145836e91cd could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:21:57.351852 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8e3ab614-5941-4bd5-8ab2-55ccb4cdd0d6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd" status: 404 len: 111 microversion: 2.25 time: 0.063957 Jul 24 01:21:57.356198 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1344/2823] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:21:57 2022] GET /compute/v2.1/servers/ef8dfe4b-e495-4584-8cd0-c145836e91cd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:21:57.357351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:57.361759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:57.380266 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.381010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.381993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.382444 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.530143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:57.530897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: a0fd2d54-e205-4d81-a201-b680dcc54d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:57.565020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.575191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.576448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:57.577121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:57.999276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:58.010311 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-29ba1660-0098-4e1b-b0d8-e038d879122d tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e" status: 200 len: 1506 microversion: 2.1 time: 0.484480 Jul 24 01:21:58.015725 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1345/2824] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:57 2022] GET /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:21:58.028208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:58.028959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: a0fd2d54-e205-4d81-a201-b680dcc54d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:58.044550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.045025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.045877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.046329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.046698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:58.060246 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:58.067723 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bbedc8b-b28f-4eb8-a71d-184ad841ce7a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f" status: 200 len: 1515 microversion: 2.1 time: 0.720371 Jul 24 01:21:58.068317 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1480/2825] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:57 2022] GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f => generated 1515 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:58.098319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:58.099307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:58.118315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: a0fd2d54-e205-4d81-a201-b680dcc54d1e] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:21:58.137788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.141913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.144937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.145396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.311089 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23c17b48-975e-4eb8-828c-bf38723005f2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e" status: 204 len: 0 microversion: 2.1 time: 0.287196 Jul 24 01:21:58.315581 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1346/2826] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:21:58 2022] DELETE /compute/v2.1/servers/a0fd2d54-e205-4d81-a201-b680dcc54d1e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:21:58.327752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:58.328549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:58.346609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.347141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.350530 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.351157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.693226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:58.713047 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4178cdf-8f03-4f10-b2ee-fd6c04503f9c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 200 len: 1515 microversion: 2.1 time: 0.631118 Jul 24 01:21:58.714013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1481/2827] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:58 2022] GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 1515 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:58.728046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:58.730672 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:58.750565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.753690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.756015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:58.761264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:58.793860 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:58.825744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a359086-9830-4c50-b04b-54435e1a6413 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.509032 Jul 24 01:21:58.827289 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1347/2828] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:58 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:58.853644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3b34ec3-0131-4007-8686-5796e2e0ebf9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Action: 'create', calling method: .version_select at 0x7f05eb9358b0>, body: {"keypair": {"name": "tempest-keypair-171276352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+kHk5dc9uZqSMWyrcLqwpy1rQBGH+HtgbR4Di5w3CEHuMy0GCIDQGP9TGPD7E1LiNvc4oiUVXIcd94zb4nToc+vEPhq9uKiyB0y/2j+SCuQFNkGzkB5aZJEVGpZYGYrg=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:58.864085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: bdfe158e-15a5-4227-aba3-c039b49e30ea] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:21:58.896460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3b34ec3-0131-4007-8686-5796e2e0ebf9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Getting quotas for project 37d719380c51434683b3dcd83722913f. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:21:58.914343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3b34ec3-0131-4007-8686-5796e2e0ebf9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Getting quotas for user 5553b37350644a20b64ce76ebf60b44b and project 37d719380c51434683b3dcd83722913f. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:21:59.010351 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3b34ec3-0131-4007-8686-5796e2e0ebf9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.170082 Jul 24 01:21:59.017773 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1348/2829] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:21:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:21:59.028437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:59.031265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:59.067875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:59.070886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:59.071805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:59.072259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:59.087367 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3338a7b5-3cf7-4030-b592-8aca8550eea9 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea" status: 204 len: 0 microversion: 2.1 time: 0.371896 Jul 24 01:21:59.088612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1482/2830] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:21:58 2022] DELETE /compute/v2.1/servers/bdfe158e-15a5-4227-aba3-c039b49e30ea => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:21:59.176826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:21:59.348685 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e9316d11-b7f2-4bfa-a0c3-47408800e2dd tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 204 len: 0 microversion: 2.1 time: 0.332484 Jul 24 01:21:59.350551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1349/2831] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:21:59 2022] DELETE /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:21:59.359816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:59.361559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:59.381226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-694763585", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "14dab60c-8e5d-4fef-81c9-bb4db0eb258e"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:21:59.384119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:59.384587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:59.385382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:59.385851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:59.471211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] validate_networks() for [('14dab60c-8e5d-4fef-81c9-bb4db0eb258e', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:21:59.853513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:21:59.871021 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6f06cdd2-9887-455c-9d85-e8ad3e3958ee tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 200 len: 1521 microversion: 2.1 time: 0.515049 Jul 24 01:21:59.880385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1483/2832] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:59 2022] GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:21:59.887771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:21:59.888010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:21:59.899027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:59.899488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:21:59.900291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:21:59.900737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:00.335099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:00.354883 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab799d38-fb30-4e7e-aa4f-3aaa7e3b245f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.481713 Jul 24 01:22:00.358396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1484/2833] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:21:59 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:00.653821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:22:00.654348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:22:00.655005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:22:00.655625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:22:00.656155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:22:00.687448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:00.688591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:00.696133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:00.698669 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:00.745792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Getting quotas for project dfd38af4d6e2417b9b73b03ee795328f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:00.764072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Getting quotas for user 5a34b91b8c3d4fe3a42e0ceffa767726 and project dfd38af4d6e2417b9b73b03ee795328f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:00.796876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Going to run 2 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:22:00.804745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:22:00.888395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:00.889192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:00.901135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:00.901599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:00.902417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:00.902864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:00.926612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=dd4ad5bd-4ebe-43fa-abde-ab5021e272e0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:22:00.987645 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:01.069328 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79172261-64c7-440d-acfd-82ce17e54d31 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.685155 Jul 24 01:22:01.070902 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1350/2834] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:21:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 1697 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 24 01:22:01.089800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:01.149382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:01.151256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Searching by: {'deleted': False, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:01.221750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:01.236159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:01.237270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:01.239863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:01.356710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:22:01.366962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:01.385032 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-faf02ab8-6f1b-40e9-ac6e-1fa22b7f856d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 200 len: 1521 microversion: 2.1 time: 0.500759 Jul 24 01:22:01.385868 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1485/2835] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:00 2022] GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:22:01.403354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:01.407448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:01.435506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:01.435968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:01.445028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:01.445503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:01.504062 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a6b5a44-39bc-4066-b920-dc1838f0590c tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.427661 Jul 24 01:22:01.506967 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1351/2836] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:22:01 2022] GET /compute/v2.1/servers => generated 1331 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:01.546322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be695eac-7d49-48c9-940e-f9d4156ec5ca tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:01.555049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be695eac-7d49-48c9-940e-f9d4156ec5ca tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:01.831309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-be695eac-7d49-48c9-940e-f9d4156ec5ca tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:01.859520 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be695eac-7d49-48c9-940e-f9d4156ec5ca tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1217 microversion: 2.1 time: 0.332684 Jul 24 01:22:01.866003 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1352/2837] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:01 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1217 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:02.355240 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:02.403847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:02.404758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:02.434768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:02.438244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:02.446453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:02.448898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:03.131486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:03.147625 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85a4efe1-d69a-4474-9a81-18b54f67d141 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 200 len: 1521 microversion: 2.1 time: 0.747856 Jul 24 01:22:03.151622 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1353/2838] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:02 2022] GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 1521 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:03.164036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:03.166401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:03.190209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:03.191799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:03.194573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:03.195347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:03.990741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:04.009281 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de4b94cc-a16d-424d-ba22-3b7da37e25d5 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1269 microversion: 2.1 time: 0.856445 Jul 24 01:22:04.013363 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1354/2839] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:03 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1269 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:04.019411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-864af2d0-c680-4039-a838-c08b4ae18f17 req-a020d8a9-3a0e-48e8-ad88-bf59e08a34b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e666f0e4-280e-48ba-9527-1c05662d761e", "name": "network-vif-plugged", "status": "completed", "tag": "772d8297-76c5-4bac-8bde-dfa18ec8ecbc"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:04.067923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-864af2d0-c680-4039-a838-c08b4ae18f17 req-a020d8a9-3a0e-48e8-ad88-bf59e08a34b0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:04.071311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-864af2d0-c680-4039-a838-c08b4ae18f17 req-a020d8a9-3a0e-48e8-ad88-bf59e08a34b0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:04.124531 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-864af2d0-c680-4039-a838-c08b4ae18f17 req-a020d8a9-3a0e-48e8-ad88-bf59e08a34b0 service nova] Creating event network-vif-plugged:772d8297-76c5-4bac-8bde-dfa18ec8ecbc for instance e666f0e4-280e-48ba-9527-1c05662d761e on n-h2-master-1 Jul 24 01:22:04.145635 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-864af2d0-c680-4039-a838-c08b4ae18f17 req-a020d8a9-3a0e-48e8-ad88-bf59e08a34b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130472 Jul 24 01:22:04.152507 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1355/2840] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:04.176271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:04.180708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:04.197333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:04.199405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:04.201376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:04.202292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.020967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:05.046026 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a927a19b-49ae-4625-9290-d8f9eb53c671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 3.651380 Jul 24 01:22:05.047765 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1486/2841] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:01 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 3661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:05.056007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:05.057405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:05.072901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:05.091964 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc4617fb-561c-4baf-b988-ad109430f59a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 200 len: 1479 microversion: 2.1 time: 0.927178 Jul 24 01:22:05.101986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1356/2842] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:04 2022] GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 1479 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:05.102914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4015fb5c-7b0a-47d8-b0ec-f56ee6fb1875 req-c5c38cb0-dbb0-40ae-983b-cfbc2556ab06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd2d54-e205-4d81-a201-b680dcc54d1e", "name": "network-vif-deleted", "tag": "0f54fc26-8969-43c0-b5ea-9e63ce7c94dc"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:05.107732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.109274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.112151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.114751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.145169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4015fb5c-7b0a-47d8-b0ec-f56ee6fb1875 req-c5c38cb0-dbb0-40ae-983b-cfbc2556ab06 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.146868 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4015fb5c-7b0a-47d8-b0ec-f56ee6fb1875 req-c5c38cb0-dbb0-40ae-983b-cfbc2556ab06 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.190871 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4015fb5c-7b0a-47d8-b0ec-f56ee6fb1875 req-c5c38cb0-dbb0-40ae-983b-cfbc2556ab06 service nova] Creating event network-vif-deleted:0f54fc26-8969-43c0-b5ea-9e63ce7c94dc for instance a0fd2d54-e205-4d81-a201-b680dcc54d1e on n-h1-master-1 Jul 24 01:22:05.209007 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4015fb5c-7b0a-47d8-b0ec-f56ee6fb1875 req-c5c38cb0-dbb0-40ae-983b-cfbc2556ab06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114001 Jul 24 01:22:05.214091 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1357/2843] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:05.362384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:05.371144 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-73f5a97e-b9d6-4ce6-95a4-7fc227c038fe tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1275 microversion: 2.1 time: 0.321482 Jul 24 01:22:05.375208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9493c59e-a146-4d70-9944-38f496df3bdb req-1ee2d355-ff79-4816-a139-5ef1a6672bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea0cfe2-d5df-4e92-ac00-6f64011e8b0e", "name": "network-vif-deleted", "tag": "6d73d4f9-b30e-48fd-95db-4799e60f7e50"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:05.401799 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1487/2844] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:05 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:05.405269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9493c59e-a146-4d70-9944-38f496df3bdb req-1ee2d355-ff79-4816-a139-5ef1a6672bc4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.406241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9493c59e-a146-4d70-9944-38f496df3bdb req-1ee2d355-ff79-4816-a139-5ef1a6672bc4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.438271 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9493c59e-a146-4d70-9944-38f496df3bdb req-1ee2d355-ff79-4816-a139-5ef1a6672bc4 service nova] Creating event network-vif-deleted:6d73d4f9-b30e-48fd-95db-4799e60f7e50 for instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e on n-h2-master-1 Jul 24 01:22:05.447974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:05.448578 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9493c59e-a146-4d70-9944-38f496df3bdb req-1ee2d355-ff79-4816-a139-5ef1a6672bc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084131 Jul 24 01:22:05.448777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:05.450581 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1358/2845] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:05.461374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.461844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.462677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.463159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.521956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:05.704906 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4abeb205-ac1f-4ad1-b80f-77c872e8ecec tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 204 len: 0 microversion: 2.25 time: 0.260133 Jul 24 01:22:05.706421 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1488/2846] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:22:05 2022] DELETE /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:22:05.722000 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:05.722713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:05.740435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.741635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:05.745357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:05.746258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.068013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:06.069889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:06.088315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.091169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.093327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.094021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.499275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:06.512349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:06.533294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:06.535541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:06.537376 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-165476e1-d80a-4d6b-ab52-0b40f91d3ab5 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1732 microversion: 2.25 time: 0.826579 Jul 24 01:22:06.539379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1b58808c-1a9f-4d30-a59c-c6e708d55bc2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1313 microversion: 2.1 time: 0.477389 Jul 24 01:22:06.546871 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1359/2847] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:05 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1732 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:06.555334 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1489/2848] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:06 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:06.563448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:06.565467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:06.571330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:06.573187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:06.574054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.574751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.575777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.577072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.591574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.592148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.594382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.594830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.623698 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] HTTP exception thrown: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e HTTP/1.1 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: exception: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'cea0cfe2-d5df-4e92-ac00-6f64011e8b0e'} Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:06.625734 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.631448 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:06.631448 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:06.631448 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:06.631448 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:06.631448 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:06.631448 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:06.631448 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.633078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 404 to user: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:06.634504 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-36dea081-c9c5-4731-8d59-ba628cb7b7d0 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 404 len: 111 microversion: 2.1 time: 0.086352 Jul 24 01:22:06.635128 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1360/2849] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:06 2022] GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:22:06.640731 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1005525376", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f017f65c-1b38-45ab-bf21-3d69840e21d5"}, {"port": "86dc5ccc-4155-4bbe-89ce-b5108cebb1c1", "tag": "port-1"}, {"port": "563bde46-aa44-416a-953e-81183c46ef04", "tag": "port-2"}, {"uuid": "ccf0da13-b1ac-430e-9cd2-390653b95037", "tag": "net-1"}, {"uuid": "ccf0da13-b1ac-430e-9cd2-390653b95037"}, {"uuid": "b105a6f5-7eaf-4c4f-85a0-893a4b8b9f14", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b105a6f5-7eaf-4c4f-85a0-893a4b8b9f14", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1c172977-46a8-4597-9c9d-0a62bcd295d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c95591a4-693c-43d8-bfb9-efa860594f6f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "24aaed5e-c32e-46fb-8423-cca2694ab1a2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--625282213"}], "key_name": "tempest-keypair-171276352", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:06.685000 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:06.698292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4c2cfea-aac4-4eb5-b2c8-15de0c5f5536 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1275 microversion: 2.1 time: 0.141402 Jul 24 01:22:06.699426 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1490/2850] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:06 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:06.709554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:06.715021 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:06.716004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:06.722343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.722802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.723616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.724420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.833861 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-094bba4e-9c21-4587-972a-22a7b1bd8740 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.131119 Jul 24 01:22:06.835826 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1491/2851] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:22:06 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:22:06.855507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] validate_networks() for [('f017f65c-1b38-45ab-bf21-3d69840e21d5', None, None, None, None, None), (None, None, '86dc5ccc-4155-4bbe-89ce-b5108cebb1c1', None, None, None), (None, None, '563bde46-aa44-416a-953e-81183c46ef04', None, None, None), ('ccf0da13-b1ac-430e-9cd2-390653b95037', None, None, None, None, None), ('ccf0da13-b1ac-430e-9cd2-390653b95037', None, None, None, None, None), ('b105a6f5-7eaf-4c4f-85a0-893a4b8b9f14', '10.2.2.100', None, None, None, None), ('b105a6f5-7eaf-4c4f-85a0-893a4b8b9f14', '10.2.2.200', None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:22:06.862224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6947092e-1389-4832-953b-00d0b68f93af tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6947092e-1389-4832-953b-00d0b68f93af tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 24 01:22:06.866196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6947092e-1389-4832-953b-00d0b68f93af tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:06.873283 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6947092e-1389-4832-953b-00d0b68f93af tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020463 Jul 24 01:22:06.875117 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1492/2852] 10.222.0.27 () {58 vars in 1181 bytes} [Sun Jul 24 01:22:06 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:22:06.881172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:06.888124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:06.888818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:06.897570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.898256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.899293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:06.899971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:06.958040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:22:07.023759 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f56068e-09c3-4ca2-a517-7a4cc0a11293 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.147890 Jul 24 01:22:07.027040 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1493/2853] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:22:06 2022] GET /compute/v2.1/servers => generated 683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:07.038833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.043401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:07.044352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.servers [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Removing options 'limit' from query {{(pid=119561) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 24 01:22:07.045464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:07.055069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.055841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.057059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.057898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.091032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:22:07.140216 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-34518154-d7f6-4c08-9fc5-4c49e4bf7654 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.105515 Jul 24 01:22:07.140982 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1494/2854] 10.222.0.27 () {58 vars in 1143 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:07.158764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c3c93c6-cb58-4b6e-96af-8ddcb4b0e6d5 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c3c93c6-cb58-4b6e-96af-8ddcb4b0e6d5 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi '-1' Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 24 01:22:07.163662 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 24 01:22:07.168695 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.170876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c3c93c6-cb58-4b6e-96af-8ddcb4b0e6d5 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:07.172109 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c3c93c6-cb58-4b6e-96af-8ddcb4b0e6d5 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021889 Jul 24 01:22:07.174778 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1495/2855] 10.222.0.27 () {58 vars in 1141 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:22:07.186320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-012dfcd2-922d-4f8d-b38b-160b91fa2f69 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-012dfcd2-922d-4f8d-b38b-160b91fa2f69 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: action_args: {} Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'testing' Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 24 01:22:07.190450 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:07.195043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-012dfcd2-922d-4f8d-b38b-160b91fa2f69 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:07.196004 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-012dfcd2-922d-4f8d-b38b-160b91fa2f69 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.015739 Jul 24 01:22:07.197870 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1496/2856] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:22:07.207305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1b551c11-093e-4123-b7b3-7a1111e2bff8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.211304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b551c11-093e-4123-b7b3-7a1111e2bff8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:07.212818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b551c11-093e-4123-b7b3-7a1111e2bff8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:07.224520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.servers [None req-1b551c11-093e-4123-b7b3-7a1111e2bff8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Flavor 'non_existing_flavor' could not be found {{(pid=119561) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 24 01:22:07.225775 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1b551c11-093e-4123-b7b3-7a1111e2bff8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.024434 Jul 24 01:22:07.227027 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1497/2857] 10.222.0.27 () {58 vars in 1177 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:22:07.241169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.245280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:07.246245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:07.252524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.253360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.254418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.255099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.354462 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e78572be-a760-4d9b-8485-eda0b6ad19cb tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.118912 Jul 24 01:22:07.356876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1498/2858] 10.222.0.27 () {58 vars in 1173 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:22:07.370514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.374355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:07.375200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:07.381459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.382354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.383320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.383948 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.518052 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-243ad19a-5bbb-42ae-a618-9e698e88d267 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.152250 Jul 24 01:22:07.528543 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1499/2859] 10.222.0.27 () {58 vars in 1183 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:22:07.534759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4ec093d1-a5be-4028-8270-635294b1afac req-070df81c-7ba2-40a2-be79-11708b561a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfe158e-15a5-4227-aba3-c039b49e30ea", "name": "network-vif-deleted", "tag": "fd9495d6-86c7-402f-967e-b718a6ef43ec"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:07.544417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4ec093d1-a5be-4028-8270-635294b1afac req-070df81c-7ba2-40a2-be79-11708b561a0c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.545095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4ec093d1-a5be-4028-8270-635294b1afac req-070df81c-7ba2-40a2-be79-11708b561a0c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.560558 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4ec093d1-a5be-4028-8270-635294b1afac req-070df81c-7ba2-40a2-be79-11708b561a0c service nova] Creating event network-vif-deleted:fd9495d6-86c7-402f-967e-b718a6ef43ec for instance bdfe158e-15a5-4227-aba3-c039b49e30ea on n-h1-master-1 Jul 24 01:22:07.567700 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4ec093d1-a5be-4028-8270-635294b1afac req-070df81c-7ba2-40a2-be79-11708b561a0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035791 Jul 24 01:22:07.568718 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1500/2860] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:07.574843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.579996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:07.581098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:07.587553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.588310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.589269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.589726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.622255 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:22:07.662800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:07.670366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.670819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.894649 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20518b82-f6bd-44ec-b433-2d720b349787 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.324234 Jul 24 01:22:07.895483 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1501/2861] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:07.910549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:07.911288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:07.917853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.918305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:07.919091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:07.919520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:08.197113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:08.214127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:08.218344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:08.226584 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03bfbca9-51b6-4b76-8243-3834c0ca58f0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1732 microversion: 2.25 time: 0.321888 Jul 24 01:22:08.227932 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1502/2862] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:07 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1732 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:08.233533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:08.235113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:08.242007 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:08.243603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:08.245050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:08.245904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:08.591610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:08.607379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24677179-55e2-43de-a99a-51975aeddfda tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1499 microversion: 2.1 time: 0.377623 Jul 24 01:22:08.620723 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1503/2863] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:08 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1499 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:08.636492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:08.637393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:08.661073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:08.661480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:08.665319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:08.665804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:08.988416 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:08.997917 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dc084ef2-19a6-445f-aafd-3f03505e5120 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 0.375842 Jul 24 01:22:09.007509 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1504/2864] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:08 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:09.009340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f23944e-eca3-4f6c-a76c-e7c7a377a89a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:09.013166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f23944e-eca3-4f6c-a76c-e7c7a377a89a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:09.014356 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f23944e-eca3-4f6c-a76c-e7c7a377a89a tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.009577 Jul 24 01:22:09.023088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1505/2865] 10.222.0.27 () {58 vars in 1177 bytes} [Sun Jul 24 01:22:09 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:22:09.023088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:09.024131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:09.036170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.037248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.037768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.038369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.072524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lazy-loading 'flavor' on Instance uuid e666f0e4-280e-48ba-9527-1c05662d761e {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:22:09.206827 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:09.234646 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-efbad2c3-938f-45be-99df-f995d6cc11e8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "POST /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e/action" status: 200 len: 32 microversion: 2.1 time: 0.218163 Jul 24 01:22:09.235266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1506/2866] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:22:09 2022] POST /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:22:09.243843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:09.248555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:09.249052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Searching by: {'deleted': False, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:22:09.258089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.258587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.259478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.260018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.300750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:22:09.334541 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a8cb2d0-3182-4173-8de7-3b7f98b812df tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.097239 Jul 24 01:22:09.342688 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1507/2867] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:22:09 2022] GET /compute/v2.1/servers => generated 683 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:09.342688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:09.342688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:09.350508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.351564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.352362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.352796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.452527 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:09.463124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:09.464996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:09.466350 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e5a0f8e7-b9e6-4b0f-8ce6-61697f562349 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1664 microversion: 2.25 time: 0.129620 Jul 24 01:22:09.467045 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1508/2868] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:09 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1664 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:09.486454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:09.487087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:09.503213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.503790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.504632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:09.505072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:09.995069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:10.004234 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2441e5c3-69ed-4327-87d7-e9af2e3717e2 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 0.536108 Jul 24 01:22:10.018441 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1509/2869] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:09 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:10.023599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:10.024110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:10.042270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.042730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.043519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.043960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.087543 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] HTTP exception thrown: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e HTTP/1.1 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: exception: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'cea0cfe2-d5df-4e92-ac00-6f64011e8b0e'} Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:10.089281 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 404 to user: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-76f60335-b241-4e22-aea0-ff8b11852807 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 404 len: 111 microversion: 2.1 time: 0.071574 Jul 24 01:22:10.093110 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1510/2870] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:22:10 2022] DELETE /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:22:10.096377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-bad4c7e3-73d4-42b0-9ff9-256be23c0723 req-bbc9284f-f55a-4a0f-bb30-056f69bb499e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4ad5bd-4ebe-43fa-abde-ab5021e272e0", "tag": "928f3547-d4e3-49ce-a075-f39a7dbb8041"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:10.118925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bad4c7e3-73d4-42b0-9ff9-256be23c0723 req-bbc9284f-f55a-4a0f-bb30-056f69bb499e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.119085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bad4c7e3-73d4-42b0-9ff9-256be23c0723 req-bbc9284f-f55a-4a0f-bb30-056f69bb499e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.161013 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-bad4c7e3-73d4-42b0-9ff9-256be23c0723 req-bbc9284f-f55a-4a0f-bb30-056f69bb499e service nova] Creating event network-changed:928f3547-d4e3-49ce-a075-f39a7dbb8041 for instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 on n-h1-master-1 Jul 24 01:22:10.179820 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-bad4c7e3-73d4-42b0-9ff9-256be23c0723 req-bbc9284f-f55a-4a0f-bb30-056f69bb499e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087317 Jul 24 01:22:10.187451 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1511/2871] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:10.198010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:10.199056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:10.213288 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.221220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.222355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.222950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.663493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:10.672042 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e244a4a8-b6a5-41d4-aa76-77f64d4b30d1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 0.483039 Jul 24 01:22:10.672631 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1512/2872] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:10 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:10.681399 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:10.681933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:10.698974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.702503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.704484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.705184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.763721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:10.906236 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e8fb2f2-c5e6-4869-b316-863ade313e7e tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f" status: 204 len: 0 microversion: 2.1 time: 0.231284 Jul 24 01:22:10.909059 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1513/2873] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:22:10 2022] DELETE /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:22:10.915772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:10.917950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:10.925587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.926353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:10.927290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:10.928114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.287664 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:11.441962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:11.450969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:11.452615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:11.459487 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4772a5a0-a178-45e8-af93-a95ffcf396f7 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1664 microversion: 2.25 time: 0.543284 Jul 24 01:22:11.461523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1514/2874] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:10 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1664 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:11.481320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:11.482587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:11.491164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.491909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.494314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.494926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.542221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:22:11.542941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:22:11.543639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:22:11.544578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:22:11.545212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:22:11.551430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:11.566317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.567109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.568209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.570438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.610555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Getting quotas for project 37d719380c51434683b3dcd83722913f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:11.621073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Getting quotas for user 5553b37350644a20b64ce76ebf60b44b and project 37d719380c51434683b3dcd83722913f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:11.698437 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-813082f6-9567-4091-b780-1bc9c9ecb2b1 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "DELETE /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 204 len: 0 microversion: 2.1 time: 0.231149 Jul 24 01:22:11.700521 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1515/2875] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:22:11 2022] DELETE /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:22:11.713055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:11.714015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:11.722051 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:11.727965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.727965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.728787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.729394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.887624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:22:11.890797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1c172977-46a8-4597-9c9d-0a62bcd295d0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c95591a4-693c-43d8-bfb9-efa860594f6f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24aaed5e-c32e-46fb-8423-cca2694ab1a2',volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:22:11.950504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:11.960898 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0ee4d697-46c2-4901-8b0d-5013105a9065 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 0.258315 Jul 24 01:22:11.966089 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1516/2876] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:11 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:11.978305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:11.978944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:11.987667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.988162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:11.989113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:11.989341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.277464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.291523 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4813b3ae-9b06-4a78-9a26-60dd8562a6c3 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 0.320691 Jul 24 01:22:12.292748 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1517/2877] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:11 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:12.298668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:12.299803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: cea0cfe2-d5df-4e92-ac00-6f64011e8b0e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:12.306362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:12.307141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.308079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:12.308597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.342300 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] HTTP exception thrown: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e HTTP/1.1 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: exception: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'cea0cfe2-d5df-4e92-ac00-6f64011e8b0e'} Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:12.346033 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:12.350465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:12.350465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:12.350465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:12.350465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:12.350465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:12.350465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. Jul 24 01:22:12.350465 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:12.351317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 404 to user: Instance cea0cfe2-d5df-4e92-ac00-6f64011e8b0e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:12.353786 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-620e59f5-3a2f-4897-828e-4d2b88358e56 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e" status: 404 len: 111 microversion: 2.1 time: 0.058511 Jul 24 01:22:12.359288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1518/2878] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:12 2022] GET /compute/v2.1/servers/cea0cfe2-d5df-4e92-ac00-6f64011e8b0e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:22:12.377054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9f8b7ef3-e808-46d2-b9dd-f8e53f94ec9e req-9df7f24a-cefc-4ddb-81c6-7cb07ab1418c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0", "name": "network-vif-deleted", "tag": "e51ff2a6-c9bc-4402-a926-4d10ea46461f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:12.392500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f8b7ef3-e808-46d2-b9dd-f8e53f94ec9e req-9df7f24a-cefc-4ddb-81c6-7cb07ab1418c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:12.394040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f8b7ef3-e808-46d2-b9dd-f8e53f94ec9e req-9df7f24a-cefc-4ddb-81c6-7cb07ab1418c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.418503 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9f8b7ef3-e808-46d2-b9dd-f8e53f94ec9e req-9df7f24a-cefc-4ddb-81c6-7cb07ab1418c service nova] Creating event network-vif-deleted:e51ff2a6-c9bc-4402-a926-4d10ea46461f for instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 on n-h1-master-1 Jul 24 01:22:12.425400 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9f8b7ef3-e808-46d2-b9dd-f8e53f94ec9e req-9df7f24a-cefc-4ddb-81c6-7cb07ab1418c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064568 Jul 24 01:22:12.427103 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1519/2879] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:12.435820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:12.436916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:12.441429 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38b8815a-a4f0-469c-a467-db7b92f14097 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.800046 Jul 24 01:22:12.449168 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1361/2880] 10.222.0.27 () {62 vars in 1188 bytes} [Sun Jul 24 01:22:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 5813 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:22:12.454911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:12.457032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.458481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:12.459223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.467858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bafa80de-86d0-40d0-8c7e-81f6350b2abd tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:12.471023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bafa80de-86d0-40d0-8c7e-81f6350b2abd tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:12.573514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bafa80de-86d0-40d0-8c7e-81f6350b2abd tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.587795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bafa80de-86d0-40d0-8c7e-81f6350b2abd tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.592439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bafa80de-86d0-40d0-8c7e-81f6350b2abd tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.604326 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bafa80de-86d0-40d0-8c7e-81f6350b2abd tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1285 microversion: 2.42 time: 0.146049 Jul 24 01:22:12.619919 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1362/2881] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:12 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:12.630967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:12.637861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:12.655524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:12.658187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.662800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:12.663496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:12.840795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.852219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.868973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.870357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:12.875415 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c7e3f7b-4980-4c1c-9f3e-ce09736b65fb tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 200 len: 1664 microversion: 2.25 time: 0.253883 Jul 24 01:22:12.878479 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1363/2882] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:12 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 1664 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:12.891113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b3ab756f-3b75-4535-8a87-fb6f4c926d8c tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f" status: 200 len: 1521 microversion: 2.1 time: 0.460014 Jul 24 01:22:12.892641 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1520/2883] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:12 2022] GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:12.981267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:12.982695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:13.004315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:13.005159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:13.006191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:13.006846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:13.308607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:13.309793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:13.310425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:13.318999 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:13.319752 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:13.320599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:13.321047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:13.323622 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8721912-df1b-4053-b1ae-760ce01bc012 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 0.348780 Jul 24 01:22:13.327978 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1364/2884] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:12 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:13.381973 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:13.626900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4c7d97d-9f79-4a43-822a-525aadee7047 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:13.628480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d4c7d97d-9f79-4a43-822a-525aadee7047 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:13.815668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d4c7d97d-9f79-4a43-822a-525aadee7047 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:13.834597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d4c7d97d-9f79-4a43-822a-525aadee7047 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:13.837573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d4c7d97d-9f79-4a43-822a-525aadee7047 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:13.844170 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d4c7d97d-9f79-4a43-822a-525aadee7047 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1285 microversion: 2.42 time: 0.220901 Jul 24 01:22:13.845373 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1365/2885] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:13 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:22:13.913953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:13.914909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:13.930689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:13.936668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:13.939149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:13.941042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:14.020975 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] HTTP exception thrown: Instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 could not be found. Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Request method failure captured: Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 HTTP/1.1 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JzGaCWJQTmFGkMDDZ5nycua3iLtF1niMyijANOX-syC6mhqPU3TZ7dtA87qM0mDn6qt0oSu4EMC2ckmSHhYBy7P3JO2WpQEbQDHvoAgxTC4lWTRE0fAItFHRDZTNe4L4bFroEb8ZbL9CCzTbVe_4xF1kM257EqC_En1GpTOHC8os_I Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.25 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6caac543f0e47e5908eb146739cddca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 735a3f7d7e454f14a7a4ed229affd75b Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 could not be found. Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0'} Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 could not be found. Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 could not be found. Jul 24 01:22:14.027399 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 could not be found. Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Returning 404 to user: Instance 8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-24c27784-78ec-4fc7-9ef8-df2e9e7c8f4d tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0" status: 404 len: 111 microversion: 2.25 time: 0.133275 Jul 24 01:22:14.031445 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1366/2886] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:13 2022] GET /compute/v2.1/servers/8e3e1d8a-1e46-4ff1-b6c0-6b7fc80b21b0 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:22:14.045442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:14.050104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:14.068367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:14.073874 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:14.074340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:14.075150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:14.075736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:14.077123 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fd488131-975d-47cc-9b7a-f1ee52e76512 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 0.772386 Jul 24 01:22:14.077848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1521/2887] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:13 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:22:14.103379 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8880942c-ee3c-43b5-a9ed-da57188f5b46 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '.version_select at 0x7f05eae4c3a0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:14.147821 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8880942c-ee3c-43b5-a9ed-da57188f5b46 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866869818" status: 204 len: 0 microversion: 2.25 time: 0.058389 Jul 24 01:22:14.148891 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1522/2888] 10.222.0.27 () {60 vars in 1258 bytes} [Sun Jul 24 01:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866869818 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:22:14.345559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:14.346543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:14.353813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:14.354582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:14.356096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:14.356759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:14.693548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:14.697729 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:14.707469 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-211cd4b4-dbe6-4dea-b648-1e23489921e8 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f" status: 200 len: 1521 microversion: 2.1 time: 0.674703 Jul 24 01:22:14.709368 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1367/2889] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:14 2022] GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:14.807042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-72f9b0ff-46ad-41d3-aa13-a746b6df3ceb req-42ac63a1-f68e-45ba-9f07-f63bb2e0797f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3aab3fa-7900-4605-8969-e247819a40a8", "tag": "f40bf963-eeee-4a8d-8a5b-bee0b310e4b0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:14.836589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-72f9b0ff-46ad-41d3-aa13-a746b6df3ceb req-42ac63a1-f68e-45ba-9f07-f63bb2e0797f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:14.842450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-72f9b0ff-46ad-41d3-aa13-a746b6df3ceb req-42ac63a1-f68e-45ba-9f07-f63bb2e0797f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:14.853939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:14.864334 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-74fbf673-e01e-4b5c-aede-9a249db7ee4a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 0.523567 Jul 24 01:22:14.867276 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-72f9b0ff-46ad-41d3-aa13-a746b6df3ceb req-42ac63a1-f68e-45ba-9f07-f63bb2e0797f service nova] Creating event network-changed:f40bf963-eeee-4a8d-8a5b-bee0b310e4b0 for instance b3aab3fa-7900-4605-8969-e247819a40a8 on n-h2-master-1 Jul 24 01:22:14.875370 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1523/2890] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:14 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:14.877412 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-72f9b0ff-46ad-41d3-aa13-a746b6df3ceb req-42ac63a1-f68e-45ba-9f07-f63bb2e0797f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078400 Jul 24 01:22:14.878634 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1368/2891] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:14.881407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:14.882245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:14.889232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:14.889935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:14.890886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:14.892154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:15.026702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:15.066942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:15.072877 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:15.077111 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c86f2650-33c3-4987-9950-c8badac6ce48 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1575 microversion: 2.42 time: 0.198956 Jul 24 01:22:15.078700 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1524/2892] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:14 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:15.096508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:15.097322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:15.115414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:15.116312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:15.119607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:15.120541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:15.599882 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-172f1ba4-7fd6-41ef-8823-481399bed3e2 req-5f5f4ca9-62e4-4ded-a9b4-fe993e798bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60483b9c-5e82-4da2-a0f3-a851c1007a7f", "name": "network-vif-deleted", "tag": "c9f52d4e-682d-4b4d-9b32-cb149bbcd934"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:15.629348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-172f1ba4-7fd6-41ef-8823-481399bed3e2 req-5f5f4ca9-62e4-4ded-a9b4-fe993e798bba service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:15.638469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-172f1ba4-7fd6-41ef-8823-481399bed3e2 req-5f5f4ca9-62e4-4ded-a9b4-fe993e798bba service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:15.672482 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-172f1ba4-7fd6-41ef-8823-481399bed3e2 req-5f5f4ca9-62e4-4ded-a9b4-fe993e798bba service nova] Creating event network-vif-deleted:c9f52d4e-682d-4b4d-9b32-cb149bbcd934 for instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f on n-h1-master-1 Jul 24 01:22:15.684834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-172f1ba4-7fd6-41ef-8823-481399bed3e2 req-5f5f4ca9-62e4-4ded-a9b4-fe993e798bba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095817 Jul 24 01:22:15.689420 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1525/2893] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:15.731816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:15.732538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:15.752896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:15.753417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:15.755222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:15.759007 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:15.840599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:15.841993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:15.842797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lazy-loading 'fault' on Instance uuid 60483b9c-5e82-4da2-a0f3-a851c1007a7f {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:22:16.198009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d8758357384418aeca2b24f1e8bd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0fe7868ac524f4498b1dadc33efae7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:16.209933 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8d4050b-194e-4829-896a-9ba4b10f7b4d tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f" status: 200 len: 1313 microversion: 2.1 time: 0.482936 Jul 24 01:22:16.213721 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1526/2894] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:15 2022] GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:16.225781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:16.226426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:16.246601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:16.249225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:16.251450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:16.252105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:16.411496 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:16.427220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02e19e4b-b9c7-4a44-bdf2-da21dec48b7b tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 1.330251 Jul 24 01:22:16.428160 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1369/2895] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:15 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:16.440150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:16.444301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:16.452964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:16.460494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:16.462083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:16.462817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:16.660531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:16.680066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:16.681976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:16.683423 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09ad64dc-48ce-4838-858b-c9cb682e5540 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1593 microversion: 2.42 time: 0.254102 Jul 24 01:22:16.684509 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1370/2896] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:16 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1593 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:16.852551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:16.874801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-072d0ffd-f0ba-4fe2-bd2f-ec31328e7857 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 0.660288 Jul 24 01:22:16.878900 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1527/2897] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:16 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:17.228035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.228664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 60483b9c-5e82-4da2-a0f3-a851c1007a7f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.243627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.244102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.245180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.245809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.316607 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] HTTP exception thrown: Instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f could not be found. Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f HTTP/1.1 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f could not be found. Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '60483b9c-5e82-4da2-a0f3-a851c1007a7f'} Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f could not be found. Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f could not be found. Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:17.321135 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.327475 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:17.327475 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:17.327475 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:17.327475 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:17.327475 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:17.327475 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f could not be found. Jul 24 01:22:17.327475 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.359422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 404 to user: Instance 60483b9c-5e82-4da2-a0f3-a851c1007a7f could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:17.362894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.363537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.365833 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8311f3e8-be51-41e4-8708-52a461d55532 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f" status: 404 len: 111 microversion: 2.1 time: 0.137991 Jul 24 01:22:17.374902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.375656 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1371/2898] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:17 2022] GET /compute/v2.1/servers/60483b9c-5e82-4da2-a0f3-a851c1007a7f => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:22:17.380198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.384548 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.385101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.387418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.388898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] [instance: 74f881ec-70c2-4065-86be-8f9723814487] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.397800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.398375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.399274 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.399868 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.420549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] HTTP exception thrown: Instance 74f881ec-70c2-4065-86be-8f9723814487 could not be found. Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Request method failure captured: Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 HTTP/1.1 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J6Esn6ZreKij-Y45ug7hjTJ29eDPnGy1Fv9eulbQXoi4Q8GgxbuwyhsKXxcRpoLMvPwyfkXSAEiZSPcIb3SRupdxObIJ8SjnsrldelyOUAlGS6gDULTXRSgvYfB9ePcnWVTSfKCB8U9MQZJH7esO-Y3OaV3YbcgL8cahHJzduKZyms Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fe7868ac524f4498b1dadc33efae7b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fe7868ac524f4498b1dadc33efae7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a0fe7868ac524f4498b1dadc33efae7b Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1043701757 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 59d8758357384418aeca2b24f1e8bd12 Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ListServersNegativeTestJSON-1043701757-project Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 74f881ec-70c2-4065-86be-8f9723814487 could not be found. Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '74f881ec-70c2-4065-86be-8f9723814487'} Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f881ec-70c2-4065-86be-8f9723814487 could not be found. Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f881ec-70c2-4065-86be-8f9723814487 could not be found. Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:17.422527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f881ec-70c2-4065-86be-8f9723814487 could not be found. Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:17.427570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] Returning 404 to user: Instance 74f881ec-70c2-4065-86be-8f9723814487 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:17.428927 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56a37dbc-0656-4ca3-81b5-703c1807aae4 tempest-ListServersNegativeTestJSON-1043701757 tempest-ListServersNegativeTestJSON-1043701757-project] 10.222.0.27 "GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487" status: 404 len: 111 microversion: 2.1 time: 0.050179 Jul 24 01:22:17.430028 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1372/2899] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:17 2022] GET /compute/v2.1/servers/74f881ec-70c2-4065-86be-8f9723814487 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:22:17.447236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.448127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.452030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:17.464624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.470241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.471691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.472520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.580343 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-90bef733-1295-4084-a527-c1a36be79a64 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 204 len: 0 microversion: 2.25 time: 0.222126 Jul 24 01:22:17.581443 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1528/2900] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:22:17 2022] DELETE /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:22:17.591759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.601264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.613642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.614350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.615171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.618235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.708853 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:17.778860 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:17.794732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ca953cc1-d55b-4cca-a252-54031987e4a1 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 0.352788 Jul 24 01:22:17.795249 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1373/2901] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:17 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:17.804351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:17.804971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:17.825956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.826901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:17.828236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:17.830984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.700261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:18.717071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:18.720537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:18.722306 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-460a7a0a-57ca-4fa9-9c21-e47958b88a06 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1548 microversion: 2.25 time: 1.136652 Jul 24 01:22:18.734777 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1529/2902] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:17 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1548 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:18.741255 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:18.742836 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:18.751993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:18.752854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.753872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:18.754839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.867811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:18.893765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:18.895847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:18.897161 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-afa784c3-d032-49d7-ab4a-1cc2a9ddd9b2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1660 microversion: 2.42 time: 1.100970 Jul 24 01:22:18.898180 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1374/2903] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:17 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1660 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:18.902884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5efb8c38-2688-4748-b406-c6fd2ad17ebb req-ee75d078-4b91-44f5-b938-a8385c30d827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f881ec-70c2-4065-86be-8f9723814487", "name": "network-vif-deleted", "tag": "f62ac16b-5573-4158-9804-4338746e802e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:18.922004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5efb8c38-2688-4748-b406-c6fd2ad17ebb req-ee75d078-4b91-44f5-b938-a8385c30d827 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:18.922629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5efb8c38-2688-4748-b406-c6fd2ad17ebb req-ee75d078-4b91-44f5-b938-a8385c30d827 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:18.947743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5efb8c38-2688-4748-b406-c6fd2ad17ebb req-ee75d078-4b91-44f5-b938-a8385c30d827 service nova] Creating event network-vif-deleted:f62ac16b-5573-4158-9804-4338746e802e for instance 74f881ec-70c2-4065-86be-8f9723814487 on n-h2-master-1 Jul 24 01:22:18.959625 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5efb8c38-2688-4748-b406-c6fd2ad17ebb req-ee75d078-4b91-44f5-b938-a8385c30d827 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058605 Jul 24 01:22:18.961949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1375/2904] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:18.978564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5f943064-202f-471e-91cd-df7f733ca0c3 req-bba7e018-dcd7-495e-a7ad-9c14334831dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4ad5bd-4ebe-43fa-abde-ab5021e272e0", "name": "network-vif-plugged", "status": "completed", "tag": "928f3547-d4e3-49ce-a075-f39a7dbb8041"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:19.000242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5f943064-202f-471e-91cd-df7f733ca0c3 req-bba7e018-dcd7-495e-a7ad-9c14334831dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.000242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5f943064-202f-471e-91cd-df7f733ca0c3 req-bba7e018-dcd7-495e-a7ad-9c14334831dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.033342 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5f943064-202f-471e-91cd-df7f733ca0c3 req-bba7e018-dcd7-495e-a7ad-9c14334831dd service nova] Creating event network-vif-plugged:928f3547-d4e3-49ce-a075-f39a7dbb8041 for instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 on n-h1-master-1 Jul 24 01:22:19.048836 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5f943064-202f-471e-91cd-df7f733ca0c3 req-bba7e018-dcd7-495e-a7ad-9c14334831dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079328 Jul 24 01:22:19.053533 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1376/2905] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:19.066117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:19.067291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:19.092988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.093494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.096905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.097869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.135755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:19.151462 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b0701d5e-b32c-40c4-99a0-2d24a985775d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 0.414778 Jul 24 01:22:19.152444 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1530/2906] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:18 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:19.389353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:19.423511 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2fbc0472-2492-4836-928c-0a86bcb44289 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 0.367235 Jul 24 01:22:19.434208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1377/2907] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:19 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:19.746394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:19.754593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:19.756994 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:19.815913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.818824 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.820663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.822804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.917491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:19.918743 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:19.928931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.940301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:19.949069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:19.949820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:20.439358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.478267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.481291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.483082 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aebbb72f-66c1-4828-9955-fea8e21852cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1660 microversion: 2.42 time: 0.570502 Jul 24 01:22:20.511947 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1378/2908] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:19 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1660 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:20.557393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.580512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.589159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:20.593252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-099cd456-ad66-4d7e-9aa3-c0fb2ecbe7d9 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1548 microversion: 2.25 time: 0.854088 Jul 24 01:22:20.614560 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1531/2909] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:19 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1548 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:20.620771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:20.635231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:20.656833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:20.659636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:20.660784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:20.664895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:20.919658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0eb71682-0c2e-411e-882d-8ee97ade8c9e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Action: 'create', calling method: .version_select at 0x7f05eb9384c0>, body: {"keypair": {"name": "tempest-keypair-1407989908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhJxpu7B53D+J4GrikZN3TLZH14QAHVelPqHkvlFSyZsdr/FWW1fHNXIYW+TDOk5lU+G//uZdfnirwAaHR004+e7q3Wo/9KYARGaypgdj2wpUdQZUpPudDg080g2O+8oQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:20.962875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0eb71682-0c2e-411e-882d-8ee97ade8c9e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Getting quotas for project c60507837fec4e06bd0551093bceb959. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:20.990460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0eb71682-0c2e-411e-882d-8ee97ade8c9e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Getting quotas for user d82fd738d5bb4d5e838f67b0b76b3b56 and project c60507837fec4e06bd0551093bceb959. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:21.044551 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0eb71682-0c2e-411e-882d-8ee97ade8c9e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.530414 Jul 24 01:22:21.045187 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1379/2910] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:22:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:21.055793 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:21.056525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:21.075326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:21.075794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:21.076623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:21.077067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:21.599327 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:21.693030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:21.701783 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-406ebff8-8422-4a95-93a2-df175de15093 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 0.655474 Jul 24 01:22:21.702378 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1380/2911] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:21 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:21.718251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:21.722277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:21.740996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:21.741918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:21.745533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:21.746926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:21.979433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:22.004429 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88e4d7ef-b9ce-47c9-8af0-144c7a4314b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 1.380115 Jul 24 01:22:22.008994 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1532/2912] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:20 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:22.036374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:22.037378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:22.044523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:22.049327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:22.050488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:22.051813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:22.335823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:22.351718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:22.360986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:22.365161 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-329b4509-9565-4111-b4da-9999e9387a8f tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1706 microversion: 2.42 time: 0.653667 Jul 24 01:22:22.377750 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1381/2913] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:21 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1706 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:22.507417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:22.520264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:22.529963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:22.531326 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64006ce6-1a9c-4c5e-800a-b3b5bf79ef97 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 200 len: 1548 microversion: 2.25 time: 0.510277 Jul 24 01:22:22.531985 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1533/2914] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:22 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 1548 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:22.721029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:22.721660 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:22.735986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:22.736552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:22.737261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:22.737768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:23.026774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:23.027396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:23.051618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:23.052075 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:23.052872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:23.053311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:24.502704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:24.552205 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58e89b7b-b13c-4a13-8818-5fa4f0120cf2 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 1.834080 Jul 24 01:22:24.553048 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1382/2915] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:22 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:24.575551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2547445b-2b1a-4586-8f50-9581218fd300 req-49159442-4b14-460b-a616-2f912ead16fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756", "name": "network-vif-deleted", "tag": "42c48376-af28-46ff-826d-a163933356db"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:24.613533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2547445b-2b1a-4586-8f50-9581218fd300 req-49159442-4b14-460b-a616-2f912ead16fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:24.619217 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2547445b-2b1a-4586-8f50-9581218fd300 req-49159442-4b14-460b-a616-2f912ead16fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:24.652234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2547445b-2b1a-4586-8f50-9581218fd300 req-49159442-4b14-460b-a616-2f912ead16fb service nova] Creating event network-vif-deleted:42c48376-af28-46ff-826d-a163933356db for instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 on n-h2-master-1 Jul 24 01:22:24.671157 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2547445b-2b1a-4586-8f50-9581218fd300 req-49159442-4b14-460b-a616-2f912ead16fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114763 Jul 24 01:22:24.671950 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1383/2916] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:24.691436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:24.692348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:24.706302 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:24.711390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:24.712683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:24.715902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:24.716479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:24.884759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:24.895502 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-95631f8e-1e1f-4273-a7a1-31fdc14684b8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 1.872832 Jul 24 01:22:24.907442 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1534/2917] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:23 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:22:24.912825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:24.913660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:24.932010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:24.932475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:24.933287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:24.933798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:24.972183 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] HTTP exception thrown: Instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 could not be found. Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Request method failure captured: Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 HTTP/1.1 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3JzGaCWJQTmFGkMDDZ5nycua3iLtF1niMyijANOX-syC6mhqPU3TZ7dtA87qM0mDn6qt0oSu4EMC2ckmSHhYBy7P3JO2WpQEbQDHvoAgxTC4lWTRE0fAItFHRDZTNe4L4bFroEb8ZbL9CCzTbVe_4xF1kM257EqC_En1GpTOHC8os_I Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.25 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6caac543f0e47e5908eb146739cddca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 735a3f7d7e454f14a7a4ed229affd75b Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 could not be found. Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756'} Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 could not be found. Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 could not be found. Jul 24 01:22:24.978950 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 could not be found. Jul 24 01:22:24.983925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:24.986700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Returning 404 to user: Instance 8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:24.987793 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea5b1bf1-9170-423b-a15e-fee9d776e71f tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756" status: 404 len: 111 microversion: 2.25 time: 0.078890 Jul 24 01:22:24.988927 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1535/2918] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:24 2022] GET /compute/v2.1/servers/8ddd7dcd-5b77-4d92-aff4-7e27cbdb7756 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:22:24.997091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:25.001378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:25.024233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.024699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:25.025510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.037080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:25.076361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:25.100310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:25.101901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:25.103145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09b9faba-6692-4415-9ed8-17a3686c48e4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1706 microversion: 2.42 time: 0.427617 Jul 24 01:22:25.103737 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1384/2919] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:24 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1706 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:25.112916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:25.240594 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:25.293148 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-10af9100-b2a6-4893-b83b-88035bef03c6 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 204 len: 0 microversion: 2.25 time: 0.299609 Jul 24 01:22:25.293324 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1536/2920] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:22:24 2022] DELETE /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:22:25.302988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:25.309014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:25.321365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.322208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:25.378906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.396089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:25.569657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:25.570880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:25.594849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.602501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:25.603369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:25.603822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:26.341194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:26.356747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:26.361523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:26.365384 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c79ea1dd-4023-456f-8a2e-d7be6bad2db0 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1564 microversion: 2.25 time: 1.065693 Jul 24 01:22:26.371031 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1385/2921] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:25 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1564 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:26.383050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:26.385002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:26.400755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:26.405054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:26.406049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:26.406880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:26.937060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:26.948955 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-377522f9-45a7-4344-b78d-33b7b533cd61 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 1.383350 Jul 24 01:22:26.951092 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1537/2922] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:25 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:26.966960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:26.967711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:26.985652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:26.986273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:26.987114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:26.987566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:27.542921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:27.561338 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fbdf838-d26f-4663-9b5a-eb708f48faa3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 1.187664 Jul 24 01:22:27.562551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1386/2923] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:26 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:27.569340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:27.573561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:27.601194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:27.602117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:27.603219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:27.606997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:27.870951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:27.904017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:27.908908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:27.912761 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a60cba34-9302-4c3f-acb9-579b8760c432 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1752 microversion: 2.42 time: 0.960217 Jul 24 01:22:27.916898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1538/2924] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:26 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1752 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:27.937189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ec0825f0-6940-4d0d-8a16-420e33d03631 req-a581f457-59bd-4c8e-b456-7c65239a1fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3aab3fa-7900-4605-8969-e247819a40a8", "name": "network-vif-plugged", "status": "completed", "tag": "f40bf963-eeee-4a8d-8a5b-bee0b310e4b0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:27.949348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ec0825f0-6940-4d0d-8a16-420e33d03631 req-a581f457-59bd-4c8e-b456-7c65239a1fc5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:27.952789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ec0825f0-6940-4d0d-8a16-420e33d03631 req-a581f457-59bd-4c8e-b456-7c65239a1fc5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:27.968400 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ec0825f0-6940-4d0d-8a16-420e33d03631 req-a581f457-59bd-4c8e-b456-7c65239a1fc5 service nova] Creating event network-vif-plugged:f40bf963-eeee-4a8d-8a5b-bee0b310e4b0 for instance b3aab3fa-7900-4605-8969-e247819a40a8 on n-h2-master-1 Jul 24 01:22:27.975809 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ec0825f0-6940-4d0d-8a16-420e33d03631 req-a581f457-59bd-4c8e-b456-7c65239a1fc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044402 Jul 24 01:22:27.977129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1539/2925] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:22:27.983466 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:27.984392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:27.993312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:27.994110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:27.995069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:27.996192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:28.514107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:28.536451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:28.541108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735a3f7d7e454f14a7a4ed229affd75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6caac543f0e47e5908eb146739cddca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:28.543162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4225fc91-8f4d-46eb-a174-c554f1bd3a25 tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 200 len: 1564 microversion: 2.25 time: 0.978433 Jul 24 01:22:28.547432 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1387/2926] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:27 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 1564 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:28.588532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:28.589477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:28.602215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:28.604408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:28.606769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:28.607517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:29.445811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:29.457990 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e14284c-a4b5-4e8e-9c74-718f3d1220be tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1317 microversion: 2.1 time: 1.478957 Jul 24 01:22:29.458597 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1540/2927] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:27 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1317 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:29.466367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:29.466995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:29.503536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:29.504114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:29.504971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:29.505420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:30.178896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:30.196605 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3936233f-8f5d-4f5f-af04-d58e368535a7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 1.620527 Jul 24 01:22:30.197549 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1388/2928] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:28 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:22:30.202214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-629d6950-892a-4b01-afde-8eedde30ddc8 req-491bf332-bd7c-4fef-8ceb-3a192405649a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ffed3-aa7a-4f34-b7ff-36bf1f302095", "name": "network-vif-deleted", "tag": "66e73105-afa5-41a2-834d-bf1ca582b139"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:30.230039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-629d6950-892a-4b01-afde-8eedde30ddc8 req-491bf332-bd7c-4fef-8ceb-3a192405649a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:30.230496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-629d6950-892a-4b01-afde-8eedde30ddc8 req-491bf332-bd7c-4fef-8ceb-3a192405649a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:30.243332 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-629d6950-892a-4b01-afde-8eedde30ddc8 req-491bf332-bd7c-4fef-8ceb-3a192405649a service nova] Creating event network-vif-deleted:66e73105-afa5-41a2-834d-bf1ca582b139 for instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 on n-h1-master-1 Jul 24 01:22:30.263651 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-629d6950-892a-4b01-afde-8eedde30ddc8 req-491bf332-bd7c-4fef-8ceb-3a192405649a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064708 Jul 24 01:22:30.264291 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1389/2929] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:30.275321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:30.278836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] [instance: 940ffed3-aa7a-4f34-b7ff-36bf1f302095] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:30.293736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:30.300243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:30.301972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:30.302583 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:30.316051 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:30.343695 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] HTTP exception thrown: Instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 could not be found. Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Request method failure captured: Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 HTTP/1.1 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3JzGaCWJQTmFGkMDDZ5nycua3iLtF1niMyijANOX-syC6mhqPU3TZ7dtA87qM0mDn6qt0oSu4EMC2ckmSHhYBy7P3JO2WpQEbQDHvoAgxTC4lWTRE0fAItFHRDZTNe4L4bFroEb8ZbL9CCzTbVe_4xF1kM257EqC_En1GpTOHC8os_I Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.25 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6caac543f0e47e5908eb146739cddca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6caac543f0e47e5908eb146739cddca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e6caac543f0e47e5908eb146739cddca Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101 Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 735a3f7d7e454f14a7a4ed229affd75b Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1867978101-project Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 could not be found. Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '940ffed3-aa7a-4f34-b7ff-36bf1f302095'} Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 could not be found. Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 could not be found. Jul 24 01:22:30.350439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 could not be found. Jul 24 01:22:30.355897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:30.358796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] Returning 404 to user: Instance 940ffed3-aa7a-4f34-b7ff-36bf1f302095 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:30.361614 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aaeb68d7-e61b-4cde-87b4-01f30e1b179c tempest-LiveAutoBlockMigrationV225Test-1867978101 tempest-LiveAutoBlockMigrationV225Test-1867978101-project] 10.222.0.27 "GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095" status: 404 len: 111 microversion: 2.25 time: 0.095914 Jul 24 01:22:30.362516 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1390/2930] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:30 2022] GET /compute/v2.1/servers/940ffed3-aa7a-4f34-b7ff-36bf1f302095 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:22:30.403819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:30.426046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:30.434856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:30.436698 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-18d8c747-4aab-4d3b-ac9a-dd5035b3b9e7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1752 microversion: 2.42 time: 0.974605 Jul 24 01:22:30.450510 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1541/2931] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:29 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1752 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:30.477378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:30.478153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:30.513595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:30.514949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:30.522271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:30.522828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:31.011251 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=26 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:31.214057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:31.214815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:31.230354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:31.230809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:31.231609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:31.232047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:31.572350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:31.588721 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72545ac3-0ddf-4a0b-b4ac-105d72d8ee0e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 200 len: 1505 microversion: 2.1 time: 1.115814 Jul 24 01:22:31.590621 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1391/2932] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:30 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 1505 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:31.602846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-390374981", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "093bbef0-84ef-4b62-9d4b-b59243a6df5f"}], "security_groups": [{"name": "tempest-securitygroup--1638685744"}], "key_name": "tempest-keypair-1407989908", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:32.201860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:32.215215 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c610da47-5f78-436b-8252-69818dd8690e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1505 microversion: 2.1 time: 1.003767 Jul 24 01:22:32.221470 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1542/2933] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:31 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1505 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:32.231474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:32.233734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:32.251124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] validate_networks() for [('093bbef0-84ef-4b62-9d4b-b59243a6df5f', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:22:32.260634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:32.261352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:32.262594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:32.264086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:33.112562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:33.126583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:33.128947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:33.130423 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf62a738-515c-4056-aeda-7476cb82861a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1844 microversion: 2.42 time: 0.907290 Jul 24 01:22:33.144190 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1543/2934] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:32 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1844 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:33.151440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:33.152708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:33.162494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:33.164330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:33.165348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:33.166046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:34.522577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:34.537173 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ceb9ec9b-6255-4469-8767-2b326adfea68 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0" status: 200 len: 1504 microversion: 2.1 time: 1.391068 Jul 24 01:22:34.538655 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1544/2935] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:33 2022] GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 => generated 1504 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:34.561793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:34.562607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:34.571088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:34.571816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:34.572790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:34.573394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.210209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:22:35.211537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:22:35.212351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:22:35.212999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:22:35.213644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:22:35.233873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.235310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.236452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.237118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.280258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Getting quotas for project c60507837fec4e06bd0551093bceb959. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:35.286254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Getting quotas for user d82fd738d5bb4d5e838f67b0b76b3b56 and project c60507837fec4e06bd0551093bceb959. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:35.315585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:22:35.318868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:22:35.416574 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e5abf3a7-d088-46c9-87b5-047103cb005d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.824404 Jul 24 01:22:35.417233 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1392/2936] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:22:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 3826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:22:35.439014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:35.440023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:35.446722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.447462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.449735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.450374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.516854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:35.530435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-06aa9ab3-84d6-4a75-ae04-0c4d9e9e7671 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1485 microversion: 2.1 time: 0.990520 Jul 24 01:22:35.536024 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1545/2937] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:34 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1485 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:35.550126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b1b2ba77-8397-4c22-8e5d-520e6821d490 req-bdf6dd83-b059-44e6-85c1-8ac03cb08d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "a25f1481-9636-49b6-a9f4-4b944673adff"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:35.582488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b1b2ba77-8397-4c22-8e5d-520e6821d490 req-bdf6dd83-b059-44e6-85c1-8ac03cb08d3a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.583183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b1b2ba77-8397-4c22-8e5d-520e6821d490 req-bdf6dd83-b059-44e6-85c1-8ac03cb08d3a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.612128 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b1b2ba77-8397-4c22-8e5d-520e6821d490 req-bdf6dd83-b059-44e6-85c1-8ac03cb08d3a service nova] Creating event network-changed:a25f1481-9636-49b6-a9f4-4b944673adff for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:22:35.624582 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b1b2ba77-8397-4c22-8e5d-520e6821d490 req-bdf6dd83-b059-44e6-85c1-8ac03cb08d3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087074 Jul 24 01:22:35.627436 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1546/2938] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:35.639676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:35.643264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:35.671405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.676681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.678479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:35.684298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:35.758694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:35.945390 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ec2c4c8-5532-4674-8d0b-b4075a9f6aad tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0" status: 204 len: 0 microversion: 2.1 time: 0.313466 Jul 24 01:22:35.946914 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1547/2939] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:22:35 2022] DELETE /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:22:35.959427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8c56b15a-9edd-4ad3-b4ac-2a7ab57744dc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:35.960816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c56b15a-9edd-4ad3-b4ac-2a7ab57744dc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:36.237896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8c56b15a-9edd-4ad3-b4ac-2a7ab57744dc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:36.254249 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8c56b15a-9edd-4ad3-b4ac-2a7ab57744dc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1241 microversion: 2.1 time: 0.304637 Jul 24 01:22:36.254897 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1548/2940] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:35 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1241 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:36.260214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-386282267", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:36.367722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:36.387219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:36.402575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:36.404104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd0bfc19-dff9-4123-9b0e-bd5b1f56bb8e tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1865 microversion: 2.42 time: 0.980719 Jul 24 01:22:36.404910 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1393/2941] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:35 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1865 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:36.406016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] validate_networks() for [('0e557ce4-7ca3-450c-bdac-fc87df3a754c', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:22:36.411020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:36.411832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:36.418682 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:36.419471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:36.420488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:36.421146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:36.482977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:22:36.630985 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ca3a855-e98e-43f6-a9ac-95892956619e tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 204 len: 0 microversion: 2.1 time: 0.224246 Jul 24 01:22:36.632121 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1394/2942] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:22:36 2022] DELETE /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:22:36.650692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:36.651742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:36.663158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:36.663995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:36.665013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:36.669002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:37.387504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:37.396280 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d110a3b-683b-492e-9978-5813abc201b7 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0" status: 200 len: 1510 microversion: 2.1 time: 0.758104 Jul 24 01:22:37.400729 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1395/2943] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:36 2022] GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 => generated 1510 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:37.405888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:37.413256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:37.426045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:37.436665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:37.438002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:37.438667 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:38.134502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:38.143876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e517d968-2d7a-4dc3-bf27-a35807001642 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1237 microversion: 2.1 time: 0.741711 Jul 24 01:22:38.154307 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1396/2944] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:37 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1237 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:38.161701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:38.162993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:38.170349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:38.171136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:38.172814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:38.173481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:38.554780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:22:38.555237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:22:38.555695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:22:38.556114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:22:38.556660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:22:38.597472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:38.602064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:38.604225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:38.606107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:38.658198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Getting quotas for project 6b725b9f1812465f8a350e1a68e067a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:38.668258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Getting quotas for user 1dda9fc0670f4e11ad4d8089bf1687c3 and project 6b725b9f1812465f8a350e1a68e067a0. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:38.694789 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:38.697977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:22:38.706265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:22:38.803885 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-967065cc-6809-4110-814b-7803a1186753 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.547833 Jul 24 01:22:38.810242 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1549/2945] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:22:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:22:38.819032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-243870d5-cad5-4cea-a182-a6c62673dad4 req-0c85a570-2062-492c-af27-10d41ab565bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "86dc5ccc-4155-4bbe-89ce-b5108cebb1c1"}, {"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "563bde46-aa44-416a-953e-81183c46ef04"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:38.839098 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-243870d5-cad5-4cea-a182-a6c62673dad4 req-0c85a570-2062-492c-af27-10d41ab565bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:38.839548 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-243870d5-cad5-4cea-a182-a6c62673dad4 req-0c85a570-2062-492c-af27-10d41ab565bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:38.862382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-243870d5-cad5-4cea-a182-a6c62673dad4 req-0c85a570-2062-492c-af27-10d41ab565bc service nova] Creating event network-changed:86dc5ccc-4155-4bbe-89ce-b5108cebb1c1 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:22:38.869850 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-243870d5-cad5-4cea-a182-a6c62673dad4 req-0c85a570-2062-492c-af27-10d41ab565bc service nova] Creating event network-changed:563bde46-aa44-416a-953e-81183c46ef04 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:22:38.875440 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-243870d5-cad5-4cea-a182-a6c62673dad4 req-0c85a570-2062-492c-af27-10d41ab565bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063409 Jul 24 01:22:38.881767 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1550/2946] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:38.887895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:38.898764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:38.906168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:38.910380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:38.911475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:38.912098 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:39.669089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:39.686722 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-678d18fe-26f8-4c16-abfa-4db861d91728 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0" status: 200 len: 1510 microversion: 2.1 time: 0.803356 Jul 24 01:22:39.687532 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1551/2947] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:38 2022] GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 => generated 1510 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:39.700702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:39.701714 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:39.723841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:39.724574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:39.725575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:39.726222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:39.879736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:39.894691 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:39.896237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:39.899076 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-483201d4-650e-4c3c-8a20-990002d35996 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1886 microversion: 2.42 time: 1.743131 Jul 24 01:22:39.899683 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1397/2948] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:38 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1886 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:39.908818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:39.909450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:39.928613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:39.929091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:39.933499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:39.934303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:40.274063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:40.296855 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a03ad7b4-e979-4aae-ac12-3d1f6434c76a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1217 microversion: 2.1 time: 0.603258 Jul 24 01:22:40.301779 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1552/2949] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:39 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1217 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:40.473723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:40.483549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c444e37-2b7d-4bfe-8733-0e1654918f9f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1299 microversion: 2.1 time: 0.582788 Jul 24 01:22:40.494078 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1398/2950] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:39 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1299 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:40.710651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:40.712796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:40.724527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:40.725461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:40.726771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:40.734287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:40.919281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:40.920482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:40.931313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:40.934660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:40.935705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:40.942630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:42.518543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a34b91b8c3d4fe3a42e0ceffa767726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd38af4d6e2417b9b73b03ee795328f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:42.530249 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-175109ac-a3a8-442f-8498-12d0943b0fed tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0" status: 200 len: 1510 microversion: 2.1 time: 1.829546 Jul 24 01:22:42.532233 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1553/2951] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:40 2022] GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 => generated 1510 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:42.538697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2b62e875-1726-43fe-84f0-b73765a722b7 req-9a29a3e3-b570-4813-8dc3-4ee44347cbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "9894718f-24b7-4560-8bf6-ac8c173245f5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:42.558136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2b62e875-1726-43fe-84f0-b73765a722b7 req-9a29a3e3-b570-4813-8dc3-4ee44347cbc2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:42.558900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2b62e875-1726-43fe-84f0-b73765a722b7 req-9a29a3e3-b570-4813-8dc3-4ee44347cbc2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:42.578653 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2b62e875-1726-43fe-84f0-b73765a722b7 req-9a29a3e3-b570-4813-8dc3-4ee44347cbc2 service nova] Creating event network-changed:9894718f-24b7-4560-8bf6-ac8c173245f5 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:22:42.584931 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2b62e875-1726-43fe-84f0-b73765a722b7 req-9a29a3e3-b570-4813-8dc3-4ee44347cbc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050914 Jul 24 01:22:42.586282 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1554/2952] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:42.607133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:42.608068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:42.615682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:42.616634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:42.617798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:42.618493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:42.796323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:42.806287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:42.807880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:42.810017 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bedfba0c-beb2-475c-9498-43d20e7bb22c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1886 microversion: 2.42 time: 1.894653 Jul 24 01:22:42.810884 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1399/2953] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:40 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1886 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:22:42.816360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:42.817170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:42.823773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:42.824228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:42.825478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:42.825478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:42.835626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:42.846597 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6aec63dd-81d4-4df8-a744-f80785849955 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1271 microversion: 2.1 time: 0.257455 Jul 24 01:22:42.858906 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1555/2954] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:42 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1271 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:42.865799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2fdf34ec-d8ba-4ff2-ab6c-b490d8f9f19e req-93d11cfe-c77a-410c-a16f-846b2e619cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4ad5bd-4ebe-43fa-abde-ab5021e272e0", "name": "network-vif-deleted", "tag": "928f3547-d4e3-49ce-a075-f39a7dbb8041"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:42.875906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2fdf34ec-d8ba-4ff2-ab6c-b490d8f9f19e req-93d11cfe-c77a-410c-a16f-846b2e619cce service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:42.876347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2fdf34ec-d8ba-4ff2-ab6c-b490d8f9f19e req-93d11cfe-c77a-410c-a16f-846b2e619cce service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:42.880963 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:42.889474 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2fdf34ec-d8ba-4ff2-ab6c-b490d8f9f19e req-93d11cfe-c77a-410c-a16f-846b2e619cce service nova] Creating event network-vif-deleted:928f3547-d4e3-49ce-a075-f39a7dbb8041 for instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 on n-h1-master-1 Jul 24 01:22:42.896736 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2fdf34ec-d8ba-4ff2-ab6c-b490d8f9f19e req-93d11cfe-c77a-410c-a16f-846b2e619cce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035819 Jul 24 01:22:42.897361 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1556/2955] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:43.075471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:43.090210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d8ef2a2d-c287-450e-ae51-99988bd579ec tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1299 microversion: 2.1 time: 0.277396 Jul 24 01:22:43.106764 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1400/2956] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:42 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:43.550952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:43.552496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: dd4ad5bd-4ebe-43fa-abde-ab5021e272e0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:43.561464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.562562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:43.563661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.564604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:43.590684 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] HTTP exception thrown: Instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 could not be found. Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Request method failure captured: Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 HTTP/1.1 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6U1ktFIcCvaqky3rz-NidbFeX1tbvxGrIVH1YL472ZoTGkw2aWNYc8-I14Y8ja7Ojhyjuvj6B-hYPfzaQDYYFN7IRuzS1mWMmCvtpujmQcREQrEb2W_pmX83KrnzvJ8yz0FFhREwj3g4YOs2vG-Gtru85hiB2sreNIsP1i6kkCG8k Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: dfd38af4d6e2417b9b73b03ee795328f Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MultipleCreateTestJSON-435160408 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dfd38af4d6e2417b9b73b03ee795328f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfd38af4d6e2417b9b73b03ee795328f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dfd38af4d6e2417b9b73b03ee795328f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfd38af4d6e2417b9b73b03ee795328f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MultipleCreateTestJSON-435160408 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: dfd38af4d6e2417b9b73b03ee795328f Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MultipleCreateTestJSON-435160408 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MultipleCreateTestJSON-435160408-project Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5a34b91b8c3d4fe3a42e0ceffa767726 Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MultipleCreateTestJSON-435160408-project Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: exception: Instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 could not be found. Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'dd4ad5bd-4ebe-43fa-abde-ab5021e272e0'} Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 could not be found. Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 could not be found. Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:43.593086 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.600614 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:43.600614 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:43.600614 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:43.600614 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:43.600614 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:43.600614 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 could not be found. Jul 24 01:22:43.600614 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.603730 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Returning 404 to user: Instance dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:43.605153 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e273bb0-a982-40e7-b5ff-63496d011904 tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0" status: 404 len: 111 microversion: 2.1 time: 0.059574 Jul 24 01:22:43.616088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:43.617100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] [instance: b3aab3fa-7900-4605-8969-e247819a40a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:43.620975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1557/2957] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:43 2022] GET /compute/v2.1/servers/dd4ad5bd-4ebe-43fa-abde-ab5021e272e0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:22:43.625576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.626353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:43.627459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.628123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:43.645422 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] HTTP exception thrown: Instance b3aab3fa-7900-4605-8969-e247819a40a8 could not be found. Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Request method failure captured: Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 HTTP/1.1 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J6U1ktFIcCvaqky3rz-NidbFeX1tbvxGrIVH1YL472ZoTGkw2aWNYc8-I14Y8ja7Ojhyjuvj6B-hYPfzaQDYYFN7IRuzS1mWMmCvtpujmQcREQrEb2W_pmX83KrnzvJ8yz0FFhREwj3g4YOs2vG-Gtru85hiB2sreNIsP1i6kkCG8k Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: dfd38af4d6e2417b9b73b03ee795328f Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-MultipleCreateTestJSON-435160408 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dfd38af4d6e2417b9b73b03ee795328f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfd38af4d6e2417b9b73b03ee795328f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dfd38af4d6e2417b9b73b03ee795328f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfd38af4d6e2417b9b73b03ee795328f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-MultipleCreateTestJSON-435160408 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: dfd38af4d6e2417b9b73b03ee795328f Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-MultipleCreateTestJSON-435160408 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-MultipleCreateTestJSON-435160408-project Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5a34b91b8c3d4fe3a42e0ceffa767726 Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-MultipleCreateTestJSON-435160408-project Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b3aab3fa-7900-4605-8969-e247819a40a8 could not be found. Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b3aab3fa-7900-4605-8969-e247819a40a8'} Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3aab3fa-7900-4605-8969-e247819a40a8 could not be found. Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3aab3fa-7900-4605-8969-e247819a40a8 could not be found. Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:22:43.647634 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.651458 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:22:43.651458 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:22:43.651458 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:22:43.651458 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:22:43.651458 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:22:43.651458 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3aab3fa-7900-4605-8969-e247819a40a8 could not be found. Jul 24 01:22:43.651458 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:22:43.657197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] Returning 404 to user: Instance b3aab3fa-7900-4605-8969-e247819a40a8 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:22:43.658604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f71146e9-1d27-4e86-8713-6dc2018eaadf tempest-MultipleCreateTestJSON-435160408 tempest-MultipleCreateTestJSON-435160408-project] 10.222.0.27 "GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8" status: 404 len: 111 microversion: 2.1 time: 0.047545 Jul 24 01:22:43.663108 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1401/2958] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:43 2022] GET /compute/v2.1/servers/b3aab3fa-7900-4605-8969-e247819a40a8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:22:43.834662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:43.837469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:43.848464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.849786 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:43.851123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.851814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:43.867354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:43.868146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:43.885303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.885795 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:43.886594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:43.887034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:44.073325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:44.082123 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-979b7c20-c178-4781-8982-69aa2c6a6165 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1271 microversion: 2.1 time: 0.220826 Jul 24 01:22:44.083317 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1402/2959] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:43 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:44.113405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:44.114504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:44.122821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:44.123452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:44.124555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:44.125259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:44.286749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:44.295363 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0392d599-67ed-4b9d-bfa5-0a3c54d447cc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1299 microversion: 2.1 time: 0.188366 Jul 24 01:22:44.305884 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1403/2960] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:44 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:44.679601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8dead789-eb01-4561-b5c2-ff6d4b4ced48 req-7cd52d59-2257-4df8-8e56-c9841bb92058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3aab3fa-7900-4605-8969-e247819a40a8", "name": "network-vif-deleted", "tag": "f40bf963-eeee-4a8d-8a5b-bee0b310e4b0"}, {"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:44.722492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8dead789-eb01-4561-b5c2-ff6d4b4ced48 req-7cd52d59-2257-4df8-8e56-c9841bb92058 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:44.723118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8dead789-eb01-4561-b5c2-ff6d4b4ced48 req-7cd52d59-2257-4df8-8e56-c9841bb92058 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:44.755198 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8dead789-eb01-4561-b5c2-ff6d4b4ced48 req-7cd52d59-2257-4df8-8e56-c9841bb92058 service nova] Creating event network-vif-deleted:f40bf963-eeee-4a8d-8a5b-bee0b310e4b0 for instance b3aab3fa-7900-4605-8969-e247819a40a8 on n-h2-master-1 Jul 24 01:22:44.758090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8dead789-eb01-4561-b5c2-ff6d4b4ced48 req-7cd52d59-2257-4df8-8e56-c9841bb92058 service nova] Creating event network-changed:2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:22:44.780888 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8dead789-eb01-4561-b5c2-ff6d4b4ced48 req-7cd52d59-2257-4df8-8e56-c9841bb92058 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.105233 Jul 24 01:22:44.784173 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1404/2961] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:45.158459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:45.200118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:45.215047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:45.236902 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-56eb3a12-b9d0-45f0-97e0-c629030d5d7c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.394799 Jul 24 01:22:45.239063 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1558/2962] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:43 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:45.251129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:45.251763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:45.265184 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:45.270424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:45.270899 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:45.271734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:45.272183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:45.310657 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:45.482132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1158132199", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "4015265e-e6b0-4e47-bccc-5d1d48270467"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:45.586741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:22:47.542014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:47.555378 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5a02bb3f-cfba-49a7-a0a4-bf40a68bcd51 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 2.310000 Jul 24 01:22:47.555934 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1559/2963] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:45 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:47.570602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:47.571243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:47.602247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:47.602716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:47.604138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:47.605187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:48.389026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:48.404442 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c29aeea-a5b1-465a-bbd6-8ff4d37a71dd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.847359 Jul 24 01:22:48.422937 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1560/2964] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:47 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:48.438455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:48.439328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:48.447950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:48.448812 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:48.449929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:48.450556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:48.647410 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:48.679867 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:48.967129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:48.987597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:48.993484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:48.996166 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-173fab73-35ad-44cd-87ed-3ad926876d02 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.571787 Jul 24 01:22:48.997394 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1561/2965] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:48 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:49.003533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3bafd669-b51a-40c4-bf36-7cc15596695e req-19633d24-162d-4386-806b-815e172e358e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "8db72927-4ceb-4d2a-8c5d-12b5eaec48d0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:49.032547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3bafd669-b51a-40c4-bf36-7cc15596695e req-19633d24-162d-4386-806b-815e172e358e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:49.033964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3bafd669-b51a-40c4-bf36-7cc15596695e req-19633d24-162d-4386-806b-815e172e358e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:49.051697 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3bafd669-b51a-40c4-bf36-7cc15596695e req-19633d24-162d-4386-806b-815e172e358e service nova] Creating event network-changed:8db72927-4ceb-4d2a-8c5d-12b5eaec48d0 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:22:49.063980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3bafd669-b51a-40c4-bf36-7cc15596695e req-19633d24-162d-4386-806b-815e172e358e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061761 Jul 24 01:22:49.064959 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1562/2966] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:49.081425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:49.082681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:49.096821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:49.097838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:49.099153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:49.100970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:49.940640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:22:49.941872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:22:49.942238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:22:49.943191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:22:49.943721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:22:49.962942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:49.963600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:49.974969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:49.975381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:50.021355 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:22:50.038218 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:22:50.082559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:22:50.087785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:50.096859 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6de4173-c80e-40b7-8a53-b88a4ab3bc0e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 1.029806 Jul 24 01:22:50.101431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1563/2967] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:49 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:50.111241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:22:50.116494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:50.126493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:50.142051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:50.142762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:50.144652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:50.145299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:50.294878 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-523b6d20-483a-44c7-82fa-a2217e11ffc6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.316540 Jul 24 01:22:50.298422 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1405/2968] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 5321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:22:50.304232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:50.306248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:50.316361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:50.316999 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:50.317997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:50.318851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:51.198986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:51.220750 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3cc2a50-d7c8-4552-8e9b-32f9d8897692 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 1.102396 Jul 24 01:22:51.224118 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1564/2969] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:50 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:51.232920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:51.233768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:51.246442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:51.247146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:51.248674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:51.249314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:51.362864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:51.367593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:51.374530 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9cfb228-2df7-4689-bd73-e3e41c935815 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1197 microversion: 2.1 time: 0.149010 Jul 24 01:22:51.379565 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1565/2970] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:51 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:51.387201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7d6dd670-a189-4d72-97e0-991b9bd7960e req-708aaf2c-ce9b-4cf6-92e8-594846a5d912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "b191e26a-3767-42da-a129-49e4941782bf"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:51.390119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:51.392668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:51.394129 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-45f90238-2e3f-401e-8202-8caf1817c2a8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.094501 Jul 24 01:22:51.395247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1406/2971] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:50 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:51.401221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:51.408714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:51.411427 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7d6dd670-a189-4d72-97e0-991b9bd7960e req-708aaf2c-ce9b-4cf6-92e8-594846a5d912 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:51.412073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7d6dd670-a189-4d72-97e0-991b9bd7960e req-708aaf2c-ce9b-4cf6-92e8-594846a5d912 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:51.425905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:51.426546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:51.427578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:51.428222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:51.429491 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7d6dd670-a189-4d72-97e0-991b9bd7960e req-708aaf2c-ce9b-4cf6-92e8-594846a5d912 service nova] Creating event network-changed:b191e26a-3767-42da-a129-49e4941782bf for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:22:51.436455 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7d6dd670-a189-4d72-97e0-991b9bd7960e req-708aaf2c-ce9b-4cf6-92e8-594846a5d912 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054864 Jul 24 01:22:51.438304 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1566/2972] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:52.244640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:52.245401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:52.258133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:52.258546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:52.259089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:52.260422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:52.261142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:52.269904 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-82589937-91e7-4daa-bb8b-1526387af3a4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 0.872048 Jul 24 01:22:52.279589 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1407/2973] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:51 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:52.393422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:52.394204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:52.400660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:52.401328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:52.402367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:52.402878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:52.446866 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:53.017621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:53.025147 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3edcd163-1ad6-40fb-b632-3b5387e78708 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1251 microversion: 2.1 time: 0.636227 Jul 24 01:22:53.035828 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1408/2974] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:52 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1251 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:22:53.041146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:53.042056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:53.048894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:53.056308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:53.057356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:53.058010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:53.545453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:53.561454 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-648b2f97-bd1a-4e1c-857e-d6a7ba16cfc5 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 1.320380 Jul 24 01:22:53.564639 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1567/2975] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:52 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:53.571038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3275cff2-b5fb-4140-91e3-c80bf06896b4 req-b3893ee0-fc73-41e8-a4cc-efa0a944c586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0523ef6e-9c39-40db-9a57-6a214c6e7c96", "tag": "15eda9b6-b239-4216-949d-a9cb797834ce"}, {"name": "network-changed", "server_uuid": "7f87e018-4100-4486-b086-4ca4dc17e290", "tag": "72c16541-b9a8-471c-8223-1f9b0a727708"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:53.587984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3275cff2-b5fb-4140-91e3-c80bf06896b4 req-b3893ee0-fc73-41e8-a4cc-efa0a944c586 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:53.588445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3275cff2-b5fb-4140-91e3-c80bf06896b4 req-b3893ee0-fc73-41e8-a4cc-efa0a944c586 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:53.604491 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3275cff2-b5fb-4140-91e3-c80bf06896b4 req-b3893ee0-fc73-41e8-a4cc-efa0a944c586 service nova] Creating event network-changed:15eda9b6-b239-4216-949d-a9cb797834ce for instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 on n-h1-master-1 Jul 24 01:22:53.605256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3275cff2-b5fb-4140-91e3-c80bf06896b4 req-b3893ee0-fc73-41e8-a4cc-efa0a944c586 service nova] Creating event network-changed:72c16541-b9a8-471c-8223-1f9b0a727708 for instance 7f87e018-4100-4486-b086-4ca4dc17e290 on n-h2-master-1 Jul 24 01:22:53.617629 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3275cff2-b5fb-4140-91e3-c80bf06896b4 req-b3893ee0-fc73-41e8-a4cc-efa0a944c586 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051215 Jul 24 01:22:53.618280 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1568/2976] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:53.626031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:53.630640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:53.640492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:53.641921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:53.644851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:53.645381 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:54.335079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:54.347476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:54.349546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:54.352265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-000297a4-54f9-4a9b-9f1f-303a6c6a777b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.314698 Jul 24 01:22:54.353331 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1409/2977] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:53 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:54.365727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:54.367217 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:54.372102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:54.376574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:54.377038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:54.378026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:54.379486 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:54.383260 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b0e4893-4b65-4b2f-a2db-2b96d66f86b7 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 0.761466 Jul 24 01:22:54.385627 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1569/2978] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:53 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:54.580507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:54.583270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:54.590829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:54.592509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:54.593549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:54.594194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:55.230209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:55.244537 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c8bc408-e9ac-46f2-96de-121194441b7b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1293 microversion: 2.1 time: 0.888236 Jul 24 01:22:55.258218 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1410/2979] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:54 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1293 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:55.264204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7c9ff6b7-4ac5-498e-9f61-a3754e8be4d2 req-4d5bc8a8-dff3-492a-8c94-9d198fa0fa71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9678c4ac-087e-4c4e-89a8-61fce0d303b5", "tag": "31a4c232-f771-4431-8aec-6381ec24d25a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:22:55.285433 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:55.293784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7c9ff6b7-4ac5-498e-9f61-a3754e8be4d2 req-4d5bc8a8-dff3-492a-8c94-9d198fa0fa71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:55.294258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7c9ff6b7-4ac5-498e-9f61-a3754e8be4d2 req-4d5bc8a8-dff3-492a-8c94-9d198fa0fa71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:55.309321 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7c9ff6b7-4ac5-498e-9f61-a3754e8be4d2 req-4d5bc8a8-dff3-492a-8c94-9d198fa0fa71 service nova] Creating event network-changed:31a4c232-f771-4431-8aec-6381ec24d25a for instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 on n-h2-master-1 Jul 24 01:22:55.315390 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7c9ff6b7-4ac5-498e-9f61-a3754e8be4d2 req-4d5bc8a8-dff3-492a-8c94-9d198fa0fa71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055375 Jul 24 01:22:55.316021 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1411/2980] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:22:55.376381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:55.377231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:55.388406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:55.388956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:55.389860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:55.390502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:55.804880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:55.814473 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25a66685-ed71-4440-85dc-f7f29a6fbb05 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 1.238065 Jul 24 01:22:55.823924 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1570/2981] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:54 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:22:55.830111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:55.830820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:55.837051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:55.837874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:55.838737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:55.839270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:56.476044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:56.497705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:56.502495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:56.504212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-055d5a7b-17be-40bc-b83f-7408bf0e3797 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.135009 Jul 24 01:22:56.505215 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1412/2982] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:55 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:56.513501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:56.514334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:56.523944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:56.524459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:56.525282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:56.525797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:56.560606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:56.578875 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8f67462-a692-405a-9f2e-e50efb9634dc tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 0.751545 Jul 24 01:22:56.587936 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1571/2983] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:55 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:56.832883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:56.833568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:56.846065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:56.859052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:56.864312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:56.865194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:57.046643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:57.054709 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f4f3116-29bc-4a92-8d6a-b8cddf8ab616 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1293 microversion: 2.1 time: 0.548191 Jul 24 01:22:57.055472 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1413/2984] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:56 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1293 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:57.410319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:57.418727 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3c416a02-4bb1-4346-8815-42b979514f6b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.591427 Jul 24 01:22:57.419486 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1572/2985] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:56 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:22:57.523826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:57.524377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:57.531190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:57.531835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:57.532417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:57.532865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:57.599374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:57.600495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:57.608134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:57.610097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:57.611232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:57.611841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:58.900912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:58.915571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:58.924717 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f85d8e4d-3a1f-4326-90a8-73950bba5c41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 1.330351 Jul 24 01:22:58.933769 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1573/2986] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:57 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:58.936003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:58.940012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:58.940190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:58.940640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:58.943878 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-689ab8ee-1668-4272-9350-f7eb12537881 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.423927 Jul 24 01:22:58.945295 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1414/2987] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:57 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:22:58.950682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:58.951361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:58.958899 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:58.959734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:58.961966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:58.962644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:58.963920 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:58.964385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:58.965777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:58.966860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:59.614868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:59.626231 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-629f4a4f-7795-464c-863c-50dfa4ec6b91 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1293 microversion: 2.1 time: 0.690321 Jul 24 01:22:59.627311 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1574/2988] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:58 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1293 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:59.641357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:22:59.649513 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44d71c76-97f0-48a2-beec-fb8b72c38747 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.702497 Jul 24 01:22:59.650707 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1415/2989] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:58 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:22:59.948750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:59.949721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:59.963514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:22:59.964832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:22:59.980328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:59.981748 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:59.987892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:59.990427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:59.991372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:22:59.997285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:22:59.998825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:00.001910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:00.004874 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:00.119238 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:01.252699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:01.273435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ec6216c-2428-4f0f-95a3-9546ebc1c0b4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 1.334579 Jul 24 01:23:01.274314 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1575/2990] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:22:59 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:01.288454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:01.291728 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:01.312352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:01.313192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:01.314341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:01.316369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:01.322040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:01.332256 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:01.341556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:01.349418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:01.351135 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5da71bb5-1825-445b-bb39-7ecaf6dad33c tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.391788 Jul 24 01:23:01.354064 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1416/2991] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:22:59 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:01.362369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:01.363372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:01.380495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:01.381095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:01.382044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:01.382620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:01.899533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:01.913169 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2760204a-0ea9-42b1-93db-196abbddbc53 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.554713 Jul 24 01:23:01.925882 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1417/2992] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:01 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:01.938384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:01.951764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ea2fa62-6d1e-42be-a8c2-3aed07e3ec25 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1293 microversion: 2.1 time: 0.675143 Jul 24 01:23:01.954314 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1576/2993] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:01 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1293 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:02.122570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7cb5093b-7941-4e30-9f3c-a4b3b9973a12 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Action: 'create', calling method: .version_select at 0x7f05eb1175e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-270714425", "policies": ["affinity"]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:02.158562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-7cb5093b-7941-4e30-9f3c-a4b3b9973a12 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:02.177407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-7cb5093b-7941-4e30-9f3c-a4b3b9973a12 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:02.268532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-7cb5093b-7941-4e30-9f3c-a4b3b9973a12 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:02.279699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-7cb5093b-7941-4e30-9f3c-a4b3b9973a12 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:02.292227 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:02.293247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:02.309035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:02.311490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:02.312553 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7cb5093b-7941-4e30-9f3c-a4b3b9973a12 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.381627 Jul 24 01:23:02.315516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:02.317315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:02.323683 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1418/2994] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:23:01 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:02.336870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-67cea274-b408-4d97-b94c-df3f53ad2c50 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Action: 'create', calling method: .version_select at 0x7f05eaff51f0>, body: {"server_group": {"name": "tempest-server-group-739674436", "policies": ["affinity"]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:02.387040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-67cea274-b408-4d97-b94c-df3f53ad2c50 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:02.400438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-67cea274-b408-4d97-b94c-df3f53ad2c50 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:02.539055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-67cea274-b408-4d97-b94c-df3f53ad2c50 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:02.568571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-67cea274-b408-4d97-b94c-df3f53ad2c50 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:02.597216 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-67cea274-b408-4d97-b94c-df3f53ad2c50 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.271092 Jul 24 01:23:02.598412 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1419/2995] 10.222.0.27 () {60 vars in 1172 bytes} [Sun Jul 24 01:23:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:02.604397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:02.605961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:02.620950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:02.621841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:02.623243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:02.624560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:02.877904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:02.892792 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87865eea-7080-487e-bfa0-0be07936a606 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 0.604837 Jul 24 01:23:02.893881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1577/2996] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:02 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:02.906863 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4d38ce5a-ad09-4f8a-95d5-a852f8163cf6 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Action: 'create', calling method: .version_select at 0x7f05eac41ee0>, body: {"server_group": {"name": "tempest-server-group-739674436", "policies": ["affinity"]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:02.960459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4d38ce5a-ad09-4f8a-95d5-a852f8163cf6 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:02.981582 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4d38ce5a-ad09-4f8a-95d5-a852f8163cf6 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:03.013237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:03.032840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:03.046267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:03.048340 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ecd4396c-5b34-423f-a205-18d530b18ba6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.447938 Jul 24 01:23:03.060650 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1420/2997] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:02 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:03.066870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:03.069829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:03.085557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4d38ce5a-ad09-4f8a-95d5-a852f8163cf6 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:03.093996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:03.094463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:03.095270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:03.095714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:03.101302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4d38ce5a-ad09-4f8a-95d5-a852f8163cf6 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:03.133611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4d38ce5a-ad09-4f8a-95d5-a852f8163cf6 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.238218 Jul 24 01:23:03.134274 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1578/2998] 10.222.0.27 () {60 vars in 1172 bytes} [Sun Jul 24 01:23:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:03.150805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:03.151585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:03.167009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:03.167463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:03.168433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:03.172047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:03.647560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:03.660132 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ee4f51c-7cb9-48a7-91ac-62586052c113 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.597880 Jul 24 01:23:03.660941 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1421/2999] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:03 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:03.665649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c051957f-d956-42ee-9f09-4a6523f44f11 req-e2423e7f-13e6-4766-99bc-8a0d255db854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0523ef6e-9c39-40db-9a57-6a214c6e7c96", "name": "network-vif-plugged", "status": "completed", "tag": "15eda9b6-b239-4216-949d-a9cb797834ce"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:03.691549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c051957f-d956-42ee-9f09-4a6523f44f11 req-e2423e7f-13e6-4766-99bc-8a0d255db854 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:03.691549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c051957f-d956-42ee-9f09-4a6523f44f11 req-e2423e7f-13e6-4766-99bc-8a0d255db854 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:03.713359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c051957f-d956-42ee-9f09-4a6523f44f11 req-e2423e7f-13e6-4766-99bc-8a0d255db854 service nova] Creating event network-vif-plugged:15eda9b6-b239-4216-949d-a9cb797834ce for instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 on n-h1-master-1 Jul 24 01:23:03.738549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c051957f-d956-42ee-9f09-4a6523f44f11 req-e2423e7f-13e6-4766-99bc-8a0d255db854 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076205 Jul 24 01:23:03.739746 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1422/3000] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:03.751539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d1277f6-24eb-4a2c-9b15-a2ea56505522 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:03.784186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:03.795842 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ade060a2-de25-48b9-bb27-55ad04aa6980 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1293 microversion: 2.1 time: 0.653913 Jul 24 01:23:03.811105 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1579/3001] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:03 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1293 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:03.838249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d1277f6-24eb-4a2c-9b15-a2ea56505522 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/25d113e6-14a4-44b7-b74d-516255554980" status: 204 len: 0 microversion: 2.1 time: 0.097027 Jul 24 01:23:03.841224 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1423/3002] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:03 2022] DELETE /compute/v2.1/os-server-groups/25d113e6-14a4-44b7-b74d-516255554980 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:03.851716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dece303-2b1f-44f7-af68-0377a72e2524 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:03.868417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dece303-2b1f-44f7-af68-0377a72e2524 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.022543 Jul 24 01:23:03.878819 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1580/3003] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:23:03 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:03.888697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-adad6b36-cb75-4f91-bb2a-3cdbf6944e23 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:03.910667 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:03.911780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:03.932700 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:03.935529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:03.942821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:03.944905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:03.981339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-adad6b36-cb75-4f91-bb2a-3cdbf6944e23 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/0573a186-fbac-4cba-bb51-632a0e3fc232" status: 204 len: 0 microversion: 2.1 time: 0.096741 Jul 24 01:23:03.985844 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1424/3004] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:03 2022] DELETE /compute/v2.1/os-server-groups/0573a186-fbac-4cba-bb51-632a0e3fc232 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:03.995902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f24c53e0-1598-4843-909e-c2902641ad43 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:04.031353 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f24c53e0-1598-4843-909e-c2902641ad43 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.043344 Jul 24 01:23:04.038604 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1425/3005] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:23:03 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:04.044012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0efc34c1-55d3-4c71-8634-90dc98b9bdda tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Action: 'create', calling method: .version_select at 0x7f05eadfd5e0>, body: {"server_group": {"name": "tempest-server-group-1656722613", "policies": ["affinity"]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:04.080522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0efc34c1-55d3-4c71-8634-90dc98b9bdda tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:04.111005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0efc34c1-55d3-4c71-8634-90dc98b9bdda tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:04.114816 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:04.225119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0efc34c1-55d3-4c71-8634-90dc98b9bdda tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:04.256933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0efc34c1-55d3-4c71-8634-90dc98b9bdda tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:04.294627 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0efc34c1-55d3-4c71-8634-90dc98b9bdda tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.254453 Jul 24 01:23:04.303567 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1426/3006] 10.222.0.27 () {60 vars in 1172 bytes} [Sun Jul 24 01:23:04 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:04.310254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:04.315730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:04.329430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:04.331866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:04.332964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:04.333630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:04.808149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:04.830539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:04.832198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:04.833517 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-48196df7-a56b-40ed-abde-793086a61539 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.528024 Jul 24 01:23:04.845321 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1427/3007] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:04 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:04.853580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7cb1d77e-73cd-446e-be9d-6dee9f5e05a0 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:04.904567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:04.914978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7cb1d77e-73cd-446e-be9d-6dee9f5e05a0 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3d21b384-6180-49b7-b3d1-c2bc1e40e375" status: 204 len: 0 microversion: 2.1 time: 0.067444 Jul 24 01:23:04.915892 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac63fc18-3e5e-4398-99d2-3e705263b33b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1313 microversion: 2.1 time: 1.009826 Jul 24 01:23:04.916013 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1428/3008] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:04 2022] DELETE /compute/v2.1/os-server-groups/3d21b384-6180-49b7-b3d1-c2bc1e40e375 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:04.922492 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1581/3009] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:03 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1313 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:04.929833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:04.931406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:04.932056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:04.933899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:04.944090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:04.944568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:04.945369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:04.945883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:04.948104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:04.949917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:04.952455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:04.956471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:05.348747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:05.371287 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40388aa6-c77e-421d-a3d1-e727de89c300 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1293 microversion: 2.1 time: 0.443742 Jul 24 01:23:05.372573 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1582/3010] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:04 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1293 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:05.387172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1311b4f0-b5d8-4a21-971a-99ec4c7651d4 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:05.411677 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1311b4f0-b5d8-4a21-971a-99ec4c7651d4 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.035028 Jul 24 01:23:05.419569 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1583/3011] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:23:05 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:05.425829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-838d0313-22ef-4142-9701-7184ea217fbc tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Action: 'create', calling method: .version_select at 0x7f05eae4cee0>, body: {"server_group": {"name": "tempest-server-group-432945398", "policies": ["anti-affinity"]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:05.436390 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:05.453744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-838d0313-22ef-4142-9701-7184ea217fbc tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:05.460648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-838d0313-22ef-4142-9701-7184ea217fbc tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:05.544103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-838d0313-22ef-4142-9701-7184ea217fbc tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:05.552987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-838d0313-22ef-4142-9701-7184ea217fbc tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_groups'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:05.580524 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-838d0313-22ef-4142-9701-7184ea217fbc tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.159108 Jul 24 01:23:05.587752 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1584/3012] 10.222.0.27 () {60 vars in 1172 bytes} [Sun Jul 24 01:23:05 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:05.599147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd8a09c3-0f19-4560-b3fe-e6e1831624e5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:05.665846 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cd8a09c3-0f19-4560-b3fe-e6e1831624e5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/6deb40e3-a6d8-4362-9658-b829c6bb03ff" status: 204 len: 0 microversion: 2.1 time: 0.076552 Jul 24 01:23:05.670135 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1585/3013] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:05 2022] DELETE /compute/v2.1/os-server-groups/6deb40e3-a6d8-4362-9658-b829c6bb03ff => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:05.680900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bcb568f7-4d77-457e-88fb-086822e5808f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:05.705945 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bcb568f7-4d77-457e-88fb-086822e5808f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.027361 Jul 24 01:23:05.719274 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1586/3014] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:23:05 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:05.789305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-682739550", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "b17ee63b-e764-4ef3-86bb-89d0ab9b024a"}]}, "os:scheduler_hints": {"group": "9e779ae7-e375-40ca-ae6d-f0646ad763cc"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:05.805808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:05.816523 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-968c0cc2-bbc2-4dac-bfec-8218f648139a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.897656 Jul 24 01:23:05.820078 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1429/3015] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:04 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:05.845382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-aeef8e8a-b494-4f8b-8983-09a2f1a45bdd req-5a1edbe7-3c7d-4dcc-97ea-5ef81ac1b029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9678c4ac-087e-4c4e-89a8-61fce0d303b5", "name": "network-vif-plugged", "status": "completed", "tag": "31a4c232-f771-4431-8aec-6381ec24d25a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:05.872002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aeef8e8a-b494-4f8b-8983-09a2f1a45bdd req-5a1edbe7-3c7d-4dcc-97ea-5ef81ac1b029 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:05.872457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aeef8e8a-b494-4f8b-8983-09a2f1a45bdd req-5a1edbe7-3c7d-4dcc-97ea-5ef81ac1b029 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:05.887806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] validate_networks() for [('b17ee63b-e764-4ef3-86bb-89d0ab9b024a', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:23:05.916178 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-aeef8e8a-b494-4f8b-8983-09a2f1a45bdd req-5a1edbe7-3c7d-4dcc-97ea-5ef81ac1b029 service nova] Creating event network-vif-plugged:31a4c232-f771-4431-8aec-6381ec24d25a for instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 on n-h2-master-1 Jul 24 01:23:05.931984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-aeef8e8a-b494-4f8b-8983-09a2f1a45bdd req-5a1edbe7-3c7d-4dcc-97ea-5ef81ac1b029 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102515 Jul 24 01:23:05.937482 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1430/3016] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:05.944065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:05.944992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:05.964603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:05.966813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:05.968089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:05.972659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:07.023547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:07.064103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:07.066404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:07.067702 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8843707-4b1a-45ec-b529-a2e829860fa6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.128904 Jul 24 01:23:07.079769 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1431/3017] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:05 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:07.092098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:07.095074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:07.108120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:07.111030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:07.112192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:07.112817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:07.665226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:07.684898 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28e8a493-dc08-4a7c-b934-4d207a90ad60 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1500 microversion: 2.1 time: 0.603626 Jul 24 01:23:07.700130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1432/3018] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:07 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1500 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:07.711028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:07.712005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:07.730440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:07.740378 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:07.741521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:07.742629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:07.963653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:07.982615 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c6c6f7d-90ad-4112-a8bc-0b2e2e70f274 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1293 microversion: 2.1 time: 0.272732 Jul 24 01:23:07.984773 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1433/3019] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:07 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:07.998762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:08.007074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:08.024720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:08.026561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:08.027896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:08.029537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:08.067995 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:08.651898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:23:08.652435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:23:08.653221 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:23:08.653806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:23:08.654354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:23:08.676284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:08.689547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3e6f6c5a-30c3-4dd6-b254-5eb0de9ac8e8 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.701180 Jul 24 01:23:08.694240 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1434/3020] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:07 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:08.711629 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:08.713563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:08.722190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:08.723547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:08.723961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:08.724123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:08.725141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:08.725801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:08.730323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:08.733467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:08.800333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lazy-loading 'flavor' on Instance uuid 0523ef6e-9c39-40db-9a57-6a214c6e7c96 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:23:08.809557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:08.828287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:08.898635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:23:08.912482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:23:09.065502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119561) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 24 01:23:09.066143 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-332bba9a-921c-4a43-8407-dc61b3ee6237 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "POST /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96/action" status: 200 len: 32 microversion: 2.1 time: 0.364161 Jul 24 01:23:09.069204 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1435/3021] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:23:08 2022] POST /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96/action => generated 32 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:23:09.109996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:09.117638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:09.143245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.145962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.150700 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.154229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.175077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_group_members'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:09.199374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_group_members'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:09.323474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_group_members'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:09.344362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Getting quotas for user 71b31a7e59f94d6ea7749c7ae004fea2 and project a463acfa253e4eadb23ff67c2e1058dc. Resources: {'server_group_members'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:09.414893 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8978cc93-ad7a-4884-abcc-f62795a97005 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.629411 Jul 24 01:23:09.415855 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1587/3022] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:23:09.426189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-20768119-c91d-4457-807b-ae9f17d75ca7 req-b0e2b284-b02a-4288-b3ef-da4c10fe00f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87e018-4100-4486-b086-4ca4dc17e290", "name": "network-vif-plugged", "status": "completed", "tag": "72c16541-b9a8-471c-8223-1f9b0a727708"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:09.447540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-20768119-c91d-4457-807b-ae9f17d75ca7 req-b0e2b284-b02a-4288-b3ef-da4c10fe00f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.448001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-20768119-c91d-4457-807b-ae9f17d75ca7 req-b0e2b284-b02a-4288-b3ef-da4c10fe00f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.474588 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-20768119-c91d-4457-807b-ae9f17d75ca7 req-b0e2b284-b02a-4288-b3ef-da4c10fe00f1 service nova] Creating event network-vif-plugged:72c16541-b9a8-471c-8223-1f9b0a727708 for instance 7f87e018-4100-4486-b086-4ca4dc17e290 on n-h2-master-1 Jul 24 01:23:09.489396 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-20768119-c91d-4457-807b-ae9f17d75ca7 req-b0e2b284-b02a-4288-b3ef-da4c10fe00f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066820 Jul 24 01:23:09.490052 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1588/3023] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:09.496939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:09.503946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:09.519064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.519517 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.522751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.525687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.838864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:09.853582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:09.858356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:09.863658 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eca1ed2d-1236-40df-9df8-4017cab2aa8b tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.784624 Jul 24 01:23:09.866936 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1436/3024] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:09 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:09.878141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:09.883511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:09.899953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.905558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.907209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:09.907879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:09.982664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:09.992903 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-587f19eb-80ce-49d7-95d4-b1810b6cd673 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1474 microversion: 2.1 time: 0.499949 Jul 24 01:23:09.998095 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1589/3025] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:09 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1474 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:10.003716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fcd14414-03c2-4f80-be50-b9e203e949f3 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:10.019472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fcd14414-03c2-4f80-be50-b9e203e949f3 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:10.206181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fcd14414-03c2-4f80-be50-b9e203e949f3 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:10.213256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fcd14414-03c2-4f80-be50-b9e203e949f3 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1212 microversion: 2.1 time: 0.213719 Jul 24 01:23:10.225215 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1590/3026] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:09 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1212 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:10.238599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:10.239225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:10.250310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:10.251371 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:10.252734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:10.253726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:10.488042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:10.503197 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6229719f-8832-46ac-ae19-c9a37fd46a45 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.633820 Jul 24 01:23:10.508388 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1437/3027] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:09 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:10.561514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1163243412", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:10.683522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:23:10.793127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:10.828428 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bc252f5-1b72-4087-9550-a4ddf7abb0fc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1367 microversion: 2.1 time: 0.596641 Jul 24 01:23:10.831796 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1591/3028] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:10 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1367 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:10.889265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:10.892413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:10.909474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:10.912565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:10.915401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:10.916784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:11.564176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:11.587023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:11.590708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:11.597184 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6e6c925-9141-4de8-8ef7-6d3489ca79cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.713709 Jul 24 01:23:11.598125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1592/3029] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:10 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:23:11.739438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:23:11.740543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:23:11.741245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:23:11.741850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:23:11.742435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:23:11.766415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:11.767075 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:11.768206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:11.768840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:11.804866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:11.811422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:11.830277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:23:11.837403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:23:11.908199 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dc7fccd9-40be-4b4e-a34d-53653d6d425e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.398380 Jul 24 01:23:11.909833 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1438/3030] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:23:11.934850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:11.935450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:11.950614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:11.951530 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:11.951863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:11.955543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:11.976988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-843271767", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "b5b337e0-48a8-4ba6-84a6-fc06868dc421"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:12.059648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] validate_networks() for [('b5b337e0-48a8-4ba6-84a6-fc06868dc421', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:23:12.123159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:12.138229 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0395f924-2ba2-470b-9bd3-cd1034c9b4ad tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1272 microversion: 2.1 time: 0.226751 Jul 24 01:23:12.139168 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1439/3031] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:11 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:12.149819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:12.150481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:12.179769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:12.181119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:12.183239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:12.184156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:12.767688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:12.777629 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04275fe3-77f3-4533-afcd-f91be4480815 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.636301 Jul 24 01:23:12.784613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1440/3032] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:12 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:12.791969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:12.792937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:12.813124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:12.813869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:12.820321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:12.821470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.251261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:13.259295 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-937dd149-d9b1-4a22-bf4a-5666d4de7577 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1558 microversion: 2.1 time: 0.473510 Jul 24 01:23:13.263010 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1441/3033] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:12 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1558 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:13.269478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:13.278990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:13.286122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.287206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.288173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.288771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.318678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:23:13.460599 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3183691c-1e65-485b-8d80-8279a1560727 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea" status: 204 len: 0 microversion: 2.1 time: 0.194568 Jul 24 01:23:13.463408 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1442/3034] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:13 2022] DELETE /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:13.478046 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:13.479549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:13.488751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.489637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.490695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.491593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.803882 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:23:13.804843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:23:13.805340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:23:13.805815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:23:13.806248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:23:13.817219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.817704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.818780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:13.819344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:13.838842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Getting quotas for project 04e896d3688c4c72bcf461445bada1f8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:13.849122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Getting quotas for user 266a0979256344c497b6979cfdacc6ad and project 04e896d3688c4c72bcf461445bada1f8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:13.859807 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:13.935346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:23:13.938737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:23:14.048488 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-652c4bba-2617-4c48-8f5d-f54caef74e18 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.448714 Jul 24 01:23:14.057042 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1593/3035] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:23:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:23:14.068099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:14.068676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:14.076480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:14.077857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:14.078951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:14.079609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:14.193087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:14.208461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:14.210205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:14.211477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b1e23b5-4dab-4671-80f3-b7b9873be0cf tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.744317 Jul 24 01:23:14.219509 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1443/3036] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:13 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:14.236071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6d729b7-05e9-4135-9119-4b64d4d561e6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:14.250540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6d729b7-05e9-4135-9119-4b64d4d561e6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:14.289931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-05e9-4135-9119-4b64d4d561e6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:14.290327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-05e9-4135-9119-4b64d4d561e6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:14.291134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-05e9-4135-9119-4b64d4d561e6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:14.291578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-05e9-4135-9119-4b64d4d561e6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:14.490164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:14.511243 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a47ad032-4aee-43d9-82aa-89a5ca69b996 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1270 microversion: 2.1 time: 0.450505 Jul 24 01:23:14.515945 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1594/3037] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:14 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1270 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:14.538056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:14.539803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:14.558260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:14.560439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:14.564761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:14.567118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:15.330310 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6d729b7-05e9-4135-9119-4b64d4d561e6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.109371 Jul 24 01:23:15.332550 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1444/3038] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:23:14 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-interface => generated 285 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:15.339561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:15.340433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:15.343951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:15.356640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:15.357301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:15.358534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:15.358774 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a6f56eb-4fd5-44ae-a2a0-43b30f7e19f4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea" status: 200 len: 1211 microversion: 2.1 time: 0.837431 Jul 24 01:23:15.359358 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:15.370064 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1595/3039] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:14 2022] GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea => generated 1211 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:15.386158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:15.387282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:15.403799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:15.404282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:15.407612 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:15.408076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:15.651451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:15.660118 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f6b708d3-65de-4b8d-b5f0-798e491f5e93 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1276 microversion: 2.1 time: 0.287611 Jul 24 01:23:15.676481 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1596/3040] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:15 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1276 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:15.945201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1168075574", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:16.045400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:23:16.377927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:16.391998 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1aecdb5-eb8f-4587-959e-75be5924bac1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 1.057083 Jul 24 01:23:16.405306 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1445/3041] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:15 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:16.418841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:16.419611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:16.438629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:16.439261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:16.440160 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:16.440684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:16.907509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:23:16.908516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:23:16.909185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:23:16.909794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:23:16.910535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:23:16.928139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:16.940122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:16.941408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:16.942344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:16.990536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:16.999277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for user 01e7c66073564bb0b78b2309d281d1f1 and project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:17.031586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:23:17.035199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:23:17.129954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8bfc6c9-6c63-4cdf-a846-c74df281e347 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.452043 Jul 24 01:23:17.130646 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1597/3042] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:23:17.167938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:17.168963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:17.195756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.199758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:17.200832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.216040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:17.438872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:17.453146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:17.456405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:17.457628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c12403a4-d6bf-47e4-80a7-2d097d2477fc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 1.048887 Jul 24 01:23:17.458228 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1446/3043] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:16 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:17.473440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:17.474354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:17.487768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.488525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:17.490420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.493434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:17.525136 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea HTTP/1.1 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea'} Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:17.531525 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:17.536325 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:17.536325 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:17.536325 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:17.536325 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:17.536325 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:23:17.536325 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:17.538206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:17.539415 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f1731af-d425-4325-be9b-8e7b27448cdf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea" status: 404 len: 111 microversion: 2.1 time: 0.080274 Jul 24 01:23:17.542390 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1447/3044] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:17 2022] GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:17.552406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:17.553322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:17.572429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.575845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:17.577417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.578282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:17.914690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:17.928359 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a080dcb-d710-4630-9cd8-401adb899dbd tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.792350 Jul 24 01:23:17.928913 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1598/3045] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:17 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:17.940020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:17.940936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:17.960423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.961142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:17.962390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:17.963141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:18.272795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:18.286358 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00065be7-5246-45ae-b3cb-892281621d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1217 microversion: 2.1 time: 0.356347 Jul 24 01:23:18.294917 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1599/3046] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:17 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1217 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:18.303062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:18.305520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:18.327023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:18.345280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:18.347571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:18.348671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:18.379509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:18.387546 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:18.395862 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4da5b63f-a56b-4731-8cc8-0bf480857ac0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1324 microversion: 2.1 time: 0.852167 Jul 24 01:23:18.397392 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1448/3047] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:17 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1324 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:18.414288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1372394055", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "4015265e-e6b0-4e47-bccc-5d1d48270467"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:18.534856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:23:19.672603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:19.682758 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4f541e5-f7d6-4221-ba27-14df62f041f5 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 1.384187 Jul 24 01:23:19.695317 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1600/3048] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:18 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:19.701106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:19.702090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:19.711636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:19.711901 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:19.712848 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:19.713457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:20.525006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:20.543742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:20.547193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:20.603739 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bc07ffd1-8384-4f99-b8c4-f717928e46fe tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.892331 Jul 24 01:23:20.607827 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1601/3049] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:19 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:20.623321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-53e1cc64-e139-40b7-8a91-4c82e7661835 req-06c50926-7922-4bf6-8e4e-c450152047c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8453b723-e274-4000-866d-fe51b8eecb1b", "tag": "79224a27-6ed0-4437-a115-427cf9259065"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:20.653280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-53e1cc64-e139-40b7-8a91-4c82e7661835 req-06c50926-7922-4bf6-8e4e-c450152047c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:20.654263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-53e1cc64-e139-40b7-8a91-4c82e7661835 req-06c50926-7922-4bf6-8e4e-c450152047c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:20.684377 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-53e1cc64-e139-40b7-8a91-4c82e7661835 req-06c50926-7922-4bf6-8e4e-c450152047c0 service nova] Creating event network-changed:79224a27-6ed0-4437-a115-427cf9259065 for instance 8453b723-e274-4000-866d-fe51b8eecb1b on n-h1-master-1 Jul 24 01:23:20.694564 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-53e1cc64-e139-40b7-8a91-4c82e7661835 req-06c50926-7922-4bf6-8e4e-c450152047c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081520 Jul 24 01:23:20.705265 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1602/3050] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:20.716610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:20.721957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:20.736362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:20.737183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:20.738298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:20.738987 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:20.763979 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:21.471109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:23:21.474501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:23:21.475222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:23:21.475647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:23:21.476846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:23:21.510105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.510779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.511757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.514871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.558693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:21.560517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:21.566624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:21.573489 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6ea0952-923e-4e6d-94c3-29404f1236a5 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.866434 Jul 24 01:23:21.574141 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1603/3051] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:20 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:21.583397 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:21.585916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:23:21.587499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:21.588134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:21.590827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:23:21.611765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.612224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.613024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.613468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.653341 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7b4881e-5964-40bd-ac48-a29580fdce07 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.253680 Jul 24 01:23:21.654760 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1449/3052] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:23:21.662477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:21.663990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:21.675303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.676154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.677218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.677938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.852774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:21.862183 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-314938c8-8633-495b-8040-2ca8523cb1ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1271 microversion: 2.1 time: 0.286716 Jul 24 01:23:21.866882 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1604/3053] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:21 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:21.876683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3fbdf75c-4c92-438a-9f9e-cf56a99edc0b req-fd4ab5e4-3c76-4c5e-9cd3-3f57c3963b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "86dc5ccc-4155-4bbe-89ce-b5108cebb1c1"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:21.899164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fbdf75c-4c92-438a-9f9e-cf56a99edc0b req-fd4ab5e4-3c76-4c5e-9cd3-3f57c3963b20 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.899610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fbdf75c-4c92-438a-9f9e-cf56a99edc0b req-fd4ab5e4-3c76-4c5e-9cd3-3f57c3963b20 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.933964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3fbdf75c-4c92-438a-9f9e-cf56a99edc0b req-fd4ab5e4-3c76-4c5e-9cd3-3f57c3963b20 service nova] Creating event network-vif-plugged:86dc5ccc-4155-4bbe-89ce-b5108cebb1c1 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:21.942950 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3fbdf75c-4c92-438a-9f9e-cf56a99edc0b req-fd4ab5e4-3c76-4c5e-9cd3-3f57c3963b20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074733 Jul 24 01:23:21.943813 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1605/3054] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:21.957346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:21.959096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:21.975378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.978162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:21.979174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:21.979728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:22.919999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:22.929447 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f849583f-7f22-44c4-bf36-4b5ae58994c5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1324 microversion: 2.1 time: 1.272058 Jul 24 01:23:22.930081 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1450/3055] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:21 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1324 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:22.934629 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c32abc27-5cc9-4cf7-b146-c73fdd6e00df req-71226cf4-0faa-48b6-8a31-5cb01c0de8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec5f28b8-0b54-456f-8f88-50e572f731bb", "tag": "7696ed08-9e46-4ed1-9784-657518dbbdc4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:22.947204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c32abc27-5cc9-4cf7-b146-c73fdd6e00df req-71226cf4-0faa-48b6-8a31-5cb01c0de8ab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:22.948056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c32abc27-5cc9-4cf7-b146-c73fdd6e00df req-71226cf4-0faa-48b6-8a31-5cb01c0de8ab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:22.965704 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c32abc27-5cc9-4cf7-b146-c73fdd6e00df req-71226cf4-0faa-48b6-8a31-5cb01c0de8ab service nova] Creating event network-changed:7696ed08-9e46-4ed1-9784-657518dbbdc4 for instance ec5f28b8-0b54-456f-8f88-50e572f731bb on n-h1-master-1 Jul 24 01:23:22.970936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c32abc27-5cc9-4cf7-b146-c73fdd6e00df req-71226cf4-0faa-48b6-8a31-5cb01c0de8ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039679 Jul 24 01:23:22.971798 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1451/3056] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:22.978822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:22.980357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:22.988846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:22.989306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:22.990357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:22.990808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.129040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:23.139117 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-584fb81b-7625-435a-8290-c523a32906dd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 1.193978 Jul 24 01:23:23.159277 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1606/3057] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:21 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:23.166065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:23.166960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:23.174791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.175511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.176978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.177631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.513979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:23.530119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-471d7a55-0e42-47e6-9842-dd97cfdef77e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1281 microversion: 2.1 time: 0.368847 Jul 24 01:23:23.533527 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1607/3058] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:23 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:23.545401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:23.546887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:23.562288 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.563580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.565398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.567426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.759284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:23.800675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:23.805641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:23.812322 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2069bfc2-22f2-4bf3-a320-b71025325215 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.839116 Jul 24 01:23:23.827643 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1452/3059] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:22 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:23.838308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:23.840249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:23.848491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.849310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.850345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.850898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.931710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:23.949468 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4ab6b7e-09d8-4a03-b6dd-a5780541a89f tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.410903 Jul 24 01:23:23.961352 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1608/3060] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:23 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:23.969332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:23.970240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:23.976919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:23.989434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.990020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.991443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:23.991857 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1fae06e-fc5b-47da-95fc-25cc0ad58385 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1271 microversion: 2.1 time: 0.160755 Jul 24 01:23:23.992688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:23.993715 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1453/3061] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:23 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:24.002824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "563bde46-aa44-416a-953e-81183c46ef04"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "a25f1481-9636-49b6-a9f4-4b944673adff"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "8db72927-4ceb-4d2a-8c5d-12b5eaec48d0"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "9894718f-24b7-4560-8bf6-ac8c173245f5"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:24.016073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.018415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.035262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Creating event network-vif-plugged:563bde46-aa44-416a-953e-81183c46ef04 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:24.036019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Creating event network-vif-plugged:a25f1481-9636-49b6-a9f4-4b944673adff for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:24.036795 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Creating event network-vif-plugged:8db72927-4ceb-4d2a-8c5d-12b5eaec48d0 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:24.037374 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Creating event network-vif-plugged:9894718f-24b7-4560-8bf6-ac8c173245f5 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:24.037996 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] Creating event network-vif-plugged:2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:24.045087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0e4ab727-d5ad-409b-899d-e51f84c1a22b req-6d3f3956-ddb9-4e56-a1c5-4cac5bbc9e39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.049476 Jul 24 01:23:24.046825 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1454/3062] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:24.164515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:24.165251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:24.183132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.183661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.184668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.185120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.333019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:24.346314 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16f54558-704a-474d-9ea3-b214d10154f5 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1324 microversion: 2.1 time: 0.382634 Jul 24 01:23:24.346971 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1609/3063] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:23 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:24.465439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:24.477088 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9fbb1fed-dc4e-4e47-a6fa-1f8d70699345 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.318097 Jul 24 01:23:24.479234 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1455/3064] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:24 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:24.551749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:24.552821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:24.561008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.562447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.563465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.564147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.650526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:24.660391 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a077d1a-8347-4c7c-b7f2-43095fc183f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1279 microversion: 2.1 time: 0.115764 Jul 24 01:23:24.661611 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1610/3065] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:24 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:24.835177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:24.836297 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:24.847626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.848453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.849561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.850272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.968596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:24.969201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:24.987054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.989626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:24.990864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:24.991560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:25.270780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:25.290678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:25.293296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:25.295402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c6fcd037-6837-4f43-8940-09b7abf9405a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.464694 Jul 24 01:23:25.297026 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1456/3066] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:24 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:25.302694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:25.304247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:25.315054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:25.315924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:25.318529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:25.319297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:25.360280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:25.371654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38665631-a71a-4be1-bda4-3b667a310f62 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.407593 Jul 24 01:23:25.372801 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1611/3067] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:24 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:25.387189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a9649276-157e-47c1-b3ea-21ded54cbca2 req-b2a7488b-1dd6-4968-b202-e7deb40cd89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f87e018-4100-4486-b086-4ca4dc17e290", "tag": "72c16541-b9a8-471c-8223-1f9b0a727708"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:25.402077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a9649276-157e-47c1-b3ea-21ded54cbca2 req-b2a7488b-1dd6-4968-b202-e7deb40cd89a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:25.403618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a9649276-157e-47c1-b3ea-21ded54cbca2 req-b2a7488b-1dd6-4968-b202-e7deb40cd89a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:25.429205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a9649276-157e-47c1-b3ea-21ded54cbca2 req-b2a7488b-1dd6-4968-b202-e7deb40cd89a service nova] Creating event network-changed:72c16541-b9a8-471c-8223-1f9b0a727708 for instance 7f87e018-4100-4486-b086-4ca4dc17e290 on n-h2-master-1 Jul 24 01:23:25.439900 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a9649276-157e-47c1-b3ea-21ded54cbca2 req-b2a7488b-1dd6-4968-b202-e7deb40cd89a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064457 Jul 24 01:23:25.441040 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1612/3068] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:25.455769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:25.456979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:25.466171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:25.466965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:25.468513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:25.469247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:25.767957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:25.776970 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b75913b-059b-489d-bc1e-370260cc3f34 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1313 microversion: 2.1 time: 0.478592 Jul 24 01:23:25.781516 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1457/3069] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:25 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:25.791259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:25.806170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:25.816780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:25.823906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:25.824967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:25.825432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.231004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:26.236504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46bf8428-e170-4a17-a07a-cc6d3c4ce999 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1324 microversion: 2.1 time: 0.793600 Jul 24 01:23:26.237971 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1613/3070] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:25 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1324 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:26.255901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:26.256901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:26.264111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.265662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.266467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.267191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.284935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:26.304266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ce67678-16b5-410c-ad80-73bcbfc089d1 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.520941 Jul 24 01:23:26.307196 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1458/3071] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:25 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:26.321639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-31060e0b-f9fb-4ca7-bfd0-4eee12effc01 req-fee590d0-9bda-4238-bc9e-715ba7395d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "b191e26a-3767-42da-a129-49e4941782bf"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:26.332900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-31060e0b-f9fb-4ca7-bfd0-4eee12effc01 req-fee590d0-9bda-4238-bc9e-715ba7395d16 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.333349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-31060e0b-f9fb-4ca7-bfd0-4eee12effc01 req-fee590d0-9bda-4238-bc9e-715ba7395d16 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.346731 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-31060e0b-f9fb-4ca7-bfd0-4eee12effc01 req-fee590d0-9bda-4238-bc9e-715ba7395d16 service nova] Creating event network-vif-plugged:b191e26a-3767-42da-a129-49e4941782bf for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:26.355031 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-31060e0b-f9fb-4ca7-bfd0-4eee12effc01 req-fee590d0-9bda-4238-bc9e-715ba7395d16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041242 Jul 24 01:23:26.360174 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1459/3072] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:26.365808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:26.366515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:26.376661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.377616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.379239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.379858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.704513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:26.719165 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f3a69b3f-76c9-440f-871d-f5d8da885546 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.468463 Jul 24 01:23:26.720407 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1614/3073] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:26 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:26.727145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:26.728985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:26.740300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.741586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.743841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.744598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.928826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:26.939073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:26.940789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:26.942675 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18fe795e-281f-4bf7-9a01-b36fb283f5be tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.580905 Jul 24 01:23:26.956010 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:26.966397 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1460/3074] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:26 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:26.973421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:26.974104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:26.981623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.982147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:26.983011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:26.983487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.017812 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=44 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:27.030071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:27.039642 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-017e8b69-42e1-4987-a39a-1598d9f70e4b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.317896 Jul 24 01:23:27.040609 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1615/3075] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:26 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:27.140277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:27.148376 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-89ca6e53-7e5f-4132-aa66-c699b719b956 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1313 microversion: 2.1 time: 0.180827 Jul 24 01:23:27.148963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1461/3076] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:26 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:27.265924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:27.266998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:27.274374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.275073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.277882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.278540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.334682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:27.335627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:27.343330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.344147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.345576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.346273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.883573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:27.895732 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-183f6a31-3bde-4759-a0ef-4f69228dcf09 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1324 microversion: 2.1 time: 0.633867 Jul 24 01:23:27.898217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1616/3077] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:27 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1324 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:27.906393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4565307c-f547-43cb-a9cc-02e6c2f87307 req-e25c57c6-40ca-4182-abc6-530729fe374f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c413c5-2e70-402c-9b9d-0bfa730ef8cf", "tag": "fd4040b1-a47f-4fc4-9db7-10af4e82644a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:27.914992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:27.922840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4565307c-f547-43cb-a9cc-02e6c2f87307 req-e25c57c6-40ca-4182-abc6-530729fe374f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.923682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4565307c-f547-43cb-a9cc-02e6c2f87307 req-e25c57c6-40ca-4182-abc6-530729fe374f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.926127 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18f174b2-4657-4abc-b56f-3e7d1e0554c3 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.596682 Jul 24 01:23:27.935971 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1462/3078] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:27 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:27.942536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:27.943151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:27.946883 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4565307c-f547-43cb-a9cc-02e6c2f87307 req-e25c57c6-40ca-4182-abc6-530729fe374f service nova] Creating event network-changed:fd4040b1-a47f-4fc4-9db7-10af4e82644a for instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf on n-h2-master-1 Jul 24 01:23:27.950709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.951171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.952571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.953376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.953633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4565307c-f547-43cb-a9cc-02e6c2f87307 req-e25c57c6-40ca-4182-abc6-530729fe374f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054018 Jul 24 01:23:27.954301 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1617/3079] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:27.960063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2a5159e4-e615-412b-985f-de3dc5a1b106 req-d172df43-d85d-4eae-997f-2079bee5f43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf89b5b-4b91-403f-b73a-10e217ea471e", "tag": "4f462090-d02a-49fd-a851-148c8dc7cb4d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:27.969648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2a5159e4-e615-412b-985f-de3dc5a1b106 req-d172df43-d85d-4eae-997f-2079bee5f43e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:27.970266 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2a5159e4-e615-412b-985f-de3dc5a1b106 req-d172df43-d85d-4eae-997f-2079bee5f43e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:27.982794 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2a5159e4-e615-412b-985f-de3dc5a1b106 req-d172df43-d85d-4eae-997f-2079bee5f43e service nova] Creating event network-changed:4f462090-d02a-49fd-a851-148c8dc7cb4d for instance cbf89b5b-4b91-403f-b73a-10e217ea471e on n-h2-master-1 Jul 24 01:23:27.989175 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2a5159e4-e615-412b-985f-de3dc5a1b106 req-d172df43-d85d-4eae-997f-2079bee5f43e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033592 Jul 24 01:23:27.989802 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1618/3080] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:27.995089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:27.995789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:28.003396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.003963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.005111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.005590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.203609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:28.228418 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c54063cf-9be2-44e1-af3d-0f757b8154ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.289563 Jul 24 01:23:28.238174 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1463/3081] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:27 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:28.243625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:28.244348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:28.244733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:28.252191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.253377 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.254404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.255061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.256769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:28.258790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:28.260247 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-015428fd-0129-423f-af40-7c61f3150499 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1874 microversion: 2.42 time: 0.269358 Jul 24 01:23:28.261008 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1619/3082] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:27 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1874 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:28.267017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:28.268007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:28.279138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.279897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.281542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.282302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.505655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:28.516862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:28.520361 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0717ee3c-7fb6-4e6f-addb-bd5b81af2f08 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.280578 Jul 24 01:23:28.529287 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1464/3083] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:28 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:28.529287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ce0d5e07-d4b1-444e-bf2f-1a6ec4ec5a03 req-747ce7c6-a156-426a-a297-62e5a2d2a275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8453b723-e274-4000-866d-fe51b8eecb1b", "name": "network-vif-plugged", "status": "completed", "tag": "79224a27-6ed0-4437-a115-427cf9259065"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:28.537637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ce0d5e07-d4b1-444e-bf2f-1a6ec4ec5a03 req-747ce7c6-a156-426a-a297-62e5a2d2a275 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.538430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ce0d5e07-d4b1-444e-bf2f-1a6ec4ec5a03 req-747ce7c6-a156-426a-a297-62e5a2d2a275 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.542663 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93861333-ffb9-4897-ae68-1cf2b303af48 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1313 microversion: 2.1 time: 0.280428 Jul 24 01:23:28.546072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1620/3084] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:28 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:28.558293 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ce0d5e07-d4b1-444e-bf2f-1a6ec4ec5a03 req-747ce7c6-a156-426a-a297-62e5a2d2a275 service nova] Creating event network-vif-plugged:79224a27-6ed0-4437-a115-427cf9259065 for instance 8453b723-e274-4000-866d-fe51b8eecb1b on n-h1-master-1 Jul 24 01:23:28.565635 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ce0d5e07-d4b1-444e-bf2f-1a6ec4ec5a03 req-747ce7c6-a156-426a-a297-62e5a2d2a275 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042831 Jul 24 01:23:28.566455 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1465/3085] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:28.914608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:28.915233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:28.923692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.924146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.924917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.925351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.945546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:28.946307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:28.953189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.953646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:28.954575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:28.955007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.271074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:29.278786 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-653c3ed9-152a-4948-8885-672726743fea tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1324 microversion: 2.1 time: 0.368094 Jul 24 01:23:29.279374 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1621/3086] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:28 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:29.283848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:29.284464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:29.290475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.290947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.291688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.292122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.296448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:29.305040 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d288ddf9-7e8d-4d38-87fe-45b4569da579 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.363470 Jul 24 01:23:29.305734 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1466/3087] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:28 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:29.314299 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:29.315591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:29.322643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.323344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.324295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.324795 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.329400 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:29.736957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:29.744957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a9bc3a67-49cc-46b5-a9a9-f2cd6ab626e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.464526 Jul 24 01:23:29.746266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1622/3088] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:29 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:29.753980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:29.755959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:29.763317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.765290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.766238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.767226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.854208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:29.868138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:29.869665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:29.870948 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1fc715eb-93cc-47cc-b820-b28b8070cde0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2832 microversion: 2.42 time: 0.563844 Jul 24 01:23:29.871912 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1467/3089] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:23:29 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2832 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:29.877397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:29.878356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:29.885825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.886660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:29.888531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:29.889268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.236657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:30.246595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67eeb60e-91fd-4cf3-9349-ed746c9b1825 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.497634 Jul 24 01:23:30.247450 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1623/3090] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:29 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:30.253922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8362f76c-46a7-4637-847a-927ffa0dd2a7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:30.254762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8362f76c-46a7-4637-847a-927ffa0dd2a7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:30.262169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8362f76c-46a7-4637-847a-927ffa0dd2a7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.263037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8362f76c-46a7-4637-847a-927ffa0dd2a7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.263924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8362f76c-46a7-4637-847a-927ffa0dd2a7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.264360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8362f76c-46a7-4637-847a-927ffa0dd2a7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.291214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:30.298597 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:30.303560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e9ab124-2977-4455-9f64-786f8ad5c06a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1313 microversion: 2.1 time: 0.430314 Jul 24 01:23:30.304342 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1468/3091] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:29 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:30.309054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:30.309694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:30.317834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.318227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.319019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.319464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.502532 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8362f76c-46a7-4637-847a-927ffa0dd2a7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.253798 Jul 24 01:23:30.510438 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1624/3092] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Jul 24 01:23:30 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b/os-interface => generated 1831 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:23:30.510438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:30.510438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:30.515004 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.515458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.516362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.516756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.722213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:30.735543 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d0a4845e-6186-4abe-943f-212e90ad2925 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1522 microversion: 2.1 time: 0.427825 Jul 24 01:23:30.736226 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1469/3093] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:30 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:30.752152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d56300aa-a8d0-467b-8f60-8b9119efd8e1 req-8897cf53-31bd-4c42-b920-065e6ee4254d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5f28b8-0b54-456f-8f88-50e572f731bb", "name": "network-vif-plugged", "status": "completed", "tag": "7696ed08-9e46-4ed1-9784-657518dbbdc4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:30.762244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d56300aa-a8d0-467b-8f60-8b9119efd8e1 req-8897cf53-31bd-4c42-b920-065e6ee4254d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.763714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d56300aa-a8d0-467b-8f60-8b9119efd8e1 req-8897cf53-31bd-4c42-b920-065e6ee4254d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.777512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d56300aa-a8d0-467b-8f60-8b9119efd8e1 req-8897cf53-31bd-4c42-b920-065e6ee4254d service nova] Creating event network-vif-plugged:7696ed08-9e46-4ed1-9784-657518dbbdc4 for instance ec5f28b8-0b54-456f-8f88-50e572f731bb on n-h1-master-1 Jul 24 01:23:30.785003 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d56300aa-a8d0-467b-8f60-8b9119efd8e1 req-8897cf53-31bd-4c42-b920-065e6ee4254d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047524 Jul 24 01:23:30.786388 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1470/3094] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:30.794330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:30.795018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:30.803056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.803983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.805011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.805817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.835161 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] HTTP exception thrown: Instance is not a member of specified network Jul 24 01:23:30.839886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Request method failure captured: Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b/ips/invalid HTTP/1.1 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7-JT0KO0ZlJ_NvQDVkxTVP6D44s1FwAxCrqbak0vKOPUtumY4XZs-SeoYr6FJe4QjekFL0-32F27JNUr4r9I5VGiQ1oky1NFE3u2leeM7kH5x9hFAUjqLo1nftFwCRc2LEdls5bdLW-QFHroekDeNL_MGFDbyez2-6lpeZ2350obU Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 04e896d3688c4c72bcf461445bada1f8 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04e896d3688c4c72bcf461445bada1f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 04e896d3688c4c72bcf461445bada1f8 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerAddressesNegativeTestJSON-660115977-project Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 266a0979256344c497b6979cfdacc6ad Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-660115977-project Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: exception: Instance is not a member of specified network Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': '8453b723-e274-4000-866d-fe51b8eecb1b', 'id': 'invalid'} Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 24 01:23:30.842909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.847457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:30.847457 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-876f072c-93a4-461a-ae76-e7a1490dd75f tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.055973 Jul 24 01:23:30.847457 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1471/3095] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:23:30 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b/ips/invalid => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:23:30.853964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:30.854588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:30.857701 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b43ceb4-2c5c-4994-8b68-ad86cda61243 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.352991 Jul 24 01:23:30.861139 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1625/3096] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:30 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:30.871036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4008a79e-d841-4611-a0de-f683a707fda8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:30.872085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.872544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.872693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4008a79e-d841-4611-a0de-f683a707fda8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Failed to fetch instance by id 999 {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 24 01:23:30.873821 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4008a79e-d841-4611-a0de-f683a707fda8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] HTTP exception thrown: Instance 999 could not be found. Jul 24 01:23:30.874029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.875799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4008a79e-d841-4611-a0de-f683a707fda8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Request method failure captured: Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7-JT0KO0ZlJ_NvQDVkxTVP6D44s1FwAxCrqbak0vKOPUtumY4XZs-SeoYr6FJe4QjekFL0-32F27JNUr4r9I5VGiQ1oky1NFE3u2leeM7kH5x9hFAUjqLo1nftFwCRc2LEdls5bdLW-QFHroekDeNL_MGFDbyez2-6lpeZ2350obU Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 04e896d3688c4c72bcf461445bada1f8 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04e896d3688c4c72bcf461445bada1f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 04e896d3688c4c72bcf461445bada1f8 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerAddressesNegativeTestJSON-660115977-project Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 266a0979256344c497b6979cfdacc6ad Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-660115977-project Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 999 could not be found. Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': '999'} Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 24 01:23:30.877635 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:30.881536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4008a79e-d841-4611-a0de-f683a707fda8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:30.883272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4008a79e-d841-4611-a0de-f683a707fda8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020386 Jul 24 01:23:30.884870 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1626/3097] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:23:30 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:23:30.895286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:30.897580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:30.916682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.917208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.918088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:30.918591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:30.965573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:23:31.090657 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9fe4c8eb-1626-4442-a2b9-7532841ef461 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 204 len: 0 microversion: 2.1 time: 0.199356 Jul 24 01:23:31.095396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1627/3098] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:30 2022] DELETE /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:23:31.102293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:31.103116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:31.113443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.115170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:31.119776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.119776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:31.175904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:31.184045 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d65cdd26-e740-4c40-ac19-a6946bc1979b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.337452 Jul 24 01:23:31.184633 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1472/3099] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:30 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:31.265342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:31.266224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:31.272633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.273099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:31.273901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.274593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:31.498002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:31.507519 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ee8e5be7-c255-48c6-baaf-24535d18e68a tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1528 microversion: 2.1 time: 0.410387 Jul 24 01:23:31.517808 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1628/3100] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:31 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:31.523336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:31.524958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:31.535369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.536289 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:31.537195 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:31.537636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.538463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:31.564744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:31.575583 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5dfd7097-9e37-4782-bd51-287654c80155 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.314780 Jul 24 01:23:31.577459 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1473/3101] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:31 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:31.877172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:31.878568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:31.880882 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=36 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:31.887368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.887824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:31.888611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:31.889092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.156540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:32.168192 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bbe6219-9652-44f0-b4cd-875752385bdd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1313 microversion: 2.1 time: 0.648513 Jul 24 01:23:32.169187 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1629/3102] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:31 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:32.178358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-662cc305-390a-4573-a9c2-00bf3bbd3775 req-55162030-35e6-451c-9dfb-40a4f388eed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "tag": "a25f1481-9636-49b6-a9f4-4b944673adff"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:32.190913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-662cc305-390a-4573-a9c2-00bf3bbd3775 req-55162030-35e6-451c-9dfb-40a4f388eed9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.191909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-662cc305-390a-4573-a9c2-00bf3bbd3775 req-55162030-35e6-451c-9dfb-40a4f388eed9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.211645 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-662cc305-390a-4573-a9c2-00bf3bbd3775 req-55162030-35e6-451c-9dfb-40a4f388eed9 service nova] Creating event network-changed:a25f1481-9636-49b6-a9f4-4b944673adff for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:23:32.220688 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-662cc305-390a-4573-a9c2-00bf3bbd3775 req-55162030-35e6-451c-9dfb-40a4f388eed9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049986 Jul 24 01:23:32.223528 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1630/3103] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:32.234132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:32.237481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:32.241977 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:32.256836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.257366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.258174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.258612 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.348182 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:32.356033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8c3d7ff4-8c3d-41ae-aec5-620cab2f26c4 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.483454 Jul 24 01:23:32.356911 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1474/3104] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:31 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:32.459596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:32.471638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fd292867-7bd2-40d3-a600-e170cc7e4a26 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.246859 Jul 24 01:23:32.472422 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1631/3105] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:32 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:32.525425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:32.526851 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:32.536616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.536878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.538034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.538506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.597457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:32.597457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:32.602349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.602805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.603745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.604185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.789606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:32.799770 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f8609bd1-2fa4-466d-bdad-28ed452e88b8 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1528 microversion: 2.1 time: 0.278082 Jul 24 01:23:32.805498 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1475/3106] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:32 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1528 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:32.837069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:32.847975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8c34a30e-63fc-43eb-a25a-5d507b0f900c tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1312 microversion: 2.1 time: 0.257758 Jul 24 01:23:32.849221 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1632/3107] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:32 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1312 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:32.937564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-39e7f655-cbfe-4046-9c45-23468c97da42 req-b275d9f9-bc88-4532-ac84-4c80f0eb8457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf89b5b-4b91-403f-b73a-10e217ea471e", "name": "network-vif-plugged", "status": "completed", "tag": "4f462090-d02a-49fd-a851-148c8dc7cb4d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:32.958563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-39e7f655-cbfe-4046-9c45-23468c97da42 req-b275d9f9-bc88-4532-ac84-4c80f0eb8457 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:32.963233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-39e7f655-cbfe-4046-9c45-23468c97da42 req-b275d9f9-bc88-4532-ac84-4c80f0eb8457 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:32.979558 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-39e7f655-cbfe-4046-9c45-23468c97da42 req-b275d9f9-bc88-4532-ac84-4c80f0eb8457 service nova] Creating event network-vif-plugged:4f462090-d02a-49fd-a851-148c8dc7cb4d for instance cbf89b5b-4b91-403f-b73a-10e217ea471e on n-h2-master-1 Jul 24 01:23:32.988493 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-39e7f655-cbfe-4046-9c45-23468c97da42 req-b275d9f9-bc88-4532-ac84-4c80f0eb8457 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056674 Jul 24 01:23:32.989986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1476/3108] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:33.187938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:33.189027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:33.199965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.200825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.202070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.203910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.391754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:33.392849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:33.400253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.402184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.403457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.404643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.540008 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:33.549544 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a430fa44-e9c5-4fb9-b7d6-7d9c37c96a55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1313 microversion: 2.1 time: 0.366963 Jul 24 01:23:33.558895 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1633/3109] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:33 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:33.558895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:33.558895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:33.569093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.569918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.571205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.571875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.695459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:33.706143 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e6cd51d8-d849-4700-8437-a6035971d95d tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.334686 Jul 24 01:23:33.708950 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1477/3110] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:33 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:33.818430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:33.824862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:33.826169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:33.837640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.838398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.839702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.840478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.843931 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43b0c0e6-bd14-43f6-b41e-73153f1038c5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.291991 Jul 24 01:23:33.844898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1634/3111] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:33 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:33.866771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:33.867185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:33.887064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.887531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:33.888393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:33.888848 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.053555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:34.063038 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c71a428-2afd-4a39-ae10-4c6e43de6bef tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1486 microversion: 2.1 time: 0.243212 Jul 24 01:23:34.063639 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1478/3112] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:33 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1486 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:34.078179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d79017ef-a7ac-480b-95bc-9dd69fc0d7e8 req-6718cb21-d52d-4522-8268-d5fc8ee5650c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8453b723-e274-4000-866d-fe51b8eecb1b", "name": "network-vif-deleted", "tag": "79224a27-6ed0-4437-a115-427cf9259065"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:34.089783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d79017ef-a7ac-480b-95bc-9dd69fc0d7e8 req-6718cb21-d52d-4522-8268-d5fc8ee5650c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.091204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d79017ef-a7ac-480b-95bc-9dd69fc0d7e8 req-6718cb21-d52d-4522-8268-d5fc8ee5650c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.114577 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d79017ef-a7ac-480b-95bc-9dd69fc0d7e8 req-6718cb21-d52d-4522-8268-d5fc8ee5650c service nova] Creating event network-vif-deleted:79224a27-6ed0-4437-a115-427cf9259065 for instance 8453b723-e274-4000-866d-fe51b8eecb1b on n-h1-master-1 Jul 24 01:23:34.129903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:34.136931 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d79017ef-a7ac-480b-95bc-9dd69fc0d7e8 req-6718cb21-d52d-4522-8268-d5fc8ee5650c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069394 Jul 24 01:23:34.140776 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1fed5075-de66-41a2-a27a-8bcccc81e9a7 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1498 microversion: 2.1 time: 0.277002 Jul 24 01:23:34.141954 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1635/3113] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:33 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1498 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:34.142336 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1479/3114] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:34.163314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e13bedb4-91a0-4909-bc70-a8d5e998ed8e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:34.190412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.server_groups [None req-e13bedb4-91a0-4909-bc70-a8d5e998ed8e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Querying cell 0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) for 1 instances {{(pid=119561) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 24 01:23:34.191267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e13bedb4-91a0-4909-bc70-a8d5e998ed8e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.191725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e13bedb4-91a0-4909-bc70-a8d5e998ed8e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.245937 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e13bedb4-91a0-4909-bc70-a8d5e998ed8e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/9e779ae7-e375-40ca-ae6d-f0646ad763cc" status: 200 len: 221 microversion: 2.1 time: 0.090587 Jul 24 01:23:34.247277 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1636/3115] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:23:34 2022] GET /compute/v2.1/os-server-groups/9e779ae7-e375-40ca-ae6d-f0646ad763cc => generated 221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:34.265445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:34.266077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:34.279194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.279625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.280740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.281392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.315785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:23:34.404375 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02e58ce3-d46f-401c-b0e2-158cfea1abdf tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 204 len: 0 microversion: 2.1 time: 0.149468 Jul 24 01:23:34.405268 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1480/3116] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:34 2022] DELETE /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:34.415469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:34.417124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:34.427391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.428025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.428917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.429558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.569443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:34.570437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:34.577814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.578596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.579383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.579992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.590696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:34.600889 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3cae1989-b720-41cb-a711-552fcb3c8904 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1504 microversion: 2.1 time: 0.191273 Jul 24 01:23:34.601760 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1637/3117] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:34 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:34.725460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:34.726286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:34.727233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:34.736091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.736895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.737262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-250ee2f1-5048-422d-84d2-25dc9f553fea tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1313 microversion: 2.1 time: 0.172968 Jul 24 01:23:34.741192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.741830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.742049 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1481/3118] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:34 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:34.861207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:34.861858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:34.870780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.872373 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.873885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:34.874516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:34.890127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:34.924408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6523e3a-b521-44b3-9c17-af490ef52c2f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.202716 Jul 24 01:23:34.942835 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1638/3119] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:34 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:35.040861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:35.048932 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e0cf6ea0-b569-41c8-b461-8367189d02f9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.192065 Jul 24 01:23:35.049546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1482/3120] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:34 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:35.080649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:35.081136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:35.088248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.088859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.090267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.091048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.129701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.130166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.130637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lazy-loading 'fault' on Instance uuid 8453b723-e274-4000-866d-fe51b8eecb1b {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:23:35.133636 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:35.179890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '266a0979256344c497b6979cfdacc6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e896d3688c4c72bcf461445bada1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:35.188631 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ecfbab8-7523-4363-af3e-ff4877dd9fc0 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 200 len: 1314 microversion: 2.1 time: 0.112655 Jul 24 01:23:35.189272 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1639/3121] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:35 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 1314 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:35.618964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:35.619795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:35.628278 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.628888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.629958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.630510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.755330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:35.756105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:35.763294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.765024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.766126 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.766702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.768065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:35.782930 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42ea030b-b1a4-4b36-ba2a-5b00dd30caac tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1504 microversion: 2.1 time: 0.161201 Jul 24 01:23:35.789163 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1483/3122] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:35 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:35.917353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:35.925752 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb34d84f-7ee3-4ce4-bd00-6dd09d48d4b6 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1463 microversion: 2.1 time: 0.174521 Jul 24 01:23:35.926629 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1640/3123] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:35 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:35.942761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:35.943391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:35.954853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.955621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:35.956713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:35.957315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.015728 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2947539c-584f-41e0-b227-906b1ae50af2 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:36.016994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2947539c-584f-41e0-b227-906b1ae50af2 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:36.025601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2947539c-584f-41e0-b227-906b1ae50af2 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.026894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2947539c-584f-41e0-b227-906b1ae50af2 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.027437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2947539c-584f-41e0-b227-906b1ae50af2 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.028070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2947539c-584f-41e0-b227-906b1ae50af2 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.286517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:36.294139 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e02ad9e-206c-466e-a185-7853cc76ee58 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.355243 Jul 24 01:23:36.302333 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1484/3124] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:35 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:36.310370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:36.311280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:36.317506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.317985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.318766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.319199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.614314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:36.631719 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f5b5c8db-0cfe-4933-9c12-4df336be094a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.325692 Jul 24 01:23:36.648003 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1485/3125] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:36 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:36.654159 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2947539c-584f-41e0-b227-906b1ae50af2 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1614 microversion: 2.1 time: 0.706592 Jul 24 01:23:36.657072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1641/3126] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:35 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1614 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:36.660243 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:36.663973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] [instance: 8453b723-e274-4000-866d-fe51b8eecb1b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:36.678349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:36.679305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:36.690833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.692813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.694958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.697898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.704346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.706023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.710382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.713991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.716365 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:36.745325 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] HTTP exception thrown: Instance 8453b723-e274-4000-866d-fe51b8eecb1b could not be found. Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Request method failure captured: Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b HTTP/1.1 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7-JT0KO0ZlJ_NvQDVkxTVP6D44s1FwAxCrqbak0vKOPUtumY4XZs-SeoYr6FJe4QjekFL0-32F27JNUr4r9I5VGiQ1oky1NFE3u2leeM7kH5x9hFAUjqLo1nftFwCRc2LEdls5bdLW-QFHroekDeNL_MGFDbyez2-6lpeZ2350obU Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 04e896d3688c4c72bcf461445bada1f8 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04e896d3688c4c72bcf461445bada1f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e896d3688c4c72bcf461445bada1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 04e896d3688c4c72bcf461445bada1f8 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-660115977 Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerAddressesNegativeTestJSON-660115977-project Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 266a0979256344c497b6979cfdacc6ad Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-660115977-project Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 8453b723-e274-4000-866d-fe51b8eecb1b could not be found. Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8453b723-e274-4000-866d-fe51b8eecb1b'} Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8453b723-e274-4000-866d-fe51b8eecb1b could not be found. Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8453b723-e274-4000-866d-fe51b8eecb1b could not be found. Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:36.747312 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8453b723-e274-4000-866d-fe51b8eecb1b could not be found. Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] Returning 404 to user: Instance 8453b723-e274-4000-866d-fe51b8eecb1b could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9cee052-6af1-4138-b0ef-d34f06ffba02 tempest-ServerAddressesNegativeTestJSON-660115977 tempest-ServerAddressesNegativeTestJSON-660115977-project] 10.222.0.27 "GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b" status: 404 len: 111 microversion: 2.1 time: 0.097472 Jul 24 01:23:36.752633 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1486/3127] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:36 2022] GET /compute/v2.1/servers/8453b723-e274-4000-866d-fe51b8eecb1b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:36.815065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:36.821211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:36.825409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f05b985e50f44940b352b6148fc10763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4343432978b644a286aa3cf937ba8320', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:36.828258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] flavor_id is None. Assuming migration. {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 24 01:23:36.830380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 01:23:36.845414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.851978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:36.853736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:36.854697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.113927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:37.131684 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9d540a3c-96db-473c-af19-da3342a1576b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1462 microversion: 2.1 time: 0.326926 Jul 24 01:23:37.145400 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1487/3128] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:36 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1462 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:37.150251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-af43003b-91c5-403a-895e-0db440b8b717 req-5103140a-6318-4887-8a40-a3b80e4d5ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5f28b8-0b54-456f-8f88-50e572f731bb", "name": "network-vif-deleted", "tag": "7696ed08-9e46-4ed1-9784-657518dbbdc4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:37.175772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-af43003b-91c5-403a-895e-0db440b8b717 req-5103140a-6318-4887-8a40-a3b80e4d5ee7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.176480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-af43003b-91c5-403a-895e-0db440b8b717 req-5103140a-6318-4887-8a40-a3b80e4d5ee7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.198512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-af43003b-91c5-403a-895e-0db440b8b717 req-5103140a-6318-4887-8a40-a3b80e4d5ee7 service nova] Creating event network-vif-deleted:7696ed08-9e46-4ed1-9784-657518dbbdc4 for instance ec5f28b8-0b54-456f-8f88-50e572f731bb on n-h1-master-1 Jul 24 01:23:37.212066 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-af43003b-91c5-403a-895e-0db440b8b717 req-5103140a-6318-4887-8a40-a3b80e4d5ee7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065291 Jul 24 01:23:37.214875 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1488/3129] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:37.254583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b3755fdf-67da-4cb1-b1bb-64f02a2b37fd req-a50a75e5-224d-4eab-8f1c-e632ba607466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c413c5-2e70-402c-9b9d-0bfa730ef8cf", "name": "network-vif-plugged", "status": "completed", "tag": "fd4040b1-a47f-4fc4-9db7-10af4e82644a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:37.265650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3755fdf-67da-4cb1-b1bb-64f02a2b37fd req-a50a75e5-224d-4eab-8f1c-e632ba607466 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.266509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3755fdf-67da-4cb1-b1bb-64f02a2b37fd req-a50a75e5-224d-4eab-8f1c-e632ba607466 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.279741 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b3755fdf-67da-4cb1-b1bb-64f02a2b37fd req-a50a75e5-224d-4eab-8f1c-e632ba607466 service nova] Creating event network-vif-plugged:fd4040b1-a47f-4fc4-9db7-10af4e82644a for instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf on n-h2-master-1 Jul 24 01:23:37.285583 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b3755fdf-67da-4cb1-b1bb-64f02a2b37fd req-a50a75e5-224d-4eab-8f1c-e632ba607466 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Jul 24 01:23:37.286868 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1489/3130] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:23:37.313020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:37.314481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:37.321847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.323104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.324134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.324769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.502433 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ddc856c-42b5-4f3d-a266-db9b6ff205c0 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e/action" status: 202 len: 0 microversion: 2.1 time: 0.829901 Jul 24 01:23:37.503588 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1642/3131] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:23:36 2022] POST /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e/action => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:23:37.508746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:37.520385 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8e8a8f0-f58f-4713-8397-70ef4238ee41 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.211143 Jul 24 01:23:37.522163 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1490/3132] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:37 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:37.524781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:37.534764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:37.542387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.542848 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.543641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.544086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.651524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:37.652273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:37.660877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.663248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.664315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:37.664850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:37.774043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:37.789388 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb10544c-572b-4e85-a23b-042148dfb773 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1472 microversion: 2.1 time: 0.272156 Jul 24 01:23:37.804479 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1643/3133] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:37 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:37.846889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:37.855918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ae99e7df-4ca7-4ce5-aa65-91f52f388989 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.209114 Jul 24 01:23:37.856508 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1491/3134] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:37 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:38.151701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:38.152312 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:38.160052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.160505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.161432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.161906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.200901 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.202187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.202844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lazy-loading 'fault' on Instance uuid ec5f28b8-0b54-456f-8f88-50e572f731bb {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:23:38.251788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b31a7e59f94d6ea7749c7ae004fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463acfa253e4eadb23ff67c2e1058dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:38.263497 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dfc79121-2e22-41ac-b36f-d389c156f559 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 200 len: 1302 microversion: 2.1 time: 0.115530 Jul 24 01:23:38.264762 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1644/3135] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:38 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:38.539159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:38.540177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:38.547844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.548643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.549638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.550301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.808519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:38.809795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:38.826485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.827791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.830191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.831045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.903549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:38.915370 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f936cc82-fd58-4e0f-9c4b-1c497a21a021 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.377495 Jul 24 01:23:38.915370 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1492/3136] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:38 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:38.918818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:38.919451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:38.926644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.927355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:38.928577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:38.928989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.223876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:39.243286 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a4c938f-0945-4064-8b33-268dd2c8fadd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1472 microversion: 2.1 time: 0.439404 Jul 24 01:23:39.244104 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1645/3137] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:38 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:39.261387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:39.270550 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-93e34ad1-ef08-4d4b-a56b-ed9184e3c446 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1321 microversion: 2.1 time: 0.355600 Jul 24 01:23:39.271991 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1493/3138] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:38 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:39.282202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.282929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:39.290095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.290660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.291550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.292216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.306728 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] HTTP exception thrown: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Request method failure captured: Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb HTTP/1.1 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J71SKz9i6wRNtt75iRt87yTsvyC1ZrqwJ-9MxPdFWEOlPE_ZoD04iXtWHK1HHpT0_64k7xoFgtk1PLPBLeNOsYNY69MUeYQWvOZapyNCNj1RjN0P6LX4Z_t6lbNndyYZQzHbKbCChHUG6Q1xVzDd_den_3CoQ8LiKwwEWFhQyHC4xI Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a463acfa253e4eadb23ff67c2e1058dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 71b31a7e59f94d6ea7749c7ae004fea2 Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ec5f28b8-0b54-456f-8f88-50e572f731bb'} Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.308964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.314448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.314448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.314448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.314448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:39.314448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:39.314448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.314448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.317054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Returning 404 to user: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:39.318582 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf4d02f2-3176-4bc8-9478-f7beb546cf1e tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 404 len: 111 microversion: 2.1 time: 0.040542 Jul 24 01:23:39.339825 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1646/3139] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:39 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:39.353365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9feddcfd-aa82-4d67-b024-dea6352d4805 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.373333 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:39.392051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.server_groups [None req-9feddcfd-aa82-4d67-b024-dea6352d4805 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Querying cell 0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) for 1 instances {{(pid=119562) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 24 01:23:39.394681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9feddcfd-aa82-4d67-b024-dea6352d4805 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.395405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9feddcfd-aa82-4d67-b024-dea6352d4805 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.419051 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9feddcfd-aa82-4d67-b024-dea6352d4805 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.070410 Jul 24 01:23:39.419813 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1494/3140] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:23:39 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:39.431182 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-35548fec-8c41-4af4-b08e-ce8642de67c0 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.447035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.server_groups [None req-35548fec-8c41-4af4-b08e-ce8642de67c0 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Querying cell 0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) for 1 instances {{(pid=119561) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 24 01:23:39.447839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35548fec-8c41-4af4-b08e-ce8642de67c0 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.448278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35548fec-8c41-4af4-b08e-ce8642de67c0 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.465900 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-35548fec-8c41-4af4-b08e-ce8642de67c0 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/9e779ae7-e375-40ca-ae6d-f0646ad763cc" status: 200 len: 183 microversion: 2.1 time: 0.038989 Jul 24 01:23:39.467736 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1647/3141] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:23:39 2022] GET /compute/v2.1/os-server-groups/9e779ae7-e375-40ca-ae6d-f0646ad763cc => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:39.479562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.480517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:39.497963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.498696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.501763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.502435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.539020 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] HTTP exception thrown: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Request method failure captured: Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb HTTP/1.1 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J71SKz9i6wRNtt75iRt87yTsvyC1ZrqwJ-9MxPdFWEOlPE_ZoD04iXtWHK1HHpT0_64k7xoFgtk1PLPBLeNOsYNY69MUeYQWvOZapyNCNj1RjN0P6LX4Z_t6lbNndyYZQzHbKbCChHUG6Q1xVzDd_den_3CoQ8LiKwwEWFhQyHC4xI Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a463acfa253e4eadb23ff67c2e1058dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 71b31a7e59f94d6ea7749c7ae004fea2 Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ec5f28b8-0b54-456f-8f88-50e572f731bb'} Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:39.541043 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Returning 404 to user: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd3f32d5-cb95-4124-b254-c8bab5179431 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 404 len: 111 microversion: 2.1 time: 0.067794 Jul 24 01:23:39.548654 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1495/3142] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:39 2022] DELETE /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:39.552221 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.553479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] [instance: ec5f28b8-0b54-456f-8f88-50e572f731bb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:39.562341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.562793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.563584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.564674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.585040 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] HTTP exception thrown: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Request method failure captured: Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb HTTP/1.1 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J71SKz9i6wRNtt75iRt87yTsvyC1ZrqwJ-9MxPdFWEOlPE_ZoD04iXtWHK1HHpT0_64k7xoFgtk1PLPBLeNOsYNY69MUeYQWvOZapyNCNj1RjN0P6LX4Z_t6lbNndyYZQzHbKbCChHUG6Q1xVzDd_den_3CoQ8LiKwwEWFhQyHC4xI Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a463acfa253e4eadb23ff67c2e1058dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 71b31a7e59f94d6ea7749c7ae004fea2 Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ec5f28b8-0b54-456f-8f88-50e572f731bb'} Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.586673 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.591358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.591358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.591358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.591358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:39.591358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:39.591358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. Jul 24 01:23:39.591358 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.593945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Returning 404 to user: Instance ec5f28b8-0b54-456f-8f88-50e572f731bb could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:39.594844 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4715d6c6-0d80-4b12-8c18-7f0f67fa821a tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb" status: 404 len: 111 microversion: 2.1 time: 0.046520 Jul 24 01:23:39.595441 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1648/3143] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:39 2022] GET /compute/v2.1/servers/ec5f28b8-0b54-456f-8f88-50e572f731bb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:39.605730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f79c4cf-5ecb-4bcc-bb17-d3c525086f30 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.619066 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4f79c4cf-5ecb-4bcc-bb17-d3c525086f30 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] HTTP exception thrown: Instance group 6deb40e3-a6d8-4362-9658-b829c6bb03ff could not be found. Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f79c4cf-5ecb-4bcc-bb17-d3c525086f30 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Request method failure captured: Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-server-groups/6deb40e3-a6d8-4362-9658-b829c6bb03ff HTTP/1.1 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J71SKz9i6wRNtt75iRt87yTsvyC1ZrqwJ-9MxPdFWEOlPE_ZoD04iXtWHK1HHpT0_64k7xoFgtk1PLPBLeNOsYNY69MUeYQWvOZapyNCNj1RjN0P6LX4Z_t6lbNndyYZQzHbKbCChHUG6Q1xVzDd_den_3CoQ8LiKwwEWFhQyHC4xI Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a463acfa253e4eadb23ff67c2e1058dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 71b31a7e59f94d6ea7749c7ae004fea2 Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: exception: Instance group 6deb40e3-a6d8-4362-9658-b829c6bb03ff could not be found. Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6deb40e3-a6d8-4362-9658-b829c6bb03ff'} Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6deb40e3-a6d8-4362-9658-b829c6bb03ff could not be found. Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6deb40e3-a6d8-4362-9658-b829c6bb03ff could not be found. Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.620848 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.625173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.625173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.625173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:39.625173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:39.625173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6deb40e3-a6d8-4362-9658-b829c6bb03ff could not be found. Jul 24 01:23:39.625173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.625173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f79c4cf-5ecb-4bcc-bb17-d3c525086f30 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Returning 404 to user: Instance group 6deb40e3-a6d8-4362-9658-b829c6bb03ff could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:39.627120 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f79c4cf-5ecb-4bcc-bb17-d3c525086f30 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/6deb40e3-a6d8-4362-9658-b829c6bb03ff" status: 404 len: 117 microversion: 2.1 time: 0.027095 Jul 24 01:23:39.633839 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1496/3144] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:39 2022] DELETE /compute/v2.1/os-server-groups/6deb40e3-a6d8-4362-9658-b829c6bb03ff => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:39.636607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1f3ea69-0727-4a76-9d2c-9413a62cf44b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.650920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-d1f3ea69-0727-4a76-9d2c-9413a62cf44b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] HTTP exception thrown: Instance group 3d21b384-6180-49b7-b3d1-c2bc1e40e375 could not be found. Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1f3ea69-0727-4a76-9d2c-9413a62cf44b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Request method failure captured: Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-server-groups/3d21b384-6180-49b7-b3d1-c2bc1e40e375 HTTP/1.1 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J71SKz9i6wRNtt75iRt87yTsvyC1ZrqwJ-9MxPdFWEOlPE_ZoD04iXtWHK1HHpT0_64k7xoFgtk1PLPBLeNOsYNY69MUeYQWvOZapyNCNj1RjN0P6LX4Z_t6lbNndyYZQzHbKbCChHUG6Q1xVzDd_den_3CoQ8LiKwwEWFhQyHC4xI Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a463acfa253e4eadb23ff67c2e1058dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 71b31a7e59f94d6ea7749c7ae004fea2 Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: exception: Instance group 3d21b384-6180-49b7-b3d1-c2bc1e40e375 could not be found. Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '3d21b384-6180-49b7-b3d1-c2bc1e40e375'} Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3d21b384-6180-49b7-b3d1-c2bc1e40e375 could not be found. Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3d21b384-6180-49b7-b3d1-c2bc1e40e375 could not be found. Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.654174 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3d21b384-6180-49b7-b3d1-c2bc1e40e375 could not be found. Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1f3ea69-0727-4a76-9d2c-9413a62cf44b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Returning 404 to user: Instance group 3d21b384-6180-49b7-b3d1-c2bc1e40e375 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d1f3ea69-0727-4a76-9d2c-9413a62cf44b tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3d21b384-6180-49b7-b3d1-c2bc1e40e375" status: 404 len: 117 microversion: 2.1 time: 0.024547 Jul 24 01:23:39.659937 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1649/3145] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:39 2022] DELETE /compute/v2.1/os-server-groups/3d21b384-6180-49b7-b3d1-c2bc1e40e375 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:23:39.667286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad2fdc7e-e518-49cc-a364-dac7b4b9a803 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.677126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ad2fdc7e-e518-49cc-a364-dac7b4b9a803 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] HTTP exception thrown: Instance group 0573a186-fbac-4cba-bb51-632a0e3fc232 could not be found. Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad2fdc7e-e518-49cc-a364-dac7b4b9a803 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Request method failure captured: Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-server-groups/0573a186-fbac-4cba-bb51-632a0e3fc232 HTTP/1.1 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J71SKz9i6wRNtt75iRt87yTsvyC1ZrqwJ-9MxPdFWEOlPE_ZoD04iXtWHK1HHpT0_64k7xoFgtk1PLPBLeNOsYNY69MUeYQWvOZapyNCNj1RjN0P6LX4Z_t6lbNndyYZQzHbKbCChHUG6Q1xVzDd_den_3CoQ8LiKwwEWFhQyHC4xI Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a463acfa253e4eadb23ff67c2e1058dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 71b31a7e59f94d6ea7749c7ae004fea2 Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: exception: Instance group 0573a186-fbac-4cba-bb51-632a0e3fc232 could not be found. Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '0573a186-fbac-4cba-bb51-632a0e3fc232'} Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0573a186-fbac-4cba-bb51-632a0e3fc232 could not be found. Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0573a186-fbac-4cba-bb51-632a0e3fc232 could not be found. Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.678799 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0573a186-fbac-4cba-bb51-632a0e3fc232 could not be found. Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad2fdc7e-e518-49cc-a364-dac7b4b9a803 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Returning 404 to user: Instance group 0573a186-fbac-4cba-bb51-632a0e3fc232 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:39.683648 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad2fdc7e-e518-49cc-a364-dac7b4b9a803 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/0573a186-fbac-4cba-bb51-632a0e3fc232" status: 404 len: 117 microversion: 2.1 time: 0.018297 Jul 24 01:23:39.690541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1687a450-948a-4878-af3e-14a1d3ae9de4 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.696225 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1497/3146] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:39 2022] DELETE /compute/v2.1/os-server-groups/0573a186-fbac-4cba-bb51-632a0e3fc232 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:39.699366 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1687a450-948a-4878-af3e-14a1d3ae9de4 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] HTTP exception thrown: Instance group 25d113e6-14a4-44b7-b74d-516255554980 could not be found. Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1687a450-948a-4878-af3e-14a1d3ae9de4 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Request method failure captured: Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-server-groups/25d113e6-14a4-44b7-b74d-516255554980 HTTP/1.1 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J71SKz9i6wRNtt75iRt87yTsvyC1ZrqwJ-9MxPdFWEOlPE_ZoD04iXtWHK1HHpT0_64k7xoFgtk1PLPBLeNOsYNY69MUeYQWvOZapyNCNj1RjN0P6LX4Z_t6lbNndyYZQzHbKbCChHUG6Q1xVzDd_den_3CoQ8LiKwwEWFhQyHC4xI Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a463acfa253e4eadb23ff67c2e1058dc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a463acfa253e4eadb23ff67c2e1058dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a463acfa253e4eadb23ff67c2e1058dc Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerGroupTestJSON-1622250664 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 71b31a7e59f94d6ea7749c7ae004fea2 Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerGroupTestJSON-1622250664-project Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: exception: Instance group 25d113e6-14a4-44b7-b74d-516255554980 could not be found. Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '25d113e6-14a4-44b7-b74d-516255554980'} Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 25d113e6-14a4-44b7-b74d-516255554980 could not be found. Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 25d113e6-14a4-44b7-b74d-516255554980 could not be found. Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.700934 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 25d113e6-14a4-44b7-b74d-516255554980 could not be found. Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1687a450-948a-4878-af3e-14a1d3ae9de4 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Returning 404 to user: Instance group 25d113e6-14a4-44b7-b74d-516255554980 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:39.706284 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1687a450-948a-4878-af3e-14a1d3ae9de4 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/25d113e6-14a4-44b7-b74d-516255554980" status: 404 len: 117 microversion: 2.1 time: 0.017340 Jul 24 01:23:39.712514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8b90800-7b29-4bbc-8a2a-ba8d35068ac2 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.716045 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1650/3147] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:39 2022] DELETE /compute/v2.1/os-server-groups/25d113e6-14a4-44b7-b74d-516255554980 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:39.743926 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8b90800-7b29-4bbc-8a2a-ba8d35068ac2 tempest-ServerGroupTestJSON-1622250664 tempest-ServerGroupTestJSON-1622250664-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/9e779ae7-e375-40ca-ae6d-f0646ad763cc" status: 204 len: 0 microversion: 2.1 time: 0.035846 Jul 24 01:23:39.748618 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1498/3148] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:23:39 2022] DELETE /compute/v2.1/os-server-groups/9e779ae7-e375-40ca-ae6d-f0646ad763cc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:39.930753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:39.931273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:39.938769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.939439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:39.940379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:39.940960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.234936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:40.243324 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-138567e1-903e-4f7c-8fb0-8c6fd8d0ccaa tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1486 microversion: 2.1 time: 0.316498 Jul 24 01:23:40.244156 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1651/3149] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:39 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1486 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:40.262146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:40.263373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:40.271519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8762ac5-4ec3-43cd-ac2a-b15a8a686f3b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:40.272058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8762ac5-4ec3-43cd-ac2a-b15a8a686f3b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:40.272321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.272944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.273997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.274601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.278417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8762ac5-4ec3-43cd-ac2a-b15a8a686f3b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.278873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8762ac5-4ec3-43cd-ac2a-b15a8a686f3b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.283401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8762ac5-4ec3-43cd-ac2a-b15a8a686f3b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.284010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8762ac5-4ec3-43cd-ac2a-b15a8a686f3b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.366141 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8762ac5-4ec3-43cd-ac2a-b15a8a686f3b tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "POST /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96/action" status: 202 len: 0 microversion: 2.1 time: 0.102892 Jul 24 01:23:40.366710 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1652/3150] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:23:40 2022] POST /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:23:40.373267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:40.374084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:40.380544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.381251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.382060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.382657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.852690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:40.863788 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f616ec98-7149-4384-b058-2671eab98934 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1472 microversion: 2.1 time: 0.606672 Jul 24 01:23:40.864539 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1499/3151] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:40 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:40.882240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:40.882916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:40.891219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.891877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.892813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.893318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.929547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:40.942047 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d68161e9-5722-467f-8674-80bdae200c76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1503 microversion: 2.1 time: 0.573917 Jul 24 01:23:40.944412 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1653/3152] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:40 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1503 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:40.962243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:40.963207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:40.970520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.971033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:40.971870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:40.972479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:41.508034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:41.532583 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ddf715a9-79dc-41fe-b50f-dab60d2b571c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1494 microversion: 2.1 time: 0.650901 Jul 24 01:23:41.535260 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1500/3153] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:40 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1494 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:41.658581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:41.669007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1372a624-6e09-4a56-b744-b8690eccc578 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1503 microversion: 2.1 time: 0.711097 Jul 24 01:23:41.670622 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1654/3154] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:40 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1503 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:41.691035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:41.692849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:41.706016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:41.706753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:41.708202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:41.708794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:41.751687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:23:41.870089 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-539767af-6e16-4d6a-ae48-254df2f5bfe2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 204 len: 0 microversion: 2.1 time: 0.184602 Jul 24 01:23:41.871431 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1501/3155] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:41 2022] DELETE /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:41.883089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:41.884209 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:41.888280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:41.890370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:41.893526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:41.894404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:41.895922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:41.896953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:41.898110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:41.898976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:41.901122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:41.902581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:42.490997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:42.493465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:42.503277 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36e9954e-8026-4aef-a4ec-3237319f6fec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1509 microversion: 2.1 time: 0.626374 Jul 24 01:23:42.504206 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1655/3156] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:41 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:42.517972 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7341491a-4993-4c98-b97b-e49c113a7a70 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.637058 Jul 24 01:23:42.519449 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1502/3157] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:41 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:42.557055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:42.565277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:42.584970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:42.587314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:42.593459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:42.622567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:43.396761 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:43.425921 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b69933d-948e-405c-af9f-eec6f42eb3b0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1494 microversion: 2.1 time: 0.876687 Jul 24 01:23:43.441799 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1656/3158] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:42 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1494 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:43.523385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:43.525037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:43.542156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:43.543273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:43.552057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:43.554648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:43.555290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:43.556239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:43.556922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:43.557523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:43.558595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:43.561805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:43.569653 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:44.301204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:44.315633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88ce3ea6-6de8-42e3-99ca-a3626fe279f8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1509 microversion: 2.1 time: 0.798279 Jul 24 01:23:44.318171 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1503/3159] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:43 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1509 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:44.321790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:44.330664 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f920ec4-6e87-4ebf-8f67-2bbfe7fab859 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.798121 Jul 24 01:23:44.342904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1657/3160] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:43 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:44.454283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:44.456223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:44.472109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:44.472911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:44.474018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:44.474753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:44.850801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3b3e6b55-7958-48f6-87f9-3fc703636907 req-74f4e7d8-a2c1-4733-8c17-ebe703cb4ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c413c5-2e70-402c-9b9d-0bfa730ef8cf", "name": "network-vif-deleted", "tag": "fd4040b1-a47f-4fc4-9db7-10af4e82644a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:44.872579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3b3e6b55-7958-48f6-87f9-3fc703636907 req-74f4e7d8-a2c1-4733-8c17-ebe703cb4ff1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:44.873714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3b3e6b55-7958-48f6-87f9-3fc703636907 req-74f4e7d8-a2c1-4733-8c17-ebe703cb4ff1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:44.899633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3b3e6b55-7958-48f6-87f9-3fc703636907 req-74f4e7d8-a2c1-4733-8c17-ebe703cb4ff1 service nova] Creating event network-vif-deleted:fd4040b1-a47f-4fc4-9db7-10af4e82644a for instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf on n-h2-master-1 Jul 24 01:23:44.914858 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3b3e6b55-7958-48f6-87f9-3fc703636907 req-74f4e7d8-a2c1-4733-8c17-ebe703cb4ff1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067626 Jul 24 01:23:44.918171 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1658/3161] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:23:44.938945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:44.966343 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-26c83a6a-4bab-42f5-a68e-ba644501614a tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1500 microversion: 2.1 time: 0.522771 Jul 24 01:23:44.967120 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1504/3162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:44 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1500 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:44.996093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:44.996430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:45.011583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.012058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.012937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.013367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.072735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:23:45.220181 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-938ba733-7800-4542-b85c-b052d87e68a8 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 204 len: 0 microversion: 2.1 time: 0.229247 Jul 24 01:23:45.220788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1659/3163] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:44 2022] DELETE /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:45.229296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:45.231146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:45.243649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.249193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.250131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.250466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.340241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:45.340970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:45.360558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.361020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.362048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.362488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.417352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.417942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.418394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lazy-loading 'fault' on Instance uuid f6c413c5-2e70-402c-9b9d-0bfa730ef8cf {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:23:45.499817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:45.523053 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-adfafa72-2513-4408-994a-6a519c67a772 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 200 len: 1311 microversion: 2.1 time: 0.190953 Jul 24 01:23:45.523757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1660/3164] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:45 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:45.542019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:45.543218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:45.550235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.551114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.552254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:45.552863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:45.709753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:45.721613 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73e3cad4-10c8-418a-b74f-a2a45fb56186 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.493361 Jul 24 01:23:45.722318 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1505/3165] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:45 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:45.818467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:45.826364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af74e985-69e1-4431-9263-5d9ac98298dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.289022 Jul 24 01:23:45.837547 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1661/3166] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:45 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:46.541742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.543054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:46.551562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:46.552304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:46.553383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:46.553982 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:46.572789 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf HTTP/1.1 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f6c413c5-2e70-402c-9b9d-0bfa730ef8cf'} Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:46.574514 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:46.580342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:46.580342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:46.580342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:46.580342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:46.580342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:23:46.580342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:46.581989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:46.583171 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c2464c7c-d11c-4a6a-9260-bb15c364bdda tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 404 len: 111 microversion: 2.1 time: 0.045942 Jul 24 01:23:46.585024 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1506/3167] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:46.600851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-134bbc82-d032-4b91-bb88-e561ac8fb0a0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: .version_select at 0x7f05eaa97310>, body: {"keypair": {"name": "tempest-key-1097117572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhBp0KCLrLSdaQ1WlXd3a25b+tKr9mAvKhTYF1KIWexwKYxts5T85x3B5LsqY6sBeeD6mQtraM4dDmaqCm7EzL1kJ7GTChq+Vt5ByyumlarAix1Ozx/PW0VGHX7VrGrpw=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:46.621879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-134bbc82-d032-4b91-bb88-e561ac8fb0a0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:46.628802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-134bbc82-d032-4b91-bb88-e561ac8fb0a0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:46.663346 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-134bbc82-d032-4b91-bb88-e561ac8fb0a0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.066425 Jul 24 01:23:46.669087 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1662/3168] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:23:46 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:46.674600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '.version_select at 0x7f05ea49cee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.677562 n-d-master-1 devstack@n-api.service[119562]: WARNING oslo_db.sqlalchemy.utils [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 24 01:23:46.687917 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.017382 Jul 24 01:23:46.699646 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1507/3169] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:46.743483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.744111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:46.753763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:46.754348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:46.755209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:46.755801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:46.771306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.772414 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001437 Jul 24 01:23:46.772920 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1508/3170] 10.222.0.27 () {56 vars in 885 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 24 01:23:46.779390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.780468 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001592 Jul 24 01:23:46.785495 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1509/3171] 10.222.0.27 () {54 vars in 1034 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/v2/ => generated 379 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jul 24 01:23:46.786600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.787592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001343 Jul 24 01:23:46.788139 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1510/3172] 10.222.0.27 () {54 vars in 1040 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:46.796393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.797248 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9cf5bd3-1815-4420-a909-5736340f63e0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001240 Jul 24 01:23:46.797607 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1511/3173] 10.222.0.27 () {56 vars in 885 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 24 01:23:46.845157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:46.845824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:46.856215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:46.857124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:46.858677 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:46.859823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:47.098235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:47.108980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d074fb2b-67e6-4d75-a321-ad920900f06e tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.372632 Jul 24 01:23:47.118625 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1663/3174] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:47.125462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1134856794", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-key-1097117572", "networks": [{"uuid": "4015265e-e6b0-4e47-bccc-5d1d48270467"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:47.184225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:47.198623 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f40dfba5-2fcb-498d-b806-291d74584947 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.357817 Jul 24 01:23:47.198908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:23:47.214065 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1512/3175] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:46 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:47.995317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:23:47.996518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:23:47.997484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:23:47.998889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:23:47.999744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:23:48.009722 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:48.010410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:48.011200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:48.011637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:48.023684 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:48.033235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:23:48.040496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:23:48.054516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:23:48.057595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:23:48.109367 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89b0d42a-ab55-4619-bf51-058fdfa3cd82 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989100 Jul 24 01:23:48.110484 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1664/3176] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:23:48.128702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d43b02f3-59b5-4cb5-acca-093d8aa953a3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:48.128702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d43b02f3-59b5-4cb5-acca-093d8aa953a3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:48.173134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:48.173800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:48.182257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:48.182712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:48.183533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:48.184144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:48.263634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d43b02f3-59b5-4cb5-acca-093d8aa953a3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:48.273773 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d43b02f3-59b5-4cb5-acca-093d8aa953a3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1229 microversion: 2.1 time: 0.156972 Jul 24 01:23:48.279278 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1513/3177] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:48 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1229 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:48.284846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:48.285489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:48.308720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:48.309183 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:48.309995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:48.311074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:48.346539 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:48.476177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:48.487091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-59c6efc2-1f72-4549-93e4-3e68e1995c98 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1506 microversion: 2.1 time: 0.355226 Jul 24 01:23:48.487910 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1665/3178] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:48 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:48.755762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:48.766987 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-051dfe1e-d181-4b75-967b-2323a2d5b28a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.486005 Jul 24 01:23:48.767605 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1514/3179] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:48 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:49.293311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:49.294256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:49.317102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:49.318113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:49.323877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:49.332563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:49.473364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:49.482708 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fe023885-8e6b-4689-800b-68d4a9a01873 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1281 microversion: 2.1 time: 0.194697 Jul 24 01:23:49.490524 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1666/3180] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:49 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:49.504653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:49.505402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:49.525436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:49.526265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:49.533370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:49.534246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:49.702306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:49.718790 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-121fdb80-d669-4c0c-9d8b-f8179ea44053 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 200 len: 1464 microversion: 2.1 time: 0.218050 Jul 24 01:23:49.720204 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1515/3181] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:49 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 1464 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:49.785452 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:49.787259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:49.802211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:49.807399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:49.808428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:49.809034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.038233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-59f911cc-67d4-4c05-aa4d-9813943c4f4c req-47ac6b58-3133-48b7-8a67-6dae6e016d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0523ef6e-9c39-40db-9a57-6a214c6e7c96", "name": "network-vif-deleted", "tag": "15eda9b6-b239-4216-949d-a9cb797834ce"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:50.054386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-59f911cc-67d4-4c05-aa4d-9813943c4f4c req-47ac6b58-3133-48b7-8a67-6dae6e016d1e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:50.054847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-59f911cc-67d4-4c05-aa4d-9813943c4f4c req-47ac6b58-3133-48b7-8a67-6dae6e016d1e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.070697 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-59f911cc-67d4-4c05-aa4d-9813943c4f4c req-47ac6b58-3133-48b7-8a67-6dae6e016d1e service nova] Creating event network-vif-deleted:15eda9b6-b239-4216-949d-a9cb797834ce for instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 on n-h1-master-1 Jul 24 01:23:50.076824 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-59f911cc-67d4-4c05-aa4d-9813943c4f4c req-47ac6b58-3133-48b7-8a67-6dae6e016d1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399852 Jul 24 01:23:50.078302 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1667/3182] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:50.111747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:50.122188 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-751f4f70-63fe-4294-8134-244ea30bad33 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.340792 Jul 24 01:23:50.135191 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1516/3183] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:49 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:50.505897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:50.507522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:50.515494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:50.517306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.518407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:50.519187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.618722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:50.627645 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-363bc7af-3745-4399-840e-9ac7ca841949 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1287 microversion: 2.1 time: 0.127179 Jul 24 01:23:50.628629 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1668/3184] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:50 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:50.739669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:50.741099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: 0523ef6e-9c39-40db-9a57-6a214c6e7c96] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:50.753812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:50.754560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.755648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:50.756327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.781436 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] HTTP exception thrown: Instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 could not be found. Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Request method failure captured: Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 HTTP/1.1 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J6ZPoVufEDFmVjlOx_BiqyIa7IGNkupbWYdMK0IhpiDEBrWwlyE58m4O2nvufwDMGWlPXjcqXBBnCSG0Rr6HuP7PiqqbAui7sSF8ptGkJ9NVuCdyGDMonAZP7umFQQeul2t6Jv12s5Ub_p4vjshzr_affh3VshsgTcJw3o_Fi0HLeo Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 6b725b9f1812465f8a350e1a68e067a0 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerRescueTestJSON-373338542 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b725b9f1812465f8a350e1a68e067a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b725b9f1812465f8a350e1a68e067a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b725b9f1812465f8a350e1a68e067a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b725b9f1812465f8a350e1a68e067a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerRescueTestJSON-373338542 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 6b725b9f1812465f8a350e1a68e067a0 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerRescueTestJSON-373338542 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerRescueTestJSON-373338542-project Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1dda9fc0670f4e11ad4d8089bf1687c3 Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerRescueTestJSON-373338542-project Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 could not be found. Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '0523ef6e-9c39-40db-9a57-6a214c6e7c96'} Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 could not be found. Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 could not be found. Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:50.783335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 could not be found. Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Returning 404 to user: Instance 0523ef6e-9c39-40db-9a57-6a214c6e7c96 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0af19544-2d01-44b9-8fc2-7e8984331286 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96" status: 404 len: 111 microversion: 2.1 time: 0.052297 Jul 24 01:23:50.789405 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1517/3185] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:50 2022] GET /compute/v2.1/servers/0523ef6e-9c39-40db-9a57-6a214c6e7c96 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:50.796132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:50.796803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:50.806756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:50.807332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.810076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:50.813200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:50.866127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:23:51.028775 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f0962ef4-a757-4b08-8326-85191df967c0 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 204 len: 0 microversion: 2.1 time: 0.238352 Jul 24 01:23:51.033800 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1669/3186] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:23:50 2022] DELETE /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:23:51.040267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:51.041545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:51.051431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:51.052163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:51.053266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:51.054023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:51.142059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:51.143196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:51.159977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:51.160992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:51.162528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:51.163323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:51.727295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:51.760764 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b878a549-7daa-4b72-b57c-62a20efffb0f tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1491 microversion: 2.1 time: 0.722621 Jul 24 01:23:51.765899 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1518/3187] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:51 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1491 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:51.775249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:51.777986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:51.789714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:51.791394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:51.792434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:51.795821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:51.919222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:51.927897 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-588561dc-3af0-49f8-be55-21e2480410a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.791074 Jul 24 01:23:51.938717 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1670/3188] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:51 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:52.137838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:52.149218 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-352918cd-ff40-4bc0-8c61-d102b3bb5896 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1329 microversion: 2.1 time: 0.379223 Jul 24 01:23:52.150871 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1519/3189] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:51 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1329 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:52.558446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-61679d02-c521-446e-b729-dca5373edb0c req-bdbb0fad-d701-465c-acc3-8ce9fa2e7eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7349c407-af32-4e19-bd68-1b3de371c37c", "tag": "b3deb623-0999-4275-b0b7-5e3c190bab08"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:52.573060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-61679d02-c521-446e-b729-dca5373edb0c req-bdbb0fad-d701-465c-acc3-8ce9fa2e7eed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:52.573817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-61679d02-c521-446e-b729-dca5373edb0c req-bdbb0fad-d701-465c-acc3-8ce9fa2e7eed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:52.608981 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-61679d02-c521-446e-b729-dca5373edb0c req-bdbb0fad-d701-465c-acc3-8ce9fa2e7eed service nova] Creating event network-changed:b3deb623-0999-4275-b0b7-5e3c190bab08 for instance 7349c407-af32-4e19-bd68-1b3de371c37c on n-h1-master-1 Jul 24 01:23:52.616732 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-61679d02-c521-446e-b729-dca5373edb0c req-bdbb0fad-d701-465c-acc3-8ce9fa2e7eed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063224 Jul 24 01:23:52.617605 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1671/3190] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:52.785405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:52.786527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:52.796698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:52.797528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:52.799815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:52.800277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:52.948907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:52.951718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:52.970809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:52.972728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:52.973772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:52.974375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:53.307916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:53.319004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8328e94-6926-4252-8d1e-8dda52699467 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1491 microversion: 2.1 time: 0.541606 Jul 24 01:23:53.320025 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1520/3191] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:52 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1491 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:53.334959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:53.335953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:53.348799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:53.349200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:53.350407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:53.352402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:53.466251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:53.491080 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36ab6039-0060-4db3-952a-5f9baac21584 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.536183 Jul 24 01:23:53.492525 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1672/3192] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:52 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:53.839389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:53.850642 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec5f0b51-44e2-43c8-95ed-b76333caca5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1329 microversion: 2.1 time: 0.529104 Jul 24 01:23:53.851718 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1521/3193] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:53 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1329 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:54.336702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:54.337279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:54.346411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.347096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.348248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.348892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.509537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:54.510560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:54.517479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.518346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.519440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.520152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.722626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:54.728796 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:54.736848 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38bbedf6-3d96-43ef-a47a-b4b557bd9f6c tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1491 microversion: 2.1 time: 0.403945 Jul 24 01:23:54.746234 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1673/3194] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:54 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1491 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:54.878113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:54.880205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:54.893508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.894397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:54.895934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:54.897307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:55.079474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:55.090565 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-790d9ac7-9c0f-4232-8496-53335781487a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.585091 Jul 24 01:23:55.092398 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1522/3195] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:54 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:55.282607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-86f1265c-1496-4458-89cf-7a0cb6e15534 req-b0307631-1107-4b6f-98ea-234da1f6415a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e666f0e4-280e-48ba-9527-1c05662d761e", "name": "network-vif-deleted", "tag": "772d8297-76c5-4bac-8bde-dfa18ec8ecbc"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:23:55.305901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-86f1265c-1496-4458-89cf-7a0cb6e15534 req-b0307631-1107-4b6f-98ea-234da1f6415a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:55.320434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-86f1265c-1496-4458-89cf-7a0cb6e15534 req-b0307631-1107-4b6f-98ea-234da1f6415a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:55.383978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-86f1265c-1496-4458-89cf-7a0cb6e15534 req-b0307631-1107-4b6f-98ea-234da1f6415a service nova] Creating event network-vif-deleted:772d8297-76c5-4bac-8bde-dfa18ec8ecbc for instance e666f0e4-280e-48ba-9527-1c05662d761e on n-h2-master-1 Jul 24 01:23:55.388513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:55.393857 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-86f1265c-1496-4458-89cf-7a0cb6e15534 req-b0307631-1107-4b6f-98ea-234da1f6415a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117255 Jul 24 01:23:55.395126 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1523/3196] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:23:55.400747 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bfe743a0-dafb-4e1e-a451-51e588aba603 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1329 microversion: 2.1 time: 0.531839 Jul 24 01:23:55.402445 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1674/3197] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:54 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1329 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:55.756024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:55.756904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:55.769932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:55.770632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:55.771595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:55.772788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:55.839995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:55.840718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:55.856438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lazy-loading 'fault' on Instance uuid e666f0e4-280e-48ba-9527-1c05662d761e {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:23:55.962204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dda9fc0670f4e11ad4d8089bf1687c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b725b9f1812465f8a350e1a68e067a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:55.980111 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c38cb47-0eaf-4c78-9c4f-983584b9c9bd tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 200 len: 1303 microversion: 2.1 time: 0.227541 Jul 24 01:23:55.992761 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1524/3198] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:55 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:56.111453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:56.112010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:56.130658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:56.132708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:56.133896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:56.135170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:56.421556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:56.423070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:56.431610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:56.432530 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:56.433736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:56.434367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:56.436454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:56.446952 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad28d2c4-def1-4eb0-ba7a-0644ee98f0bd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.341361 Jul 24 01:23:56.458395 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1675/3199] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:56 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:57.001687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:57.002752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] [instance: e666f0e4-280e-48ba-9527-1c05662d761e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:57.020129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:57.020835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:57.022714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:57.024719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:57.063765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] HTTP exception thrown: Instance e666f0e4-280e-48ba-9527-1c05662d761e could not be found. Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Request method failure captured: Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e HTTP/1.1 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6ZPoVufEDFmVjlOx_BiqyIa7IGNkupbWYdMK0IhpiDEBrWwlyE58m4O2nvufwDMGWlPXjcqXBBnCSG0Rr6HuP7PiqqbAui7sSF8ptGkJ9NVuCdyGDMonAZP7umFQQeul2t6Jv12s5Ub_p4vjshzr_affh3VshsgTcJw3o_Fi0HLeo Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 6b725b9f1812465f8a350e1a68e067a0 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerRescueTestJSON-373338542 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b725b9f1812465f8a350e1a68e067a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b725b9f1812465f8a350e1a68e067a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b725b9f1812465f8a350e1a68e067a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b725b9f1812465f8a350e1a68e067a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerRescueTestJSON-373338542 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 6b725b9f1812465f8a350e1a68e067a0 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerRescueTestJSON-373338542 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerRescueTestJSON-373338542-project Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1dda9fc0670f4e11ad4d8089bf1687c3 Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerRescueTestJSON-373338542-project Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: exception: Instance e666f0e4-280e-48ba-9527-1c05662d761e could not be found. Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e666f0e4-280e-48ba-9527-1c05662d761e'} Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e666f0e4-280e-48ba-9527-1c05662d761e could not be found. Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e666f0e4-280e-48ba-9527-1c05662d761e could not be found. Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:23:57.071747 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:57.078717 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:23:57.078717 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:23:57.078717 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:23:57.078717 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:23:57.078717 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:23:57.078717 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e666f0e4-280e-48ba-9527-1c05662d761e could not be found. Jul 24 01:23:57.078717 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:23:57.082133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] Returning 404 to user: Instance e666f0e4-280e-48ba-9527-1c05662d761e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:23:57.085278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7298ae70-f421-4e41-b8d0-bed754855b50 tempest-ServerRescueTestJSON-373338542 tempest-ServerRescueTestJSON-373338542-project] 10.222.0.27 "GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e" status: 404 len: 111 microversion: 2.1 time: 0.088191 Jul 24 01:23:57.087102 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1676/3200] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:56 2022] GET /compute/v2.1/servers/e666f0e4-280e-48ba-9527-1c05662d761e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:23:57.273758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:57.290027 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b909e03a-0f32-49ad-9d0b-4b57b8004e5b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1329 microversion: 2.1 time: 0.872687 Jul 24 01:23:57.291917 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1525/3201] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:56 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1329 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:23:57.467720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:57.469187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:57.485481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:57.487308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:57.489616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:57.491680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:58.019232 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:58.051054 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:58.312792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:58.314350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:58.319552 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:58.336310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:58.342542 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:58.343899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:58.345073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:58.688106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:58.710190 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16e056ce-29a7-40b9-b8be-78e702547bee tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 1.247605 Jul 24 01:23:58.711453 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1677/3202] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:57 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:58.853524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:23:58.864487 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23ba8bba-31d9-49d9-a095-5b68bb261025 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1329 microversion: 2.1 time: 0.556845 Jul 24 01:23:58.867293 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1526/3203] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:58 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1329 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:23:59.728596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:59.729238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:59.743474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:59.743942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:59.746147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:59.746605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:59.884675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:23:59.885227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:23:59.900101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:59.900563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:23:59.904993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:23:59.905620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:00.369361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:00.385984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d7ab2169-018e-4a34-8f33-de0c1708ef6e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1329 microversion: 2.1 time: 0.504799 Jul 24 01:24:00.400139 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1527/3204] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:59 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1329 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:00.491924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:00.512912 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d0e4bd6c-7876-4a58-96af-bdf555547915 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1477 microversion: 2.1 time: 0.788486 Jul 24 01:24:00.533728 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1678/3205] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:23:59 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1477 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:00.540881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e25739d1-4f9c-47d7-a5c5-0c36bedf7edc req-2f7482e1-fa97-4be0-a020-3588ef556910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7349c407-af32-4e19-bd68-1b3de371c37c", "name": "network-vif-plugged", "status": "completed", "tag": "b3deb623-0999-4275-b0b7-5e3c190bab08"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:00.565871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e25739d1-4f9c-47d7-a5c5-0c36bedf7edc req-2f7482e1-fa97-4be0-a020-3588ef556910 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:00.566318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e25739d1-4f9c-47d7-a5c5-0c36bedf7edc req-2f7482e1-fa97-4be0-a020-3588ef556910 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:00.616797 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e25739d1-4f9c-47d7-a5c5-0c36bedf7edc req-2f7482e1-fa97-4be0-a020-3588ef556910 service nova] Creating event network-vif-plugged:b3deb623-0999-4275-b0b7-5e3c190bab08 for instance 7349c407-af32-4e19-bd68-1b3de371c37c on n-h1-master-1 Jul 24 01:24:00.638839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e25739d1-4f9c-47d7-a5c5-0c36bedf7edc req-2f7482e1-fa97-4be0-a020-3588ef556910 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098512 Jul 24 01:24:00.639642 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1679/3206] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:00.838422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-636006a3-2b21-446a-90be-18c1f17b4a92 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'create', calling method: .version_select at 0x7f05ea411160>, body: {"keypair": {"name": "tempest-keypair-1865003904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV8mp6Lr3k3JM4lwbieK/mfocGI1hcbFDtO2trWFyyNd8xS5EDoAAk6SZ4J/6cdLuAzRix9uc/B4NeSth088Wk1rcjEWExO7YEt87O1U49nxW2x0U9HsUq4gHeeIJeqAA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:00.859472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-636006a3-2b21-446a-90be-18c1f17b4a92 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for project b8eb99dbda38447a8ff7721744633469. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:00.871736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-636006a3-2b21-446a-90be-18c1f17b4a92 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for user 472ff2bf65fb473ba60274de014b08a9 and project b8eb99dbda38447a8ff7721744633469. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:00.950552 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-636006a3-2b21-446a-90be-18c1f17b4a92 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.548858 Jul 24 01:24:00.952656 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1528/3207] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:24:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 552 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:24:00.964762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1433252029", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:01.063107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] validate_networks() for [('65a31ff2-0877-4fce-9a40-a0060b7ea868', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:24:01.414590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:01.414590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:01.433192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:01.435980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:01.437224 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:01.437879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:01.952621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:01.964854 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd9e9531-3b66-498b-8377-f453836a95c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1329 microversion: 2.1 time: 0.554580 Jul 24 01:24:01.969823 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1529/3208] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:01 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1329 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:01.992082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:01.992738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:02.005813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:02.006410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:02.008771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:02.011916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.177528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:03.185354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5fcbb852-5c7f-4375-a38c-af6d12555d9b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1476 microversion: 2.1 time: 1.209223 Jul 24 01:24:03.192729 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1530/3209] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:01 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1476 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:03.198596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-54b063a1-c6df-44d7-a2ca-450e59f25927 req-c6b83511-59a2-45f4-8589-3ea79c8826e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf89b5b-4b91-403f-b73a-10e217ea471e", "name": "network-vif-unplugged", "status": "completed", "tag": "4f462090-d02a-49fd-a851-148c8dc7cb4d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:03.222024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-54b063a1-c6df-44d7-a2ca-450e59f25927 req-c6b83511-59a2-45f4-8589-3ea79c8826e0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:03.224791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-54b063a1-c6df-44d7-a2ca-450e59f25927 req-c6b83511-59a2-45f4-8589-3ea79c8826e0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.251778 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-54b063a1-c6df-44d7-a2ca-450e59f25927 req-c6b83511-59a2-45f4-8589-3ea79c8826e0 service nova] Creating event network-vif-unplugged:4f462090-d02a-49fd-a851-148c8dc7cb4d for instance cbf89b5b-4b91-403f-b73a-10e217ea471e on n-h1-master-1 Jul 24 01:24:03.266083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-54b063a1-c6df-44d7-a2ca-450e59f25927 req-c6b83511-59a2-45f4-8589-3ea79c8826e0 service nova] Instance cbf89b5b-4b91-403f-b73a-10e217ea471e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:24:03.291372 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-54b063a1-c6df-44d7-a2ca-450e59f25927 req-c6b83511-59a2-45f4-8589-3ea79c8826e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096662 Jul 24 01:24:03.292344 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1531/3210] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:03.302547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:03.303301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:03.311735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:03.312129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.313042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:03.313446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.544044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:03.545125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:03.545509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:03.546446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:03.546864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:03.584707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:03.587441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.591631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:03.594488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:03.658740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:03.681307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for user 5ab27e46e8534384abea2875fb9946df and project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:03.718409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:24:03.724521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:24:03.799828 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5b3fb5f-e8d3-4972-a972-322f17f5bc1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.033746 Jul 24 01:24:03.805327 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1680/3211] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:24:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 3036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:24:03.817973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fdbbbe66-f484-476c-8639-e2f8ed962b1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:03.818620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fdbbbe66-f484-476c-8639-e2f8ed962b1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:03.962208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:03.978644 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-552d686d-b635-49fd-a8fc-928ddc9a4cd5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1511 microversion: 2.1 time: 0.680332 Jul 24 01:24:03.979868 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1532/3212] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:03 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1511 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:04.005223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:04.006978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:04.021599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:04.027039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:04.030294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:04.034225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:04.051748 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:04.080364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fdbbbe66-f484-476c-8639-e2f8ed962b1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:04.090580 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fdbbbe66-f484-476c-8639-e2f8ed962b1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1222 microversion: 2.1 time: 0.283876 Jul 24 01:24:04.097289 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1681/3213] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:03 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1222 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:04.205082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:04.206173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:04.230825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:04.232828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:04.237635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:04.238152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:04.986163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:05.002821 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e96b7405-527a-4557-a98f-fede89108d9e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1476 microversion: 2.1 time: 0.800772 Jul 24 01:24:05.007475 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1682/3214] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:04 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1476 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:05.031788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1778327871", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:05.034347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:05.052550 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56b26e05-5a73-4357-a790-147a8b9bd9c9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1511 microversion: 2.1 time: 1.054543 Jul 24 01:24:05.071838 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1533/3215] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:03 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1511 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:05.084554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:05.088728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:05.102923 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:05.109245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:05.110404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:05.112657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:05.144101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:05.195340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] validate_networks() for [('65a31ff2-0877-4fce-9a40-a0060b7ea868', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:24:05.258136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:24:05.518561 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c53cf741-9974-4d89-899d-e5e016abfadc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 204 len: 0 microversion: 2.1 time: 0.444931 Jul 24 01:24:05.520338 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1534/3216] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:24:05 2022] DELETE /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:24:05.535766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ed968b77-2be4-402c-ad52-5b430b3ad33e req-cc5ff3d4-a1c2-4cbf-b2f6-3a872ce0dad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf89b5b-4b91-403f-b73a-10e217ea471e", "tag": "4f462090-d02a-49fd-a851-148c8dc7cb4d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:05.549545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ed968b77-2be4-402c-ad52-5b430b3ad33e req-cc5ff3d4-a1c2-4cbf-b2f6-3a872ce0dad4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:05.550484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ed968b77-2be4-402c-ad52-5b430b3ad33e req-cc5ff3d4-a1c2-4cbf-b2f6-3a872ce0dad4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:05.575938 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ed968b77-2be4-402c-ad52-5b430b3ad33e req-cc5ff3d4-a1c2-4cbf-b2f6-3a872ce0dad4 service nova] Creating event network-changed:4f462090-d02a-49fd-a851-148c8dc7cb4d for instance cbf89b5b-4b91-403f-b73a-10e217ea471e on n-h1-master-1 Jul 24 01:24:05.611451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-ed968b77-2be4-402c-ad52-5b430b3ad33e req-cc5ff3d4-a1c2-4cbf-b2f6-3a872ce0dad4 service nova] Instance cbf89b5b-4b91-403f-b73a-10e217ea471e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:24:05.661475 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ed968b77-2be4-402c-ad52-5b430b3ad33e req-cc5ff3d4-a1c2-4cbf-b2f6-3a872ce0dad4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137320 Jul 24 01:24:05.670506 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1535/3217] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:05.739980 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:05.747782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:05.785980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:05.790494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:05.797254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:05.811660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:06.707068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:06.714647 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8339bbc1-4f41-4266-bae6-d59ae8cc017a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1517 microversion: 2.1 time: 1.038639 Jul 24 01:24:06.715759 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1536/3218] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:05 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1517 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:06.722678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:06.723916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:06.734283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:06.735040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:06.736322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:06.737410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:07.856500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:07.868477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73a76dd8-58ec-4eee-8bbc-c5c515eb9c43 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1474 microversion: 2.1 time: 1.150428 Jul 24 01:24:07.872430 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1537/3219] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:06 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1474 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:07.884857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:07.885790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:07.904711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:07.909611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:07.911551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:07.912181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:08.333869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:08.334437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:08.335149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:08.335820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:08.336332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:08.359529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:08.360331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:08.361598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:08.362652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:08.399661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:08.411001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for user 5ab27e46e8534384abea2875fb9946df and project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:08.434662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:24:08.440187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:24:08.534748 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d7ab864-3e4b-4a79-85cd-f7774414755a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.522784 Jul 24 01:24:08.538440 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1683/3220] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:24:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:24:08.558433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-292b1590-58d6-4de1-afee-3c7f12d2b897 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:08.561558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-292b1590-58d6-4de1-afee-3c7f12d2b897 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:08.697957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:08.710051 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-db6d2bd1-d2e1-43f7-906d-2797620b4aeb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1517 microversion: 2.1 time: 0.829851 Jul 24 01:24:08.710997 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1538/3221] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:07 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1517 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:08.742223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-292b1590-58d6-4de1-afee-3c7f12d2b897 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:08.752090 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-292b1590-58d6-4de1-afee-3c7f12d2b897 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1222 microversion: 2.1 time: 0.207580 Jul 24 01:24:08.754989 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1684/3222] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:08 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1222 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:08.895276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:08.896781 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:08.907202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:08.908040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:08.909833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:08.910684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.510503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:09.526210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a2ce97b-ee95-4ce6-9164-170a81c674f8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1471 microversion: 2.1 time: 0.638880 Jul 24 01:24:09.527189 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1539/3223] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:08 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1471 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:09.552270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca025161-67e5-45b6-807a-ff73eed4f528 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:09.553069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ca025161-67e5-45b6-807a-ff73eed4f528 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:09.569377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca025161-67e5-45b6-807a-ff73eed4f528 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.570281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca025161-67e5-45b6-807a-ff73eed4f528 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.571451 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca025161-67e5-45b6-807a-ff73eed4f528 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.572176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca025161-67e5-45b6-807a-ff73eed4f528 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.645823 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca025161-67e5-45b6-807a-ff73eed4f528 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e/action" status: 204 len: 0 microversion: 2.1 time: 0.105198 Jul 24 01:24:09.646773 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1685/3224] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:24:09 2022] POST /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e/action => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:24:09.658870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:09.659986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:09.671284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.672087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.674113 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.674566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.730075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:09.732094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:09.746291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.747042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:09.748118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:09.748967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:10.191633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:10.208520 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c9c1408-f3da-4aca-b49a-afa086ea7165 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1517 microversion: 2.1 time: 0.483717 Jul 24 01:24:10.219279 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1686/3225] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:09 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1517 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:10.224585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:10.225193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:10.252700 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:10.254205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:10.255196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:10.255807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:10.340449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:10.349719 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-77289453-b7f9-44a4-89cd-3d1a26aa866c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1471 microversion: 2.1 time: 0.694935 Jul 24 01:24:10.350322 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1540/3226] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:09 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1471 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:10.364964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-460e212c-fb43-42b3-bfad-4b010023fc8d req-7d2eb01c-3814-46fe-8e9a-a1726a6517d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf89b5b-4b91-403f-b73a-10e217ea471e", "name": "network-vif-plugged", "status": "completed", "tag": "4f462090-d02a-49fd-a851-148c8dc7cb4d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:10.376068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-460e212c-fb43-42b3-bfad-4b010023fc8d req-7d2eb01c-3814-46fe-8e9a-a1726a6517d8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:10.376759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-460e212c-fb43-42b3-bfad-4b010023fc8d req-7d2eb01c-3814-46fe-8e9a-a1726a6517d8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:10.410224 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-460e212c-fb43-42b3-bfad-4b010023fc8d req-7d2eb01c-3814-46fe-8e9a-a1726a6517d8 service nova] Creating event network-vif-plugged:4f462090-d02a-49fd-a851-148c8dc7cb4d for instance cbf89b5b-4b91-403f-b73a-10e217ea471e on n-h1-master-1 Jul 24 01:24:10.421329 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-460e212c-fb43-42b3-bfad-4b010023fc8d req-7d2eb01c-3814-46fe-8e9a-a1726a6517d8 service nova] Instance cbf89b5b-4b91-403f-b73a-10e217ea471e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:24:10.452157 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-460e212c-fb43-42b3-bfad-4b010023fc8d req-7d2eb01c-3814-46fe-8e9a-a1726a6517d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100414 Jul 24 01:24:10.453630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1541/3227] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:10.465149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1726789022", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "904f3614-5f61-426a-96da-4b8965aeacb8"}], "security_groups": [{"name": "tempest-securitygroup--117031817"}], "key_name": "tempest-keypair-1865003904", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:10.623180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:10.640248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3bfce15e-a00f-45d6-87dd-3f3b3ef87a67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1280 microversion: 2.1 time: 0.419693 Jul 24 01:24:10.641434 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1687/3228] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:10 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1280 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:10.863589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] validate_networks() for [('904f3614-5f61-426a-96da-4b8965aeacb8', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:24:10.906969 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:11.053430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-97c10d12-73d6-48b6-8433-a052e842df0b req-0627062d-673b-4bf1-a99e-a83b0016c76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7349c407-af32-4e19-bd68-1b3de371c37c", "name": "network-vif-deleted", "tag": "b3deb623-0999-4275-b0b7-5e3c190bab08"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:11.083275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-97c10d12-73d6-48b6-8433-a052e842df0b req-0627062d-673b-4bf1-a99e-a83b0016c76d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.084223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-97c10d12-73d6-48b6-8433-a052e842df0b req-0627062d-673b-4bf1-a99e-a83b0016c76d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.108085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-97c10d12-73d6-48b6-8433-a052e842df0b req-0627062d-673b-4bf1-a99e-a83b0016c76d service nova] Creating event network-vif-deleted:b3deb623-0999-4275-b0b7-5e3c190bab08 for instance 7349c407-af32-4e19-bd68-1b3de371c37c on n-h1-master-1 Jul 24 01:24:11.113573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-97c10d12-73d6-48b6-8433-a052e842df0b req-0627062d-673b-4bf1-a99e-a83b0016c76d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068860 Jul 24 01:24:11.114764 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1688/3229] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:24:11.227302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:11.228069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:11.235797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.236258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.237234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.237695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.270609 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:11.275512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.275981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.276428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lazy-loading 'fault' on Instance uuid 7349c407-af32-4e19-bd68-1b3de371c37c {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:11.374956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:11.383364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e506b31-cc4e-44ef-95fe-059277f4ce94 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 200 len: 1319 microversion: 2.1 time: 0.160795 Jul 24 01:24:11.384280 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1689/3230] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:11 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:11.399339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:11.400324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:11.413507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.414172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.415246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.415773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.729220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:11.755134 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-827a2dbf-7847-4b77-bf4a-d6ab57998112 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1471 microversion: 2.1 time: 0.359612 Jul 24 01:24:11.758238 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1690/3231] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:11 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1471 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:11.768108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:11.769604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:11.778737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.779482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.780460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:11.781453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:11.920855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:11.938622 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bef83a1-0e74-424c-abf4-f4c71d803f1b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1280 microversion: 2.1 time: 0.176455 Jul 24 01:24:11.939214 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1691/3232] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:11 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:12.267490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:12.268686 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:12.269404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:12.269990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:12.270509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:12.282502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.283206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:12.285353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.286073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:12.307961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for project b8eb99dbda38447a8ff7721744633469. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:12.314982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for user 472ff2bf65fb473ba60274de014b08a9 and project b8eb99dbda38447a8ff7721744633469. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:12.329772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:24:12.332729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:24:12.402584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:12.403184 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:12.411214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.411708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:12.412445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.412946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:12.447139 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09e17c13-afcc-4f07-aaad-8b2cdbd1844d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.991891 Jul 24 01:24:12.448160 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1542/3233] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:24:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:24:12.457182 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c HTTP/1.1 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '7349c407-af32-4e19-bd68-1b3de371c37c'} Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:12.460509 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:12.465728 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:12.465728 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:12.465728 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:24:12.465728 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:24:12.465728 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:24:12.465728 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:12.467570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d471b3bc-f016-4ea5-9f6c-6e1f6e7bef0f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:12.468391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:24:12.469390 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be8d4296-25a7-4fe3-9948-570fe3d7c67f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 404 len: 111 microversion: 2.1 time: 0.071333 Jul 24 01:24:12.470101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1692/3234] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:12 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:24:12.471072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d471b3bc-f016-4ea5-9f6c-6e1f6e7bef0f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:12.487633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bb7a59c-2a46-4f7d-b2eb-cf15b151cfb3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '.version_select at 0x7f05eaa97160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:12.517431 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bb7a59c-2a46-4f7d-b2eb-cf15b151cfb3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-1097117572" status: 202 len: 0 microversion: 2.1 time: 0.042714 Jul 24 01:24:12.527305 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1693/3235] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:24:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1097117572 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:24:12.593283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d471b3bc-f016-4ea5-9f6c-6e1f6e7bef0f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:12.610085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d471b3bc-f016-4ea5-9f6c-6e1f6e7bef0f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:12.613915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d471b3bc-f016-4ea5-9f6c-6e1f6e7bef0f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:12.615292 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d471b3bc-f016-4ea5-9f6c-6e1f6e7bef0f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1282 microversion: 2.20 time: 0.158882 Jul 24 01:24:12.617585 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1543/3236] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:12 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:12.687138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1138911840", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "4015265e-e6b0-4e47-bccc-5d1d48270467"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:12.769120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:24:12.776151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:12.776775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:12.797479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.798057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:12.798863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:12.799411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:13.353537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:13.363342 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bd39e776-e4b6-4a34-b9ab-2da3b016c97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1471 microversion: 2.1 time: 0.590902 Jul 24 01:24:13.367906 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1544/3237] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:12 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1471 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:13.378016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:13.381748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:13.397824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:13.398295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:13.399608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:13.400054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.312995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:14.313702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:14.314246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:14.315665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:14.316342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:14.334631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:14.336627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.338456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:14.339179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.384465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:14.394394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:14.418892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:24:14.422056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:24:14.429362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:14.444208 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-618b0b0e-621f-470e-b4d1-4cbd34769462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1322 microversion: 2.1 time: 1.074931 Jul 24 01:24:14.444858 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1545/3238] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:13 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1322 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:14.449639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-bc0ccdf9-066f-4757-b16b-e07949e00980 req-aa6fa982-86ec-49a4-b3f4-576071e0c466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb80ae4d-7c53-4ac1-a20d-c9a603f08253", "tag": "18f0aab4-c772-4204-bb69-e7056d19fa6a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:14.472025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bc0ccdf9-066f-4757-b16b-e07949e00980 req-aa6fa982-86ec-49a4-b3f4-576071e0c466 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:14.472472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bc0ccdf9-066f-4757-b16b-e07949e00980 req-aa6fa982-86ec-49a4-b3f4-576071e0c466 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.490847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-bc0ccdf9-066f-4757-b16b-e07949e00980 req-aa6fa982-86ec-49a4-b3f4-576071e0c466 service nova] Creating event network-changed:18f0aab4-c772-4204-bb69-e7056d19fa6a for instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 on n-h2-master-1 Jul 24 01:24:14.516012 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6f628e0a-e1ec-4af5-bec1-84350893219b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834882 Jul 24 01:24:14.518224 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-bc0ccdf9-066f-4757-b16b-e07949e00980 req-aa6fa982-86ec-49a4-b3f4-576071e0c466 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071858 Jul 24 01:24:14.523752 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1694/3239] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:24:14.531889 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1546/3240] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:14.548102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:14.549263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:14.549398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:14.554474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:14.567295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:14.568447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:14.569754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.570468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.570776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:14.573401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.574774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:14.579887 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:14.787433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:14.800715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:14.805865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:14.809104 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-77a00433-d6f2-4b52-a7cd-f0514326bba9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1340 microversion: 2.20 time: 0.288717 Jul 24 01:24:14.809989 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1695/3241] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:14 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1340 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:14.837477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6bd31c75-76ec-4bf1-99aa-36162951a5dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:14.838427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6bd31c75-76ec-4bf1-99aa-36162951a5dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:15.047400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6bd31c75-76ec-4bf1-99aa-36162951a5dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:15.055812 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6bd31c75-76ec-4bf1-99aa-36162951a5dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1209 microversion: 2.1 time: 0.231814 Jul 24 01:24:15.068459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1696/3242] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:14 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:15.242729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:15.254552 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61b23f2c-534a-424c-bb92-98068ae05484 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1463 microversion: 2.1 time: 0.720912 Jul 24 01:24:15.263168 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1547/3243] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:14 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1463 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:15.279974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01a26d08-6749-4374-9f9c-7ed9dec80c88 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:15.280873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-01a26d08-6749-4374-9f9c-7ed9dec80c88 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:15.293306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a26d08-6749-4374-9f9c-7ed9dec80c88 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.293797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a26d08-6749-4374-9f9c-7ed9dec80c88 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.295174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a26d08-6749-4374-9f9c-7ed9dec80c88 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.306468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01a26d08-6749-4374-9f9c-7ed9dec80c88 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.431690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-474541f7-de96-4ff1-826c-ff152eef21bc req-735f6696-77cf-4d74-b62c-3053ea599e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17729231-087d-479b-8bd2-ac9d0f8f19df", "tag": "596a0dd6-a686-48e0-963c-333ae11b4af5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:15.445865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-474541f7-de96-4ff1-826c-ff152eef21bc req-735f6696-77cf-4d74-b62c-3053ea599e41 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.446582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-474541f7-de96-4ff1-826c-ff152eef21bc req-735f6696-77cf-4d74-b62c-3053ea599e41 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.460699 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-474541f7-de96-4ff1-826c-ff152eef21bc req-735f6696-77cf-4d74-b62c-3053ea599e41 service nova] Creating event network-changed:596a0dd6-a686-48e0-963c-333ae11b4af5 for instance 17729231-087d-479b-8bd2-ac9d0f8f19df on n-h1-master-1 Jul 24 01:24:15.474559 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-474541f7-de96-4ff1-826c-ff152eef21bc req-735f6696-77cf-4d74-b62c-3053ea599e41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248550 Jul 24 01:24:15.475819 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1697/3244] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:15.483604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:15.484723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:15.493319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.494558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.495646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.496723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.516260 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:15.819263 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01a26d08-6749-4374-9f9c-7ed9dec80c88 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1614 microversion: 2.1 time: 0.544058 Jul 24 01:24:15.832467 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1548/3245] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:15 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1614 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:15.838390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:15.839544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:15.851878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.852588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:15.853528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:15.853993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.000647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.008961 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b222960-e113-419f-bcea-a151126d0664 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1322 microversion: 2.1 time: 0.531143 Jul 24 01:24:16.012175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.014869 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1698/3246] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:15 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:16.032698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7101c0d9-fcfe-4fee-ad5a-b7539e49e77c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '.version_select at 0x7f05eaa95160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:16.035234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7101c0d9-fcfe-4fee-ad5a-b7539e49e77c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:16.035689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7101c0d9-fcfe-4fee-ad5a-b7539e49e77c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.043345 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.045645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.050299 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7101c0d9-fcfe-4fee-ad5a-b7539e49e77c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.026074 Jul 24 01:24:16.051756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd066682-ed5a-4ddc-a22e-2267f210e936 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1340 microversion: 2.20 time: 0.220438 Jul 24 01:24:16.052810 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1549/3247] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:15 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1340 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:16.053834 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1699/3248] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:24:16 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:16.077098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:16.078076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:16.088318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:16.089049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.090184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:16.091479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.237297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2066955207", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:16.253380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:16.272513 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2a2cfa18-02e8-4324-9969-925212caa141 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1213 microversion: 2.1 time: 0.191280 Jul 24 01:24:16.274148 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1550/3249] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:16 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:16.314858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:24:16.833638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:16.834315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:16.834571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:16.835203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:16.835951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:16.852719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:16.853186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.854305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:16.854753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:16.910440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:16.928389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for user 01e7c66073564bb0b78b2309d281d1f1 and project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:16.973843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:24:16.979832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:24:17.031007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:17.031611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:17.046527 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:17.047441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:17.048494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:17.049340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:17.060203 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:17.079118 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e09ce957-a65b-4d11-9e0e-4eeed60b9d18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846012 Jul 24 01:24:17.084205 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1700/3250] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:24:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:24:17.108154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:17.108793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:17.133009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:17.133477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:17.139373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:17.140052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:18.437508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.452715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.457177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.459734 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f44d6ba-f446-48de-8f7e-86d1d40dd596 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 1.373613 Jul 24 01:24:18.460957 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1701/3251] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:17 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:18.470130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:18.471171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:18.491441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:18.492398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:18.494439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:18.495218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:18.693317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.703341 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ab45b31-084c-44d7-a737-e3459c215ec4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1322 microversion: 2.1 time: 1.677014 Jul 24 01:24:18.708332 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1551/3252] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:17 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1322 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:18.720724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:18.721617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:18.728307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:18.728896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:18.729733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:18.730607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:18.775908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.784866 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1adcddf3-030f-417e-8d0e-d494b5f54050 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1265 microversion: 2.1 time: 0.322388 Jul 24 01:24:18.786828 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1702/3253] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:18 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:18.892721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:18.900964 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ede59358-2720-4bc2-a719-33aa50230bb8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1267 microversion: 2.1 time: 0.191146 Jul 24 01:24:18.910047 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1552/3254] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:18 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:19.485063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:19.487428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:19.518622 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:19.518890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:19.519689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:19.520129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:19.725014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:19.725748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:19.742744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:19.744942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:19.746479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:19.747478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:20.615345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:20.626389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:20.628328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:20.629789 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d709fba3-a207-4331-807d-39dbfed637c6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 1.154596 Jul 24 01:24:20.642078 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1703/3255] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:19 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:20.647668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:20.648509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:20.656822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:20.658139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:20.659092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:20.659692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:20.819298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:20.832120 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a11b99bb-d024-4ad8-8290-6e3a54ca207b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1322 microversion: 2.1 time: 1.111478 Jul 24 01:24:20.836349 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1553/3256] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:19 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1322 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:20.846490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:20.847419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:20.865133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:20.870258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:20.871567 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:20.872812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:21.558460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:21.579860 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cda838f3-3bdd-473b-97a8-f385acac5f6c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1313 microversion: 2.1 time: 0.936162 Jul 24 01:24:21.591896 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1704/3257] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:20 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1313 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:21.648646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:21.649341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:21.656974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:21.658133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:21.660870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:21.663856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.061214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.089725 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fce959e-d536-498e-a199-d02054a7a2ff tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 1.251982 Jul 24 01:24:22.106114 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1554/3258] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:20 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:22.134183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:22.135446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:22.148543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.149011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.150321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.150804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.298299 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:22.341407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.353856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.356770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.358454 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c0578011-0438-42b7-8f98-c9ef12ac08ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.713805 Jul 24 01:24:22.359279 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1705/3259] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:21 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:24:22.500523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-141c9fcb-6d09-44ca-8233-5315e63c553e req-34786345-6137-4181-9995-67c8a901d10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb80ae4d-7c53-4ac1-a20d-c9a603f08253", "name": "network-vif-plugged", "status": "completed", "tag": "18f0aab4-c772-4204-bb69-e7056d19fa6a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:22.515511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-141c9fcb-6d09-44ca-8233-5315e63c553e req-34786345-6137-4181-9995-67c8a901d10f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.516374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-141c9fcb-6d09-44ca-8233-5315e63c553e req-34786345-6137-4181-9995-67c8a901d10f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.534908 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-141c9fcb-6d09-44ca-8233-5315e63c553e req-34786345-6137-4181-9995-67c8a901d10f service nova] Creating event network-vif-plugged:18f0aab4-c772-4204-bb69-e7056d19fa6a for instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 on n-h2-master-1 Jul 24 01:24:22.541634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-141c9fcb-6d09-44ca-8233-5315e63c553e req-34786345-6137-4181-9995-67c8a901d10f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180637 Jul 24 01:24:22.543343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1706/3260] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:22.603251 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:22.628922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:22.646668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:22.677868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.678508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.682081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.686276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.779180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:22.798958 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd34a9af-e565-4ea0-bb88-214d79896ccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1322 microversion: 2.1 time: 0.690016 Jul 24 01:24:22.816525 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1555/3261] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:22 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:22.822565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1b2b5aa0-d071-423d-9136-4a6ce4a76464 req-517f0dee-c0f4-4880-a977-b017a6d62155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dbeb3c-a904-46e7-8403-8f1474e89a29", "tag": "ad6e6c9c-6133-4e8a-98f0-d89f0796a812"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:22.835387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1b2b5aa0-d071-423d-9136-4a6ce4a76464 req-517f0dee-c0f4-4880-a977-b017a6d62155 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:22.837856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1b2b5aa0-d071-423d-9136-4a6ce4a76464 req-517f0dee-c0f4-4880-a977-b017a6d62155 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:22.853376 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1b2b5aa0-d071-423d-9136-4a6ce4a76464 req-517f0dee-c0f4-4880-a977-b017a6d62155 service nova] Creating event network-changed:ad6e6c9c-6133-4e8a-98f0-d89f0796a812 for instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 on n-h1-master-1 Jul 24 01:24:22.859675 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1b2b5aa0-d071-423d-9136-4a6ce4a76464 req-517f0dee-c0f4-4880-a977-b017a6d62155 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041569 Jul 24 01:24:22.860296 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1556/3262] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:23.111701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:23.112466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:23.123637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.124468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:23.125531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.126236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:23.361888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:23.379786 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4e5e5e7c-1224-4942-acff-f47b60c6a6b9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1313 microversion: 2.1 time: 0.765632 Jul 24 01:24:23.381731 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1707/3263] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:22 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1313 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:23.396381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:23.397589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:23.405761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.406226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:23.407017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.407512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:23.823688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:23.832243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec6a7eeb-8cd0-49b8-9408-20e3f399d080 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 0.726912 Jul 24 01:24:23.832840 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1557/3264] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:23 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:23.841884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:23.842918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:23.850662 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.851590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:23.852649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:23.853346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.001162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.013153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.015404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.016680 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f5010519-dd1b-45e2-aa2a-c100e109d7d9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2950 microversion: 2.42 time: 0.633257 Jul 24 01:24:24.017333 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1708/3265] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:23 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2950 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:24.027638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-700968f5-284d-4c7c-8289-f32acf9c6472 req-4f1ebdab-96e3-407e-864a-1d7bede0948b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:24.045478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-700968f5-284d-4c7c-8289-f32acf9c6472 req-4f1ebdab-96e3-407e-864a-1d7bede0948b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.046096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-700968f5-284d-4c7c-8289-f32acf9c6472 req-4f1ebdab-96e3-407e-864a-1d7bede0948b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.064632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-700968f5-284d-4c7c-8289-f32acf9c6472 req-4f1ebdab-96e3-407e-864a-1d7bede0948b service nova] Creating event network-changed:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h1-master-1 Jul 24 01:24:24.078053 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-700968f5-284d-4c7c-8289-f32acf9c6472 req-4f1ebdab-96e3-407e-864a-1d7bede0948b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059058 Jul 24 01:24:24.080240 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1709/3266] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:24.098073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:24.099053 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:24.107726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.108502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.109298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.109761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.356147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.368170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.370254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.371699 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-568a3f63-7b45-4111-a655-add5aa105132 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.537654 Jul 24 01:24:24.374615 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1558/3267] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:23 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:24.382777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e73c054-5c47-481d-b963-f06e898cd7e0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:24.385023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e73c054-5c47-481d-b963-f06e898cd7e0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:24.407778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e73c054-5c47-481d-b963-f06e898cd7e0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.416814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e73c054-5c47-481d-b963-f06e898cd7e0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.418069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e73c054-5c47-481d-b963-f06e898cd7e0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.419829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e73c054-5c47-481d-b963-f06e898cd7e0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.624519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:24.635077 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e8a87f9-ef93-4712-8abd-b1147fdca34c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1322 microversion: 2.1 time: 0.553496 Jul 24 01:24:24.636225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1710/3268] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:24 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:24.642126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:24.643063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:24.650375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.651432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.652344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.652855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.771891 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e73c054-5c47-481d-b963-f06e898cd7e0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.394455 Jul 24 01:24:24.772986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1559/3269] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Jul 24 01:24:24 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b/os-interface => generated 1831 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:24.784185 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2f7f6a22-463b-4054-8347-903a8de4b744 req-7aa8f184-5199-416e-9841-9fea33d9185b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17729231-087d-479b-8bd2-ac9d0f8f19df", "name": "network-vif-plugged", "status": "completed", "tag": "596a0dd6-a686-48e0-963c-333ae11b4af5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:24.798515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2f7f6a22-463b-4054-8347-903a8de4b744 req-7aa8f184-5199-416e-9841-9fea33d9185b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.799111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2f7f6a22-463b-4054-8347-903a8de4b744 req-7aa8f184-5199-416e-9841-9fea33d9185b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.814859 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2f7f6a22-463b-4054-8347-903a8de4b744 req-7aa8f184-5199-416e-9841-9fea33d9185b service nova] Creating event network-vif-plugged:596a0dd6-a686-48e0-963c-333ae11b4af5 for instance 17729231-087d-479b-8bd2-ac9d0f8f19df on n-h1-master-1 Jul 24 01:24:24.827547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2f7f6a22-463b-4054-8347-903a8de4b744 req-7aa8f184-5199-416e-9841-9fea33d9185b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052197 Jul 24 01:24:24.831144 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1560/3270] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:24.855851 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:24.856840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:24.864497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.865069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:24.866070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:24.866753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:25.729899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:25.741890 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e4ac817-79b3-4e83-b0dd-cad7fa55a7da tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1313 microversion: 2.1 time: 1.104339 Jul 24 01:24:25.750143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1711/3271] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:24 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1313 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:25.755005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:25.755617 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:25.781698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.782168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:25.782962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.783397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:25.923178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:25.936840 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ca84dd4e-a3fb-4229-80b1-aa4d9fcfe63d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 1.085526 Jul 24 01:24:25.947230 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1561/3272] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:24 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:25.952792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:25.954501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:25.962681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.963365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:25.964735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:25.965371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.614284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:26.636481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:26.640354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:26.642618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e5bb5a5-bf28-46c7-beac-24ce0eac6e2b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.891260 Jul 24 01:24:26.643980 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1712/3273] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:25 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:26.650231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7018e7cb-ac79-4f88-bba6-7b87fadc5f1a req-4384e9e8-388e-47df-8f3d-269d1c3a83df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c", "tag": "373babc8-35c3-4e90-bf8a-87a0fd93dfd4"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:26.662771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7018e7cb-ac79-4f88-bba6-7b87fadc5f1a req-4384e9e8-388e-47df-8f3d-269d1c3a83df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.663694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7018e7cb-ac79-4f88-bba6-7b87fadc5f1a req-4384e9e8-388e-47df-8f3d-269d1c3a83df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.683988 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7018e7cb-ac79-4f88-bba6-7b87fadc5f1a req-4384e9e8-388e-47df-8f3d-269d1c3a83df service nova] Creating event network-changed:373babc8-35c3-4e90-bf8a-87a0fd93dfd4 for instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c on n-h2-master-1 Jul 24 01:24:26.692992 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7018e7cb-ac79-4f88-bba6-7b87fadc5f1a req-4384e9e8-388e-47df-8f3d-269d1c3a83df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045009 Jul 24 01:24:26.693910 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1713/3274] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:26.722331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:26.731917 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1ed3f1e3-d105-4411-9b03-99e495e5dace tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1322 microversion: 2.1 time: 0.783064 Jul 24 01:24:26.746496 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1562/3275] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:25 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1322 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:26.761875 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:26.765083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:26.774998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.775871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.776924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.777609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.886047 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:26.943759 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=30 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:26.954410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:26.955713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:26.963754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.964496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:26.966350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:26.966990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:27.282990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:27.291678 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a122c761-1111-4006-89c0-3bbf5cea3a23 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1313 microversion: 2.1 time: 0.534345 Jul 24 01:24:27.293365 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1714/3276] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:26 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:27.384817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:27.394119 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8e248536-cac1-4ea9-a0ed-dba8e6f06d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 0.444144 Jul 24 01:24:27.404722 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1563/3277] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:26 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:27.666524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:27.667319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:27.676714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:27.677589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:27.678604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:27.680486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:27.764791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:27.766130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:27.773049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:27.773872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:27.775045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:27.775839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:28.482093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.496468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.502928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.506596 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9e87fb84-5816-46ef-9973-2fa4f7e08317 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.844160 Jul 24 01:24:28.507287 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1715/3278] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:27 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:28.533210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:28.534602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:28.543133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:28.544052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:28.545452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:28.546211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:28.752054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.767535 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-31f0a7c8-12a6-429a-b1c8-a3facb1e7107 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1516 microversion: 2.1 time: 1.007870 Jul 24 01:24:28.768464 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1564/3279] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:27 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1516 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:28.774007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:28.779284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:28.787836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:28.788391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:28.789263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:28.789805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:28.951127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:28.959332 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6eb7206-cf64-4be1-a7e6-bfa138c8bad3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1313 microversion: 2.1 time: 0.447691 Jul 24 01:24:28.960370 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1716/3280] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:28 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:28.966502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b1aadda3-b133-49fd-93d1-427c0a8928c1 req-5dd0eb95-971a-4562-b30a-3871169a2175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dbeb3c-a904-46e7-8403-8f1474e89a29", "name": "network-vif-plugged", "status": "completed", "tag": "ad6e6c9c-6133-4e8a-98f0-d89f0796a812"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:28.976704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b1aadda3-b133-49fd-93d1-427c0a8928c1 req-5dd0eb95-971a-4562-b30a-3871169a2175 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:28.978060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b1aadda3-b133-49fd-93d1-427c0a8928c1 req-5dd0eb95-971a-4562-b30a-3871169a2175 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:28.992323 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b1aadda3-b133-49fd-93d1-427c0a8928c1 req-5dd0eb95-971a-4562-b30a-3871169a2175 service nova] Creating event network-vif-plugged:ad6e6c9c-6133-4e8a-98f0-d89f0796a812 for instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 on n-h1-master-1 Jul 24 01:24:28.999985 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b1aadda3-b133-49fd-93d1-427c0a8928c1 req-5dd0eb95-971a-4562-b30a-3871169a2175 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038004 Jul 24 01:24:29.000949 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1717/3281] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:29.007776 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:29.008825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:29.022132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.022606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.024979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.025641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.071900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lazy-loading 'flavor' on Instance uuid 17729231-087d-479b-8bd2-ac9d0f8f19df {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:29.104627 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:29.207788 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03c14bc3-cdd3-4d4f-b052-b1f9560f1fdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action" status: 200 len: 32 microversion: 2.1 time: 0.205201 Jul 24 01:24:29.209476 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1718/3282] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:24:29 2022] POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:24:29.225113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:29.226417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:29.235530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.236367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.237408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.238284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.260572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.273566 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e19ec26c-0be1-446a-aefd-a817299c7e73 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 0.504009 Jul 24 01:24:29.277659 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1565/3283] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:28 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:29.493108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.509025 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a2a3eb3-48f4-4718-83ef-7c5adccb92c5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.290157 Jul 24 01:24:29.512873 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1719/3284] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:29 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:29.528064 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:29.528560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:29.536531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.541722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.547238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.547707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.815396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.823989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.827083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:29.828570 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c9ae671-356d-4090-8275-2d99e48aeafa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.305210 Jul 24 01:24:29.829963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1566/3285] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:29 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:29.976792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:29.977407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:29.988277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.988903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:29.990122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:29.990928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.296508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:30.297136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:30.297524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:30.311664 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-19eca2b9-2176-4319-a188-3ddf67ab366c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1313 microversion: 2.1 time: 0.338845 Jul 24 01:24:30.312269 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1720/3286] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:29 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:30.324145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.324611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.326466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.326894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.529208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:30.531261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:30.544833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.545541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.547829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.552191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.740493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:30.756151 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6725dd1d-dc8a-4ff0-ba6f-313fe9399ced tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 0.464659 Jul 24 01:24:30.765976 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1567/3287] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:30 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:30.844039 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:30.853881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:30.855712 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:30.855951 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e5d27679-fd83-4336-bec9-19a1967da217 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.330925 Jul 24 01:24:30.857426 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1721/3288] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:30 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:30.865172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.866099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:30.867141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:30.867798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.068168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.084384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.090041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.093192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ccd2cd8-62f5-46bf-8a82-2ccd1949d255 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.248800 Jul 24 01:24:31.104238 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1568/3289] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:30 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:31.227363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-30025706", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "765780c0-efd6-4733-8fc7-d3f841ca6141"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:31.299247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] validate_networks() for [('765780c0-efd6-4733-8fc7-d3f841ca6141', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:24:31.330862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:31.332683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:31.344459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.345243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.346420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.347063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.376188 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:31.647961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.657743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13dbbba0-8445-4b47-86a0-618083e6b2a8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1463 microversion: 2.1 time: 0.333118 Jul 24 01:24:31.670250 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1569/3290] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:31 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1463 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:31.676032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:31.677348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:31.684596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.685641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.686867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.687488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.803736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:31.818305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Old instance type m1.heat2, new instance type m1.heat {{(pid=119562) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 01:24:31.828284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:31.829123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:31.829825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:31.830630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:31.832205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:31.837234 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:31.879727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:31.880329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:31.881258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:31.881825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:31.882566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:31.895630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.896411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.897464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:31.898137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:31.913766 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:31.926392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Getting quotas for project 4978ac73559545f080ff9ae3ebff0bbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:31.936583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Getting quotas for user 203831e3a6874ec1b359f3d873cf5b42 and project 4978ac73559545f080ff9ae3ebff0bbf. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:31.955506 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:24:31.958969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:24:31.990212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-22b145e0-f8fe-4123-97ad-60ef11fcae69 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29/action" status: 202 len: 0 microversion: 2.1 time: 0.318320 Jul 24 01:24:31.994891 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1570/3291] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:24:31 2022] POST /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:24:32.002318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:32.002997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:32.011779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.012395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.013637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.014183 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.041361 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1b63067b-8dc0-42b0-9a80-d3eaa8865a26 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.892904 Jul 24 01:24:32.051195 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1722/3292] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:24:32.056699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:32.057603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:32.065860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.066550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.067555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.068152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.336400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.352957 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-db1dd61c-8b61-4b64-9a7b-926375756ca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 0.356863 Jul 24 01:24:32.356873 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1571/3293] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:31 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:32.372792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:32.374905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:32.387824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.389240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.392180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.395741 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.396385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.400063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f811213-68ae-4faa-bae2-da7069cb949b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.347069 Jul 24 01:24:32.420235 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1723/3294] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:32 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:32.429644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5fce982c-4686-4c0a-bd9b-9c77892af285 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:32.430684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5fce982c-4686-4c0a-bd9b-9c77892af285 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:32.535095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5fce982c-4686-4c0a-bd9b-9c77892af285 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.545785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5fce982c-4686-4c0a-bd9b-9c77892af285 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.550137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5fce982c-4686-4c0a-bd9b-9c77892af285 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.551376 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5fce982c-4686-4c0a-bd9b-9c77892af285 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1260 microversion: 2.26 time: 0.128219 Jul 24 01:24:32.555280 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1724/3295] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:32 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1260 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:32.564642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:32.568525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:32.588250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.589835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.593101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.593582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.882558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:32.893299 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9dab7a7-72f9-4f79-b286-74149044ba5d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1472 microversion: 2.1 time: 0.534871 Jul 24 01:24:32.896663 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1572/3296] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:32 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1472 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:32.906371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-bafbc333-84a6-4cc2-bd58-8ff0cf6f33cb req-0d1e5ad8-efb4-4bb8-9c86-282f548e8ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c", "name": "network-vif-plugged", "status": "completed", "tag": "373babc8-35c3-4e90-bf8a-87a0fd93dfd4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:32.933770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bafbc333-84a6-4cc2-bd58-8ff0cf6f33cb req-0d1e5ad8-efb4-4bb8-9c86-282f548e8ad2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:32.935952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bafbc333-84a6-4cc2-bd58-8ff0cf6f33cb req-0d1e5ad8-efb4-4bb8-9c86-282f548e8ad2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:32.964801 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-bafbc333-84a6-4cc2-bd58-8ff0cf6f33cb req-0d1e5ad8-efb4-4bb8-9c86-282f548e8ad2 service nova] Creating event network-vif-plugged:373babc8-35c3-4e90-bf8a-87a0fd93dfd4 for instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c on n-h2-master-1 Jul 24 01:24:32.977206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-bafbc333-84a6-4cc2-bd58-8ff0cf6f33cb req-0d1e5ad8-efb4-4bb8-9c86-282f548e8ad2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077371 Jul 24 01:24:32.980085 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1573/3297] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:32.992240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.005632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.007467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.009540 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a85d553-c561-42b7-8c9e-4f5d0e01d34a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.453027 Jul 24 01:24:33.023447 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1725/3298] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:32 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:33.376091 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:33.379464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:33.391337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.392066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.393304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.393907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.421224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:33.421903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:33.436307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.436769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.443323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.443868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.756263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.764018 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3895c410-60a4-4cb5-bdf2-1416ee53611c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 0.394010 Jul 24 01:24:33.764615 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1574/3299] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:33 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:33.770255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:33.771191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:33.778418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.778867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.779649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.780375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.783963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.791804 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b1e68005-a43f-4fd4-83c1-08b7b3470c45 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.375925 Jul 24 01:24:33.792999 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1726/3300] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:33 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:33.898867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.908318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.910253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:33.914734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:33.915995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:33.923104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5fc18d17-7614-4a83-8f66-81ac12e0c90c tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1312 microversion: 2.26 time: 0.156603 Jul 24 01:24:33.924878 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1575/3301] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:33 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:33.929042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.929505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:33.930319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:33.930758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:34.040866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:34.041540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:34.049037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.049806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:34.050811 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.051402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:34.776354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:34.792482 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a72764f7-426c-4fd0-85cb-cde17ec49bdf tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1472 microversion: 2.1 time: 0.882596 Jul 24 01:24:34.793970 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1727/3302] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:33 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1472 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:34.805356 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:34.805988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:34.813462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.814446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:34.815450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.816076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:34.831353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:34.849208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:34.852467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:34.859641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-71bb735f-9fb1-4426-80ee-f9e9726d19ee tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.832404 Jul 24 01:24:34.861413 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1576/3303] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:34 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:34.874187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:34.874900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:34.903087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.905445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:34.906287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:34.908921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.363261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.400885 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b1757a00-e444-473b-97f2-b637206dd7a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1309 microversion: 2.1 time: 0.603912 Jul 24 01:24:35.401540 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1728/3304] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:34 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1309 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:35.412973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:35.417358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:35.446627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.449241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:35.451089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.452298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:35.458143 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-22399f43-7c28-4509-a956-787e0cd5a753 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.592472 Jul 24 01:24:35.460315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.467737 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1577/3305] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:34 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:35.484006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f240ef53-492d-405b-ba67-85cd35c2f453 req-e3f2a61d-b535-439a-a155-fe77456d2dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "name": "network-vif-plugged", "status": "completed", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:35.501033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f240ef53-492d-405b-ba67-85cd35c2f453 req-e3f2a61d-b535-439a-a155-fe77456d2dfe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:35.501765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f240ef53-492d-405b-ba67-85cd35c2f453 req-e3f2a61d-b535-439a-a155-fe77456d2dfe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.531632 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f240ef53-492d-405b-ba67-85cd35c2f453 req-e3f2a61d-b535-439a-a155-fe77456d2dfe service nova] Creating event network-vif-plugged:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h1-master-1 Jul 24 01:24:35.547120 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f240ef53-492d-405b-ba67-85cd35c2f453 req-e3f2a61d-b535-439a-a155-fe77456d2dfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075429 Jul 24 01:24:35.553942 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1578/3306] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:35.717470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.733046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.738994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:35.745156 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-506e00e0-4d12-4e77-ba59-4577a7889ae3 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1318 microversion: 2.26 time: 0.342416 Jul 24 01:24:35.761201 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1729/3307] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:35 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:35.811536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:35.812634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:35.819471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:35.820293 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.821302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:35.821970 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.878538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:35.879162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:35.885910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:35.886366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:35.887893 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:35.888295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.279541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.287890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.289403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.289564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.290561 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a845e6eb-6b20-40cc-961b-44dfa498d942 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1407 microversion: 2.20 time: 0.415888 Jul 24 01:24:36.291115 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1730/3308] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:35 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:24:36.300304 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-474c24a2-579e-4dff-8d22-eee4b9de867a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1472 microversion: 2.1 time: 0.492850 Jul 24 01:24:36.304789 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1579/3309] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:35 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:36.420247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:36.420862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:36.429512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.429993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.430775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.431650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.481106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:36.482240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:36.497995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.498734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.499735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.500367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.879579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.891241 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f66da230-a26a-48b0-80d4-ea1a1e3f0b10 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1490 microversion: 2.1 time: 0.476361 Jul 24 01:24:36.891835 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1731/3310] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:36 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1490 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:36.896603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:36.897267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:36.905151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.905701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.906478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:36.906916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:36.953469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:36.961265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ef2b2fb-eaab-482d-adf3-a20257ddb102 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.486669 Jul 24 01:24:36.962137 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1580/3311] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:36 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:37.009071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1138911840", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "4015265e-e6b0-4e47-bccc-5d1d48270467"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:37.074485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:24:37.645235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:37.653829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:37.655484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:37.657305 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-95496208-9860-4ac4-b6cf-480e4fce6567 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1360 microversion: 2.26 time: 0.764442 Jul 24 01:24:37.658021 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1732/3312] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:36 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1360 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:37.662774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a5d1027-ba88-45aa-8d77-f7b3954fed9c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cea7316-3865-4f11-ae89-20893b9663f1"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:37.663983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a5d1027-ba88-45aa-8d77-f7b3954fed9c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:37.673451 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a5d1027-ba88-45aa-8d77-f7b3954fed9c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:37.673930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a5d1027-ba88-45aa-8d77-f7b3954fed9c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:37.674707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a5d1027-ba88-45aa-8d77-f7b3954fed9c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:37.675144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a5d1027-ba88-45aa-8d77-f7b3954fed9c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:37.973355 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a5d1027-ba88-45aa-8d77-f7b3954fed9c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "POST /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313655 Jul 24 01:24:37.974874 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1733/3313] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:24:37 2022] POST /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:38.000414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:38.003226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:38.016361 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.017253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.019220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.019969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.024402 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:38.437843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:24:38.438404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:24:38.438730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:24:38.439146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:24:38.439557 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:24:38.466520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.466968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.467773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.468215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.499101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:24:38.506837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:24:38.522195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:38.524070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:24:38.526871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:24:38.536668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:38.540947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:38.546413 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fd44c3f1-9c0b-4a41-84e7-d9875c21a530 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1600 microversion: 2.20 time: 0.569638 Jul 24 01:24:38.548688 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1734/3314] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:37 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1600 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:38.558292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:38.560512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:38.586694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.587570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.591185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.593343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.596813 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6757365f-7084-4347-8914-6fbdaf401a1f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591535 Jul 24 01:24:38.598253 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1581/3315] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:24:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:24:38.604636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:38.606591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:38.616987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.617722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:38.618698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:38.619483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.017783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.027440 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e6013446-c7f0-426c-97fc-e75a2a8a721f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.427833 Jul 24 01:24:39.035193 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1582/3316] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:38 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:39.040921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66bc5b72-e631-43bb-98df-1f5653b513b9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:39.051303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66bc5b72-e631-43bb-98df-1f5653b513b9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:39.058255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66bc5b72-e631-43bb-98df-1f5653b513b9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:39.059379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66bc5b72-e631-43bb-98df-1f5653b513b9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.065420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66bc5b72-e631-43bb-98df-1f5653b513b9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:39.066301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66bc5b72-e631-43bb-98df-1f5653b513b9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.078170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.092544 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-52e2958e-e99d-4169-80e4-565607e0a028 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.541440 Jul 24 01:24:39.098679 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1735/3317] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:38 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:39.116071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3334ffa3-503b-4894-9ed2-3970f02737d9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:39.119358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3334ffa3-503b-4894-9ed2-3970f02737d9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:39.276188 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-66bc5b72-e631-43bb-98df-1f5653b513b9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.239437 Jul 24 01:24:39.283304 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1583/3318] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Jul 24 01:24:39 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:24:39.283304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:39.284136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:39.305539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:39.308046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.310031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:39.315493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.352719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3334ffa3-503b-4894-9ed2-3970f02737d9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.364099 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3334ffa3-503b-4894-9ed2-3970f02737d9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1209 microversion: 2.1 time: 0.258817 Jul 24 01:24:39.364843 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1736/3319] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:39 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1209 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:39.386324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-bc539f49-6e3e-47ef-9da0-48f28f5d7425 req-3b395e56-704b-447c-8798-6ae836f36f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c143ada-4a02-4d81-a17a-594f8c321732", "tag": "a2ba43bc-217c-4d23-9877-ceed90cff437"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:39.398993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bc539f49-6e3e-47ef-9da0-48f28f5d7425 req-3b395e56-704b-447c-8798-6ae836f36f74 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:39.399811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bc539f49-6e3e-47ef-9da0-48f28f5d7425 req-3b395e56-704b-447c-8798-6ae836f36f74 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:39.441860 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-bc539f49-6e3e-47ef-9da0-48f28f5d7425 req-3b395e56-704b-447c-8798-6ae836f36f74 service nova] Creating event network-changed:a2ba43bc-217c-4d23-9877-ceed90cff437 for instance 8c143ada-4a02-4d81-a17a-594f8c321732 on n-h2-master-1 Jul 24 01:24:39.449895 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-bc539f49-6e3e-47ef-9da0-48f28f5d7425 req-3b395e56-704b-447c-8798-6ae836f36f74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069384 Jul 24 01:24:39.450928 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1737/3320] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:39.762662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.771626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.779459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:39.780776 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16f95a30-29a5-4a08-8e50-307b95e7501b tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1360 microversion: 2.26 time: 0.501867 Jul 24 01:24:39.781458 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1584/3321] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:39 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1360 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:40.052997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:40.054082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:40.060784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.061469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.062458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.063054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.110886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:40.111494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:40.120223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.120945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.127332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.128019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.424445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:40.435833 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-567b5143-86ca-4d6d-b221-10a3bf6db014 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.387758 Jul 24 01:24:40.437800 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1738/3322] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:40 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:40.449486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:40.451978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:40.467614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.468064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.469635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.471743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.483710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:40.494159 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7bad428a-73a2-4f91-9b52-3018f0a289aa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.386928 Jul 24 01:24:40.495379 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1585/3323] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:40 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:40.572838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:40.584320 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4b2cd9d9-07a3-40c1-9184-008674205601 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1267 microversion: 2.1 time: 0.145088 Jul 24 01:24:40.586888 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1739/3324] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:40 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:40.800449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:40.801684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:40.809461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.810194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:40.811185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:40.811776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.053743 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:41.072042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:41.073628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:41.075146 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-280db7e4-5dde-479d-980b-2b9fecd0324a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1360 microversion: 2.26 time: 0.278810 Jul 24 01:24:41.075709 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1586/3325] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:40 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1360 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:41.196214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b81cc9a4-4ece-4c8e-a961-a4783a55434b req-907cf621-b290-4e4a-97f7-1ebfd4c35c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:41.211451 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b81cc9a4-4ece-4c8e-a961-a4783a55434b req-907cf621-b290-4e4a-97f7-1ebfd4c35c71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:41.211884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b81cc9a4-4ece-4c8e-a961-a4783a55434b req-907cf621-b290-4e4a-97f7-1ebfd4c35c71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.225954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b81cc9a4-4ece-4c8e-a961-a4783a55434b req-907cf621-b290-4e4a-97f7-1ebfd4c35c71 service nova] Creating event network-changed:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h1-master-1 Jul 24 01:24:41.234289 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b81cc9a4-4ece-4c8e-a961-a4783a55434b req-907cf621-b290-4e4a-97f7-1ebfd4c35c71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044336 Jul 24 01:24:41.234963 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1740/3326] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:41.453454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:41.454112 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:41.466363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:41.466824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.470335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:41.473704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.483726 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:41.512759 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:41.513684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:41.527018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:41.538337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.541399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:41.543762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.859569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:41.869004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-62186205-043a-4da4-90e1-81fd053ae0f4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.419681 Jul 24 01:24:41.873760 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1587/3327] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:41 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:41.885407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:41.886339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:41.897044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:41.901962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:41.904132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:41.910236 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:41.911620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:42.306124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.315993 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f47f6195-7cfd-47a7-a0ff-03dced5242aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.440342 Jul 24 01:24:42.322266 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1588/3328] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:41 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:42.334342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:42.334974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:42.346356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:42.346763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:42.351856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:42.352327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:42.399478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.417598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b223e7df-1576-40f7-b95c-1c050d678f9c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.900613 Jul 24 01:24:42.422168 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1741/3329] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:41 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:42.645084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.666560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.669455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:42.677839 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf28c5bd-e335-4b94-bbb3-b4ae74141e10 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1360 microversion: 2.26 time: 0.352440 Jul 24 01:24:42.680719 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1589/3330] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:42 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1360 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:42.891040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:42.892457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:42.911746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:42.912475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:42.913491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:42.914250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.339309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:43.339980 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:43.359611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.360440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.362616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.363296 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.725825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:43.727422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:43.743481 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-395ddac3-c84c-407c-aad3-16d08a110804 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.857336 Jul 24 01:24:43.748960 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1742/3331] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:42 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:43.768707 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c700f642-23c5-422a-b329-9481f2e94876 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.432981 Jul 24 01:24:43.779036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:43.779036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:43.782191 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1590/3332] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:43 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:43.787846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c0768872-6d77-468f-aff4-0e6ab56d8817 req-9ce835c4-bf4a-4caa-93e3-4beab07e0429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850584c7-6e80-493a-a68f-997723d8da09", "tag": "fe832425-4fe9-4227-8ddb-f499a5a19e43"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:43.799116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c0768872-6d77-468f-aff4-0e6ab56d8817 req-9ce835c4-bf4a-4caa-93e3-4beab07e0429 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.799886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c0768872-6d77-468f-aff4-0e6ab56d8817 req-9ce835c4-bf4a-4caa-93e3-4beab07e0429 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.800115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.800586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.801382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.801861 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.818601 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c0768872-6d77-468f-aff4-0e6ab56d8817 req-9ce835c4-bf4a-4caa-93e3-4beab07e0429 service nova] Creating event network-changed:fe832425-4fe9-4227-8ddb-f499a5a19e43 for instance 850584c7-6e80-493a-a68f-997723d8da09 on n-h1-master-1 Jul 24 01:24:43.826250 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c0768872-6d77-468f-aff4-0e6ab56d8817 req-9ce835c4-bf4a-4caa-93e3-4beab07e0429 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042205 Jul 24 01:24:43.828162 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1591/3333] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:43.834617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:43.835633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:43.851310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.854460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:43.855862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:43.856709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.200156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:44.211205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:44.222455 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4ef2e6f7-ed44-4b8e-8387-b3a1bf2ca7c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.459059 Jul 24 01:24:44.225754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:44.227530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:44.229271 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5656f298-9717-4e49-a577-456f4b2e6f31 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1360 microversion: 2.26 time: 0.399536 Jul 24 01:24:44.230046 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1592/3334] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:43 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1360 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:44.240753 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1743/3335] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:43 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:44.751527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f4a0ebb4-cd5c-4e3d-9ece-ade82de04b41 req-1e77bccd-0394-4926-b467-16de1bf5269e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c143ada-4a02-4d81-a17a-594f8c321732", "name": "network-vif-plugged", "status": "completed", "tag": "a2ba43bc-217c-4d23-9877-ceed90cff437"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:44.773259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f4a0ebb4-cd5c-4e3d-9ece-ade82de04b41 req-1e77bccd-0394-4926-b467-16de1bf5269e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.774188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f4a0ebb4-cd5c-4e3d-9ece-ade82de04b41 req-1e77bccd-0394-4926-b467-16de1bf5269e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.774515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:44.775651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:44.789090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f4a0ebb4-cd5c-4e3d-9ece-ade82de04b41 req-1e77bccd-0394-4926-b467-16de1bf5269e service nova] Creating event network-vif-plugged:a2ba43bc-217c-4d23-9877-ceed90cff437 for instance 8c143ada-4a02-4d81-a17a-594f8c321732 on n-h2-master-1 Jul 24 01:24:44.796172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.797781 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f4a0ebb4-cd5c-4e3d-9ece-ade82de04b41 req-1e77bccd-0394-4926-b467-16de1bf5269e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051198 Jul 24 01:24:44.798442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.799258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1593/3336] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:44.799399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.799707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.808291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:44.809897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:44.818549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.819418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:44.820480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:44.821135 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:45.500683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:45.501321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:45.509149 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d36103ca-2d51-4765-b77f-eb29f1b9b8b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.708225 Jul 24 01:24:45.514422 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3b00b9ad-469c-4b97-8c98-fd90d3d147d5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.754339 Jul 24 01:24:45.515007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1744/3337] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:44 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:45.519898 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1594/3338] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:44 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:45.524922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:45.525626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:45.528975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:45.529597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:45.533004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:45.533413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:45.534244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:45.534686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:45.551897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:45.553183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:45.554238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:45.554979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:45.760899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:45.772673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:45.772852 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-383ad1ac-b92f-434a-8fb9-eb9478a23e0c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.251606 Jul 24 01:24:45.773708 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1595/3339] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:45 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:45.783159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:45.784719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:45.785900 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de98545c-7cf5-4cdb-9a75-821fc4659ed7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1360 microversion: 2.26 time: 0.264774 Jul 24 01:24:45.786455 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1745/3340] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:45 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1360 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:46.527047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:46.527818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:46.531679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:46.532303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:46.536111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.536560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.537430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.537966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.540415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.541131 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.542029 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.542540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.754207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:46.767040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:46.768483 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-992d9bd0-9aad-407a-a084-a7b7160fbfc2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.245478 Jul 24 01:24:46.771200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1596/3341] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:46 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:46.784124 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-746b3514-b43a-4512-9632-915aad3d2f6b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.256716 Jul 24 01:24:46.793690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:46.794823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:46.797311 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1746/3342] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:46 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:46.803345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.804061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.804682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:46.805074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.805522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.815430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:46.822041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.822638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:46.823664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:46.824908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:47.039489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:47.042943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:47.062965 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-136a0314-d6fa-4cb3-b6b3-028ab0163c1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.275484 Jul 24 01:24:47.063875 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1597/3343] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:46 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:47.069580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:47.071362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:47.072656 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bff5d75f-d6ef-4ebf-9417-fee473e524a7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1360 microversion: 2.26 time: 0.272202 Jul 24 01:24:47.073331 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1747/3344] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:46 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1360 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:24:47.790427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:47.791168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:47.799010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:47.799513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:47.800263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:47.800704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:47.806616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:47.807699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:47.817473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:47.818670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:47.819593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:47.820365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.029118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.034589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.037621 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58cfe2e7-d039-4514-a07d-832598078074 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.235451 Jul 24 01:24:48.038368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1748/3345] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:47 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:48.045201 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c6b05b3e-7490-4618-85c2-f4046308e3b5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.258968 Jul 24 01:24:48.055114 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1598/3346] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:47 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:48.085415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.085869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.093185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.093988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.094774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.095219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.098856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.100785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.107467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.108101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.108997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.109544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.287243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.297968 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e88090a-7516-4ad1-8772-3afe57f1cbc0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.216606 Jul 24 01:24:48.298560 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1749/3347] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:48 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:48.328788 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.337005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.338538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:48.339756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81b49034-1ca2-44e3-a7a8-dcfeb6976be1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1544 microversion: 2.26 time: 0.249012 Jul 24 01:24:48.340329 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1599/3348] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:48 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1544 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:24:48.358526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eaaf59d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.366637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.366996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.367481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.373514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.374012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.374791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.375239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.398989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.399446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.413045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.413494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.443414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:48.459169 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b33802e-f43e-40bf-9c01-c126faed72eb tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1498768695" status: 201 len: 0 microversion: 2.26 time: 0.104926 Jul 24 01:24:48.459849 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1750/3349] 10.222.0.27 () {62 vars in 1379 bytes} [Sun Jul 24 01:24:48 2022] PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1498768695 => generated 0 bytes in 106 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 24 01:24:48.470467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b4428954-c307-4203-8ef7-fb097a6b6f3a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea4119d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.478197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4428954-c307-4203-8ef7-fb097a6b6f3a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.478652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4428954-c307-4203-8ef7-fb097a6b6f3a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.486617 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:48.498079 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b4428954-c307-4203-8ef7-fb097a6b6f3a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1498768695" status: 204 len: 0 microversion: 2.26 time: 0.031709 Jul 24 01:24:48.498705 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1600/3350] 10.222.0.27 () {60 vars in 1360 bytes} [Sun Jul 24 01:24:48 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1498768695 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:24:48.508902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eabbd5e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.518478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.519009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.519758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.525687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.526156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.526922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.527632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.531755 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:48.553621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.554101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.575635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:48.594849 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d3b7140-a998-4b64-94d6-475385b550b8 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 204 len: 0 microversion: 2.26 time: 0.091737 Jul 24 01:24:48.596120 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1751/3351] 10.222.0.27 () {60 vars in 1294 bytes} [Sun Jul 24 01:24:48 2022] DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:24:48.605146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4aa7974d-90d2-469e-b192-e5b449c1eb6a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea2ffc10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.611395 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:48.615074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4aa7974d-90d2-469e-b192-e5b449c1eb6a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.615536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4aa7974d-90d2-469e-b192-e5b449c1eb6a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.630787 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4aa7974d-90d2-469e-b192-e5b449c1eb6a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 200 len: 12 microversion: 2.26 time: 0.029591 Jul 24 01:24:48.631742 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1601/3352] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 01:24:48 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:48.642551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea968550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.651135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.651876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.652594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.658642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.659091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.659863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.660326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.688312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.688764 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.699754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.700420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.732701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:48.752551 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ba810c2-e90e-4bfd-868a-e75c6d360257 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1032568378" status: 201 len: 0 microversion: 2.26 time: 0.115137 Jul 24 01:24:48.753310 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1752/3353] 10.222.0.27 () {62 vars in 1379 bytes} [Sun Jul 24 01:24:48 2022] PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1032568378 => generated 0 bytes in 117 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 24 01:24:48.763679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6cbf6a62-92f4-40d0-a099-d7150228d0c7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea411040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.771618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbf6a62-92f4-40d0-a099-d7150228d0c7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.772305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbf6a62-92f4-40d0-a099-d7150228d0c7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.782785 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6cbf6a62-92f4-40d0-a099-d7150228d0c7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 200 len: 36 microversion: 2.26 time: 0.023344 Jul 24 01:24:48.783293 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1602/3354] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 01:24:48 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 36 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:48.795392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eaa95160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.803372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.803943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.804521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.811716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.812456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.813209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.813709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.843169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.843634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.868629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:48.887337 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67e737e5-43c9-4e80-b4a0-c909fac6b7b2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1032568378" status: 204 len: 0 microversion: 2.26 time: 0.096213 Jul 24 01:24:48.888291 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1753/3355] 10.222.0.27 () {60 vars in 1363 bytes} [Sun Jul 24 01:24:48 2022] DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-1032568378 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:24:48.896501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08ae23e8-794f-4030-8df1-e3f4943909c2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea2d8790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.905602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08ae23e8-794f-4030-8df1-e3f4943909c2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.906088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08ae23e8-794f-4030-8df1-e3f4943909c2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.915799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08ae23e8-794f-4030-8df1-e3f4943909c2 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 200 len: 12 microversion: 2.26 time: 0.023343 Jul 24 01:24:48.916454 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1603/3356] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 01:24:48 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:48.927838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eb53d1f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:48.937051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.937549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.938310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:48.944631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.945353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.946490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.947085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.970856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:48.971205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:48.984329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:49.002248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d053384e-e8df-45d4-8bf0-12aaea03a0f1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 204 len: 0 microversion: 2.26 time: 0.078734 Jul 24 01:24:49.003096 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1754/3357] 10.222.0.27 () {60 vars in 1294 bytes} [Sun Jul 24 01:24:48 2022] DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:24:49.012555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea3c3310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.021056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.021504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.022225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.027971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.028425 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.029187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.029621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.055123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.057606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.059018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.059801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.063237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.063766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.064799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.065314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.068492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.068944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.095575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:49.112191 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f776eef-37c3-459f-9a85-dd16fe7885ce tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-391083340" status: 201 len: 0 microversion: 2.26 time: 0.103853 Jul 24 01:24:49.112850 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1604/3358] 10.222.0.27 () {62 vars in 1376 bytes} [Sun Jul 24 01:24:49 2022] PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-391083340 => generated 0 bytes in 105 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 24 01:24:49.117549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.118387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.130989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.131525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.132387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.133020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.150637 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:49.361628 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:49.364074 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:49.371111 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-41c19aea-ca40-4cf0-abcb-8ec4f5909744 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.320168 Jul 24 01:24:49.371702 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1755/3359] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:49 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:49.384693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eb53d700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.412169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.412624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.413115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.419455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.419916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.420690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.421129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.427194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:49.436618 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6461120c-465e-4466-b373-9f3a8c1f70d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.322277 Jul 24 01:24:49.437507 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1605/3360] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:49 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:49.445869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.446336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.453292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.453969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.458778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.459238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.460242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.460709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.461494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.461960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.485421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:49.500222 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c76361eb-17b8-453f-9e0b-ee404af98245 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-380236946" status: 201 len: 0 microversion: 2.26 time: 0.127475 Jul 24 01:24:49.500881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1756/3361] 10.222.0.27 () {62 vars in 1376 bytes} [Sun Jul 24 01:24:49 2022] PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-380236946 => generated 0 bytes in 129 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 24 01:24:49.509800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea968b80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.520317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.520317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.520317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.525628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.526193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.527074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.528405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.561525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.562115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.577880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:49.592713 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fb57b1dd-082a-43c3-930c-f35b7cc0fe17 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 204 len: 0 microversion: 2.26 time: 0.086708 Jul 24 01:24:49.593325 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1757/3362] 10.222.0.27 () {60 vars in 1294 bytes} [Sun Jul 24 01:24:49 2022] DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:24:49.602549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-290d4135-1696-4f7a-9662-7ff93ceb86b1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eac6ed30>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.604528 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:49.612184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-290d4135-1696-4f7a-9662-7ff93ceb86b1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.612651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-290d4135-1696-4f7a-9662-7ff93ceb86b1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.623303 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-290d4135-1696-4f7a-9662-7ff93ceb86b1 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 200 len: 12 microversion: 2.26 time: 0.025387 Jul 24 01:24:49.623933 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1758/3363] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 01:24:49 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:49.633466 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eabf0af0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.643178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.643888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.644417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.650845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.651296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.652354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.653296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.676758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.677204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.689164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:49.695518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:49.705036 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb802003-5e32-44a4-b40a-f536433ff2ac tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 204 len: 0 microversion: 2.26 time: 0.075446 Jul 24 01:24:49.705350 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fc934283-2e81-47d0-9067-40b2bd275368 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.257499 Jul 24 01:24:49.706584 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1606/3365] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:49 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:49.706735 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1759/3365] 10.222.0.27 () {60 vars in 1294 bytes} [Sun Jul 24 01:24:49 2022] DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:24:49.716751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eabbda60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.724590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.725045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.725530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.731593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.732144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.732926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.733369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.759233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.759677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.769800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.770248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.778391 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=5,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:49.797900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:49.815257 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b0137c69-5384-4a0a-bd32-1f9a28243ab9 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-578233258" status: 201 len: 0 microversion: 2.26 time: 0.103231 Jul 24 01:24:49.815935 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1760/3366] 10.222.0.27 () {62 vars in 1376 bytes} [Sun Jul 24 01:24:49 2022] PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-578233258 => generated 0 bytes in 105 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 24 01:24:49.827403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea47e940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:49.836767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.837276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.837788 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.845421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.845901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.846739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.847255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.873539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.874111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.883426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.883991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.908874 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:49.925858 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e01ad7c9-07be-408a-835a-4f7725278f14 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-78420633" status: 201 len: 0 microversion: 2.26 time: 0.103900 Jul 24 01:24:49.926536 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1607/3367] 10.222.0.27 () {62 vars in 1373 bytes} [Sun Jul 24 01:24:49 2022] PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags/tempest-tag-78420633 => generated 0 bytes in 106 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Jul 24 01:24:49.937598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Action: 'update_all', calling method: .version_select at 0x7f05eae70e50>, body: {"tags": ["tempest-tag-1227791098", "tempest-tag-2125696904"]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:49.946273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.946619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.947180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:49.953773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.954226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.954978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.955449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:49.979543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:49.980086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.002061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:50.026418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f05e69a5-ed68-4132-94e9-8b56de502fa0 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 200 len: 62 microversion: 2.26 time: 0.094419 Jul 24 01:24:50.027071 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1761/3368] 10.222.0.27 () {62 vars in 1311 bytes} [Sun Jul 24 01:24:49 2022] PUT /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 62 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:50.037389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5fa6637-7bd6-4cef-98c6-2421b8d94aa7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05ea4111f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:50.045972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5fa6637-7bd6-4cef-98c6-2421b8d94aa7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.046420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5fa6637-7bd6-4cef-98c6-2421b8d94aa7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.055624 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5fa6637-7bd6-4cef-98c6-2421b8d94aa7 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 200 len: 62 microversion: 2.26 time: 0.022271 Jul 24 01:24:50.056234 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1608/3369] 10.222.0.27 () {60 vars in 1291 bytes} [Sun Jul 24 01:24:50 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 62 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:50.066383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '.version_select at 0x7f05eae70d30>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:50.073953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.074912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.075384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:50.080960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.081402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.082201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.082632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.105338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.106126 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.121093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lazy-loading 'flavor' on Instance uuid 8c143ada-4a02-4d81-a17a-594f8c321732 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:50.140581 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8c92e55a-a1ff-4027-9346-a4fcd0637379 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags" status: 204 len: 0 microversion: 2.26 time: 0.078162 Jul 24 01:24:50.141214 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1762/3370] 10.222.0.27 () {60 vars in 1294 bytes} [Sun Jul 24 01:24:50 2022] DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732/tags => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:24:50.150990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:50.151490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:50.158820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.159272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.160063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.160507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.188418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:24:50.265188 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:50.280551 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-280bf7ec-2120-4c67-a677-22b16414996f tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 204 len: 0 microversion: 2.26 time: 0.132706 Jul 24 01:24:50.284639 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1609/3371] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:24:50 2022] DELETE /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:24:50.291289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:50.292090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:50.299662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.300127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.300887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.301318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.389363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:50.390109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:50.396109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.396557 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.397326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.397788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.605044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:50.616265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:50.618024 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:50.619334 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-991b33e1-51fa-4827-b85e-a0722bd01360 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1550 microversion: 2.26 time: 0.333280 Jul 24 01:24:50.629630 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1763/3372] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:50 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1550 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:50.629630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:50.629630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:50.636605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.637762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.638842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.640630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.664093 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:50.677065 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e2624cf9-e38c-455d-9dfd-e4d88eacdcdb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.291784 Jul 24 01:24:50.677811 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1610/3373] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:50 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:50.729921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:50.735834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:50.753577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.754167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.755125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.755540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.871331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:50.880415 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-444d9d05-0e49-4af4-83ed-507483f1dabb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.258328 Jul 24 01:24:50.880995 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1764/3374] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:50 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:50.885972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-607781de-d72a-4b18-b72f-5173514a94c7 req-6617862f-203e-4dc9-acb5-3602c5a51148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850584c7-6e80-493a-a68f-997723d8da09", "name": "network-vif-plugged", "status": "completed", "tag": "fe832425-4fe9-4227-8ddb-f499a5a19e43"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:50.895719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-607781de-d72a-4b18-b72f-5173514a94c7 req-6617862f-203e-4dc9-acb5-3602c5a51148 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:50.896157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-607781de-d72a-4b18-b72f-5173514a94c7 req-6617862f-203e-4dc9-acb5-3602c5a51148 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:50.908587 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-607781de-d72a-4b18-b72f-5173514a94c7 req-6617862f-203e-4dc9-acb5-3602c5a51148 service nova] Creating event network-vif-plugged:fe832425-4fe9-4227-8ddb-f499a5a19e43 for instance 850584c7-6e80-493a-a68f-997723d8da09 on n-h1-master-1 Jul 24 01:24:50.913609 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-607781de-d72a-4b18-b72f-5173514a94c7 req-6617862f-203e-4dc9-acb5-3602c5a51148 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031130 Jul 24 01:24:50.914248 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1765/3375] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:50.927789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:50.935904 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78f1a9a9-43a9-48be-a573-51ea7541b97d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.212935 Jul 24 01:24:50.937092 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1611/3376] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:50 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:51.642922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:51.643900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:51.650556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.651031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:51.651797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.652918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:51.697319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:51.698208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:51.705390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.706141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:51.707143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.707750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:51.856034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:51.864857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:51.868230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:51.869718 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eb976375-9309-4db8-bdc4-54066ae4af93 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1550 microversion: 2.26 time: 0.232922 Jul 24 01:24:51.870387 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1766/3377] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:51 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1550 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:24:51.891742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:51.898061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:51.898680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:51.899722 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e697a3d-93cd-4176-818f-4eaa95935813 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.207715 Jul 24 01:24:51.900312 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1612/3378] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:51 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:51.906502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.906502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:51.907210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.907659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:51.954833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:51.956736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:51.966725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.967648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:51.969066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:51.969910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.098025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:52.109988 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9332e46b-7734-44f0-9040-59d1b9bdc142 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1309 microversion: 2.1 time: 0.215496 Jul 24 01:24:52.110836 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1767/3379] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:51 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1309 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:52.167204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:52.176270 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c7f5a87-9049-45a7-85b0-631eaab79ca1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.225798 Jul 24 01:24:52.176855 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1613/3380] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:51 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:52.368218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0430aac9-1c50-41b6-893b-d306e504a8e9"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:52.369308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:52.377276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.377276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.377654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.378344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.511250 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] HTTP exception thrown: Volume 0430aac9-1c50-41b6-893b-d306e504a8e9 could not be found. Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Request method failure captured: Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments/3cea7316-3865-4f11-ae89-20893b9663f1 HTTP/1.1 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 74 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7LXuyYYUAthlYxgFzOv4evUpuqTm1LV7lE9U6FAwwaxL9l0TQH_Wu_bjZM9TzPRH2FeMk-N0adwb2LOfRNB-sz6FH0lFFyQRG3d8igJ3ym5IjjsJiD4PW0rRcOPsr9HEI2wNFgNO6FG4aL4AbVp7BDx_63nfZ7trgBjiH4a24ly-Q Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: f61c6d99deff4ac5a3d519d720cfb9f4 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesAdminNegativeTest-60824931 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f61c6d99deff4ac5a3d519d720cfb9f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f61c6d99deff4ac5a3d519d720cfb9f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f61c6d99deff4ac5a3d519d720cfb9f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f61c6d99deff4ac5a3d519d720cfb9f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesAdminNegativeTest-60824931 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: f61c6d99deff4ac5a3d519d720cfb9f4 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-60824931 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesAdminNegativeTest-60824931-project-admin Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 13ae58c891f04b258dbd2709ce7a32b6 Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesAdminNegativeTest-60824931-project-admin Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: {"volumeAttachment": {"volumeId": "0430aac9-1c50-41b6-893b-d306e504a8e9"}} Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: exception: Volume 0430aac9-1c50-41b6-893b-d306e504a8e9 could not be found. Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': '7f87e018-4100-4486-b086-4ca4dc17e290', 'id': '3cea7316-3865-4f11-ae89-20893b9663f1', 'body': {'volumeAttachment': {'volumeId': '0430aac9-1c50-41b6-893b-d306e504a8e9'}}} Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0430aac9-1c50-41b6-893b-d306e504a8e9 could not be found. (HTTP 404) (Request-ID: req-0122bd79-64a1-4651-83e8-79924828280a) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:24:52.538930 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0430aac9-1c50-41b6-893b-d306e504a8e9 could not be found. Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0430aac9-1c50-41b6-893b-d306e504a8e9 could not be found. Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0430aac9-1c50-41b6-893b-d306e504a8e9 could not be found. Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Returning 400 to user: Volume 0430aac9-1c50-41b6-893b-d306e504a8e9 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-514a9691-3ffa-4d4d-bb85-7e54720a976b tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments/3cea7316-3865-4f11-ae89-20893b9663f1" status: 400 len: 107 microversion: 2.1 time: 0.293963 Jul 24 01:24:52.544943 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1768/3381] 10.222.0.27 () {60 vars in 1432 bytes} [Sun Jul 24 01:24:52 2022] PUT /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments/3cea7316-3865-4f11-ae89-20893b9663f1 => generated 107 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:24:52.614976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:52.615479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:52.623836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.624600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.625590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.626220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.739748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lazy-loading 'services' on Instance uuid 7f87e018-4100-4486-b086-4ca4dc17e290 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:24:52.827163 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-37d9f64e-05d0-42d4-8250-7562dfba7d9a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments/3cea7316-3865-4f11-ae89-20893b9663f1" status: 202 len: 0 microversion: 2.1 time: 0.215949 Jul 24 01:24:52.828254 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1614/3382] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:24:52 2022] DELETE /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments/3cea7316-3865-4f11-ae89-20893b9663f1 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:24:52.838158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c57674f-fe0a-4df4-ac59-3f9b8cceba3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:52.841011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c57674f-fe0a-4df4-ac59-3f9b8cceba3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:52.848008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c57674f-fe0a-4df4-ac59-3f9b8cceba3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.848828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c57674f-fe0a-4df4-ac59-3f9b8cceba3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.849896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c57674f-fe0a-4df4-ac59-3f9b8cceba3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.850691 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c57674f-fe0a-4df4-ac59-3f9b8cceba3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.895687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:52.896632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:52.899359 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c57674f-fe0a-4df4-ac59-3f9b8cceba3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066418 Jul 24 01:24:52.909153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.909816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.910787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.911976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.914072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1769/3383] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:24:52 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:52.922677 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:52.923555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:52.931242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.932002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:52.932985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:52.934945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.511009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:53.519633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:53.527720 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00cd1612-f39c-4da2-8609-fc37c2b41cf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.610820 Jul 24 01:24:53.530062 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1770/3384] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:52 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:53.531180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:53.536961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:53.538285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:53.539786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '203831e3a6874ec1b359f3d873cf5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4978ac73559545f080ff9ae3ebff0bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:53.540640 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ef299ae-ac35-4072-a684-9277edfe0a9a tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 200 len: 1550 microversion: 2.26 time: 0.656321 Jul 24 01:24:53.541552 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1615/3385] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:52 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 1550 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:24:53.545869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.546450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.547330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.547871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.552508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d1d0123c-d57c-49a1-a17f-c99c83c785c7 req-871d515d-482b-4663-b6ec-353a8a412a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c143ada-4a02-4d81-a17a-594f8c321732", "name": "network-vif-deleted", "tag": "a2ba43bc-217c-4d23-9877-ceed90cff437"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:53.563134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d1d0123c-d57c-49a1-a17f-c99c83c785c7 req-871d515d-482b-4663-b6ec-353a8a412a39 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.564222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d1d0123c-d57c-49a1-a17f-c99c83c785c7 req-871d515d-482b-4663-b6ec-353a8a412a39 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.577408 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d1d0123c-d57c-49a1-a17f-c99c83c785c7 req-871d515d-482b-4663-b6ec-353a8a412a39 service nova] Creating event network-vif-deleted:a2ba43bc-217c-4d23-9877-ceed90cff437 for instance 8c143ada-4a02-4d81-a17a-594f8c321732 on n-h2-master-1 Jul 24 01:24:53.583811 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d1d0123c-d57c-49a1-a17f-c99c83c785c7 req-871d515d-482b-4663-b6ec-353a8a412a39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035084 Jul 24 01:24:53.585899 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1616/3386] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:53.593168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:53.594170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:53.601288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.602061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.603071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.603503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.759230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:53.793087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:53.794119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4cc7e170-eb22-4298-b75a-ff951c3e68c0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1490 microversion: 2.1 time: 0.261865 Jul 24 01:24:53.797030 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1771/3387] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:53 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1490 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:53.803021 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01001460-0d99-48e8-9882-d1639068501c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.215670 Jul 24 01:24:53.803524 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1617/3388] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:53 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:53.814891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:53.814891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:53.820932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.821692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.822308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.822750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.914640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-704fc4c3-8b6c-4be3-838b-a7acbfa649e7 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:53.915922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-704fc4c3-8b6c-4be3-838b-a7acbfa649e7 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:53.923181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-704fc4c3-8b6c-4be3-838b-a7acbfa649e7 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.923888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-704fc4c3-8b6c-4be3-838b-a7acbfa649e7 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.925013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-704fc4c3-8b6c-4be3-838b-a7acbfa649e7 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:53.925635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-704fc4c3-8b6c-4be3-838b-a7acbfa649e7 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:53.989592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-704fc4c3-8b6c-4be3-838b-a7acbfa649e7 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081149 Jul 24 01:24:53.990220 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1618/3389] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:24:53 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:24:54.007291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:54.028423 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e29e571f-7c14-4bac-8833-0cbf7fd23ec6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1490 microversion: 2.1 time: 0.218349 Jul 24 01:24:54.028997 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1772/3390] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:53 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1490 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:54.045580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:54.046252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:54.052962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.053422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.054244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.054681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.057445 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:54.220069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:54.230006 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bef3b165-0219-41af-9f7a-ae8c210138c1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1490 microversion: 2.1 time: 0.188603 Jul 24 01:24:54.238175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1619/3391] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:54 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1490 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:54.247954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:54.248465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:54.254792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.255248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.256063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.256513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.283588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:24:54.385592 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bfdbc65-755b-492e-8f83-f2f78f4daad4 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 204 len: 0 microversion: 2.1 time: 0.141655 Jul 24 01:24:54.390137 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1773/3392] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:24:54 2022] DELETE /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:24:54.395850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:54.396505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:54.405050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.405876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.406934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.407386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.545576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:54.546749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:54.554041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.554769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.555754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.556367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.560990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:54.570512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58efa173-5239-433d-a8a3-5ebc592fe121 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1496 microversion: 2.1 time: 0.178652 Jul 24 01:24:54.571122 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1620/3393] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:54 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1496 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:54.580810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:54.580810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] [instance: 8c143ada-4a02-4d81-a17a-594f8c321732] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:54.586380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.586837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.587630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.588068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.597057 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=94,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:54.606963 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] HTTP exception thrown: Instance 8c143ada-4a02-4d81-a17a-594f8c321732 could not be found. Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Request method failure captured: Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 HTTP/1.1 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J9OowolUgE2HW_G9N7oiZ4EQ2VpGk8p7ZEGkQS6kAcoPrsTmk1UY1gWzXax7noR3WTEMSDCXFqBsK76koUGLBIua8PLGnogWkg1arwICGxZ5PrDfpGUTm4AlmD7YijdE6EAJtZDngTqsuyiqVZrmrjPNglL-DwIMkfvXalb45fTAPQ Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.26 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 4978ac73559545f080ff9ae3ebff0bbf Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerTagsTestJSON-1358208672 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4978ac73559545f080ff9ae3ebff0bbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4978ac73559545f080ff9ae3ebff0bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4978ac73559545f080ff9ae3ebff0bbf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4978ac73559545f080ff9ae3ebff0bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerTagsTestJSON-1358208672 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 4978ac73559545f080ff9ae3ebff0bbf Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerTagsTestJSON-1358208672 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerTagsTestJSON-1358208672-project Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 203831e3a6874ec1b359f3d873cf5b42 Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerTagsTestJSON-1358208672-project Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 8c143ada-4a02-4d81-a17a-594f8c321732 could not be found. Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8c143ada-4a02-4d81-a17a-594f8c321732'} Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c143ada-4a02-4d81-a17a-594f8c321732 could not be found. Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c143ada-4a02-4d81-a17a-594f8c321732 could not be found. Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:54.608639 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c143ada-4a02-4d81-a17a-594f8c321732 could not be found. Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] Returning 404 to user: Instance 8c143ada-4a02-4d81-a17a-594f8c321732 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:24:54.614096 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9fab67a-67af-4f72-8c55-8ed474418a23 tempest-ServerTagsTestJSON-1358208672 tempest-ServerTagsTestJSON-1358208672-project] 10.222.0.27 "GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732" status: 404 len: 111 microversion: 2.26 time: 0.037937 Jul 24 01:24:54.618054 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1621/3394] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:24:54 2022] GET /compute/v2.1/servers/8c143ada-4a02-4d81-a17a-594f8c321732 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:24:54.822687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:54.823569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:54.838076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.839539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.841364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:54.844445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:54.863971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:54.875613 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-552eb414-804c-47bf-89d3-2958569e26a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.334554 Jul 24 01:24:54.876218 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1774/3395] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:54 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:55.002310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f47ac52a-5691-426d-9106-344c7bd5dd7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:55.003884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f47ac52a-5691-426d-9106-344c7bd5dd7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:55.015820 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47ac52a-5691-426d-9106-344c7bd5dd7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:55.017627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47ac52a-5691-426d-9106-344c7bd5dd7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:55.018753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47ac52a-5691-426d-9106-344c7bd5dd7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:55.019363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f47ac52a-5691-426d-9106-344c7bd5dd7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:55.069251 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f47ac52a-5691-426d-9106-344c7bd5dd7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071833 Jul 24 01:24:55.070582 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1775/3396] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:24:54 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:55.143825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:55.155228 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffeb521a-542c-4fab-8de4-644b7d15296c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.336374 Jul 24 01:24:55.167053 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1622/3397] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:54 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:55.593576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:55.595697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:55.614796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:55.616882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:55.617896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:55.620403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:55.861254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:55.874764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f1e7335-8faf-426d-9583-a8e24fbbd68b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1496 microversion: 2.1 time: 0.289281 Jul 24 01:24:55.885880 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1776/3398] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:55 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1496 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:55.895492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:55.897977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:55.907516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:55.908282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:55.909277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:55.910195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.086131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97efc38c-715a-4892-b917-1dd44e525b27 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:56.087218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97efc38c-715a-4892-b917-1dd44e525b27 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:56.096293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97efc38c-715a-4892-b917-1dd44e525b27 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:56.097056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97efc38c-715a-4892-b917-1dd44e525b27 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.098259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97efc38c-715a-4892-b917-1dd44e525b27 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:56.098994 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97efc38c-715a-4892-b917-1dd44e525b27 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.159765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97efc38c-715a-4892-b917-1dd44e525b27 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082666 Jul 24 01:24:56.161911 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1777/3399] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:24:56 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:24:56.176899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:56.178174 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:56.200426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:56.201168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.203363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:56.204203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.422147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:56.432269 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c6e6b056-e0fe-4940-9417-3717bd6bf85e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.542591 Jul 24 01:24:56.442243 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1623/3400] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:55 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:56.522013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:56.532483 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-85c5852e-5256-4edd-aead-e58669babfa7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.361758 Jul 24 01:24:56.542623 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1778/3401] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:56 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:56.893588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0b4e9415-26e3-4e89-bedb-edb6032115c3 req-94d74e1d-99d5-4bb0-81ab-524769f42d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850584c7-6e80-493a-a68f-997723d8da09", "name": "network-vif-deleted", "tag": "fe832425-4fe9-4227-8ddb-f499a5a19e43"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:24:56.897683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:56.898567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:56.916093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0b4e9415-26e3-4e89-bedb-edb6032115c3 req-94d74e1d-99d5-4bb0-81ab-524769f42d3b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:56.919074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0b4e9415-26e3-4e89-bedb-edb6032115c3 req-94d74e1d-99d5-4bb0-81ab-524769f42d3b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.934627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:56.935386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.941250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:56.942524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:56.984402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0b4e9415-26e3-4e89-bedb-edb6032115c3 req-94d74e1d-99d5-4bb0-81ab-524769f42d3b service nova] Creating event network-vif-deleted:fe832425-4fe9-4227-8ddb-f499a5a19e43 for instance 850584c7-6e80-493a-a68f-997723d8da09 on n-h1-master-1 Jul 24 01:24:56.992104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0b4e9415-26e3-4e89-bedb-edb6032115c3 req-94d74e1d-99d5-4bb0-81ab-524769f42d3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108064 Jul 24 01:24:57.002049 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1624/3402] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:57.112606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:57.167426 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c30d9d32-0de6-4e02-bceb-c939a871678f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 200 len: 1294 microversion: 2.1 time: 0.277925 Jul 24 01:24:57.174474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-919027b6-5d3b-411e-8eb4-b2c8e2b9f7f3 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:57.175735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-919027b6-5d3b-411e-8eb4-b2c8e2b9f7f3 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:57.182596 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1779/3403] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:56 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 1294 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:57.192383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-919027b6-5d3b-411e-8eb4-b2c8e2b9f7f3 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:57.193168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-919027b6-5d3b-411e-8eb4-b2c8e2b9f7f3 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:57.194076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-919027b6-5d3b-411e-8eb4-b2c8e2b9f7f3 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:57.194618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-919027b6-5d3b-411e-8eb4-b2c8e2b9f7f3 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:57.274154 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-919027b6-5d3b-411e-8eb4-b2c8e2b9f7f3 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104484 Jul 24 01:24:57.275289 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1625/3404] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:24:57 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:57.450562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:57.451198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:57.463746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:57.465577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:57.466806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:57.469749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:57.550422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:57.551423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:57.561660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:57.565933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:57.568243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:57.568928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:57.722886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:57.735352 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24538fdc-ff5f-481a-b47d-db5546c77312 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.289477 Jul 24 01:24:57.735990 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1780/3405] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:57 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:58.187941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:58.190794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:58.213327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.214088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.215759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.219696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.253198 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 HTTP/1.1 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '850584c7-6e80-493a-a68f-997723d8da09'} Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:58.256303 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:24:58.265005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:24:58.265005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:24:58.265005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:24:58.265005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:24:58.265005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:24:58.265005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:24:58.265005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:24:58.267926 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9ed4cb2-7678-4163-9309-9a8a7a779855 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 404 len: 111 microversion: 2.1 time: 0.082081 Jul 24 01:24:58.275368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1781/3406] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:58 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:24:58.286158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:58.286740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:58.303479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.304221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.305030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.305638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.350362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:58.366208 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16f50307-38cf-4321-93e3-0b98ba9ffd3c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.814549 Jul 24 01:24:58.368650 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1626/3407] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:57 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:24:58.394624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5fe5ba29-cee3-4a20-8e3d-8c55582ee551 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:58.396045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5fe5ba29-cee3-4a20-8e3d-8c55582ee551 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:58.403782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:24:58.409885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fe5ba29-cee3-4a20-8e3d-8c55582ee551 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.411326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fe5ba29-cee3-4a20-8e3d-8c55582ee551 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.413569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fe5ba29-cee3-4a20-8e3d-8c55582ee551 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.415391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fe5ba29-cee3-4a20-8e3d-8c55582ee551 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.517247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5fe5ba29-cee3-4a20-8e3d-8c55582ee551 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145327 Jul 24 01:24:58.521115 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1627/3408] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:24:58 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:24:58.551405 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4381660-c9ea-4120-b0ee-a92f3a438ecf tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 204 len: 0 microversion: 2.1 time: 0.274081 Jul 24 01:24:58.552664 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1782/3409] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:24:58 2022] DELETE /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:24:58.563058 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:58.563523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:58.571502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.571974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.572831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.573284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.757446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:58.762554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:58.774670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.775236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:58.776111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:58.776628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:59.294129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:59.306054 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b8b75f7-65bc-445b-a931-c6a7cd98b8ab tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1496 microversion: 2.1 time: 0.748921 Jul 24 01:24:59.307819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1628/3410] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:58 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1496 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:59.334007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:59.351910 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac94659e-020b-4a1b-ba55-51a3cb2d56ab tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.602225 Jul 24 01:24:59.362112 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1783/3411] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:58 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:24:59.394350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:59.395532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:59.402018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:59.402474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:59.403455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:59.404064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:59.530573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-faaefe84-f329-4008-bece-377c5b6c3009 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:24:59.533115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-faaefe84-f329-4008-bece-377c5b6c3009 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:24:59.554398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faaefe84-f329-4008-bece-377c5b6c3009 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:59.555076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faaefe84-f329-4008-bece-377c5b6c3009 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:59.555911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faaefe84-f329-4008-bece-377c5b6c3009 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:24:59.556355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faaefe84-f329-4008-bece-377c5b6c3009 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:24:59.645193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-faaefe84-f329-4008-bece-377c5b6c3009 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119322 Jul 24 01:24:59.649741 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1784/3412] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:24:59 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:24:59.710241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:24:59.720883 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50039578-685b-4a6f-8fae-c1ff235513ca tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.332028 Jul 24 01:24:59.721829 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1629/3413] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:24:59 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:00.332861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:00.333884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:00.346084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.346745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.347805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.350188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.368350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:00.369043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:00.390165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.390624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.391440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.391881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.844972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:00.860545 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9350436-df57-4759-924d-f8682b7fa8fd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1496 microversion: 2.1 time: 0.536026 Jul 24 01:25:00.861600 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1785/3414] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:00 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1496 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:00.872344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0a7e801a-b7be-4692-919b-fadbac013759 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:00.880877 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0a7e801a-b7be-4692-919b-fadbac013759 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:00.896864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:00.907323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a7e801a-b7be-4692-919b-fadbac013759 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.908086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a7e801a-b7be-4692-919b-fadbac013759 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.909301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a7e801a-b7be-4692-919b-fadbac013759 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.909798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a7e801a-b7be-4692-919b-fadbac013759 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.912626 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-91f87b19-6878-4af2-837c-1c29341ac18b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.547954 Jul 24 01:25:00.935429 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1630/3415] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:00 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:00.940787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:00.941748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:00.949541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.950233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.951210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:00.951810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:00.974888 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0a7e801a-b7be-4692-919b-fadbac013759 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111139 Jul 24 01:25:00.976171 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1786/3416] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:25:00 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:25:01.254826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:01.270561 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1c4e357-b323-4afe-a17b-4e5fc380eefa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.333355 Jul 24 01:25:01.271433 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1631/3417] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:00 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:01.352170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1947618934", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "093bbef0-84ef-4b62-9d4b-b59243a6df5f"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:01.380450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-41e2dd83-f8b7-4886-a64c-f91b5b9579b5 req-7390756d-4260-4068-989f-3e538095272b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c", "name": "network-vif-deleted", "tag": "373babc8-35c3-4e90-bf8a-87a0fd93dfd4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:01.401634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-41e2dd83-f8b7-4886-a64c-f91b5b9579b5 req-7390756d-4260-4068-989f-3e538095272b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:01.402869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-41e2dd83-f8b7-4886-a64c-f91b5b9579b5 req-7390756d-4260-4068-989f-3e538095272b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:01.426482 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-41e2dd83-f8b7-4886-a64c-f91b5b9579b5 req-7390756d-4260-4068-989f-3e538095272b service nova] Creating event network-vif-deleted:373babc8-35c3-4e90-bf8a-87a0fd93dfd4 for instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c on n-h2-master-1 Jul 24 01:25:01.435981 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-41e2dd83-f8b7-4886-a64c-f91b5b9579b5 req-7390756d-4260-4068-989f-3e538095272b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059514 Jul 24 01:25:01.439027 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1632/3418] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:01.507286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] validate_networks() for [('093bbef0-84ef-4b62-9d4b-b59243a6df5f', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:25:01.878507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:01.879326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:01.902777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:01.912121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:01.914324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:01.916342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.007410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:02.007861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.008508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lazy-loading 'fault' on Instance uuid ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:25:02.144080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:02.153645 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-360a9eee-f873-446f-8b35-00fe26229df3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 200 len: 1299 microversion: 2.1 time: 0.279492 Jul 24 01:25:02.155030 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1633/3419] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:01 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:02.164030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:02.165366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:02.176616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:02.177395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.178460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:02.179189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.416816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:02.425640 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-462fc1a5-88dd-42ac-a910-1025fc4ba27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.269351 Jul 24 01:25:02.426687 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1634/3420] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:02 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:02.431666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:02.432288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:02.440190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:02.440452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.441713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:02.442215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.446608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:25:02.447332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:25:02.448083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:25:02.448609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:25:02.450043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:25:02.460018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:02.460673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.461663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:02.462336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:02.485803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Getting quotas for project c60507837fec4e06bd0551093bceb959. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:25:02.492713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Getting quotas for user d82fd738d5bb4d5e838f67b0b76b3b56 and project c60507837fec4e06bd0551093bceb959. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:25:02.507518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:25:02.510773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:25:02.563176 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-666b5859-400b-4482-92b7-0369455a8681 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217154 Jul 24 01:25:02.568970 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1787/3421] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:25:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:25:02.575934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a00d9c6b-be47-40a6-b86a-17950dfcb594 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:02.576719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a00d9c6b-be47-40a6-b86a-17950dfcb594 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:02.645426 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:02.661377 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e205f933-dabd-4005-9a7b-11119576cdd2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.233469 Jul 24 01:25:02.662159 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1635/3422] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:02 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:02.680309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a00d9c6b-be47-40a6-b86a-17950dfcb594 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:02.689060 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a00d9c6b-be47-40a6-b86a-17950dfcb594 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1218 microversion: 2.1 time: 0.117814 Jul 24 01:25:02.689641 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1788/3423] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:02 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:03.174352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:03.175729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:03.184652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:03.185131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:03.187681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:03.188162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:03.219586 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c HTTP/1.1 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c'} Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:03.226488 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:03.233386 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:03.233386 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:03.233386 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:03.233386 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:03.233386 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:25:03.233386 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:03.236534 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:03.237620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7cc00de3-e427-4bb8-b224-ecd605f5aca8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 404 len: 111 microversion: 2.1 time: 0.068720 Jul 24 01:25:03.238775 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1636/3424] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:03 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:25:03.363237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-218165391", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "4015265e-e6b0-4e47-bccc-5d1d48270467"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:03.424166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:25:03.444378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:03.445081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:03.453615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:03.454026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:03.454809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:03.455449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:03.754276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:03.774072 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90a11433-519b-49b2-ad45-530a4a37db7d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.333562 Jul 24 01:25:03.776113 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1637/3425] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:03 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:03.786051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:03.787672 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:03.801402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:03.802304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:03.804110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:03.805042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:03.811732 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:04.542800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:04.560046 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94ff81f9-588b-4c5d-85c8-5c5921ff9c1d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1477 microversion: 2.1 time: 0.780966 Jul 24 01:25:04.573779 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1638/3426] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:03 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1477 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:04.580681 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:04.581571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:04.588915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:04.590324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:04.591301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:04.591942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:04.763727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:04.773342 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ba1207ff-5756-4026-9dbc-f7b8f62fcf3f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1276 microversion: 2.1 time: 0.196267 Jul 24 01:25:04.774496 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1639/3427] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:04 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:04.814389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:04.815748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:04.823182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:04.825278 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:04.826277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:04.827288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:04.924117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:25:04.925173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:25:04.925818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:25:04.926540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:25:04.927225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:25:04.929737 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:04.942196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:04.943020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:04.943968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:04.944492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:04.970987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:25:04.980483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:25:05.007718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:25:05.012528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:25:05.111238 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98f9c2be-89e6-40b8-82d9-15d8310a84bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.752218 Jul 24 01:25:05.113457 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1789/3428] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:25:05.124777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-322f97b9-bc0b-47e8-a2d8-1ecf61ce63cd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:05.125509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-322f97b9-bc0b-47e8-a2d8-1ecf61ce63cd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:05.360996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-322f97b9-bc0b-47e8-a2d8-1ecf61ce63cd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:05.371990 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-322f97b9-bc0b-47e8-a2d8-1ecf61ce63cd tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1208 microversion: 2.1 time: 0.252070 Jul 24 01:25:05.372964 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1790/3429] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:05 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1208 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:05.448845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:05.458228 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-82d67de5-4e4b-4e53-925a-9c732d816541 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1522 microversion: 2.1 time: 0.660996 Jul 24 01:25:05.458829 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1640/3430] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:04 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:05.578967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:05.579589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:05.586382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:05.586835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:05.587672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:05.588049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:05.712729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0c5a1767-c03b-4ef6-9953-584e0d85dbe5 req-08ebd1a5-a01e-409c-bcfb-6d9abcc23e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dbeb3c-a904-46e7-8403-8f1474e89a29", "name": "network-vif-unplugged", "status": "completed", "tag": "ad6e6c9c-6133-4e8a-98f0-d89f0796a812"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:05.724955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0c5a1767-c03b-4ef6-9953-584e0d85dbe5 req-08ebd1a5-a01e-409c-bcfb-6d9abcc23e94 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:05.725552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0c5a1767-c03b-4ef6-9953-584e0d85dbe5 req-08ebd1a5-a01e-409c-bcfb-6d9abcc23e94 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:05.739774 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0c5a1767-c03b-4ef6-9953-584e0d85dbe5 req-08ebd1a5-a01e-409c-bcfb-6d9abcc23e94 service nova] Creating event network-vif-unplugged:ad6e6c9c-6133-4e8a-98f0-d89f0796a812 for instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 on n-h2-master-1 Jul 24 01:25:05.746112 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-0c5a1767-c03b-4ef6-9953-584e0d85dbe5 req-08ebd1a5-a01e-409c-bcfb-6d9abcc23e94 service nova] Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:25:05.762770 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0c5a1767-c03b-4ef6-9953-584e0d85dbe5 req-08ebd1a5-a01e-409c-bcfb-6d9abcc23e94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054493 Jul 24 01:25:05.764069 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1641/3431] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:05.793418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:05.795088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:05.806406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:05.807209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:05.810937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:05.814443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:06.009533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:06.023602 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fe8da12b-4ae0-4a70-8617-0045e6d74942 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1276 microversion: 2.1 time: 0.234331 Jul 24 01:25:06.038278 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1642/3432] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:05 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:06.098711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:06.108810 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc98cb5f-f188-454d-bb76-0ab61d8db981 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1476 microversion: 2.1 time: 0.534792 Jul 24 01:25:06.109744 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1791/3433] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:05 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1476 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:06.366481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-14e5f14b-577d-4f2e-896a-5772f269f080 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05ea2ffc10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:06.395547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:06.397359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:06.422670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:06.423142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:06.423957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:06.426586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:06.513586 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-14e5f14b-577d-4f2e-896a-5772f269f080 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a8e9ce4b-4c7c-449d-9f0d-0d3062a8527a" status: 200 len: 350 microversion: 2.1 time: 0.151436 Jul 24 01:25:06.514695 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1643/3434] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:06 2022] GET /compute/v2.1/os-volumes/a8e9ce4b-4c7c-449d-9f0d-0d3062a8527a => generated 350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:06.519727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:06.523096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:06.541060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:06.541452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:06.544742 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:06.546217 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.039912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:07.050247 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-44de8b02-c452-4b03-b429-4c2f7e20cd4f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1268 microversion: 2.1 time: 0.664190 Jul 24 01:25:07.061848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1792/3435] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:06 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1268 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:07.070076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:07.073931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:07.081347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:07.082059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.082871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:07.083932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.111813 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:07.451086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:07.462336 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c8981d6-2327-4e19-b22c-328202acb0cb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1502 microversion: 2.1 time: 0.945689 Jul 24 01:25:07.463121 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1644/3436] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:06 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1502 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:07.469409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:07.470426 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:07.481166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:07.481902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.482996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:07.483931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.590397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:07.600351 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9375d657-73ce-473f-9217-c3d81807659e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.537262 Jul 24 01:25:07.601122 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1793/3437] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:07 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:07.608190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:07.609169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:07.616523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:07.617228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.618038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:07.618470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.941439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:07.952144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3419f4a9-e8ba-4aaf-892e-078463d2320c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1474 microversion: 2.1 time: 0.487667 Jul 24 01:25:07.952987 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1645/3438] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:07 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1474 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:07.958422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-aec3104c-bcb8-48ec-9bf6-89cb08973b90 req-f78b89ab-8e2d-4ff5-a8c6-cd3c786ebcbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dbeb3c-a904-46e7-8403-8f1474e89a29", "tag": "ad6e6c9c-6133-4e8a-98f0-d89f0796a812"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:07.967395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aec3104c-bcb8-48ec-9bf6-89cb08973b90 req-f78b89ab-8e2d-4ff5-a8c6-cd3c786ebcbe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:07.967839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aec3104c-bcb8-48ec-9bf6-89cb08973b90 req-f78b89ab-8e2d-4ff5-a8c6-cd3c786ebcbe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:07.982422 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-aec3104c-bcb8-48ec-9bf6-89cb08973b90 req-f78b89ab-8e2d-4ff5-a8c6-cd3c786ebcbe service nova] Creating event network-changed:ad6e6c9c-6133-4e8a-98f0-d89f0796a812 for instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 on n-h2-master-1 Jul 24 01:25:07.988789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-aec3104c-bcb8-48ec-9bf6-89cb08973b90 req-f78b89ab-8e2d-4ff5-a8c6-cd3c786ebcbe service nova] Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:25:08.001035 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-aec3104c-bcb8-48ec-9bf6-89cb08973b90 req-f78b89ab-8e2d-4ff5-a8c6-cd3c786ebcbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046329 Jul 24 01:25:08.001781 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1646/3439] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:08.003821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:08.008831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b4342d4-75ed-442a-937e-e81e2c8d0021 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05ea3c04c0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:08.012938 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ccb32935-a26d-46d9-bb20-e201e8fff28b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1517 microversion: 2.1 time: 0.410134 Jul 24 01:25:08.013661 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1794/3440] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:07 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1517 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:08.031407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3b8b5f2-c39f-48ec-a5cd-61e0cf4d00d1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:08.034064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a3b8b5f2-c39f-48ec-a5cd-61e0cf4d00d1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: d1de344c-4794-40f3-8445-9275e65f332d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:08.047617 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a3b8b5f2-c39f-48ec-a5cd-61e0cf4d00d1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Instance d1de344c-4794-40f3-8445-9275e65f332d could not be found. Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3b8b5f2-c39f-48ec-a5cd-61e0cf4d00d1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/d1de344c-4794-40f3-8445-9275e65f332d/action HTTP/1.1 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 14 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: {"rescue": {}} Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: exception: Instance d1de344c-4794-40f3-8445-9275e65f332d could not be found. Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'd1de344c-4794-40f3-8445-9275e65f332d', 'body': {'rescue': {}}} Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1de344c-4794-40f3-8445-9275e65f332d could not be found. Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1de344c-4794-40f3-8445-9275e65f332d could not be found. Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:08.056115 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1de344c-4794-40f3-8445-9275e65f332d could not be found. Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3b8b5f2-c39f-48ec-a5cd-61e0cf4d00d1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 404 to user: Instance d1de344c-4794-40f3-8445-9275e65f332d could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3b8b5f2-c39f-48ec-a5cd-61e0cf4d00d1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/d1de344c-4794-40f3-8445-9275e65f332d/action" status: 404 len: 111 microversion: 2.1 time: 0.030220 Jul 24 01:25:08.066641 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1795/3441] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:08 2022] POST /compute/v2.1/servers/d1de344c-4794-40f3-8445-9275e65f332d/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:25:08.069928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:08.070985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:08.078772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b4342d4-75ed-442a-937e-e81e2c8d0021 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4ce2ea05-e6be-4a63-a3f9-ba0f2a7bad11" status: 200 len: 351 microversion: 2.1 time: 0.075021 Jul 24 01:25:08.079384 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1647/3442] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:08 2022] GET /compute/v2.1/os-volumes/4ce2ea05-e6be-4a63-a3f9-ba0f2a7bad11 => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:08.083962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.084766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.086121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.086827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.087953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-523d119f-86eb-49bc-9c7c-c20c0a2efa31 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:08.089692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-523d119f-86eb-49bc-9c7c-c20c0a2efa31 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:08.108913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523d119f-86eb-49bc-9c7c-c20c0a2efa31 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.109693 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523d119f-86eb-49bc-9c7c-c20c0a2efa31 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.110810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523d119f-86eb-49bc-9c7c-c20c0a2efa31 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.111500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-523d119f-86eb-49bc-9c7c-c20c0a2efa31 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.201816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:08.230409 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9809e15-fc33-4e60-bcf1-37bffaedc76c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1266 microversion: 2.1 time: 0.163274 Jul 24 01:25:08.242621 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1796/3443] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:08 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:08.247291 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-523d119f-86eb-49bc-9c7c-c20c0a2efa31 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action" status: 202 len: 0 microversion: 2.1 time: 0.166153 Jul 24 01:25:08.249194 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1648/3444] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:08 2022] POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:25:08.264056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:08.265388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:08.273810 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.274616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.275993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.277004 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.627825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:08.638647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:08.645343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.645823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.646613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.647051 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.704981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:08.713920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31f8d8db-8e2c-4f9e-bfd3-faee769a2094 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1522 microversion: 2.1 time: 0.460057 Jul 24 01:25:08.715359 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1797/3445] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:08 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:08.971442 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:08.972400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:08.979069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.979522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:08.980398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:08.981437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:09.460129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:09.474583 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb1c2a96-5d32-4d23-9133-588be8f29335 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.858977 Jul 24 01:25:09.475383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:09.485779 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1649/3446] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:08 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:09.491296 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-49e529f6-c859-4f78-a9eb-46e8aee50233 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1474 microversion: 2.1 time: 0.523763 Jul 24 01:25:09.492040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:09.492785 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1798/3447] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:08 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1474 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:09.501205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fd2f7783-c841-4e7b-9d85-18e1532c3b11 req-2e816cf3-795f-4940-aa75-6d048f67cdac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f65482f2-3b68-471c-a82e-8f425e25b7a0", "tag": "2b498d97-4ced-4060-9a62-c3c54c5f1c23"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:09.502923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:09.511558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:09.512650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:09.513751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:09.514429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:09.515054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fd2f7783-c841-4e7b-9d85-18e1532c3b11 req-2e816cf3-795f-4940-aa75-6d048f67cdac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:09.515571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fd2f7783-c841-4e7b-9d85-18e1532c3b11 req-2e816cf3-795f-4940-aa75-6d048f67cdac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:09.531209 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fd2f7783-c841-4e7b-9d85-18e1532c3b11 req-2e816cf3-795f-4940-aa75-6d048f67cdac service nova] Creating event network-changed:2b498d97-4ced-4060-9a62-c3c54c5f1c23 for instance f65482f2-3b68-471c-a82e-8f425e25b7a0 on n-h2-master-1 Jul 24 01:25:09.538713 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fd2f7783-c841-4e7b-9d85-18e1532c3b11 req-2e816cf3-795f-4940-aa75-6d048f67cdac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043308 Jul 24 01:25:09.539591 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1799/3448] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:09.609165 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bcc6507-030e-46b8-b9e6-e1736e59bac9 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05e9fdab80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:09.646334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:09.654701 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7021289-748b-4805-8f08-1820ef3b9bad tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1266 microversion: 2.1 time: 0.167419 Jul 24 01:25:09.655842 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1650/3449] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:09 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:09.668874 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bcc6507-030e-46b8-b9e6-e1736e59bac9 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d83d9a2-0829-4370-9c5b-ba2f39fe609c" status: 200 len: 351 microversion: 2.1 time: 0.066122 Jul 24 01:25:09.669460 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1800/3450] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:25:09 2022] GET /compute/v2.1/os-volumes/2d83d9a2-0829-4370-9c5b-ba2f39fe609c => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:09.681643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa6339ae-48ee-4bf4-b94c-c0ca96d37ec2 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05ea27a280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:09.732479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:09.733220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:09.740439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:09.740894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:09.741930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:09.742377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:09.800661 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa6339ae-48ee-4bf4-b94c-c0ca96d37ec2 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.122993 Jul 24 01:25:09.802606 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1651/3451] 10.222.0.27 () {58 vars in 1133 bytes} [Sun Jul 24 01:25:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:09.815687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c113240e-feae-483d-a292-d58b2d863b91 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05ea243550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:09.902925 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c113240e-feae-483d-a292-d58b2d863b91 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090912 Jul 24 01:25:09.903590 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1652/3452] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:25:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:09.915892 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-729eca1d-4b32-4142-84c8-81d05e1cfe1b tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05ea3c3790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:09.968451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:09.985100 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7b04b2a-8ed2-4098-9613-8dbb067efd8c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1522 microversion: 2.1 time: 0.255859 Jul 24 01:25:09.987356 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1801/3453] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:09 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:10.300425 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-729eca1d-4b32-4142-84c8-81d05e1cfe1b tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.388596 Jul 24 01:25:10.301000 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1653/3454] 10.222.0.27 () {58 vars in 1133 bytes} [Sun Jul 24 01:25:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:10.314896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86e9b08c-44bf-4665-9a9e-b2e0006d15fb tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05eae70040>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:10.426113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86e9b08c-44bf-4665-9a9e-b2e0006d15fb tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.116723 Jul 24 01:25:10.427101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1802/3455] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:25:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:10.442839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8c263fe-8410-4e06-b470-d005979cef05 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05ea27ab80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:10.494598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:10.497584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:10.508815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:10.509851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:10.511546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:10.512953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:10.561489 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e8c263fe-8410-4e06-b470-d005979cef05 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.123474 Jul 24 01:25:10.565660 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1654/3456] 10.222.0.27 () {58 vars in 1169 bytes} [Sun Jul 24 01:25:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:10.571220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:10.572367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:10.589715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:10.590224 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:10.591084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:10.591532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:10.995954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:11.008879 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c92702cd-e10e-4cf2-8be5-79b8016ca5bc tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.518776 Jul 24 01:25:11.010613 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1803/3457] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:10 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:11.025713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ecaa7fc-3cca-40d7-a84e-756058b8204c tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05e9fed0d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:11.115003 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ecaa7fc-3cca-40d7-a84e-756058b8204c tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100148 Jul 24 01:25:11.115831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1804/3458] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:25:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:11.128285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:11.129175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:11.137482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.138287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:11.139267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.139645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:11.140422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:11.151280 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-adbb900f-7a65-4ac3-8b6f-ec2f8662cd41 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1471 microversion: 2.1 time: 0.581414 Jul 24 01:25:11.152771 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1655/3459] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:10 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:11.165514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:11.167578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:11.181879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.186273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:11.187362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.187811 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:11.371924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:11.381343 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-da93d984-8e45-4a92-ac94-2d2d37a812a2 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1266 microversion: 2.1 time: 0.257221 Jul 24 01:25:11.387425 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1805/3460] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:11 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:11.397883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7165646b-1833-4205-9b02-4faf565959c6 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05e9fdaca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:11.497574 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7165646b-1833-4205-9b02-4faf565959c6 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108111 Jul 24 01:25:11.502248 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1806/3461] 10.222.0.27 () {58 vars in 1187 bytes} [Sun Jul 24 01:25:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:11.509304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ca17319-6843-411c-b550-4e795901789e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:11.510986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ca17319-6843-411c-b550-4e795901789e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:11.519025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ca17319-6843-411c-b550-4e795901789e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.519480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ca17319-6843-411c-b550-4e795901789e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:11.520480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ca17319-6843-411c-b550-4e795901789e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.520939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ca17319-6843-411c-b550-4e795901789e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:11.598263 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ca17319-6843-411c-b550-4e795901789e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29/action" status: 204 len: 0 microversion: 2.1 time: 0.094235 Jul 24 01:25:11.599355 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1807/3462] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:11 2022] POST /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:25:11.606515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20d89b94-69c2-40e7-a5d6-3c8d4e17dfc3 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] Calling method '.version_select at 0x7f05ea06f700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:11.713468 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20d89b94-69c2-40e7-a5d6-3c8d4e17dfc3 tempest-VolumesTestJSON-316252481 tempest-VolumesTestJSON-316252481-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.112566 Jul 24 01:25:11.714424 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1808/3463] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:25:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:11.719297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:11.720156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:11.732585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.733143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:11.734315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:11.734856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.190493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:12.201869 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6529697d-b45d-4a1f-bfb4-c4041ac5193e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1502 microversion: 2.1 time: 1.042259 Jul 24 01:25:12.202739 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1656/3464] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:11 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1502 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:12.209382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:12.210324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:12.221013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.221882 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.223406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.224216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.312031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:12.342326 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-665f2e8d-0264-4ce4-a034-56bb6a29ffc7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1471 microversion: 2.1 time: 0.626832 Jul 24 01:25:12.344198 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1809/3465] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:11 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1471 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:12.349490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:12.350722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:12.358899 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.359361 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.360155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.360595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.386599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lazy-loading 'flavor' on Instance uuid cb80ae4d-7c53-4ac1-a20d-c9a603f08253 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:25:12.400523 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Cannot 'rescue' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state paused Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action HTTP/1.1 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 14 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: {"rescue": {}} Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: exception: Cannot 'rescue' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state paused Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'cb80ae4d-7c53-4ac1-a20d-c9a603f08253', 'body': {'rescue': {}}} Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 in vm_state paused. Cannot rescue while the instance is in this state. Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state paused Jul 24 01:25:12.403117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state paused Jul 24 01:25:12.408135 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:12.410154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 409 to user: Cannot 'rescue' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state paused {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:12.411043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3611c90e-aa11-4a51-a0a2-b1a8bdd6b66a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action" status: 409 len: 144 microversion: 2.1 time: 0.065820 Jul 24 01:25:12.411647 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1810/3466] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:12 2022] POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action => generated 144 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:25:12.416727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:12.418028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:12.424423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.424874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.425655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.426109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.645798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:12.657255 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b26c943-c633-49ac-8f1a-d04d2c5cda8e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.452215 Jul 24 01:25:12.658274 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1657/3467] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:12 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:12.674250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e90829ea-d5bd-46d9-8662-a547fc5ddccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:12.674988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e90829ea-d5bd-46d9-8662-a547fc5ddccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:12.688906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e90829ea-d5bd-46d9-8662-a547fc5ddccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.691088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e90829ea-d5bd-46d9-8662-a547fc5ddccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.692656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e90829ea-d5bd-46d9-8662-a547fc5ddccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.693364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e90829ea-d5bd-46d9-8662-a547fc5ddccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.800966 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e90829ea-d5bd-46d9-8662-a547fc5ddccf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action" status: 202 len: 0 microversion: 2.1 time: 0.134162 Jul 24 01:25:12.806150 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1658/3468] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:12 2022] POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:25:12.814232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:12.816725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:12.824584 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.825366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.827178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:12.827929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:12.863355 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:13.047338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:13.061223 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-61698c7a-4890-4b6c-a160-1de56f5bc37a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.648226 Jul 24 01:25:13.062563 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1811/3469] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:12 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:13.069102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0332a48d-cb00-42dc-b8cc-dd3e4fb00ad4 req-ff1a3918-018f-4359-a8d3-a796825bceee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dbeb3c-a904-46e7-8403-8f1474e89a29", "name": "network-vif-plugged", "status": "completed", "tag": "ad6e6c9c-6133-4e8a-98f0-d89f0796a812"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:13.099876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0332a48d-cb00-42dc-b8cc-dd3e4fb00ad4 req-ff1a3918-018f-4359-a8d3-a796825bceee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:13.104580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0332a48d-cb00-42dc-b8cc-dd3e4fb00ad4 req-ff1a3918-018f-4359-a8d3-a796825bceee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:13.136040 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0332a48d-cb00-42dc-b8cc-dd3e4fb00ad4 req-ff1a3918-018f-4359-a8d3-a796825bceee service nova] Creating event network-vif-plugged:ad6e6c9c-6133-4e8a-98f0-d89f0796a812 for instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 on n-h2-master-1 Jul 24 01:25:13.142926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-0332a48d-cb00-42dc-b8cc-dd3e4fb00ad4 req-ff1a3918-018f-4359-a8d3-a796825bceee service nova] Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:25:13.155348 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0332a48d-cb00-42dc-b8cc-dd3e4fb00ad4 req-ff1a3918-018f-4359-a8d3-a796825bceee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091085 Jul 24 01:25:13.156134 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1812/3470] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:13.292193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:13.300131 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13685da7-71c5-49e9-addd-79913dc6f44c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1509 microversion: 2.1 time: 0.490249 Jul 24 01:25:13.300704 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1659/3471] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:12 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1509 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:13.361828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:13.362567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:13.369239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:13.369716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:13.371206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:13.371653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:13.676069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:13.676833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:13.688765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:13.689351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:13.690301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:13.690797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:14.025007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:14.038193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a10ccfa1-1f47-42b0-a89d-e97387920c8f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1471 microversion: 2.1 time: 0.680393 Jul 24 01:25:14.039833 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1813/3472] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:13 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1471 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:14.078847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:14.080431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:14.092264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:14.092904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:14.093942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:14.094683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:14.280033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:14.287921 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d7ab8a4c-f75f-49d6-a202-43013a2ccebb tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.616127 Jul 24 01:25:14.288584 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1660/3473] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:13 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:14.319250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:14.320911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:14.331197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:14.332498 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:14.333623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:14.334843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:14.540881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:14.563894 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de29ce84-1aa1-4a3b-a930-b67d5f194ca9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.488976 Jul 24 01:25:14.565176 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1814/3474] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:14 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:14.929762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:14.960292 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-97136da3-191c-40fc-9183-c1c3fa0f102c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1517 microversion: 2.1 time: 0.644636 Jul 24 01:25:14.963211 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1661/3475] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:14 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1517 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:15.060023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:15.060682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:15.063591 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:15.082756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:15.083395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:15.084011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:15.084455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:15.309053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:15.311950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:15.334158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:15.336173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:15.342786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:15.368016 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=16 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:15.376760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:15.742167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:15.749042 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:15.759172 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-50874a31-c3f0-4ae8-9b06-d392b033fecc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1463 microversion: 2.1 time: 0.706506 Jul 24 01:25:15.774505 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1815/3476] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:15 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1463 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:15.779769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:15.780407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:15.802955 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:15.803745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:15.804826 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:15.805662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:16.180513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:16.210495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-41bbca90-711e-492c-be01-57c8209ab23a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.906497 Jul 24 01:25:16.216233 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1662/3477] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:15 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:16.237379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:16.239280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:16.253985 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=99 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:16.257468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:16.259134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:16.261456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:16.262955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:16.277976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:16.295740 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f0428bb-fcb7-43e2-be80-4b57c1dc8676 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.519999 Jul 24 01:25:16.296581 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1816/3478] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:15 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:16.954756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-15202f4f-9869-41e9-8f80-50134d21c44d req-84a6b4da-d2c1-4207-89eb-063844243a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65482f2-3b68-471c-a82e-8f425e25b7a0", "name": "network-vif-plugged", "status": "completed", "tag": "2b498d97-4ced-4060-9a62-c3c54c5f1c23"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:16.967790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15202f4f-9869-41e9-8f80-50134d21c44d req-84a6b4da-d2c1-4207-89eb-063844243a0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:16.968233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15202f4f-9869-41e9-8f80-50134d21c44d req-84a6b4da-d2c1-4207-89eb-063844243a0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:16.987327 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-15202f4f-9869-41e9-8f80-50134d21c44d req-84a6b4da-d2c1-4207-89eb-063844243a0f service nova] Creating event network-vif-plugged:2b498d97-4ced-4060-9a62-c3c54c5f1c23 for instance f65482f2-3b68-471c-a82e-8f425e25b7a0 on n-h2-master-1 Jul 24 01:25:16.994398 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-15202f4f-9869-41e9-8f80-50134d21c44d req-84a6b4da-d2c1-4207-89eb-063844243a0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044945 Jul 24 01:25:16.996120 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1817/3479] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:17.002569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-18a8eae7-a04e-4e8c-bc07-7acc814aadab req-daf5f86d-feff-4c9c-8c9d-8e0d9d1179e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e67bd6-1544-4fdb-b71d-e66168f06cee", "tag": "30738793-8e6b-439b-9751-10133099f498"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:17.017892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-18a8eae7-a04e-4e8c-bc07-7acc814aadab req-daf5f86d-feff-4c9c-8c9d-8e0d9d1179e6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.018646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-18a8eae7-a04e-4e8c-bc07-7acc814aadab req-daf5f86d-feff-4c9c-8c9d-8e0d9d1179e6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.039070 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-18a8eae7-a04e-4e8c-bc07-7acc814aadab req-daf5f86d-feff-4c9c-8c9d-8e0d9d1179e6 service nova] Creating event network-changed:30738793-8e6b-439b-9751-10133099f498 for instance 13e67bd6-1544-4fdb-b71d-e66168f06cee on n-h2-master-1 Jul 24 01:25:17.049528 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-18a8eae7-a04e-4e8c-bc07-7acc814aadab req-daf5f86d-feff-4c9c-8c9d-8e0d9d1179e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051965 Jul 24 01:25:17.050353 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1818/3480] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:17.235246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:17.236573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:17.243621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.244083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.244863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.246890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.256219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:17.273095 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b062296-c52f-4369-886b-426a52b513b0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1463 microversion: 2.1 time: 1.053524 Jul 24 01:25:17.274452 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1663/3481] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:16 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1463 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:17.294716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52994df0-d589-48e5-b59f-572fab5b2d84 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'create', calling method: .version_select at 0x7f05ea27a820>, body: {"keypair": {"name": "tempest-keypair-1530882171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB47q2NPDE+9NLDHdyExH2a+oLlSZA1n27JjXvNBvpY7qFTYZIt5442kja93pyl2YVzfLiJIPJv9D4T+vekbbAplISOGhOpDTrVsi7Whqcygxe6OH7LPXxZS6BMuZeRIvA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:17.311705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-52994df0-d589-48e5-b59f-572fab5b2d84 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for project 74794638ee6a4b18aef9ff780d461b73. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:25:17.317465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-52994df0-d589-48e5-b59f-572fab5b2d84 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for user 01e7c66073564bb0b78b2309d281d1f1 and project 74794638ee6a4b18aef9ff780d461b73. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:25:17.344411 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52994df0-d589-48e5-b59f-572fab5b2d84 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054569 Jul 24 01:25:17.350258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1664/3482] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:25:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:17.364393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:17.368327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:17.379158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.380246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.381499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.382726 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.851156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:17.858665 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-92c69e5a-4ea0-499f-bfb1-d638f56cd4bd tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.630746 Jul 24 01:25:17.863145 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1819/3483] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:17 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:17.873449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7f542da-aee6-4f75-b67d-84c7f5159bd9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:17.873760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:17.875977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b7f542da-aee6-4f75-b67d-84c7f5159bd9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:17.883382 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c6e7012-0ae5-4974-b0b0-08bd99385917 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.536917 Jul 24 01:25:17.895753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1665/3484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:17 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:17.895753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:17.895753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:17.896194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7f542da-aee6-4f75-b67d-84c7f5159bd9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.898627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7f542da-aee6-4f75-b67d-84c7f5159bd9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.899302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7f542da-aee6-4f75-b67d-84c7f5159bd9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.899749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7f542da-aee6-4f75-b67d-84c7f5159bd9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.917819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.918590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.921603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:17.922144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:17.953232 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b7f542da-aee6-4f75-b67d-84c7f5159bd9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/ips" status: 200 len: 152 microversion: 2.20 time: 0.088577 Jul 24 01:25:17.953735 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1820/3485] 10.222.0.27 () {60 vars in 1288 bytes} [Sun Jul 24 01:25:17 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/ips => generated 152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:25:18.009327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lazy-loading 'flavor' on Instance uuid cb80ae4d-7c53-4ac1-a20d-c9a603f08253 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:25:18.163866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a4eec7e0-7990-46bf-9d77-5efc549cddf2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action" status: 200 len: 32 microversion: 2.1 time: 0.274991 Jul 24 01:25:18.164733 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1666/3486] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:17 2022] POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:25:18.174576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:18.175198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:18.184650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:18.187218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:18.188259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:18.191758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:18.460865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:18.476256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-254c13ab-b73d-4820-80b5-be415da8252a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.305598 Jul 24 01:25:18.477649 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1821/3487] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:18 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:18.884768 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:18.885714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:18.899690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:18.901951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:18.902979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:18.903264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:18.903889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:18.905871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:18.916396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:18.917499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:18.923297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:18.923878 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:19.211138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:19.222845 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-91a80675-ed13-49f7-b850-dd523e9b526e tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1318 microversion: 2.1 time: 0.345460 Jul 24 01:25:19.223465 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1667/3488] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:18 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:19.404183 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:19.428700 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-963389ae-2fea-40fb-ac82-e2cd55a7e031 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.529649 Jul 24 01:25:19.429315 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1822/3489] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:18 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:19.495315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:19.496227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:19.505884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:19.509150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:19.510190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:19.511357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:19.861779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:19.873527 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3cf71b6a-0302-4485-86ea-5b2e4918937f tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.382149 Jul 24 01:25:19.874472 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1668/3490] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:19 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:20.240748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:20.241369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:20.252222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:20.255257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:20.256305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:20.260317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:20.446853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:20.448802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:20.457075 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:20.457928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:20.459058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:20.459800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:20.590306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:20.606599 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-058ad161-f1a7-4016-a227-17cd6d481890 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1509 microversion: 2.1 time: 0.368695 Jul 24 01:25:20.608091 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1823/3491] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:20 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:20.664100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fd94abc0-2125-42bc-8819-54c1add02d35 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '.version_select at 0x7f05eabbd430>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:20.667191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd94abc0-2125-42bc-8819-54c1add02d35 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:20.668016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd94abc0-2125-42bc-8819-54c1add02d35 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:20.694615 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fd94abc0-2125-42bc-8819-54c1add02d35 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.035495 Jul 24 01:25:20.699183 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1824/3492] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:25:20 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:20.719613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d0adbc01-e5b9-4164-8bd9-77f7f4e3b0e6 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:20.748736 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d0adbc01-e5b9-4164-8bd9-77f7f4e3b0e6 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037341 Jul 24 01:25:20.749010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:20.751047 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1825/3493] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:25:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:20.760379 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a877720-605e-4284-997a-9e362e258c0b tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-529382602", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:20.766882 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:20.766882 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:25:20.782379 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3692f0f-8b4b-43b7-85f5-3917951bbcea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.339669 Jul 24 01:25:20.790482 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1669/3494] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:20 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:20.801150 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a877720-605e-4284-997a-9e362e258c0b tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.044775 Jul 24 01:25:20.805898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1826/3495] 10.222.0.27 () {60 vars in 1145 bytes} [Sun Jul 24 01:25:20 2022] POST /compute/v2.1/flavors => generated 498 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:20.813904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-618ec8a0-91b8-46b7-960a-4a114f68abd1 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:20.825829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-618ec8a0-91b8-46b7-960a-4a114f68abd1 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016046 Jul 24 01:25:20.842114 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1670/3496] 10.222.0.27 () {58 vars in 1181 bytes} [Sun Jul 24 01:25:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:25:20.891374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:20.892017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:20.919270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:20.920212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:20.923712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:20.927366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:21.108376 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-917139153", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "46684bda-5be4-4b32-965e-4d32a77ef0e4"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:21.213744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:21.219934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:25:21.231153 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cce099d7-fafb-452e-a62b-3314e083571a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.341957 Jul 24 01:25:21.232672 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1827/3497] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:20 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:21.316213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:21.319644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:21.349690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:21.350143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:21.350926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:21.351361 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:21.440592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lazy-loading 'flavor' on Instance uuid 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:25:21.795018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:25:21.795905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:25:21.796102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:25:21.796747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:25:21.797438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:25:21.817194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:21.817194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:21.817644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:21.818147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:21.865485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:25:21.878542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for user 01e7c66073564bb0b78b2309d281d1f1 and project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:25:21.906807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:25:21.909145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:25:21.997807 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b3e605c-d418-403f-bda2-6cae930a4008 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893625 Jul 24 01:25:22.005325 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1671/3498] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:25:22.011799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:22.013213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:22.022153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:22.023861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:22.025191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:22.025824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:22.060631 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf01e4cd-5df4-4c89-a5a6-255fed67f1f7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/action" status: 202 len: 0 microversion: 2.20 time: 0.749486 Jul 24 01:25:22.061658 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1828/3499] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:25:21 2022] POST /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:25:22.067749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ceb9d5a9-31b1-4d1e-bfee-cbb177c7baac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:22.069914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ceb9d5a9-31b1-4d1e-bfee-cbb177c7baac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:22.693640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ceb9d5a9-31b1-4d1e-bfee-cbb177c7baac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:22.705750 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ceb9d5a9-31b1-4d1e-bfee-cbb177c7baac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1278 microversion: 2.1 time: 0.638403 Jul 24 01:25:22.707165 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1829/3500] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:22 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1278 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:22.715236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:22.721052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:22.737985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:22.738412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:22.739223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:22.739634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:22.940948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:22.954046 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0278cd5b-c8bf-43b9-909c-15d244438639 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.947211 Jul 24 01:25:22.954967 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1672/3501] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:22 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:22.970342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:22.970977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:22.987359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:22.991493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:22.993523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:22.994327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:23.363742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:23.378469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:23.386153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:23.392412 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d71b708-de65-468a-bfbe-82042ea0f42a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.677835 Jul 24 01:25:23.395628 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1830/3502] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:22 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:23.549529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:23.558301 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a7ce8a3d-6b70-4bf7-87f8-f7482421f964 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.591879 Jul 24 01:25:23.559161 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1673/3503] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:22 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:23.663635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "86b22b2a-d326-4dc9-b964-3c4161f7c5c7"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:23.664756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:23.676033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:23.677422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:23.678798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:23.679857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:23.724586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:23.725151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:23.735094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:23.736080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:23.737162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:23.737809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:23.765918 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] HTTP exception thrown: Volume fa4fac83-681a-41f7-b258-5edee3798d20 could not be found. Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Request method failure captured: Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0/os-volume_attachments/fa4fac83-681a-41f7-b258-5edee3798d20 HTTP/1.1 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 74 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7LXuyYYUAthlYxgFzOv4evUpuqTm1LV7lE9U6FAwwaxL9l0TQH_Wu_bjZM9TzPRH2FeMk-N0adwb2LOfRNB-sz6FH0lFFyQRG3d8igJ3ym5IjjsJiD4PW0rRcOPsr9HEI2wNFgNO6FG4aL4AbVp7BDx_63nfZ7trgBjiH4a24ly-Q Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: f61c6d99deff4ac5a3d519d720cfb9f4 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesAdminNegativeTest-60824931 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f61c6d99deff4ac5a3d519d720cfb9f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f61c6d99deff4ac5a3d519d720cfb9f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f61c6d99deff4ac5a3d519d720cfb9f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f61c6d99deff4ac5a3d519d720cfb9f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesAdminNegativeTest-60824931 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: f61c6d99deff4ac5a3d519d720cfb9f4 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-60824931 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesAdminNegativeTest-60824931-project-admin Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 13ae58c891f04b258dbd2709ce7a32b6 Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesAdminNegativeTest-60824931-project-admin Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: {"volumeAttachment": {"volumeId": "86b22b2a-d326-4dc9-b964-3c4161f7c5c7"}} Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: exception: Volume fa4fac83-681a-41f7-b258-5edee3798d20 could not be found. Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': 'f65482f2-3b68-471c-a82e-8f425e25b7a0', 'id': 'fa4fac83-681a-41f7-b258-5edee3798d20', 'body': {'volumeAttachment': {'volumeId': '86b22b2a-d326-4dc9-b964-3c4161f7c5c7'}}} Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa4fac83-681a-41f7-b258-5edee3798d20 could not be found. (HTTP 404) (Request-ID: req-2f78731d-1f6b-47d4-a497-32f4f8eba6dc) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:25:23.768092 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa4fac83-681a-41f7-b258-5edee3798d20 could not be found. Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa4fac83-681a-41f7-b258-5edee3798d20 could not be found. Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa4fac83-681a-41f7-b258-5edee3798d20 could not be found. Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] Returning 404 to user: Volume fa4fac83-681a-41f7-b258-5edee3798d20 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b545f036-2e40-41b9-9b84-026c97df816a tempest-VolumesAdminNegativeTest-60824931 tempest-VolumesAdminNegativeTest-60824931-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0/os-volume_attachments/fa4fac83-681a-41f7-b258-5edee3798d20" status: 404 len: 109 microversion: 2.1 time: 0.110273 Jul 24 01:25:23.772924 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1831/3504] 10.222.0.27 () {60 vars in 1432 bytes} [Sun Jul 24 01:25:23 2022] PUT /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0/os-volume_attachments/fa4fac83-681a-41f7-b258-5edee3798d20 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:25:23.959901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:23.972223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:23.972849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:23.980243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-86eb024e-9621-4e2e-a408-828b948ad983 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1338 microversion: 2.1 time: 0.259668 Jul 24 01:25:23.981019 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1674/3505] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:23 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1338 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:23.984744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:23.985206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:23.986022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:23.986490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:24.412961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:24.413583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:24.435386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:24.436255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:24.437783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:24.438398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:24.459016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:24.476733 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f9d1abc-e0bf-4c12-9700-901df6472d6d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.508496 Jul 24 01:25:24.487104 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1832/3506] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:23 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:24.576970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:24.577626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:24.594060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:24.594738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:24.595797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:24.596627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:24.808015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:24.821524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:24.829030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:24.831532 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ae51d3ac-10a2-4baf-afbb-6f87bdf48ab3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.422824 Jul 24 01:25:24.833584 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1675/3507] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:24 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:25:24.876450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:24.893366 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1a809a1-d3f1-4e82-9c93-bab7bf26472b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.321337 Jul 24 01:25:24.894477 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1833/3508] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:24 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:25.003011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:25.008275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:25.029264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.030447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:25.032403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.033812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:25.156693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:25.159486 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:25.172808 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7503ec15-220f-4290-b8b2-b14860660892 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1336 microversion: 2.1 time: 0.178243 Jul 24 01:25:25.178297 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1676/3509] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:24 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1336 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:25.499455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:25.500518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:25.522183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.523786 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:25.525741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.527919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:25.813072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:25.826089 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e68c1901-fa85-4e69-8a2e-078c2fb79d27 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.331389 Jul 24 01:25:25.826813 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1834/3510] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:25 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:25.851044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:25.851653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:25.876136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.876655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:25.877502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.877984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:25.912614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:25.913350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:25.930055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.930526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:25.931500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:25.932247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:26.405814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:26.426446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:26.429046 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:26.431911 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-83907d0f-bf2b-4b6e-a286-96d8406f3af1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.585760 Jul 24 01:25:26.434498 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1677/3511] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:25 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:26.450078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:26.455614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:26.468935 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:26.471282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:26.471928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:26.472889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:26.477212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:26.483135 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-918735a0-4ebc-4182-b7e3-c551218f1e09 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.575335 Jul 24 01:25:26.489248 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1835/3512] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:25 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:26.498003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-00781809-2399-4fc8-a3fe-edfc9fdfcb8d req-520e4a81-3a34-424b-a252-8c628ce095b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e67bd6-1544-4fdb-b71d-e66168f06cee", "name": "network-vif-plugged", "status": "completed", "tag": "30738793-8e6b-439b-9751-10133099f498"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:26.506357 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:26.508630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-00781809-2399-4fc8-a3fe-edfc9fdfcb8d req-520e4a81-3a34-424b-a252-8c628ce095b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:26.509071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-00781809-2399-4fc8-a3fe-edfc9fdfcb8d req-520e4a81-3a34-424b-a252-8c628ce095b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:26.513967 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:26.524683 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-00781809-2399-4fc8-a3fe-edfc9fdfcb8d req-520e4a81-3a34-424b-a252-8c628ce095b8 service nova] Creating event network-vif-plugged:30738793-8e6b-439b-9751-10133099f498 for instance 13e67bd6-1544-4fdb-b71d-e66168f06cee on n-h2-master-1 Jul 24 01:25:26.532460 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-00781809-2399-4fc8-a3fe-edfc9fdfcb8d req-520e4a81-3a34-424b-a252-8c628ce095b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041634 Jul 24 01:25:26.533337 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1836/3513] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:26.844723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:26.845423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:26.853305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:26.853787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:26.855604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:26.856455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:26.948646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:26.969567 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-67babe14-c0a3-47bb-bd19-8f84983b9d22 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1378 microversion: 2.1 time: 0.526779 Jul 24 01:25:26.970342 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1678/3514] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:26 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1378 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:27.184701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:27.185611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:27.200561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:27.201155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:27.202117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:27.207145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:27.260456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:25:27.332348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:27.346890 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad9b1116-475c-4dbc-b090-777157eff36e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.506839 Jul 24 01:25:27.365536 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1837/3515] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:26 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:27.437736 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15b5e83d-54d6-441a-9972-750b51448d76 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 204 len: 0 microversion: 2.1 time: 0.258157 Jul 24 01:25:27.438559 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1679/3516] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:25:27 2022] DELETE /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:25:27.449457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:27.450413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:27.455398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:27.459566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:27.477381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:27.478302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:27.479902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:27.480580 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:27.481117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:27.481595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:27.485215 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:27.487770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.128997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:28.141247 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0ae8d8bc-3a42-465c-a15e-fcbbe74d804d tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1515 microversion: 2.1 time: 0.697983 Jul 24 01:25:28.142138 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1838/3517] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:27 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1515 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:28.155224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:28.156264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:28.166035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:28.168433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:28.169162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.171540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:28.174357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.182778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:28.184232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:28.185573 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2a9becc6-f5c4-4b28-898c-503fc7628052 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.736556 Jul 24 01:25:28.189002 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1680/3518] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:27 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:25:28.193930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-439c5ea0-4672-4484-b598-29b0fa3321d6 req-326b108d-f60f-4caa-9a5e-22c8d04452b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b48bf29-3067-490d-86df-7d8258aac369", "tag": "f554a1be-8a87-4df4-b910-86f58f1126fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:28.218625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-439c5ea0-4672-4484-b598-29b0fa3321d6 req-326b108d-f60f-4caa-9a5e-22c8d04452b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:28.219078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-439c5ea0-4672-4484-b598-29b0fa3321d6 req-326b108d-f60f-4caa-9a5e-22c8d04452b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.252910 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-439c5ea0-4672-4484-b598-29b0fa3321d6 req-326b108d-f60f-4caa-9a5e-22c8d04452b9 service nova] Creating event network-changed:f554a1be-8a87-4df4-b910-86f58f1126fe for instance 9b48bf29-3067-490d-86df-7d8258aac369 on n-h1-master-1 Jul 24 01:25:28.265002 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-439c5ea0-4672-4484-b598-29b0fa3321d6 req-326b108d-f60f-4caa-9a5e-22c8d04452b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074064 Jul 24 01:25:28.265634 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1681/3519] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:28.276642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:28.277359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:28.299171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:28.300743 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.301992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:28.302613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.660677 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:28.683175 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f77a1266-71c0-48d9-82c5-3b54990be644 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.538884 Jul 24 01:25:28.693515 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1839/3520] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:28 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:28.704189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:28.705297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:28.725570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:28.726152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.726845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:28.727288 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:28.910652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:28.919221 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8caa69ca-0f1c-4dbe-8898-b1da4b08c547 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1378 microversion: 2.1 time: 0.652309 Jul 24 01:25:28.924826 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1682/3521] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:28 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1378 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:29.095772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:29.105910 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c106ae6-f151-45ff-aa65-f903b90e031d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1308 microversion: 2.1 time: 0.418884 Jul 24 01:25:29.107161 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1840/3522] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:28 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:29.160626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:29.161190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:29.172939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.173686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:29.174835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.175442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:29.204691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:29.205637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:29.212541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.214155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:29.215003 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.215661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:29.613447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:29.624261 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81e11a11-f544-4ab2-9015-fa5d21d469d9 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1515 microversion: 2.1 time: 0.468961 Jul 24 01:25:29.625608 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1683/3523] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:29 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1515 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:29.668069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:29.684906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:29.686451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:29.687771 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93fb31ee-1a86-4652-9e2f-5b0c4e9ed457 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.487354 Jul 24 01:25:29.688391 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1841/3524] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:29 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:29.700937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:29.701569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:29.708052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.708521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:29.709305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.709779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:29.873263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:29.903098 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63465454-bb62-4bd0-99c4-75ca83d2dc72 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.206465 Jul 24 01:25:29.905373 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1684/3525] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:29 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:29.937115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:29.937764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:29.944209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.944666 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:29.945724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:29.946429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.131802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:30.133313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:30.141264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.141911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.143131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.143791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.308014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:30.318288 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5bb8d578-e0f7-4a36-a87f-b6236b25e810 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1378 microversion: 2.1 time: 0.385844 Jul 24 01:25:30.319227 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1842/3526] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:29 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1378 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:30.521898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:30.538911 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-712fb208-556e-4d02-8211-1dcec47cecec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1489 microversion: 2.1 time: 0.416655 Jul 24 01:25:30.553804 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1685/3527] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:30 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1489 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:30.558262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-514ed417-75fc-4bcb-82ef-0eb7b055c2d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:30.559598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-514ed417-75fc-4bcb-82ef-0eb7b055c2d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:30.570151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514ed417-75fc-4bcb-82ef-0eb7b055c2d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.570932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514ed417-75fc-4bcb-82ef-0eb7b055c2d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.571937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514ed417-75fc-4bcb-82ef-0eb7b055c2d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.572603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-514ed417-75fc-4bcb-82ef-0eb7b055c2d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.646038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:30.647056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:30.654340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.655589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.656602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.657617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.669652 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-514ed417-75fc-4bcb-82ef-0eb7b055c2d5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "PUT /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1084 microversion: 2.1 time: 0.115459 Jul 24 01:25:30.670337 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1843/3528] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:25:30 2022] PUT /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1084 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:30.687167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:30.687817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:30.694495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.694955 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.695746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.696188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.923794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:30.944360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e4032a72-fa72-43d9-bd7c-33a2d4906c47 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 200 len: 1473 microversion: 2.1 time: 0.303134 Jul 24 01:25:30.945750 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1686/3529] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:30 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:30.951927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:30.953148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:30.961997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.962546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:30.964214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:30.965652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.263223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:31.274834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-77d8740f-012f-41f8-bea7-2fb8923d847b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1510 microversion: 2.1 time: 0.591363 Jul 24 01:25:31.275431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1844/3530] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:30 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:31.286473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:31.287298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:31.297490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.298294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.299082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.299516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.326180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:31.338456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:31.346893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:31.348367 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-89b2e5c2-7d4e-4817-bdc2-559a162e0c10 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.401329 Jul 24 01:25:31.349053 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1687/3531] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:30 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:31.354589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-63a606ea-fdce-47a3-a1b2-d7207d2579cf req-9e3b0073-dab6-4d47-94ac-4987f6824e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65482f2-3b68-471c-a82e-8f425e25b7a0", "name": "network-vif-deleted", "tag": "2b498d97-4ced-4060-9a62-c3c54c5f1c23"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:31.371545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-63a606ea-fdce-47a3-a1b2-d7207d2579cf req-9e3b0073-dab6-4d47-94ac-4987f6824e3b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.372605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-63a606ea-fdce-47a3-a1b2-d7207d2579cf req-9e3b0073-dab6-4d47-94ac-4987f6824e3b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.393856 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-63a606ea-fdce-47a3-a1b2-d7207d2579cf req-9e3b0073-dab6-4d47-94ac-4987f6824e3b service nova] Creating event network-vif-deleted:2b498d97-4ced-4060-9a62-c3c54c5f1c23 for instance f65482f2-3b68-471c-a82e-8f425e25b7a0 on n-h2-master-1 Jul 24 01:25:31.400310 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-63a606ea-fdce-47a3-a1b2-d7207d2579cf req-9e3b0073-dab6-4d47-94ac-4987f6824e3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049828 Jul 24 01:25:31.402941 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1688/3532] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:31.411174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:31.412183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:31.421230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.422473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.424037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.424826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.590679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:31.602422 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a939c51-c2dd-40f7-8b92-06c4ca356322 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.321388 Jul 24 01:25:31.603465 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1845/3533] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:31 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:31.611524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:31.612393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:31.621711 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.622862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.623908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.624420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.673181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:31.693004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-618aad3d-b183-4e31-89a6-9e22d43adff7 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1510 microversion: 2.1 time: 0.286723 Jul 24 01:25:31.694758 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1689/3534] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:31 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:31.711529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:31.712030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:31.719936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.720390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.721174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.721604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.756053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:25:31.830931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:31.834192 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:31.841960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e6a2a56-ca90-4b82-b1dd-221c0d6f3211 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1378 microversion: 2.1 time: 0.236205 Jul 24 01:25:31.843288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1846/3535] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:31 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1378 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:31.871510 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc1230f6-84f0-4c08-be62-040a2654a7ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 204 len: 0 microversion: 2.1 time: 0.163623 Jul 24 01:25:31.872253 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1690/3536] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:25:31 2022] DELETE /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:25:31.880739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:31.881429 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:31.888645 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.889851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.890823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.891268 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.965332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:31.966117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: f65482f2-3b68-471c-a82e-8f425e25b7a0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:31.972192 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:31.974627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.975094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:31.975913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:31.980455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:32.000033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] HTTP exception thrown: Instance f65482f2-3b68-471c-a82e-8f425e25b7a0 could not be found. Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Request method failure captured: Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 HTTP/1.1 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J6w4a56TZyhNiN9OPaGPsH6gbwEG74Usl_0VaONT5-iUKYmkULi39M-yW9LnBJ51PJBlibkpxBX0Cd-WuVcV9F_Pd0MlUIGUt_qGhCNxV1fT88RCiiAcCeBgZtj-e43_d588WU5-gTnyx54FgLiTegyKBMAV_vsJUsS_kG-o7ZpW3Q Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: c60507837fec4e06bd0551093bceb959 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesAdminNegativeTest-190124136 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c60507837fec4e06bd0551093bceb959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c60507837fec4e06bd0551093bceb959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c60507837fec4e06bd0551093bceb959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c60507837fec4e06bd0551093bceb959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesAdminNegativeTest-190124136 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: c60507837fec4e06bd0551093bceb959 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-190124136 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesAdminNegativeTest-190124136-project Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: d82fd738d5bb4d5e838f67b0b76b3b56 Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesAdminNegativeTest-190124136-project Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f65482f2-3b68-471c-a82e-8f425e25b7a0 could not be found. Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f65482f2-3b68-471c-a82e-8f425e25b7a0'} Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f65482f2-3b68-471c-a82e-8f425e25b7a0 could not be found. Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f65482f2-3b68-471c-a82e-8f425e25b7a0 could not be found. Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:32.002831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:32.008068 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:32.008068 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:32.008068 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:32.008068 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:32.008068 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:32.008068 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f65482f2-3b68-471c-a82e-8f425e25b7a0 could not be found. Jul 24 01:25:32.008068 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:32.009524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Returning 404 to user: Instance f65482f2-3b68-471c-a82e-8f425e25b7a0 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:32.010898 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e3cab08-14b0-4df1-b7e3-ade628aaa7ee tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0" status: 404 len: 111 microversion: 2.1 time: 0.051461 Jul 24 01:25:32.014532 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1691/3537] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:31 2022] GET /compute/v2.1/servers/f65482f2-3b68-471c-a82e-8f425e25b7a0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:25:32.316849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:32.327801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3f0cc8ca-51c8-4e48-b531-c7c4cee45257 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1516 microversion: 2.1 time: 0.451154 Jul 24 01:25:32.328916 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1847/3538] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:31 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1516 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:32.367829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:32.368456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:32.379896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:32.381095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:32.382521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:32.383184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:32.386725 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:32.610791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:32.622592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:32.623947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:32.639880 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:32.640419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:32.642474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:32.643156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:32.644519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:32.645483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:32.647129 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-17c81cf3-5bda-4e04-9eec-eb2aa4388c31 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.283157 Jul 24 01:25:32.650632 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1692/3539] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:32 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:32.699183 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:32.823097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:32.833513 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e5e1a77-d8ee-4ef3-918e-e12e8acd64e5 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.216564 Jul 24 01:25:32.834875 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1848/3540] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:32 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:32.861127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:32.862164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:32.872940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:32.873969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:32.877386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:32.878974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:33.107993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:33.125495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b27040e2-9eb6-463c-a01b-b9dbbba8fc92 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1378 microversion: 2.1 time: 0.267229 Jul 24 01:25:33.134227 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1693/3541] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:32 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1378 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:33.344743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:33.345366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:33.352975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:33.353806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:33.355314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:33.356247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:33.534877 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:33.545203 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac457af5-cca6-41ce-872e-420762e12108 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1516 microversion: 2.1 time: 0.204313 Jul 24 01:25:33.549257 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1849/3542] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:33 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:33.670756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:33.672411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:33.687687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:33.691510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:33.694838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:33.695572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:33.855599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:33.856492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:33.864807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:33.865609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:33.868583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:33.870294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:34.142028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:34.159468 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:34.162804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:34.164982 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-385825d4-ba26-448b-95dc-2924787ff418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.499674 Jul 24 01:25:34.166107 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1694/3543] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:33 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:34.181901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:34.185816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:34.189400 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:34.195058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:34.195776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:34.197081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:34.198250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:34.361956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:34.408377 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71e32f47-7182-4d9d-abc0-34cef4cae96a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.559895 Jul 24 01:25:34.409593 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1850/3544] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:33 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:34.489289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:34.500490 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-add4b59f-cdb1-46fb-8930-fe8d38554042 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1378 microversion: 2.1 time: 0.331434 Jul 24 01:25:34.510932 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1695/3545] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:34 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1378 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:34.567346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:34.570219 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:34.579607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:34.580836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:34.582537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:34.583228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:34.624607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2289d841-5512-4b27-90d4-a6fe96fcb14a req-5ef17846-7ac8-4064-bbf2-a5b432008673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e67bd6-1544-4fdb-b71d-e66168f06cee", "name": "network-vif-deleted", "tag": "30738793-8e6b-439b-9751-10133099f498"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:34.633780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2289d841-5512-4b27-90d4-a6fe96fcb14a req-5ef17846-7ac8-4064-bbf2-a5b432008673 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:34.634663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2289d841-5512-4b27-90d4-a6fe96fcb14a req-5ef17846-7ac8-4064-bbf2-a5b432008673 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:34.656431 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2289d841-5512-4b27-90d4-a6fe96fcb14a req-5ef17846-7ac8-4064-bbf2-a5b432008673 service nova] Creating event network-vif-deleted:30738793-8e6b-439b-9751-10133099f498 for instance 13e67bd6-1544-4fdb-b71d-e66168f06cee on n-h2-master-1 Jul 24 01:25:34.662598 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2289d841-5512-4b27-90d4-a6fe96fcb14a req-5ef17846-7ac8-4064-bbf2-a5b432008673 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042995 Jul 24 01:25:34.663503 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1696/3546] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:34.715523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:34.725573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-368ee6af-c160-4072-b90d-639d75844dec tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 200 len: 1474 microversion: 2.1 time: 0.162523 Jul 24 01:25:34.726805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1851/3547] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:34 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 1474 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:35.014185 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c9ba78f8-adce-433d-93f4-47ee5bde925e req-ff4eca36-8246-429d-958e-19d64e44c099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48bf29-3067-490d-86df-7d8258aac369", "name": "network-vif-plugged", "status": "completed", "tag": "f554a1be-8a87-4df4-b910-86f58f1126fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:35.035815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c9ba78f8-adce-433d-93f4-47ee5bde925e req-ff4eca36-8246-429d-958e-19d64e44c099 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.036827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c9ba78f8-adce-433d-93f4-47ee5bde925e req-ff4eca36-8246-429d-958e-19d64e44c099 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.053575 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c9ba78f8-adce-433d-93f4-47ee5bde925e req-ff4eca36-8246-429d-958e-19d64e44c099 service nova] Creating event network-vif-plugged:f554a1be-8a87-4df4-b910-86f58f1126fe for instance 9b48bf29-3067-490d-86df-7d8258aac369 on n-h1-master-1 Jul 24 01:25:35.059737 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c9ba78f8-adce-433d-93f4-47ee5bde925e req-ff4eca36-8246-429d-958e-19d64e44c099 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055495 Jul 24 01:25:35.060945 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1697/3548] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:35.196704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:35.200025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:35.226526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.231890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.235417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.236135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.427597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:35.428309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:35.437923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.439196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.439996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.440429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.817602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:35.821856 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:35.837060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:35.843002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:35.844819 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e1e658ad-fb88-4d44-866d-521423dbce0e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.663845 Jul 24 01:25:35.847145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:35.849221 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1852/3549] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:35 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:35.855587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:35.856440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:35.856594 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4fd45196-a3cf-4b60-8903-68879f505751 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.434038 Jul 24 01:25:35.865874 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1698/3550] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:35 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:35.870362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:35.871363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:35.880047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.880861 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.881883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.882487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.893158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.893617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.894450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:35.894894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:35.934630 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee HTTP/1.1 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '13e67bd6-1544-4fdb-b71d-e66168f06cee'} Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:35.936859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:35.943016 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:35.943016 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:35.943016 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:35.943016 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:35.943016 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:25:35.943016 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:35.945547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:35.946645 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2f14bd0b-350c-42d0-9ee9-ca6cccad8d74 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 404 len: 111 microversion: 2.1 time: 0.083569 Jul 24 01:25:35.948497 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1699/3551] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:35 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:25:36.091262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2014252119", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "4015265e-e6b0-4e47-bccc-5d1d48270467"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:36.180766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] validate_networks() for [('4015265e-e6b0-4e47-bccc-5d1d48270467', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:25:36.199210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:36.207468 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3ff3b453-5266-49f0-8066-e2c0f027244a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1378 microversion: 2.1 time: 0.356797 Jul 24 01:25:36.208383 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1853/3552] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:35 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1378 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:36.487123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:36.487472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:36.505286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:36.505763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:36.506753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:36.507366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:36.539207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:25:36.662356 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98fe1d56-1f7c-49ac-83cc-aefbd5b38210 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 204 len: 0 microversion: 2.1 time: 0.177207 Jul 24 01:25:36.663076 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1854/3553] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:25:36 2022] DELETE /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:25:36.674054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:36.674938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:36.682864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:36.683590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:36.685194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:36.685947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.015196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.027337 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8761b9f7-1ab6-40bf-8cb5-970b60f642c4 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1682 microversion: 2.1 time: 0.359118 Jul 24 01:25:37.028427 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1855/3554] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:36 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:37.034394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.035141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.043105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.043954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.045306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.046032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.069248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:25:37.069726 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:25:37.070271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:25:37.070770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:25:37.071290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:25:37.085062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.085415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.086246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.086688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.108114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:25:37.116504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Getting quotas for user 785eebaf851240da958ed7c13d121121 and project b20fd219605f4e0c8e04a9289764a40d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:25:37.132949 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:25:37.136690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:25:37.188506 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ece1a40-92e4-4212-8ce9-fab5af8f468f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102762 Jul 24 01:25:37.194947 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1700/3555] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:25:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:25:37.202419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.203313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.216285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.216501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.217334 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.217835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.334372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.347968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.350811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.354731 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e53f7051-6c93-4b65-82fd-864e9779d3e5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.323646 Jul 24 01:25:37.357016 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1856/3556] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:37 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:37.362864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d0b389d7-4324-4a58-826f-c5d500f80ae3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.363851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d0b389d7-4324-4a58-826f-c5d500f80ae3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.518411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d0b389d7-4324-4a58-826f-c5d500f80ae3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.534296 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d0b389d7-4324-4a58-826f-c5d500f80ae3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1209 microversion: 2.1 time: 0.175542 Jul 24 01:25:37.534934 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1857/3557] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:37 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1209 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:37.544273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.544902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.554779 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.555490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.556781 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.558189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.589573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.598900 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1bd33f89-629d-4be6-b86b-bb27cc29326b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.402453 Jul 24 01:25:37.606085 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1701/3558] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:37 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:37.827893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:37.837946 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9968590d-65aa-42c8-96fa-fb5cfa3afb47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1526 microversion: 2.1 time: 0.301939 Jul 24 01:25:37.839128 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1858/3559] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:37 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1526 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:37.858839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:37.859872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:37.869422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.870732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:37.872326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:37.873039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.047385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.048591 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:38.058285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.058968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.060260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.061225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.269393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.284886 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f8550d0-98f0-4a6f-890a-018b009442cc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1526 microversion: 2.1 time: 0.433419 Jul 24 01:25:38.298244 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1702/3560] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:37 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1526 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:38.308479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7c17c10-3e51-40f4-aefe-8f8672273289 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.309389 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:38.309389 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:25:38.314975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.323648 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3fefb93b-6742-4d76-aabc-38ff40113fd6 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1682 microversion: 2.1 time: 0.282645 Jul 24 01:25:38.324797 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1859/3561] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:38 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:38.344142 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7c17c10-3e51-40f4-aefe-8f8672273289 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/46684bda-5be4-4b32-965e-4d32a77ef0e4" status: 202 len: 0 microversion: 2.1 time: 0.043396 Jul 24 01:25:38.345137 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1703/3562] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:25:38 2022] DELETE /compute/v2.1/flavors/46684bda-5be4-4b32-965e-4d32a77ef0e4 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:25:38.355169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7676179a-2c8f-4b19-93cf-05c414034769 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.375910 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7676179a-2c8f-4b19-93cf-05c414034769 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026498 Jul 24 01:25:38.376879 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1860/3563] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:25:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:38.377723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.378846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:38.388551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.389341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.390977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.391843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.394304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:38.395933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:38.406281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.408062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.409461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.409998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.542132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.550416 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Old instance type tempest-test_resize_flavor_-529382602, new instance type m1.heat {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 01:25:38.565332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:25:38.565787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:25:38.566270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:25:38.566682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:25:38.567095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:25:38.702114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.719029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.722164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.728110 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-728c3bca-2a92-459a-ad2c-90ecf9fdade0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1745 microversion: 2.20 time: 0.357655 Jul 24 01:25:38.729087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1704/3564] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:38 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1745 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:25:38.745187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.746427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:38.759572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.762298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.764189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.765583 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.810697 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40e2efce-447b-4491-a862-b9a0acdc98de tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369/action" status: 202 len: 0 microversion: 2.1 time: 0.422105 Jul 24 01:25:38.815014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1861/3565] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:38 2022] POST /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:25:38.821719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.823298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:38.836058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.836513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.837310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.840017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.881893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:38.889985 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a34d3467-f58e-4c29-b041-ebce01313153 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1261 microversion: 2.1 time: 0.160134 Jul 24 01:25:38.890587 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1705/3566] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:38 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:38.905884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:38.906509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:38.912930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.914087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:38.915080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:38.915712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.651835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:39.670898 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eacdb71a-40a1-41b0-a70a-9730e73b1161 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1503 microversion: 2.1 time: 0.854327 Jul 24 01:25:39.671864 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1862/3567] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:38 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1503 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:39.676687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:39.677313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:39.694500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.694958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.695758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.696201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.771879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:39.789221 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0d257118-e28a-4525-a6c3-e573ad7e7624 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1535 microversion: 2.1 time: 0.888047 Jul 24 01:25:39.792492 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1706/3568] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:38 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1535 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:39.800793 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9a1e14e-808c-4b94-b780-73c152369769"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:39.804288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:39.821256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.823519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.824536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.826249 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.864453 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Cannot 'attach_volume' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state rescued Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/os-volume_attachments HTTP/1.1 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 74 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: {"volumeAttachment": {"volumeId": "f9a1e14e-808c-4b94-b780-73c152369769"}} Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'attach_volume' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state rescued Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': 'cb80ae4d-7c53-4ac1-a20d-c9a603f08253', 'body': {'volumeAttachment': {'volumeId': 'f9a1e14e-808c-4b94-b780-73c152369769'}}} Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 24 01:25:39.868527 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state rescued Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state rescued Jul 24 01:25:39.874218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:25:39.877528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 409 to user: Cannot 'attach_volume' instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 while it is in vm_state rescued {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:39.878911 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c44c27b8-d7d7-4dc5-8fd0-82424d35a27b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084989 Jul 24 01:25:39.879806 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1707/3569] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:25:39 2022] POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:25:39.889987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:39.890809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:39.901003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.902081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:39.903092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:39.903713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.346097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:40.361599 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-41fabda8-0502-4335-98ce-b14af1d0a04b tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1682 microversion: 2.1 time: 0.686322 Jul 24 01:25:40.363403 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1863/3570] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:39 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1682 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:40.377470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e414f4c6-698b-43f0-a5a7-220041786ea4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:40.378498 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e414f4c6-698b-43f0-a5a7-220041786ea4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:40.392185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e414f4c6-698b-43f0-a5a7-220041786ea4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.392997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e414f4c6-698b-43f0-a5a7-220041786ea4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.393840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e414f4c6-698b-43f0-a5a7-220041786ea4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.396682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e414f4c6-698b-43f0-a5a7-220041786ea4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.431500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:40.446015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:40.454357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:40.455858 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f47e80b1-2ae6-439c-8cd6-bc3ab79d53c3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1745 microversion: 2.20 time: 0.574805 Jul 24 01:25:40.457362 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1708/3571] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:39 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1745 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:40.483831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:40.489498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:40.498010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.498581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.499918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.500686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.551537 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e414f4c6-698b-43f0-a5a7-220041786ea4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action" status: 202 len: 0 microversion: 2.1 time: 0.186136 Jul 24 01:25:40.552186 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1864/3572] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:25:40 2022] POST /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:25:40.566390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:40.567112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:40.587606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.588909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.590303 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.591355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.856614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:40.866763 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a944771a-7b8b-41a5-a9b3-642891ac4602 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1267 microversion: 2.1 time: 0.391997 Jul 24 01:25:40.867398 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1709/3573] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:40 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:40.881555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:40.883585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:40.909477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.915922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:40.920030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:40.921359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:41.653396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:41.665328 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ed8a35e-0ac2-4a89-98bc-3795652a016a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1511 microversion: 2.1 time: 1.107268 Jul 24 01:25:41.666393 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1865/3574] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:40 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1511 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:41.689514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:41.691837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:41.737297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:41.740857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:41.743592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:41.748462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.346791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:42.373345 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-53cf1451-00df-4d5e-9ae4-0e0f1ac52558 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1535 microversion: 2.1 time: 1.501717 Jul 24 01:25:42.375437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1710/3575] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:40 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1535 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:42.396035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:42.396861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:42.404901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.406424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.408405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.410942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.416765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:42.436115 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b5afdb5e-9e34-4345-846e-b0562f3f1b3a tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1614 microversion: 2.1 time: 0.768561 Jul 24 01:25:42.437023 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1866/3576] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:41 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1614 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:42.453852 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:42.454835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:42.480139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.481081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.482888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:42.487449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:42.569144 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:43.935571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:43.951772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:43.953310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:43.954683 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-db855788-8b11-43ec-9322-2d806f03dcc2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 1.578089 Jul 24 01:25:43.956253 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1711/3577] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:42 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:43.971461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:43.972368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:43.985909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:43.992690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:43.993734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:43.995933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:44.334426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:44.348254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b07cf14f-d8d5-42ea-9668-9748dfd64a2b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 1.907976 Jul 24 01:25:44.350574 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1867/3578] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:42 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:44.361320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:44.361980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:44.379241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:44.383513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:44.384373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:44.385495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:44.708131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:44.711387 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:44.724037 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0a3633db-eab7-4087-a797-e063c7555dd2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1511 microversion: 2.1 time: 0.766690 Jul 24 01:25:44.727681 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1712/3579] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:43 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1511 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:44.745695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:44.746598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:44.753297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:44.754455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:44.755435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:44.756643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:44.932918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:44.946609 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9ef5436-eafd-4918-8a58-10cd049c2fc1 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1614 microversion: 2.1 time: 0.205945 Jul 24 01:25:44.961357 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1713/3580] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:44 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1614 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:44.967034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-29594711-9465-4464-bf4e-cb79bc6a25a6 req-a01023be-3efc-4f7c-97ba-73a94e448ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "name": "network-vif-plugged", "status": "completed", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:44.992288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-29594711-9465-4464-bf4e-cb79bc6a25a6 req-a01023be-3efc-4f7c-97ba-73a94e448ce8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:45.006228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-29594711-9465-4464-bf4e-cb79bc6a25a6 req-a01023be-3efc-4f7c-97ba-73a94e448ce8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:45.046362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:45.060367 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-19dd1c9f-69aa-4ad7-a044-ec4751b72e07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1535 microversion: 2.1 time: 0.704933 Jul 24 01:25:45.061415 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1868/3581] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:44 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1535 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:45.068734 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-29594711-9465-4464-bf4e-cb79bc6a25a6 req-a01023be-3efc-4f7c-97ba-73a94e448ce8 service nova] Creating event network-vif-plugged:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h1-master-1 Jul 24 01:25:45.073280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6723a1eb-b5db-4452-bafb-ba133b1e050a req-a4163312-037a-48a2-a72c-d48dfeca574d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f87e018-4100-4486-b086-4ca4dc17e290", "name": "network-vif-deleted", "tag": "72c16541-b9a8-471c-8223-1f9b0a727708"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:45.092432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6723a1eb-b5db-4452-bafb-ba133b1e050a req-a4163312-037a-48a2-a72c-d48dfeca574d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:45.095822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6723a1eb-b5db-4452-bafb-ba133b1e050a req-a4163312-037a-48a2-a72c-d48dfeca574d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:45.101286 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-29594711-9465-4464-bf4e-cb79bc6a25a6 req-a01023be-3efc-4f7c-97ba-73a94e448ce8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137971 Jul 24 01:25:45.111533 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1714/3582] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:45.129184 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6723a1eb-b5db-4452-bafb-ba133b1e050a req-a4163312-037a-48a2-a72c-d48dfeca574d service nova] Creating event network-vif-deleted:72c16541-b9a8-471c-8223-1f9b0a727708 for instance 7f87e018-4100-4486-b086-4ca4dc17e290 on n-h2-master-1 Jul 24 01:25:45.133172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:45.145527 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:45.146262 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6723a1eb-b5db-4452-bafb-ba133b1e050a req-a4163312-037a-48a2-a72c-d48dfeca574d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082340 Jul 24 01:25:45.147064 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1869/3583] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:45.187111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:45.193706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:45.197095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:45.203705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:45.367699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:45.368578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:45.381338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:45.382418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:45.387339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:45.388080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:45.998819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:46.013372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-694e4b7c-56a6-4ea4-9071-178a2e0aa84e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 0.647007 Jul 24 01:25:46.019254 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1870/3584] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:45 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:46.055574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:46.056229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:46.094830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:46.107531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:46.111201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:46.111670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:46.112483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:46.112932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:46.120267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:46.129863 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0109143-7338-4be9-8e6c-157dfb00fb7e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 1.014900 Jul 24 01:25:46.133954 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1715/3585] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:45 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:46.157352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:46.159943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:46.193553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:46.194477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:46.195672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:46.201403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:46.323369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:46.331770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:46.334931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lazy-loading 'fault' on Instance uuid 7f87e018-4100-4486-b086-4ca4dc17e290 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:25:46.450549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82fd738d5bb4d5e838f67b0b76b3b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60507837fec4e06bd0551093bceb959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:46.464553 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a22ffcd-9572-4426-b017-7e8bb9e0488f tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 200 len: 1331 microversion: 2.1 time: 0.327902 Jul 24 01:25:46.467489 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1716/3586] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:46 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 1331 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:46.479098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:46.479892 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:46.500227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:46.500805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:46.503087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:46.504548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:46.779687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:46.794838 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f64a8917-6cba-4b00-88ea-e503ac7ebc97 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1517 microversion: 2.1 time: 0.773656 Jul 24 01:25:46.801624 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1871/3587] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:46 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1517 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:47.035034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:47.035654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:47.048453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:47.048914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:47.055792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:47.056620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:47.080104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:47.099984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e7c7b614-a1c8-4726-89a3-4eb645f86024 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.631035 Jul 24 01:25:47.110029 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1717/3588] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:46 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:47.152870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:47.153497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:47.161901 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:47.164102 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:47.184977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:47.186539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:47.192145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:47.201404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:47.525352 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:48.117743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:48.150053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:48.176657 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93ba7290-73ba-4493-b937-91943d680f18 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 1.145030 Jul 24 01:25:48.179748 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1872/3589] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:47 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:25:48.181121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:48.188529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:48.192423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] [instance: 7f87e018-4100-4486-b086-4ca4dc17e290] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:48.201793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:48.202825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:48.203878 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:48.204597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:48.208985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:48.211256 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8fb09a2e-861a-4762-9061-8bd53fb65485 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 1.062117 Jul 24 01:25:48.215443 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1718/3590] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:47 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:48.225423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:48.228930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:48.232959 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] HTTP exception thrown: Instance 7f87e018-4100-4486-b086-4ca4dc17e290 could not be found. Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Request method failure captured: Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 HTTP/1.1 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J6w4a56TZyhNiN9OPaGPsH6gbwEG74Usl_0VaONT5-iUKYmkULi39M-yW9LnBJ51PJBlibkpxBX0Cd-WuVcV9F_Pd0MlUIGUt_qGhCNxV1fT88RCiiAcCeBgZtj-e43_d588WU5-gTnyx54FgLiTegyKBMAV_vsJUsS_kG-o7ZpW3Q Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: c60507837fec4e06bd0551093bceb959 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesAdminNegativeTest-190124136 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c60507837fec4e06bd0551093bceb959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c60507837fec4e06bd0551093bceb959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c60507837fec4e06bd0551093bceb959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c60507837fec4e06bd0551093bceb959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesAdminNegativeTest-190124136 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: c60507837fec4e06bd0551093bceb959 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-190124136 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesAdminNegativeTest-190124136-project Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d82fd738d5bb4d5e838f67b0b76b3b56 Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesAdminNegativeTest-190124136-project Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 7f87e018-4100-4486-b086-4ca4dc17e290 could not be found. Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '7f87e018-4100-4486-b086-4ca4dc17e290'} Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f87e018-4100-4486-b086-4ca4dc17e290 could not be found. Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f87e018-4100-4486-b086-4ca4dc17e290 could not be found. Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:25:48.241175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:48.246121 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:25:48.246121 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:25:48.246121 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:25:48.246121 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:25:48.246121 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:25:48.246121 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f87e018-4100-4486-b086-4ca4dc17e290 could not be found. Jul 24 01:25:48.246121 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:25:48.252666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Returning 404 to user: Instance 7f87e018-4100-4486-b086-4ca4dc17e290 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:25:48.256583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b745715e-967c-4c32-a573-ba4e11bad893 tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290" status: 404 len: 111 microversion: 2.1 time: 0.073060 Jul 24 01:25:48.260808 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1873/3591] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:48 2022] GET /compute/v2.1/servers/7f87e018-4100-4486-b086-4ca4dc17e290 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:25:48.263845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:48.264714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:48.272461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:48.273381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:48.277563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2cf4025-b45c-498a-b4e8-51387a577c7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] Calling method '.version_select at 0x7f05e9eec820>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:48.320111 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2cf4025-b45c-498a-b4e8-51387a577c7c tempest-VolumesAdminNegativeTest-190124136 tempest-VolumesAdminNegativeTest-190124136-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407989908" status: 202 len: 0 microversion: 2.1 time: 0.052222 Jul 24 01:25:48.321579 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1874/3592] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:25:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407989908 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:25:48.723856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5f78b46c-8d6a-4cd7-add1-83adba4bfda1 req-4be732b9-f1e5-48ee-9686-d8d26f9254e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21239a08-0dcd-4ddf-b582-99b246ba83a5", "tag": "a90e19e9-9dda-4eef-8231-2d684d5ac8c7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:48.753521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5f78b46c-8d6a-4cd7-add1-83adba4bfda1 req-4be732b9-f1e5-48ee-9686-d8d26f9254e0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:48.754980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5f78b46c-8d6a-4cd7-add1-83adba4bfda1 req-4be732b9-f1e5-48ee-9686-d8d26f9254e0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:48.783901 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5f78b46c-8d6a-4cd7-add1-83adba4bfda1 req-4be732b9-f1e5-48ee-9686-d8d26f9254e0 service nova] Creating event network-changed:a90e19e9-9dda-4eef-8231-2d684d5ac8c7 for instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 on n-h2-master-1 Jul 24 01:25:48.799248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5f78b46c-8d6a-4cd7-add1-83adba4bfda1 req-4be732b9-f1e5-48ee-9686-d8d26f9254e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079903 Jul 24 01:25:48.802608 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1875/3593] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:25:48.905285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:48.919580 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a9f13b74-86ef-4ff1-8118-41e454906c68 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.701113 Jul 24 01:25:48.921715 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1719/3594] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:48 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:49.207357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:49.211859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:49.222691 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:49.223491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:49.224674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:49.225323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:49.241911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:49.242616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:49.264385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:49.271520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:49.277247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:49.278115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:50.383911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:50.395537 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c2a86d8-0788-4fd3-9cdc-06a04e8a8453 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 1.192313 Jul 24 01:25:50.405341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:50.407228 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1876/3595] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:49 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:50.412586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:50.413437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:50.417358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:50.421047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:50.422054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:50.422868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:50.423315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:50.425648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:50.434078 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56b4468b-6470-4fce-af58-06701ab99891 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 1.193794 Jul 24 01:25:50.438230 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1720/3596] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:49 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:50.787926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:50.798030 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67fcc11c-03db-4d0a-97b1-848723a688ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.389404 Jul 24 01:25:50.813225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1877/3597] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:50 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:50.877135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d497551-8507-4330-a471-e00407d48baa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'create', calling method: .version_select at 0x7f05ea46a550>, body: {"keypair": {"name": "tempest-keypair-241046294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+yH2XabBOcW+fbWM0wpyNtI8BaE33q2z6qospHDm53zzny/dPxF/D6nmdPvtJVZ+T3OsG2Jl39qYoJdYvo/mm9JeG/bs+wf0pkPs9zmcbJcip9Rb0rK3jT9cZ8NsJ3bA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:50.928444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6d497551-8507-4330-a471-e00407d48baa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:25:50.941068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6d497551-8507-4330-a471-e00407d48baa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for user 5ab27e46e8534384abea2875fb9946df and project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:25:50.983150 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d497551-8507-4330-a471-e00407d48baa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109499 Jul 24 01:25:50.990028 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1721/3598] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:25:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:51.412941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:51.416999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:51.432032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:51.433521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:51.435114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:51.451258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:51.459584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:51.460343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:51.491306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:51.494869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:51.499384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:51.500711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:52.195199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:52.209210 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e9a0b478-8a60-4941-8e22-cacbcad3e497 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 0.799674 Jul 24 01:25:52.211217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1878/3599] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:51 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:52.219719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:52.220753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:52.226562 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:52.232250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:52.235795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:52.237473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:52.237949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:52.453806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:52.470050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:52.472595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:52.474774 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fcbfdd24-d71c-4a82-928d-9eef47b6833a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 1.022298 Jul 24 01:25:52.476155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1722/3600] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:51 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:52.711315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:52.725901 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d8d47d2-c5f2-4d17-98f1-2762fe530e65 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.513375 Jul 24 01:25:52.726489 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1879/3601] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:52 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:53.230577 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:53.231665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:53.241070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:53.241537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:53.242395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:53.249574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:53.494716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:53.495440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:53.521384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:53.522367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:53.526485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:53.528535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:54.113026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:54.140700 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-199219fe-a4bf-4e1e-bfdd-b6a6d6534bdc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 0.903118 Jul 24 01:25:54.142041 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1723/3602] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:53 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:54.148521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:54.149448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:54.164598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:54.165412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:54.168207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:54.172481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:54.423985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:54.446782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:54.454460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:54.464093 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ebea042b-e0d4-44cd-9054-ead7417d2a7c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 0.968580 Jul 24 01:25:54.485495 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1880/3603] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:53 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:25:54.744507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:54.758336 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d59bbec6-2b06-4b4e-99bb-dda97fc9c5ae tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.614426 Jul 24 01:25:54.770801 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1724/3604] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:54 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:55.161047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:55.161989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:55.215466 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:55.219127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:55.223591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:55.224315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:55.512870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:55.514919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:55.531214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:55.532966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:55.534324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:55.535598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:56.139125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:56.150611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-292b1ce1-596d-4b76-bd4c-f5e6401ebded tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 0.996004 Jul 24 01:25:56.152186 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1881/3605] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:55 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:56.159313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:56.160154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:56.169529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:56.172209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:56.174101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:56.176514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:56.429102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:56.461177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:56.464580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:56.466027 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-052fd3a1-b999-4db9-ac4e-4adcb91e714a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 0.973644 Jul 24 01:25:56.466754 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1725/3606] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:55 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:56.754945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:56.773375 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33d247cd-c259-44dd-8c42-16a055faa33b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.619296 Jul 24 01:25:56.776208 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1882/3607] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:56 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:56.944320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-16156602-1dfa-48de-82a2-fca8afcf10f1 req-b4fc10f6-48a7-4732-9f91-26921173b8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21239a08-0dcd-4ddf-b582-99b246ba83a5", "name": "network-vif-plugged", "status": "completed", "tag": "a90e19e9-9dda-4eef-8231-2d684d5ac8c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:56.970103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-16156602-1dfa-48de-82a2-fca8afcf10f1 req-b4fc10f6-48a7-4732-9f91-26921173b8e8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:56.970866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-16156602-1dfa-48de-82a2-fca8afcf10f1 req-b4fc10f6-48a7-4732-9f91-26921173b8e8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:56.987374 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-16156602-1dfa-48de-82a2-fca8afcf10f1 req-b4fc10f6-48a7-4732-9f91-26921173b8e8 service nova] Creating event network-vif-plugged:a90e19e9-9dda-4eef-8231-2d684d5ac8c7 for instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 on n-h2-master-1 Jul 24 01:25:56.996926 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-16156602-1dfa-48de-82a2-fca8afcf10f1 req-b4fc10f6-48a7-4732-9f91-26921173b8e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058831 Jul 24 01:25:56.999001 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1726/3608] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:25:57.169411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:57.171186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:57.181868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:57.189375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:57.190571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:57.191269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:57.486617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:57.487324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:57.514705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:57.515170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:57.515987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:57.516425 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:57.994479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:58.006326 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-215f104a-f612-4e01-91b3-b5ee37c29b77 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1309 microversion: 2.1 time: 0.841967 Jul 24 01:25:58.017229 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1883/3609] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:57 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1309 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:58.042904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:58.044129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:58.060651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:58.061482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:58.062953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:58.063635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:58.202540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:58.220325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:58.222667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:58.226409 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-415a9af5-d36d-4ad1-bd6c-9dd949e353e9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 0.744851 Jul 24 01:25:58.227310 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1727/3610] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:25:57 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:25:58.240888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1084663913", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65a31ff2-0877-4fce-9a40-a0060b7ea868"}], "security_groups": [{"name": "tempest-securitygroup--403995715"}], "key_name": "tempest-keypair-241046294", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:25:58.628519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] validate_networks() for [('65a31ff2-0877-4fce-9a40-a0060b7ea868', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:25:59.353010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:25:59.363317 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-891ef863-6c26-4bea-91da-4e536d187c55 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 1.344522 Jul 24 01:25:59.363916 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1884/3611] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:58 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:25:59.391952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:25:59.392521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:25:59.413376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:59.414633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:25:59.417524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:25:59.418293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.010658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:00.020244 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-467ce56b-5449-4aeb-91ae-13744eb6bc3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1490 microversion: 2.1 time: 0.655201 Jul 24 01:26:00.037005 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1885/3612] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:59 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1490 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:00.043695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:00.045164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:00.051938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.052679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.053663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.054972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.071716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:26:00.073019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:26:00.073708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:26:00.074341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:26:00.075574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:26:00.078191 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:00.098970 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.102997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.104423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.106609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.146094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:26:00.154493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Getting quotas for user 5ab27e46e8534384abea2875fb9946df and project 2ff39f2632ca408e9795b48dbcefc815. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:26:00.172505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:26:00.175132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:26:00.239898 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-522c6361-ddcd-4323-a066-f8eb35321182 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.009009 Jul 24 01:26:00.240848 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1728/3613] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:25:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:26:00.247767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-838ef798-f8e1-4aa0-99fe-45e9d432b87a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1463002433"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:00.249393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-838ef798-f8e1-4aa0-99fe-45e9d432b87a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:00.256029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838ef798-f8e1-4aa0-99fe-45e9d432b87a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.256753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838ef798-f8e1-4aa0-99fe-45e9d432b87a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.257759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838ef798-f8e1-4aa0-99fe-45e9d432b87a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.258687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-838ef798-f8e1-4aa0-99fe-45e9d432b87a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.362359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-838ef798-f8e1-4aa0-99fe-45e9d432b87a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "PUT /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1075 microversion: 2.1 time: 0.119898 Jul 24 01:26:00.363412 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1729/3614] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:26:00 2022] PUT /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1075 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:00.379948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e01fb637-29d8-4be1-92a4-60223945b1c2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:00.380824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e01fb637-29d8-4be1-92a4-60223945b1c2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:00.563683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e01fb637-29d8-4be1-92a4-60223945b1c2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:00.583227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e01fb637-29d8-4be1-92a4-60223945b1c2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1245 microversion: 2.1 time: 0.207939 Jul 24 01:26:00.584026 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1730/3615] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:00 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:00.589136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:00.590280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:00.609515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.612216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.614105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.615145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.621975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:00.633453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:00.651317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:00.652733 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69e0ed0d-e5e9-4ede-a8b6-2e4262632354 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 0.613994 Jul 24 01:26:00.653381 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1886/3616] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:00 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:00.666053 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:00.670612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:00.690346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.690809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.691605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:00.692045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:00.737170 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:01.135393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:01.141045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:01.163939 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7619df09-f41f-4104-b7b1-f3f2e7f5b008 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1501 microversion: 2.1 time: 0.501737 Jul 24 01:26:01.170233 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1887/3617] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:00 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:01.175575 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-29c786e6-4636-4039-8eac-4de789d06001 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.588029 Jul 24 01:26:01.176750 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1731/3618] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:00 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:01.188527 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:01.189194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:01.199260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.200988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.203128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.203699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.485200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:01.498399 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2210543b-00da-4e64-b028-36041b6624f0 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1501 microversion: 2.1 time: 0.314635 Jul 24 01:26:01.500193 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1888/3619] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:01 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:01.519343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9925fb1f-a5a4-49dc-bd18-843f3eaac38a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:01.526403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9925fb1f-a5a4-49dc-bd18-843f3eaac38a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.527175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9925fb1f-a5a4-49dc-bd18-843f3eaac38a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.591093 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:01.600217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:01.600846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:01.611212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.614230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.615265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.615886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.626739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9925fb1f-a5a4-49dc-bd18-843f3eaac38a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Going to try to stop instance {{(pid=119562) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:26:01.708256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:01.723215 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-01bfcabd-0fa4-4a34-b7cb-4142240a9879 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1297 microversion: 2.1 time: 0.125992 Jul 24 01:26:01.724210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9925fb1f-a5a4-49dc-bd18-843f3eaac38a tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "POST /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5/action" status: 202 len: 0 microversion: 2.1 time: 0.206001 Jul 24 01:26:01.725263 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1889/3620] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:01 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1297 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:01.726087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1732/3621] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:26:01 2022] POST /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:26:01.737277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:01.738274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:01.739068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:01.741826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:01.751919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.754791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.755497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.756661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.757286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.758032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:01.760907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:01.762264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:02.403462 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:02.415334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:02.425845 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f283f0b-2089-42fe-b897-1d6988b91a76 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.689302 Jul 24 01:26:02.431616 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1733/3622] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:01 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:02.433986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:02.439133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:02.443072 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fd7e15e4-ddf7-4630-bfc3-6dc375c62011 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 0.716094 Jul 24 01:26:02.443899 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1890/3623] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:01 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:02.444827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:02.445653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:02.470105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:02.473184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:02.474358 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:02.474986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:02.754211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:02.756473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:02.775475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:02.776037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:02.777408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:02.777899 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:02.843426 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:02.856220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a3f002c-83ee-4380-8f8c-10fce3c3d9e5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.423008 Jul 24 01:26:02.872044 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1734/3624] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:02 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:02.907571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:02.917521 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f2bd15a-def0-44a5-b6b0-3f95d1a6c462 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1303 microversion: 2.1 time: 0.169974 Jul 24 01:26:02.918776 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1891/3625] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:02 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:03.448951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:03.449592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:03.463514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:03.464260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:03.491697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:03.492447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:03.493975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:03.497745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:03.498495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:03.499112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:03.500095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:03.503542 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:04.125709 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:04.138208 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-858947aa-a246-45c5-92f4-0c3a804bb74b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.694019 Jul 24 01:26:04.139195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1735/3626] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:03 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:04.155127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:04.156179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:04.168014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:04.171996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:04.173257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:04.175219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:04.381141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:04.398493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:04.401816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:04.413654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-61d14496-864f-4cd5-a5ad-565b8c4561af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 0.954992 Jul 24 01:26:04.415116 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1892/3627] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:03 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:04.429390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:04.430302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:04.444353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:04.445105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:04.446166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:04.446790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:04.772820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:04.788485 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d8fc331f-8bcc-4f14-9826-144e0d28cf4a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.647936 Jul 24 01:26:04.789255 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1736/3628] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:04 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:04.988240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:05.008450 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ebb7f846-002a-4860-ab81-0308c8f36463 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.586813 Jul 24 01:26:05.009761 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1893/3629] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:04 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:05.156740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:05.157561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:05.176734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.179462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.184032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.186123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.433935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:05.435148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:05.442388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.443384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.444387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.445056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.467038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:05.479859 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d0b0f340-5f14-4ec6-870c-8e2ef0dd2aba tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.327213 Jul 24 01:26:05.481301 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1737/3630] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:05 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:05.807233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:05.808698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:05.822357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.822875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.830351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:05.830913 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:05.885550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:05.903566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:05.910123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:05.911951 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-80d71bc5-441d-4240-ad72-beedc68b7926 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1740 microversion: 2.20 time: 0.482933 Jul 24 01:26:05.912426 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1894/3631] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:05 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1740 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:06.027471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:06.028281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:06.037182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.045310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.046600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.047048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.197429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:06.206198 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1081c56d-e6ed-45e8-93fe-a61730113ee8 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.403358 Jul 24 01:26:06.217502 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1738/3632] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:05 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:06.304408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-011b15b2-07ba-46f1-8305-549788fa36d0 req-d4c98c82-7ce1-463e-a2cc-fa55086729cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b442384-e51b-40a2-aa9e-86c1404f7da0", "tag": "9852d3b1-563c-4847-9ab9-41791450fbdb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:06.342064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-011b15b2-07ba-46f1-8305-549788fa36d0 req-d4c98c82-7ce1-463e-a2cc-fa55086729cf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.342517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-011b15b2-07ba-46f1-8305-549788fa36d0 req-d4c98c82-7ce1-463e-a2cc-fa55086729cf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.373784 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-011b15b2-07ba-46f1-8305-549788fa36d0 req-d4c98c82-7ce1-463e-a2cc-fa55086729cf service nova] Creating event network-changed:9852d3b1-563c-4847-9ab9-41791450fbdb for instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 on n-h1-master-1 Jul 24 01:26:06.395526 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-011b15b2-07ba-46f1-8305-549788fa36d0 req-d4c98c82-7ce1-463e-a2cc-fa55086729cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099538 Jul 24 01:26:06.396160 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1739/3633] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:06.397336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:06.415454 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-729766e6-67bd-4225-80d6-4928a209a141 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.390080 Jul 24 01:26:06.425465 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1895/3634] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:06 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:06.510955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:06.512190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:06.527739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.529192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.530345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.534244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.904401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:06.914896 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e8d0673-28e9-437f-a1f5-f9408e296348 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.419871 Jul 24 01:26:06.916109 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1740/3635] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:06 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:06.936916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:06.938217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:06.947341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.948069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:06.949091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:06.949996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:07.224353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:07.225178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:07.233723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.235125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:07.236616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.237682 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:07.260147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:07.270543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:07.272467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:07.276024 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e0e5d6d-8e5a-49f2-89b5-f6ef781b822f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1722 microversion: 2.20 time: 0.346203 Jul 24 01:26:07.279188 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1896/3636] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:06 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:07.433856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:07.436312 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:07.444526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.445298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:07.446070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.447240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:07.756489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:07.774581 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92e6af4e-b0f3-41b9-a5b3-37d886a159e3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.554010 Jul 24 01:26:07.784480 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1741/3637] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:07 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:07.830216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:07.839707 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-55308e26-334a-4c08-9656-39e46c94767b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.410956 Jul 24 01:26:07.840538 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1897/3638] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:07 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:07.934363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:07.935763 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:07.944093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.944907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:07.947151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:07.948061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:08.295623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:08.296234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:08.313288 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:08.314090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:08.315097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:08.315729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:08.385878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:08.395829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b94d05ab-09e5-4ad8-8265-af5e6a5ec1f6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.466821 Jul 24 01:26:08.397029 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1742/3639] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:07 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:08.595280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:08.607922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:08.609889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:08.611595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86f7d262-fe5d-4f70-b1cc-502e361fd2a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1722 microversion: 2.20 time: 0.319938 Jul 24 01:26:08.612167 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1898/3640] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:08 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:26:08.793254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:08.793918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:08.804127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:08.804591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:08.805387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:08.809614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:08.857492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:08.858620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:08.867420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:08.868912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:08.871039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:08.871907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.190110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:09.205069 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56c9b6e0-be83-4581-bbde-37713666bb07 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1540 microversion: 2.1 time: 0.416258 Jul 24 01:26:09.206070 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1743/3641] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:08 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1540 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:09.217352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:09.227364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c9caf0f9-4fa1-4a81-a811-ee35562e33fe tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.372338 Jul 24 01:26:09.227364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1899/3642] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:08 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:09.294032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-fb1a0698-9c23-4480-82a2-b4f511703ffd req-a205c83b-e7a0-449d-a7cf-3cd33723e0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "name": "network-vif-unplugged", "status": "completed", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:09.310282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fb1a0698-9c23-4480-82a2-b4f511703ffd req-a205c83b-e7a0-449d-a7cf-3cd33723e0f2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:09.310856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fb1a0698-9c23-4480-82a2-b4f511703ffd req-a205c83b-e7a0-449d-a7cf-3cd33723e0f2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.344992 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-fb1a0698-9c23-4480-82a2-b4f511703ffd req-a205c83b-e7a0-449d-a7cf-3cd33723e0f2 service nova] Creating event network-vif-unplugged:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h1-master-1 Jul 24 01:26:09.360632 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-fb1a0698-9c23-4480-82a2-b4f511703ffd req-a205c83b-e7a0-449d-a7cf-3cd33723e0f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070555 Jul 24 01:26:09.363562 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1744/3643] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:09.416695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:09.418036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:09.427994 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:09.428452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.429386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:09.430081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.636713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:09.638435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:09.658467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:09.659626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.663280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:09.666021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:09.848190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:09.861975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8fdb0fdb-7921-49ca-94fd-fb7ed5f7cbee tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.450561 Jul 24 01:26:09.873598 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1900/3644] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:09 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:09.948195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:09.956677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:09.959564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:09.961115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fee17a25-2085-406b-bf5a-50e1a175f237 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1722 microversion: 2.20 time: 0.333961 Jul 24 01:26:09.962095 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1745/3645] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:09 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:10.226236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:10.227618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:10.236341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.236950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.238125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.239003 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.246113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:10.247094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:10.253029 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:10.267628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.270003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.270848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.271295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.582965 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:10.595560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:10.604269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e7c18d83-4d72-4c7c-b019-733d4c1ad98a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1539 microversion: 2.1 time: 0.383873 Jul 24 01:26:10.608283 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1901/3646] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:10 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1539 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:10.624734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:10.633435 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4fa32151-5a10-44bc-b8c6-5b15058645e6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.394074 Jul 24 01:26:10.646896 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1746/3647] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:10 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:10.889053 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:10.889806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:10.902969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.903426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.913170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.913761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.980207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:10.981309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:10.994198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.995205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:10.996407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:10.998989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:11.581405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:11.595555 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5af45345-e0de-43b3-9f05-3a6b3ac53298 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.719172 Jul 24 01:26:11.614585 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1902/3648] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:10 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:11.626034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-48682570-ec21-4ffc-a2bf-07d42494a1ae req-648bce84-bf6a-4d00-ac44-a6269f49e034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48bf29-3067-490d-86df-7d8258aac369", "name": "network-vif-unplugged", "status": "completed", "tag": "f554a1be-8a87-4df4-b910-86f58f1126fe"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:11.637414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-48682570-ec21-4ffc-a2bf-07d42494a1ae req-648bce84-bf6a-4d00-ac44-a6269f49e034 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:11.638463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-48682570-ec21-4ffc-a2bf-07d42494a1ae req-648bce84-bf6a-4d00-ac44-a6269f49e034 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:11.656638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-48682570-ec21-4ffc-a2bf-07d42494a1ae req-648bce84-bf6a-4d00-ac44-a6269f49e034 service nova] Creating event network-vif-unplugged:f554a1be-8a87-4df4-b910-86f58f1126fe for instance 9b48bf29-3067-490d-86df-7d8258aac369 on n-h1-master-1 Jul 24 01:26:11.663923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-48682570-ec21-4ffc-a2bf-07d42494a1ae req-648bce84-bf6a-4d00-ac44-a6269f49e034 service nova] Instance 9b48bf29-3067-490d-86df-7d8258aac369 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:26:11.673095 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-48682570-ec21-4ffc-a2bf-07d42494a1ae req-648bce84-bf6a-4d00-ac44-a6269f49e034 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056298 Jul 24 01:26:11.674402 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1903/3649] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:11.683059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:11.684065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:11.692257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:11.693649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:11.694710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:11.695324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:11.702561 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:12.280074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:12.320517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:12.323989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:12.325876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ae14817-6b4c-43e7-a08d-084b0b6afcfc tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1725 microversion: 2.20 time: 1.349972 Jul 24 01:26:12.338887 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1747/3650] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:10 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1725 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:12.350790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:12.352026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:12.366999 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:12.367470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:12.368373 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:12.368825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:12.645997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:12.670158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24553d83-1d9b-4a77-8d97-e5c5a9405695 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1539 microversion: 2.1 time: 0.988821 Jul 24 01:26:12.679962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1904/3651] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:11 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1539 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:12.685467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ee6820e6-2b34-4bcd-becd-37c9ea1fb426 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c219c0-0772-4311-8377-c711809fe718"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:12.686629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ee6820e6-2b34-4bcd-becd-37c9ea1fb426 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:12.700458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee6820e6-2b34-4bcd-becd-37c9ea1fb426 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:12.701573 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee6820e6-2b34-4bcd-becd-37c9ea1fb426 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:12.703382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee6820e6-2b34-4bcd-becd-37c9ea1fb426 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:12.704531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee6820e6-2b34-4bcd-becd-37c9ea1fb426 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.138800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:13.152828 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2932fa2a-6d7b-43b5-8b24-afb44f666a49 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.812813 Jul 24 01:26:13.155933 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1748/3652] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:12 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:13.170567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:13.173846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:13.195841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.197336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.200462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.201166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.225913 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ee6820e6-2b34-4bcd-becd-37c9ea1fb426 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.553502 Jul 24 01:26:13.226819 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1905/3653] 10.222.0.27 () {62 vars in 1363 bytes} [Sun Jul 24 01:26:12 2022] POST /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 188 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:26:13.240851 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:13.410316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-96780067-db07-467c-a3ec-9936df88e923 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:13.411413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-96780067-db07-467c-a3ec-9936df88e923 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:13.422590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96780067-db07-467c-a3ec-9936df88e923 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.423492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96780067-db07-467c-a3ec-9936df88e923 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.427193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96780067-db07-467c-a3ec-9936df88e923 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.428026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96780067-db07-467c-a3ec-9936df88e923 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.531108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:13.554334 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c21d5063-b0a9-4e92-bbc0-e7698f0687aa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.383990 Jul 24 01:26:13.561626 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1749/3654] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:13 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:13.689735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:13.690540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:13.701901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.702543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.703878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.705429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.804381 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-96780067-db07-467c-a3ec-9936df88e923 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/action" status: 202 len: 0 microversion: 2.20 time: 0.402445 Jul 24 01:26:13.809268 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1906/3655] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:26:13 2022] POST /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:26:13.823135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:13.824099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:13.839087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.839490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:13.840917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:13.841600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.334403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:14.345969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:14.347675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:14.348870 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7eb0b68d-0578-47a9-9ff3-3cfafd5ef3d2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1751 microversion: 2.20 time: 0.537761 Jul 24 01:26:14.361125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1907/3656] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:13 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1751 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:14.366512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:14.372504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:14.385208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.393357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.394232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.394853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.404635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:14.418295 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee98d383-b472-4708-8827-27108b833965 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1471 microversion: 2.1 time: 0.733011 Jul 24 01:26:14.418927 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1750/3657] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:13 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1471 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:14.575815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:14.577161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:14.584675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.585125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.585942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:14.596812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:14.611359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:14.622652 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e04fb20-1680-4a76-b14d-9fb1d76f48fa tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.259854 Jul 24 01:26:14.634249 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1908/3658] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:14 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:14.866537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:14.885919 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8eaf4939-004b-43d1-b6bf-9178d9e7f2bb tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.314668 Jul 24 01:26:14.887247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1751/3659] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:14 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:15.371304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:15.372014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:15.393226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:15.395355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:15.396806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:15.397500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:15.436344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:15.437109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:15.451451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:15.456735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:15.460269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:15.460879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:15.991976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:16.011685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:16.013701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:16.019920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c9b87935-ea88-45cd-b2ce-6a2199cd8236 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1751 microversion: 2.20 time: 0.655222 Jul 24 01:26:16.020612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1909/3660] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:15 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1751 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:16.032569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:16.035149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:16.057726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.060817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.065478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.066188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.104059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:16.132796 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e2999d4-5513-4bfd-90b1-4bd304466b9d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1468 microversion: 2.1 time: 0.701408 Jul 24 01:26:16.150277 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1752/3661] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:15 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1468 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:16.156025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:16.159832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:16.175648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.176416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.178129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.180573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.876521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:16.892631 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5419d012-6fae-4eef-88d1-e2a4119ca52b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.868071 Jul 24 01:26:16.893425 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1910/3662] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:16 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:16.906846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:16.918122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:16.938551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.939267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.946863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:16.947692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:16.967755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:16.984784 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-280f5d48-c702-4a69-bdc1-ff908fb9648e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.828838 Jul 24 01:26:16.987087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1753/3663] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:16 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:16.996093 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c8d4197d-f4b8-4fdc-87fb-754645d2045c req-b17fdbc6-658f-4a25-822d-7542544aa735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b442384-e51b-40a2-aa9e-86c1404f7da0", "name": "network-vif-plugged", "status": "completed", "tag": "9852d3b1-563c-4847-9ab9-41791450fbdb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:17.021985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c8d4197d-f4b8-4fdc-87fb-754645d2045c req-b17fdbc6-658f-4a25-822d-7542544aa735 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.026235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c8d4197d-f4b8-4fdc-87fb-754645d2045c req-b17fdbc6-658f-4a25-822d-7542544aa735 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.059485 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c8d4197d-f4b8-4fdc-87fb-754645d2045c req-b17fdbc6-658f-4a25-822d-7542544aa735 service nova] Creating event network-vif-plugged:9852d3b1-563c-4847-9ab9-41791450fbdb for instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 on n-h1-master-1 Jul 24 01:26:17.071710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.072351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.073257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.078152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.084691 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c8d4197d-f4b8-4fdc-87fb-754645d2045c req-b17fdbc6-658f-4a25-822d-7542544aa735 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094396 Jul 24 01:26:17.085589 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1754/3664] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:17.102453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:17.104133 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:17.128503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.129575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.131439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.134624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.169619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for project 74794638ee6a4b18aef9ff780d461b73. Resources: {'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:26:17.177504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for user 01e7c66073564bb0b78b2309d281d1f1 and project 74794638ee6a4b18aef9ff780d461b73. Resources: {'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:26:17.380293 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c002ead9-4715-4acd-a1e6-85544a005340 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369/action" status: 202 len: 0 microversion: 2.1 time: 0.485191 Jul 24 01:26:17.384696 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1911/3665] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:26:16 2022] POST /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:26:17.394402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:17.395132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:17.409182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.409647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.414910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.415410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.748562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:17.761029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:17.767744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:17.771013 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18efeb9d-857c-495d-ad49-0c99198d5ae2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1753 microversion: 2.20 time: 0.682189 Jul 24 01:26:17.771599 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1755/3666] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:17 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1753 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:17.912578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:17.913531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:17.925549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.927697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:17.928759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:17.932737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:18.504222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:18.515354 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-383980d5-3df0-423c-9b7e-ea67ff365173 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1467 microversion: 2.1 time: 1.128968 Jul 24 01:26:18.517985 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1912/3667] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:17 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1467 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:18.531910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:18.533043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:18.548793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:18.550608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:18.552669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:18.554832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:18.574809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:18.589134 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23a645d2-0768-4fbd-b1a6-26cff6f9a7e3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1370 microversion: 2.1 time: 0.676337 Jul 24 01:26:18.593195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1756/3668] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:17 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1370 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:18.793738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:18.794491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:18.812563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:18.813594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:18.814681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:18.815403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:19.240023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:19.255696 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c6da8cc-519a-4a73-a2c3-dbb99057329b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.735044 Jul 24 01:26:19.259670 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1913/3669] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:18 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:19.545816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:19.546445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:19.555277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:19.562589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:19.563720 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:19.567822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:19.620408 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:19.820923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:19.850145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:19.853920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:19.869216 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0a7261d7-36fe-4b11-bccf-ad174830c682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1753 microversion: 2.20 time: 1.079693 Jul 24 01:26:19.875680 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1757/3670] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:18 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1753 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:19.900388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:19.904543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:19.925960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:19.934008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:19.935565 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:19.939058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:20.325319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:20.341919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46554b02-d2aa-4422-9aab-4752be582895 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1467 microversion: 2.1 time: 0.802299 Jul 24 01:26:20.342799 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1914/3671] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:19 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1467 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:20.357413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:20.358086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:20.386198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:20.386724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:20.392064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:20.392554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:21.458290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:21.472213 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e6eac32-c5e3-4c65-934b-0ef5e5571974 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1564 microversion: 2.1 time: 1.594492 Jul 24 01:26:21.478442 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1758/3672] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:19 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1564 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:21.486052 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e6b912c1-194a-40ec-92a9-9c4e8a539896 req-b0a2a868-3406-4a4a-bd38-382990e0c218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48bf29-3067-490d-86df-7d8258aac369", "name": "network-vif-plugged", "status": "completed", "tag": "f554a1be-8a87-4df4-b910-86f58f1126fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:21.499253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e6b912c1-194a-40ec-92a9-9c4e8a539896 req-b0a2a868-3406-4a4a-bd38-382990e0c218 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:21.499914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e6b912c1-194a-40ec-92a9-9c4e8a539896 req-b0a2a868-3406-4a4a-bd38-382990e0c218 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:21.527972 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e6b912c1-194a-40ec-92a9-9c4e8a539896 req-b0a2a868-3406-4a4a-bd38-382990e0c218 service nova] Creating event network-vif-plugged:f554a1be-8a87-4df4-b910-86f58f1126fe for instance 9b48bf29-3067-490d-86df-7d8258aac369 on n-h1-master-1 Jul 24 01:26:21.544964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-e6b912c1-194a-40ec-92a9-9c4e8a539896 req-b0a2a868-3406-4a4a-bd38-382990e0c218 service nova] Instance 9b48bf29-3067-490d-86df-7d8258aac369 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:26:21.574674 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e6b912c1-194a-40ec-92a9-9c4e8a539896 req-b0a2a868-3406-4a4a-bd38-382990e0c218 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094526 Jul 24 01:26:21.580264 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1759/3673] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:21.601292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:21.603448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:21.621720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:21.622205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:21.624068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:21.624737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:21.833081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:21.847096 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c8a32a1-7771-40d3-a07a-e1af6b216d35 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 1.502857 Jul 24 01:26:21.847720 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1915/3674] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:20 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:21.862558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:21.866468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:21.909278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:21.919095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:21.920655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:21.921616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:22.327633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:22.337328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:22.349560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:22.350979 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f0d3de26-f4c6-4f9c-beb8-5dee7e27d4f4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1753 microversion: 2.20 time: 0.769399 Jul 24 01:26:22.366089 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1760/3675] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:21 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1753 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:22.376330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-40bf0b95-5ab1-4133-8c74-ef8ce50b4ff6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:22.377127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-40bf0b95-5ab1-4133-8c74-ef8ce50b4ff6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:22.392586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bf0b95-5ab1-4133-8c74-ef8ce50b4ff6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:22.394060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bf0b95-5ab1-4133-8c74-ef8ce50b4ff6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:22.397325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bf0b95-5ab1-4133-8c74-ef8ce50b4ff6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:22.398239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40bf0b95-5ab1-4133-8c74-ef8ce50b4ff6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:22.542244 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-40bf0b95-5ab1-4133-8c74-ef8ce50b4ff6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174733 Jul 24 01:26:22.545900 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1761/3676] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:26:22 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:22.564262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:22.580118 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a0a16f2f-e067-4f11-b8e5-2239b57faa93 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1467 microversion: 2.1 time: 0.731318 Jul 24 01:26:22.580966 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1916/3677] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:21 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1467 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:22.871333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:22.871966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:22.892084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:22.892901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:22.893958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:22.894575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:23.387591 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:23.388268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:23.390390 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:23.406020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:23.406806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:23.407614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:23.408063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:23.482870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:23.507980 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1697d260-4171-4259-9fa2-8adb9b238930 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 0.638119 Jul 24 01:26:23.507980 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1762/3678] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:22 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:23.608827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:23.610269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:23.641389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:23.644031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:23.650659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:23.653000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:24.322619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:24.339777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:24.341291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:24.342518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cfc64ffd-8458-404f-803f-950d92e42dcf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1753 microversion: 2.20 time: 0.960310 Jul 24 01:26:24.343082 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1917/3679] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:23 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1753 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:26:24.648298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:24.659635 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-babf3d16-7d16-4b4f-a266-8e84f5889d75 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1467 microversion: 2.1 time: 1.065478 Jul 24 01:26:24.663940 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1763/3680] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:23 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1467 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:24.674925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:24.678843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:24.693540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:24.698161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:24.699540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:24.706080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:24.866047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eca1216b-fbbf-48ef-a0d1-345090c96757 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Action: 'create', calling method: .version_select at 0x7f05eae70310>, body: {"pool": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:25.917071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:25.933416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ee8ad4d-6fa3-470d-8272-1311fef07ad5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1511 microversion: 2.1 time: 1.267842 Jul 24 01:26:25.935724 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1764/3681] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:24 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1511 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:25.948555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:25.949758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:25.957836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:25.960180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:25.962683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:25.963562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:26.552638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:26.574718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:26.576900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:26.578488 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8fea4ebc-6366-40d0-81d9-4101f42cc24b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.641598 Jul 24 01:26:26.580056 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1765/3682] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:25 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:26.587461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:26.588526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:26.597265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:26.598287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:26.600602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:26.601551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:27.145990 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:28.079441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:28.087131 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ea410ca-a55a-401f-8a1c-c50ef23592f9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1533 microversion: 2.1 time: 1.505718 Jul 24 01:26:28.087833 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1766/3683] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:26 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1533 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:28.105699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e0e25f1c-604e-4ae0-a651-42a16fe1ed41 req-9627f479-cdea-429b-b6cb-d876a076eb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48bf29-3067-490d-86df-7d8258aac369", "name": "network-vif-unplugged", "status": "completed", "tag": "f554a1be-8a87-4df4-b910-86f58f1126fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:28.130543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e0e25f1c-604e-4ae0-a651-42a16fe1ed41 req-9627f479-cdea-429b-b6cb-d876a076eb1e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:28.134425 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e0e25f1c-604e-4ae0-a651-42a16fe1ed41 req-9627f479-cdea-429b-b6cb-d876a076eb1e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:28.160486 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e0e25f1c-604e-4ae0-a651-42a16fe1ed41 req-9627f479-cdea-429b-b6cb-d876a076eb1e service nova] Creating event network-vif-unplugged:f554a1be-8a87-4df4-b910-86f58f1126fe for instance 9b48bf29-3067-490d-86df-7d8258aac369 on n-h1-master-1 Jul 24 01:26:28.177765 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e0e25f1c-604e-4ae0-a651-42a16fe1ed41 req-9627f479-cdea-429b-b6cb-d876a076eb1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074793 Jul 24 01:26:28.182887 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1767/3684] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:28.204003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:28.204726 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:28.219177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:28.219632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:28.220420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:28.220865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:28.225425 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:28.943656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:28.988183 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5f9f1b59-caa4-4aa0-9f49-b9346273c686 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1488 microversion: 2.1 time: 0.803736 Jul 24 01:26:28.997218 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1768/3685] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:28 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1488 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:29.009703 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c584b44f-3b2f-4be5-92a6-77641222afac req-251a92a9-6c24-4e35-b751-4b64a73692b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b442384-e51b-40a2-aa9e-86c1404f7da0", "tag": "9852d3b1-563c-4847-9ab9-41791450fbdb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:29.036058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c584b44f-3b2f-4be5-92a6-77641222afac req-251a92a9-6c24-4e35-b751-4b64a73692b6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:29.036516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c584b44f-3b2f-4be5-92a6-77641222afac req-251a92a9-6c24-4e35-b751-4b64a73692b6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:29.057591 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c584b44f-3b2f-4be5-92a6-77641222afac req-251a92a9-6c24-4e35-b751-4b64a73692b6 service nova] Creating event network-changed:9852d3b1-563c-4847-9ab9-41791450fbdb for instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 on n-h1-master-1 Jul 24 01:26:29.071466 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c584b44f-3b2f-4be5-92a6-77641222afac req-251a92a9-6c24-4e35-b751-4b64a73692b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069352 Jul 24 01:26:29.072888 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1769/3686] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:29.087787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:29.089823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:29.106764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:29.110323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:29.111182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:29.111671 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:29.903996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:29.914245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:29.916207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:29.917836 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1f41b0a-46de-49ef-8933-282486faf5ca tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.843544 Jul 24 01:26:29.918646 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1770/3687] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:29 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:30.262752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:30.263249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:30.269697 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:30.273441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:30.275809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:30.277116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:30.277569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:30.334627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:26:30.455370 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff9f31e7-d262-4f94-afd1-5893d41b661a tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 204 len: 0 microversion: 2.42 time: 0.535000 Jul 24 01:26:30.458287 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1771/3688] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:26:29 2022] DELETE /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:26:30.466006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-781abcd4-dd6b-4ce7-a336-65b25ac422ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1252880002"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:30.468383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-781abcd4-dd6b-4ce7-a336-65b25ac422ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:30.478823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-781abcd4-dd6b-4ce7-a336-65b25ac422ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:30.479696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-781abcd4-dd6b-4ce7-a336-65b25ac422ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:30.480780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-781abcd4-dd6b-4ce7-a336-65b25ac422ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:30.481793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-781abcd4-dd6b-4ce7-a336-65b25ac422ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:30.581006 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-781abcd4-dd6b-4ce7-a336-65b25ac422ea tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "PUT /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1061 microversion: 2.1 time: 0.122731 Jul 24 01:26:30.582416 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1772/3689] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:26:30 2022] PUT /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1061 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:30.589216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:30.590172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:30.599173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:30.600254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:30.601425 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:30.602914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:31.034890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:31.046832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6500aec1-8588-4ebc-9e18-72086d64327b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1526 microversion: 2.1 time: 0.463037 Jul 24 01:26:31.052334 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1773/3690] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:30 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1526 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:31.065735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:31.066561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:31.087595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:31.088352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:31.089179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:31.089739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:31.861659 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eca1216b-fbbf-48ef-a0d1-345090c96757 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.496287 Jul 24 01:26:31.862886 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1918/3691] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:26:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:31.869349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:31.870802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:31.881399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:31.894857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:31.895457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:31.900735 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:31.901232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:31.903750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:31.905287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:31.908220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-febf6fda-f1cb-4222-ae60-7848134197a0 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2956 microversion: 2.42 time: 0.853128 Jul 24 01:26:31.919478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1774/3692] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:31 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2956 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:31.924544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1a46fd92-6254-43c5-8258-064c3a20a278 req-549821d2-1356-47dd-8b07-11755252cc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48bf29-3067-490d-86df-7d8258aac369", "name": "network-vif-plugged", "status": "completed", "tag": "f554a1be-8a87-4df4-b910-86f58f1126fe"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:31.946871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1a46fd92-6254-43c5-8258-064c3a20a278 req-549821d2-1356-47dd-8b07-11755252cc3a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:31.949267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1a46fd92-6254-43c5-8258-064c3a20a278 req-549821d2-1356-47dd-8b07-11755252cc3a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:31.998126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1a46fd92-6254-43c5-8258-064c3a20a278 req-549821d2-1356-47dd-8b07-11755252cc3a service nova] Creating event network-vif-plugged:f554a1be-8a87-4df4-b910-86f58f1126fe for instance 9b48bf29-3067-490d-86df-7d8258aac369 on n-h1-master-1 Jul 24 01:26:32.011732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1a46fd92-6254-43c5-8258-064c3a20a278 req-549821d2-1356-47dd-8b07-11755252cc3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090668 Jul 24 01:26:32.013769 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1775/3693] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:32.020126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:32.021035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:32.029597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:32.030389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:32.031359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:32.031972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:32.323558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:32.335067 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2888022-7f47-47fe-a1b6-af7968eb4c65 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1488 microversion: 2.1 time: 0.470889 Jul 24 01:26:32.339137 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1919/3694] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:31 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1488 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:32.356717 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:32.357342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:32.364507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:32.364967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:32.365783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:32.366231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:32.369596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:32.384586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:32.387750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:32.390570 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-71b9d4af-2311-4db6-8e48-2e3f9677a366 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.375391 Jul 24 01:26:32.391649 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1776/3695] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:32 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:32.399415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-40a549df-b2ac-4025-82d8-2400b3ef0f94 req-2caaee92-6985-45ca-8795-f200453e241a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:32.417662 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-40a549df-b2ac-4025-82d8-2400b3ef0f94 req-2caaee92-6985-45ca-8795-f200453e241a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:32.418371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-40a549df-b2ac-4025-82d8-2400b3ef0f94 req-2caaee92-6985-45ca-8795-f200453e241a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:32.443523 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-40a549df-b2ac-4025-82d8-2400b3ef0f94 req-2caaee92-6985-45ca-8795-f200453e241a service nova] Creating event network-changed:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h2-master-1 Jul 24 01:26:32.451686 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-40a549df-b2ac-4025-82d8-2400b3ef0f94 req-2caaee92-6985-45ca-8795-f200453e241a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057773 Jul 24 01:26:32.452965 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1777/3696] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:32.459735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2584afb-d385-4736-a037-59f76725ac5c tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Calling method '.version_select at 0x7f05ea42d820>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:32.900494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:32.917252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b3dc746c-a8be-49f6-ba88-e0a8e3415b1a tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1526 microversion: 2.1 time: 0.577019 Jul 24 01:26:32.917875 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1920/3697] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:32 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1526 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:32.935779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:32.936802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:32.943396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:32.944152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:32.945138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:32.946567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:33.281510 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2584afb-d385-4736-a037-59f76725ac5c tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/2a7039af-eeae-411f-b00f-c7b7eeb214d4" status: 200 len: 141 microversion: 2.1 time: 0.827092 Jul 24 01:26:33.282139 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1778/3698] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:26:32 2022] GET /compute/v2.1/os-floating-ips/2a7039af-eeae-411f-b00f-c7b7eeb214d4 => generated 141 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:33.288867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2d92ea3-36f6-4ad1-ba97-01a814fe5c1c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:33.288867 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:26:33.288867 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:26:33.294241 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-e2d92ea3-36f6-4ad1-ba97-01a814fe5c1c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] HTTP exception thrown: Flavor 46684bda-5be4-4b32-965e-4d32a77ef0e4 could not be found. Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2d92ea3-36f6-4ad1-ba97-01a814fe5c1c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Request method failure captured: Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/flavors/46684bda-5be4-4b32-965e-4d32a77ef0e4 HTTP/1.1 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8Cc2hnFDKyQ4hb7nc6DhDmIuTq4vDN0TO9jRlWD-heGIGM5_Dwn1aIrdpWIPIvPcvFC2R8lYCP4WhLIMY6taJ-WGBrfUIBw9kzVXj1vWU_Ogq7dj3xnD3yqwSxchlYp_xo0fJJhqDYZsxrKd3_siHFqR1aofVLywMloYolq1qLvhk Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 4343432978b644a286aa3cf937ba8320 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-MigrationsAdminTest-1581228377 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4343432978b644a286aa3cf937ba8320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4343432978b644a286aa3cf937ba8320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4343432978b644a286aa3cf937ba8320", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4343432978b644a286aa3cf937ba8320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-MigrationsAdminTest-1581228377 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 4343432978b644a286aa3cf937ba8320 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-MigrationsAdminTest-1581228377 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-MigrationsAdminTest-1581228377-project-admin Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f05b985e50f44940b352b6148fc10763 Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-MigrationsAdminTest-1581228377-project-admin Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: exception: Flavor 46684bda-5be4-4b32-965e-4d32a77ef0e4 could not be found. Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '46684bda-5be4-4b32-965e-4d32a77ef0e4'} Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 46684bda-5be4-4b32-965e-4d32a77ef0e4 could not be found. Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 46684bda-5be4-4b32-965e-4d32a77ef0e4 could not be found. Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:33.302811 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 46684bda-5be4-4b32-965e-4d32a77ef0e4 could not be found. Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2d92ea3-36f6-4ad1-ba97-01a814fe5c1c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Returning 404 to user: Flavor 46684bda-5be4-4b32-965e-4d32a77ef0e4 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e2d92ea3-36f6-4ad1-ba97-01a814fe5c1c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/46684bda-5be4-4b32-965e-4d32a77ef0e4" status: 404 len: 109 microversion: 2.1 time: 0.021501 Jul 24 01:26:33.310661 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1779/3699] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:33 2022] DELETE /compute/v2.1/flavors/46684bda-5be4-4b32-965e-4d32a77ef0e4 => generated 109 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:33.312535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:33.312944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:33.331172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:33.331638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:33.332522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:33.333165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:33.586606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:33.598595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff125ce8-9424-4fc9-bbf4-9bf183db743e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1488 microversion: 2.1 time: 0.669470 Jul 24 01:26:33.599359 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1921/3700] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:32 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1488 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:33.607663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16ca1f86-f8c3-4833-a3df-3011b024814c tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Calling method '.version_select at 0x7f05eae70700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:33.989392 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16ca1f86-f8c3-4833-a3df-3011b024814c tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.385148 Jul 24 01:26:33.990169 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1922/3701] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:26:33 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:33.996433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:33.996567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:34.006291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:34.017881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:34.018711 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:34.019864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:34.020577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:34.023262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:34.024974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:34.034592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-db094d2c-3e50-4fc2-8882-1688580db0e9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2956 microversion: 2.42 time: 0.727242 Jul 24 01:26:34.035299 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1780/3702] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:33 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2956 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:34.047441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-908674264", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:34.155614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:26:35.147955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:35.171257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:35.179805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:35.182564 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5330d258-48a5-4c42-8dae-552743f45621 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 1.191269 Jul 24 01:26:35.184126 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1923/3703] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:33 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:35.194604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:35.195492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:35.235019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:35.235976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:35.237184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:35.238161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:35.242375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:26:35.242948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:26:35.243411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:26:35.243858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:26:35.244269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:26:35.269000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:35.271133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:35.272572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:35.273253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:35.294208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:26:35.316989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:26:35.335569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Getting quotas for user 01e7c66073564bb0b78b2309d281d1f1 and project 74794638ee6a4b18aef9ff780d461b73. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:26:35.376551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:26:35.384992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:26:35.475216 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8ae4158-a15d-4d51-a550-f0c32b760b3d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 204 len: 0 microversion: 2.1 time: 0.289365 Jul 24 01:26:35.478166 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1924/3704] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:35 2022] DELETE /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:26:35.486650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1914ec8-fd91-47b7-adc5-2e2e08898e4a tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Calling method '.version_select at 0x7f05ea035160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:35.519541 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9704b58b-dfde-42e4-a2f8-3da7717857c1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482656 Jul 24 01:26:35.520477 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1781/3705] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:26:35.535823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:35.537074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:35.568323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:35.569150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:35.570200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:35.570918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:36.198717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:36.209379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:36.212713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:36.214149 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-473b9ae1-98d2-4359-8397-cdf37c55d4bc tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2956 microversion: 2.42 time: 0.692548 Jul 24 01:26:36.214797 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1782/3706] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:35 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2956 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:36.224081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:36.224698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:36.234612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:36.235070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:36.235854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:36.236482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:36.956352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:36.971793 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6cb84fe6-f1fd-4f19-befa-f224615c0e12 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1494 microversion: 2.1 time: 0.755633 Jul 24 01:26:36.983541 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1783/3707] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:36 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1494 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:36.997887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:36.998924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:37.016911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:37.017698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:37.019678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:37.021519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:37.152992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:37.162429 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-efbf05ee-4a8f-4821-a1b3-beec4f4e4811 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1216 microversion: 2.1 time: 0.177410 Jul 24 01:26:37.173045 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1784/3708] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:36 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:37.180938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:37.181626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:37.198876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:37.199560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:37.200424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:37.202243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:37.907320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:37.927434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:37.936978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:37.944811 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0659ae44-cc74-4c4c-b055-4d344463e0b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.770583 Jul 24 01:26:37.965138 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1785/3709] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:37 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:37.986290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:37.996037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:38.024111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:38.025417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:38.029009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:38.029791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:39.312133 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1914ec8-fd91-47b7-adc5-2e2e08898e4a tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/2a7039af-eeae-411f-b00f-c7b7eeb214d4" status: 202 len: 0 microversion: 2.1 time: 3.832138 Jul 24 01:26:39.318903 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1925/3710] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:26:35 2022] DELETE /compute/v2.1/os-floating-ips/2a7039af-eeae-411f-b00f-c7b7eeb214d4 => generated 0 bytes in 3835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:26:39.325555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:39.326892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:39.344319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:39.347559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:39.350478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:39.351125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:39.688811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:39.705079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:39.713905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:39.718290 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ff8fd1e-5040-4177-bbc4-6dd2f678257d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2914 microversion: 2.42 time: 1.750909 Jul 24 01:26:39.723252 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1786/3711] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:37 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2914 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:39.761083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:39.766625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:39.795926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:39.809190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:39.815350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:39.816588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:39.910967 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:40.028885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:40.041351 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f68ffb0-cf71-4aab-bf8c-48694d090889 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1494 microversion: 2.1 time: 0.726402 Jul 24 01:26:40.043498 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1926/3712] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:39 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1494 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:40.057731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1b6e4557-2a3b-4fb9-bc4d-2c96dd3cdeaa req-992ed5ec-54d7-4497-bfa2-59fc6b77ed8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:40.082843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1b6e4557-2a3b-4fb9-bc4d-2c96dd3cdeaa req-992ed5ec-54d7-4497-bfa2-59fc6b77ed8d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:40.084554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1b6e4557-2a3b-4fb9-bc4d-2c96dd3cdeaa req-992ed5ec-54d7-4497-bfa2-59fc6b77ed8d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:40.123357 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1b6e4557-2a3b-4fb9-bc4d-2c96dd3cdeaa req-992ed5ec-54d7-4497-bfa2-59fc6b77ed8d service nova] Creating event network-vif-unplugged:2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:40.149717 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1b6e4557-2a3b-4fb9-bc4d-2c96dd3cdeaa req-992ed5ec-54d7-4497-bfa2-59fc6b77ed8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099186 Jul 24 01:26:40.152039 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1927/3713] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:40.171420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:40.175056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:40.201538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:40.203486 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:40.205356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:40.208731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:40.240299 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:40.260909 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0529abf5-24e4-4428-a5d9-c2c366cb67b2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1264 microversion: 2.1 time: 0.525480 Jul 24 01:26:40.264205 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1787/3714] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:39 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1264 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:40.282523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-22192570-3a9c-45c8-b876-f77a3f4bd834 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Action: 'create', calling method: .version_select at 0x7f05eacfcb80>, body: {"pool": null} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:41.399364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:41.422772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:41.432659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:41.443119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-730767b1-ac2d-4ddc-8c63-962db2561f29 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 1.289323 Jul 24 01:26:41.452474 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1928/3715] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:40 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:41.468050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:41.468785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:41.479076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:41.479930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:41.483124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:41.483863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:41.952574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:41.963690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:41.975733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:41.977463 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7877c2be-95c7-41f6-aaac-baf942acf856 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2868 microversion: 2.42 time: 0.523681 Jul 24 01:26:41.978208 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1929/3716] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:41 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2868 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:42.011624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:42.012717 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:42.026025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:42.030921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:42.032204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:42.040659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:42.924091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:42.936203 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d8060df-8880-479c-833b-4589daf9b4a6 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 200 len: 1494 microversion: 2.1 time: 0.944148 Jul 24 01:26:42.944270 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1930/3717] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:41 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 1494 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:42.954367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a70a48ae-7bf1-48e9-b6c5-1353ef2b9616 req-905a53f7-9895-47db-99b5-2d73f299b669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-deleted", "tag": "b191e26a-3767-42da-a129-49e4941782bf"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:42.970089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a70a48ae-7bf1-48e9-b6c5-1353ef2b9616 req-905a53f7-9895-47db-99b5-2d73f299b669 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:42.971016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a70a48ae-7bf1-48e9-b6c5-1353ef2b9616 req-905a53f7-9895-47db-99b5-2d73f299b669 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:42.995906 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a70a48ae-7bf1-48e9-b6c5-1353ef2b9616 req-905a53f7-9895-47db-99b5-2d73f299b669 service nova] Creating event network-vif-deleted:b191e26a-3767-42da-a129-49e4941782bf for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:43.009275 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a70a48ae-7bf1-48e9-b6c5-1353ef2b9616 req-905a53f7-9895-47db-99b5-2d73f299b669 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062151 Jul 24 01:26:43.011059 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1931/3718] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:43.021935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:43.023006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:43.036118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:43.037286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:43.041090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:43.042582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:43.419571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:43.446921 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7afeac52-1e9c-4609-9b14-a75db03c370f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1270 microversion: 2.1 time: 0.430097 Jul 24 01:26:43.448984 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1932/3719] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:43 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1270 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:43.467108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:43.469472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:43.487596 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:43.489777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:43.494432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:43.495213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:43.535098 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:43.904246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:43.925164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:43.929359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:43.934993 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a7c44c1-5b6d-4bc5-986c-a4af89753017 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.483203 Jul 24 01:26:43.935873 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1933/3720] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:43 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:43.958235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "b191e26a-3767-42da-a129-49e4941782bf"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "a25f1481-9636-49b6-a9f4-4b944673adff"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "9894718f-24b7-4560-8bf6-ac8c173245f5"}, {"server_uuid": "21239a08-0dcd-4ddf-b582-99b246ba83a5", "name": "network-vif-unplugged", "status": "completed", "tag": "a90e19e9-9dda-4eef-8231-2d684d5ac8c7"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "8db72927-4ceb-4d2a-8c5d-12b5eaec48d0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:43.989506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:43.990324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:44.026082 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Creating event network-vif-unplugged:b191e26a-3767-42da-a129-49e4941782bf for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:44.026552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Creating event network-vif-unplugged:a25f1481-9636-49b6-a9f4-4b944673adff for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:44.032297 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Creating event network-vif-unplugged:9894718f-24b7-4560-8bf6-ac8c173245f5 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:44.033102 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Creating event network-vif-unplugged:a90e19e9-9dda-4eef-8231-2d684d5ac8c7 for instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 on n-h2-master-1 Jul 24 01:26:44.033858 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] Creating event network-vif-unplugged:8db72927-4ceb-4d2a-8c5d-12b5eaec48d0 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:44.053312 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cc9af2e7-f830-4db0-a8de-56db420f3414 req-eff4f1c5-e33d-4f67-9da4-fef249d4e747 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.105182 Jul 24 01:26:44.056260 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1934/3721] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:44.072061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:44.074625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:44.092363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:44.098322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:44.100837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:44.102733 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:44.823827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:44.852792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:44.854981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:44.865412 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1922f61f-b7de-4c81-b3ab-810d7e6cf0e8 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2662 microversion: 2.42 time: 0.807733 Jul 24 01:26:44.868231 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1935/3722] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:44 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2662 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:44.882561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d64277a2-0e02-45d3-9f27-e23081b82837 req-bfe22d10-f164-457b-bd1c-72311948d35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21239a08-0dcd-4ddf-b582-99b246ba83a5", "name": "network-vif-deleted", "tag": "a90e19e9-9dda-4eef-8231-2d684d5ac8c7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:44.909896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d64277a2-0e02-45d3-9f27-e23081b82837 req-bfe22d10-f164-457b-bd1c-72311948d35c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:44.916726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d64277a2-0e02-45d3-9f27-e23081b82837 req-bfe22d10-f164-457b-bd1c-72311948d35c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:44.975761 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d64277a2-0e02-45d3-9f27-e23081b82837 req-bfe22d10-f164-457b-bd1c-72311948d35c service nova] Creating event network-vif-deleted:a90e19e9-9dda-4eef-8231-2d684d5ac8c7 for instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 on n-h2-master-1 Jul 24 01:26:44.997593 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d64277a2-0e02-45d3-9f27-e23081b82837 req-bfe22d10-f164-457b-bd1c-72311948d35c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126159 Jul 24 01:26:45.010034 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1936/3723] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:45.026352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:45.031001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:45.051226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.054734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.056472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.057165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.094416 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 HTTP/1.1 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '21239a08-0dcd-4ddf-b582-99b246ba83a5'} Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.096491 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.101194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:45.101194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:45.101194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:45.101194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:45.101194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.101194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.104509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:45.106577 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c9d8f792-229a-49a2-8b37-0ac0b12e2d5e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 404 len: 111 microversion: 2.1 time: 0.092938 Jul 24 01:26:45.108370 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1937/3724] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:45 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:45.127525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:45.128926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:45.139844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.140461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.142129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.142939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.295444 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:45.344223 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-22192570-3a9c-45c8-b876-f77a3f4bd834 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.078675 Jul 24 01:26:45.345047 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1788/3725] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:26:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:45.350713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:45.351399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:45.364804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.371666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.372534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.373242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.374041 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:45.608726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:45.624200 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ecbf75e3-6816-49a4-a8bb-599cfaeca531 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.514452 Jul 24 01:26:45.625105 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1938/3726] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:45 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:45.641149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b9915c9e-c5d2-4b8e-aa11-462090cdeac1 req-61cd9dff-0d4c-4c6c-b972-a72a9c08e5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-deleted", "tag": "8db72927-4ceb-4d2a-8c5d-12b5eaec48d0"}, {"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-deleted", "tag": "9894718f-24b7-4560-8bf6-ac8c173245f5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:45.660348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b9915c9e-c5d2-4b8e-aa11-462090cdeac1 req-61cd9dff-0d4c-4c6c-b972-a72a9c08e5b3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.663294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b9915c9e-c5d2-4b8e-aa11-462090cdeac1 req-61cd9dff-0d4c-4c6c-b972-a72a9c08e5b3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.706302 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b9915c9e-c5d2-4b8e-aa11-462090cdeac1 req-61cd9dff-0d4c-4c6c-b972-a72a9c08e5b3 service nova] Creating event network-vif-deleted:8db72927-4ceb-4d2a-8c5d-12b5eaec48d0 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:45.707295 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b9915c9e-c5d2-4b8e-aa11-462090cdeac1 req-61cd9dff-0d4c-4c6c-b972-a72a9c08e5b3 service nova] Creating event network-vif-deleted:9894718f-24b7-4560-8bf6-ac8c173245f5 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:45.726622 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b9915c9e-c5d2-4b8e-aa11-462090cdeac1 req-61cd9dff-0d4c-4c6c-b972-a72a9c08e5b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097511 Jul 24 01:26:45.728025 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1939/3727] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:45.734237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:45.734965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:45.743212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.743810 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.744763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.745323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.765724 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 HTTP/1.1 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '21239a08-0dcd-4ddf-b582-99b246ba83a5'} Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:45.768359 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.775085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:45.776123 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6dc99e08-6bac-4027-a544-535ed68174dc tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 404 len: 111 microversion: 2.1 time: 0.044167 Jul 24 01:26:45.777038 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1940/3728] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:45 2022] DELETE /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:45.784305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16afc3c4-ea66-4ce4-b468-4a6c1f90d14c tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Calling method '.version_select at 0x7f05e9ff5ee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:45.835578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:45.846792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:45.848409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:45.865828 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a7cf4565-867d-4c2a-875b-770aab5db432 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.503469 Jul 24 01:26:45.867031 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1789/3729] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:45 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:45.890046 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:45.891013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 21239a08-0dcd-4ddf-b582-99b246ba83a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:45.910553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.911285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.914537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:45.922387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:45.960257 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 HTTP/1.1 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '21239a08-0dcd-4ddf-b582-99b246ba83a5'} Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.968395 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:45.973989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:45.973989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:45.973989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:45.973989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:45.973989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. Jul 24 01:26:45.973989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:45.987237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 21239a08-0dcd-4ddf-b582-99b246ba83a5 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:45.988158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3377130d-a2bc-4d8c-bee5-759d08284cfa tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5" status: 404 len: 111 microversion: 2.1 time: 0.114810 Jul 24 01:26:45.988760 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1790/3730] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:45 2022] GET /compute/v2.1/servers/21239a08-0dcd-4ddf-b582-99b246ba83a5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:46.009588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:46.021818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:46.039519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:46.046250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:46.056174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:46.056905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:46.636142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:46.653593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:46.662078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:46.666843 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-303b7433-2718-4d62-aa81-f1203b4f84ee tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2391 microversion: 2.42 time: 0.670297 Jul 24 01:26:46.668764 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1791/3731] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:45 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2391 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:46.683776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:46.684626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:46.698475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:46.706943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:46.708306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:46.709309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:46.732937 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee HTTP/1.1 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '13e67bd6-1544-4fdb-b71d-e66168f06cee'} Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:46.744077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:46.750249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:46.754159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:46.756155 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f935aff-33c8-425e-9fdd-03c8108c2a9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 404 len: 111 microversion: 2.1 time: 0.085505 Jul 24 01:26:46.761465 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1792/3732] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:46 2022] DELETE /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:46.777423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:46.778641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:46.792057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:46.793469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:46.794864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:46.795607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.017556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:47.033255 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd60d109-2426-4a5d-a548-73a5e02bcb98 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.269969 Jul 24 01:26:47.044449 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1793/3733] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:46 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:47.057068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.058042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 13e67bd6-1544-4fdb-b71d-e66168f06cee] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.078798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.080373 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.081558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.082316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.108813 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee HTTP/1.1 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '13e67bd6-1544-4fdb-b71d-e66168f06cee'} Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.113019 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.120560 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.120560 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.120560 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.120560 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.120560 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. Jul 24 01:26:47.120560 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.124305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 13e67bd6-1544-4fdb-b71d-e66168f06cee could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.126003 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e0454c65-e14d-4263-87ce-51a8b91f6ea9 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee" status: 404 len: 111 microversion: 2.1 time: 0.074094 Jul 24 01:26:47.127079 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1794/3734] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:47 2022] GET /compute/v2.1/servers/13e67bd6-1544-4fdb-b71d-e66168f06cee => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.147334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.158402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.173634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.174500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.179966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.183568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.194649 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16afc3c4-ea66-4ce4-b468-4a6c1f90d14c tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62" status: 202 len: 0 microversion: 2.1 time: 1.416126 Jul 24 01:26:47.195970 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1941/3735] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:26:45 2022] DELETE /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62 => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:26:47.201523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.202295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.214685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.215446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.216900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.219363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.239511 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 HTTP/1.1 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '850584c7-6e80-493a-a68f-997723d8da09'} Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.249077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.254925 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.258845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.260015 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32349938-d0c0-4d0a-86de-128e2d1a9849 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 404 len: 111 microversion: 2.1 time: 0.062859 Jul 24 01:26:47.265400 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1942/3736] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:47 2022] DELETE /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.272372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8b3235a4-f059-42c5-8e0c-815a8f5ee530 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Calling method '.version_select at 0x7f05eae70a60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.366892 n-d-master-1 devstack@n-api.service[119561]: DEBUG neutronclient.v2_0.client [None req-8b3235a4-f059-42c5-8e0c-815a8f5ee530 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e19df3df-78a7-4dd5-8aba-807ea6145d62 could not be found", "detail": ""}} {{(pid=119561) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:26:47.368131 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-8b3235a4-f059-42c5-8e0c-815a8f5ee530 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] HTTP exception thrown: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8b3235a4-f059-42c5-8e0c-815a8f5ee530 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Request method failure captured: Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62 HTTP/1.1 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J-_whT4oG2Ra13JoNMWwMGsWKSiR4zX3xDfyVd5b09D9r0G5wVrYNsrAn5Z32gitk2HmvcAkxEDFUzhd9p4TaQtOEtth9za5PXdHHXQP8SzhQvN2yEDvXlS34-KPa2S80rYC-VOABAVTKoCueTB2Y_O9rt1AVzN1HceediJYH_eTQc Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a253ae01d6d8460abe1126aec263b625 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-FloatingIPsTestJSON-1395291900 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a253ae01d6d8460abe1126aec263b625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a253ae01d6d8460abe1126aec263b625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a253ae01d6d8460abe1126aec263b625", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a253ae01d6d8460abe1126aec263b625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-FloatingIPsTestJSON-1395291900 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a253ae01d6d8460abe1126aec263b625 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1395291900 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-FloatingIPsTestJSON-1395291900-project Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: cfca678863924bf9bd6ab0120b222800 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-FloatingIPsTestJSON-1395291900-project Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: exception: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e19df3df-78a7-4dd5-8aba-807ea6145d62'} Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e19df3df-78a7-4dd5-8aba-807ea6145d62 could not be found Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a3bba78-e668-4d6c-829e-b82e47b96594'] Jul 24 01:26:47.373628 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62. Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.380997 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.385569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8b3235a4-f059-42c5-8e0c-815a8f5ee530 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Returning 404 to user: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.387123 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8b3235a4-f059-42c5-8e0c-815a8f5ee530 tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62" status: 404 len: 111 microversion: 2.1 time: 0.120504 Jul 24 01:26:47.387696 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1943/3737] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:26:47 2022] GET /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.392942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.393623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 850584c7-6e80-493a-a68f-997723d8da09] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.408355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.408719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:47.408882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.409957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.410908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.419982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:47.421857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:47.423211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1105805-e685-41d6-9751-e0dc590162a9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.294896 Jul 24 01:26:47.423843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1795/3738] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:47 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:47.429268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16ff6d0e-e86d-4640-b837-96950578c2cd tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Calling method '.version_select at 0x7f05eb1171f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.432461 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 HTTP/1.1 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '850584c7-6e80-493a-a68f-997723d8da09'} Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.434206 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 850584c7-6e80-493a-a68f-997723d8da09 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.439963 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b5f0764d-d5fd-4176-ad2b-5a3a1017d439 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09" status: 404 len: 111 microversion: 2.1 time: 0.046808 Jul 24 01:26:47.441703 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1944/3739] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:47 2022] GET /compute/v2.1/servers/850584c7-6e80-493a-a68f-997723d8da09 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.453354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.454540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.464028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.464770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.465948 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.466715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.485332 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c HTTP/1.1 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c'} Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.494800 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.500171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.501180 n-d-master-1 devstack@n-api.service[119562]: DEBUG neutronclient.v2_0.client [None req-16ff6d0e-e86d-4640-b837-96950578c2cd tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e19df3df-78a7-4dd5-8aba-807ea6145d62 could not be found", "detail": ""}} {{(pid=119562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 24 01:26:47.501180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-16ff6d0e-e86d-4640-b837-96950578c2cd tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] HTTP exception thrown: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16ff6d0e-e86d-4640-b837-96950578c2cd tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Request method failure captured: Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62 HTTP/1.1 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J-_whT4oG2Ra13JoNMWwMGsWKSiR4zX3xDfyVd5b09D9r0G5wVrYNsrAn5Z32gitk2HmvcAkxEDFUzhd9p4TaQtOEtth9za5PXdHHXQP8SzhQvN2yEDvXlS34-KPa2S80rYC-VOABAVTKoCueTB2Y_O9rt1AVzN1HceediJYH_eTQc Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a253ae01d6d8460abe1126aec263b625 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-FloatingIPsTestJSON-1395291900 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a253ae01d6d8460abe1126aec263b625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a253ae01d6d8460abe1126aec263b625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a253ae01d6d8460abe1126aec263b625", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a253ae01d6d8460abe1126aec263b625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-FloatingIPsTestJSON-1395291900 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a253ae01d6d8460abe1126aec263b625 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1395291900 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-FloatingIPsTestJSON-1395291900-project Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: cfca678863924bf9bd6ab0120b222800 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-FloatingIPsTestJSON-1395291900-project Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: exception: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'e19df3df-78a7-4dd5-8aba-807ea6145d62'} Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e19df3df-78a7-4dd5-8aba-807ea6145d62 could not be found Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24b8eea9-46fb-40d6-9782-e2f9437a4c4e'] Jul 24 01:26:47.501909 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62. Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16ff6d0e-e86d-4640-b837-96950578c2cd tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] Returning 404 to user: Floating IP not found for ID e19df3df-78a7-4dd5-8aba-807ea6145d62 {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.508077 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16ff6d0e-e86d-4640-b837-96950578c2cd tempest-FloatingIPsTestJSON-1395291900 tempest-FloatingIPsTestJSON-1395291900-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62" status: 404 len: 111 microversion: 2.1 time: 0.078504 Jul 24 01:26:47.514475 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1796/3740] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:26:47 2022] DELETE /compute/v2.1/os-floating-ips/e19df3df-78a7-4dd5-8aba-807ea6145d62 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.514777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.514777 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af8921af-fcf7-402d-8d89-c493a0894f9b tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 404 len: 111 microversion: 2.1 time: 0.070984 Jul 24 01:26:47.515326 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1945/3741] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:47 2022] DELETE /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.521951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.522578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.541504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.542072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.543028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.544383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.583149 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c HTTP/1.1 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c'} Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.584722 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ccbe6599-9144-43a1-932a-54364d5e7063 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c" status: 404 len: 111 microversion: 2.1 time: 0.068549 Jul 24 01:26:47.591817 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1797/3742] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:47 2022] GET /compute/v2.1/servers/ff3ee63c-90f2-4e92-8b4a-5a04aad0d68c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.599992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.600499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.614405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.614874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.615668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.616108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.655730 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c HTTP/1.1 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '7349c407-af32-4e19-bd68-1b3de371c37c'} Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.657474 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.662219 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.664303 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-56b8d4c6-3efa-4176-b102-69cae198395c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 404 len: 111 microversion: 2.1 time: 0.065022 Jul 24 01:26:47.675636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.677016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 7349c407-af32-4e19-bd68-1b3de371c37c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.681450 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1946/3743] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:47 2022] DELETE /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.694353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.698079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.699038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.700358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.701022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.702055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.737694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.738684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.745158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.745629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.791638 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c HTTP/1.1 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7349c407-af32-4e19-bd68-1b3de371c37c'} Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.798060 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.803454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.803454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.803454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.803454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.803454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. Jul 24 01:26:47.803454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.803454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 7349c407-af32-4e19-bd68-1b3de371c37c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.808122 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8c2e0a60-c8bd-4654-97a8-75b102577d8d tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c" status: 404 len: 111 microversion: 2.1 time: 0.134533 Jul 24 01:26:47.808955 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1798/3744] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:47 2022] GET /compute/v2.1/servers/7349c407-af32-4e19-bd68-1b3de371c37c => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.832388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:47.832885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:47.860183 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.860638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.861419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.880651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:47.928427 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf HTTP/1.1 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f6c413c5-2e70-402c-9b9d-0bfa730ef8cf'} Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:47.931029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:47.936257 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b422da5b-a9bb-4f0e-bc7b-783fb794481c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 404 len: 111 microversion: 2.1 time: 0.116302 Jul 24 01:26:47.937555 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1799/3745] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:47 2022] DELETE /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:47.941691 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-44152011-be71-4771-a7b6-c4defbcc8be8 req-84af3afc-dfb6-40e4-a367-ad4648ed6216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-deleted", "tag": "2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:47.966605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-44152011-be71-4771-a7b6-c4defbcc8be8 req-84af3afc-dfb6-40e4-a367-ad4648ed6216 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:47.967057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-44152011-be71-4771-a7b6-c4defbcc8be8 req-84af3afc-dfb6-40e4-a367-ad4648ed6216 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.003104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-44152011-be71-4771-a7b6-c4defbcc8be8 req-84af3afc-dfb6-40e4-a367-ad4648ed6216 service nova] Creating event network-vif-deleted:2bf203bd-5e6e-45f6-9a6b-0a4b5613b7c7 for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:48.013566 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-44152011-be71-4771-a7b6-c4defbcc8be8 req-84af3afc-dfb6-40e4-a367-ad4648ed6216 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075952 Jul 24 01:26:48.017291 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1800/3746] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:48.024275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:48.026014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: f6c413c5-2e70-402c-9b9d-0bfa730ef8cf] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:48.033944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.034646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.037237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.038342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.095524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf HTTP/1.1 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f6c413c5-2e70-402c-9b9d-0bfa730ef8cf'} Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.102506 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.107760 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:48.107760 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:48.107760 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:48.107760 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:48.107760 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. Jul 24 01:26:48.107760 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.110453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance f6c413c5-2e70-402c-9b9d-0bfa730ef8cf could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:48.111575 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d8efcc51-1d48-4840-87d1-713425e6ac42 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf" status: 404 len: 111 microversion: 2.1 time: 0.092864 Jul 24 01:26:48.118838 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1801/3747] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:48 2022] GET /compute/v2.1/servers/f6c413c5-2e70-402c-9b9d-0bfa730ef8cf => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:48.132116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:48.134133 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:48.145621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.150690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.151873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.153955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.471016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:48.485860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:48.493500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:48.500327 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2180b26-1baa-45d1-8bd7-86b086454448 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2345 microversion: 2.42 time: 0.811275 Jul 24 01:26:48.506254 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1947/3748] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:47 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2345 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:48.519802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:48.536459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:48.568502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.568895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.572785 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.575638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.614896 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea HTTP/1.1 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea'} Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:48.616784 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:48.621650 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ac27537-9ede-4597-983d-7b8ead3aa269 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea" status: 404 len: 111 microversion: 2.1 time: 0.116497 Jul 24 01:26:48.624265 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1948/3749] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:48 2022] DELETE /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:48.628286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:48.628914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:48.638320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.639500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.640496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.641045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.784026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:48.793295 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-60fe1931-bb24-4002-bc5f-fc557201297d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.673272 Jul 24 01:26:48.798610 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1802/3750] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:48 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:48.803590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:48.814648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:48.822508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.831417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.832371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.832902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.857847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea HTTP/1.1 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea'} Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.859710 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:48.865178 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:48.865178 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:48.865178 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:48.865178 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:48.865178 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. Jul 24 01:26:48.865178 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:26:48.866392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:48.868018 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec59f10d-8c49-40db-aa6c-2edbd2adf83e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea" status: 404 len: 111 microversion: 2.1 time: 0.068258 Jul 24 01:26:48.868787 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1803/3751] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:48 2022] GET /compute/v2.1/servers/2d3507a3-09d2-4fb9-ba69-92e4f2a2f3ea => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:48.877236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:48.878162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:48.885980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.886654 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.887522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:48.888038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:48.928773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:26:49.087027 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e88c9eba-5b6a-4a0c-a390-bda593d032e8 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 204 len: 0 microversion: 2.1 time: 0.211995 Jul 24 01:26:49.088012 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1804/3752] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:26:48 2022] DELETE /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:26:49.099323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:49.100967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:49.108534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:49.109347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:49.111120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:49.111784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:49.465345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:49.485816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:49.488222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:49.490081 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b56cdddb-d1ff-4924-b4d1-e7a741b092a7 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.865582 Jul 24 01:26:49.491192 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1949/3753] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:48 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:49.515738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:49.527212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:49.528332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:49.535609 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ec79481-c516-4e9a-8253-ea704e179082 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1480 microversion: 2.1 time: 0.443287 Jul 24 01:26:49.544687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:49.548645 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:49.549166 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1805/3754] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:49 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1480 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:49.550573 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:49.551148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:49.817554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:49.822950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:49.833716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:49.834374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:49.835416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:49.836939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:49.866488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:49.881500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:49.885319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:49.891253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e4fc6d21-56c4-477f-aca7-95f0a56d9c82 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 2231 microversion: 2.42 time: 0.372660 Jul 24 01:26:49.892029 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1950/3755] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:49 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 2231 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:26:50.046862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1805e8f9-daf2-4a12-9d86-fcf746ee9de5 req-af0c9ee5-a38f-4aaa-8eff-ef7f763eea23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf24f66-1454-40ba-bbf2-f57df2ccc7ca", "tag": "89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:50.056633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1805e8f9-daf2-4a12-9d86-fcf746ee9de5 req-af0c9ee5-a38f-4aaa-8eff-ef7f763eea23 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:50.057088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1805e8f9-daf2-4a12-9d86-fcf746ee9de5 req-af0c9ee5-a38f-4aaa-8eff-ef7f763eea23 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:50.069027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1805e8f9-daf2-4a12-9d86-fcf746ee9de5 req-af0c9ee5-a38f-4aaa-8eff-ef7f763eea23 service nova] Creating event network-changed:89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef for instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca on n-h2-master-1 Jul 24 01:26:50.075210 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1805e8f9-daf2-4a12-9d86-fcf746ee9de5 req-af0c9ee5-a38f-4aaa-8eff-ef7f763eea23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Jul 24 01:26:50.076091 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1951/3756] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:26:50.152955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:50.172715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a997267c-c743-4790-8833-0d72a293b401 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.361064 Jul 24 01:26:50.173998 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1806/3757] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:49 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:50.515421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:50.516171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:50.531125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:50.531591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:50.532407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:50.532842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:50.554454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:50.555332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:50.578078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:50.583706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:50.585099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:50.586503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:51.111492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.144146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.153507 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1b8fc1a-2eae-4513-b647-54090479007f tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1480 microversion: 2.1 time: 0.603096 Jul 24 01:26:51.165895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.166765 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1807/3758] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:50 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1480 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:51.171676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.172912 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05c9c978-beee-48d3-ad5d-05714d39b1e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.667805 Jul 24 01:26:51.173484 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1952/3759] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:50 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:51.178188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:51.179088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:51.196604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:51.199723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:51.200764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:51.201407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:51.207447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:51.214035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:51.225067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:51.225528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:51.226911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:51.227425 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:51.473558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.490859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.496785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.499620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee1f3ae2-5de4-4679-b4cd-026886b5e0b4 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.331506 Jul 24 01:26:51.514292 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1808/3760] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:51 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:51.683701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:51.700402 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5a6f7f8b-cc99-498f-b28c-df4ddd4776d0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.511055 Jul 24 01:26:51.702506 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1953/3761] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:51 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:52.175578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:52.176210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:52.176770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7bda0eb2-d1e6-4f16-b0cb-a4f654f5af1d req-ffb69105-ef2e-4a19-84b9-73e6e73b4cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ccce789-d901-4d4a-a017-774c5d2a5d8b", "name": "network-vif-deleted", "tag": "a25f1481-9636-49b6-a9f4-4b944673adff"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:52.192137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:52.192608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:52.192863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7bda0eb2-d1e6-4f16-b0cb-a4f654f5af1d req-ffb69105-ef2e-4a19-84b9-73e6e73b4cec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:52.193740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7bda0eb2-d1e6-4f16-b0cb-a4f654f5af1d req-ffb69105-ef2e-4a19-84b9-73e6e73b4cec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:52.194258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:52.194708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:52.221272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7bda0eb2-d1e6-4f16-b0cb-a4f654f5af1d req-ffb69105-ef2e-4a19-84b9-73e6e73b4cec service nova] Creating event network-vif-deleted:a25f1481-9636-49b6-a9f4-4b944673adff for instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b on n-h1-master-1 Jul 24 01:26:52.238819 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7bda0eb2-d1e6-4f16-b0cb-a4f654f5af1d req-ffb69105-ef2e-4a19-84b9-73e6e73b4cec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067575 Jul 24 01:26:52.254682 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1954/3762] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:52.280625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:52.282758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:52.302484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:52.305535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:52.306580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:52.309240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:53.059728 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.078005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.079897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.085703 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2a0324c-fb46-4ac2-8e23-58235e9070f0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.822483 Jul 24 01:26:53.099690 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1955/3763] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:52 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:53.112093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:53.112968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:53.139259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:53.140171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:53.141300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:53.141967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:53.200627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.210943 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cae1cb5a-4515-4fd8-af64-9d77cdf2cf9e tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1480 microversion: 2.1 time: 1.040965 Jul 24 01:26:53.216546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1809/3764] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:52 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1480 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:53.224174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:53.232446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:53.239692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:53.242866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:53.243871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:53.247099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:53.250696 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:53.389607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.404635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.411189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.412730 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bebd68fa-1eb4-4560-8ef2-0fa928d9c1ef tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.311795 Jul 24 01:26:53.413476 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1956/3765] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:53 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:53.607177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:53.617722 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e17ae5e-eb9d-42e4-97f4-78d83b2c8637 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.399604 Jul 24 01:26:53.622635 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1810/3766] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:53 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:54.107288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:54.108662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:54.146589 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:54.151184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:54.152573 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:54.155335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:54.155969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:54.233797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:54.234464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:54.248124 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:54.249940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:54.250417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:54.251228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:54.251653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:54.536125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:54.544827 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c19b90ee-e474-42f4-ad07-904e274ad52c tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1438 microversion: 2.1 time: 0.315304 Jul 24 01:26:54.552912 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1811/3767] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:54 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1438 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:54.565461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e485ed8a-7ea7-42d1-9236-5302dea60531 req-798d6135-0f8a-43ee-b2f6-afb3c6a91553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9678c4ac-087e-4c4e-89a8-61fce0d303b5", "name": "network-vif-deleted", "tag": "31a4c232-f771-4431-8aec-6381ec24d25a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:54.594746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e485ed8a-7ea7-42d1-9236-5302dea60531 req-798d6135-0f8a-43ee-b2f6-afb3c6a91553 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:54.595195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e485ed8a-7ea7-42d1-9236-5302dea60531 req-798d6135-0f8a-43ee-b2f6-afb3c6a91553 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:54.611991 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e485ed8a-7ea7-42d1-9236-5302dea60531 req-798d6135-0f8a-43ee-b2f6-afb3c6a91553 service nova] Creating event network-vif-deleted:31a4c232-f771-4431-8aec-6381ec24d25a for instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 on n-h2-master-1 Jul 24 01:26:54.634112 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e485ed8a-7ea7-42d1-9236-5302dea60531 req-798d6135-0f8a-43ee-b2f6-afb3c6a91553 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078268 Jul 24 01:26:54.636179 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1812/3768] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:26:54.641629 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:54.643443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:54.671044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:54.671840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:54.674606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:54.675787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:55.261697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.268739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.271158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.281630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.282967 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f6277427-cbe2-4e43-b6d7-59f41d1b5bb0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 1.180143 Jul 24 01:26:55.283562 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1957/3769] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:54 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:55.285264 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.291505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:55.292039 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:55.292757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.296379 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80382c12-911d-4a6d-b2e1-5ebb97516312 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.657174 Jul 24 01:26:55.297242 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1813/3770] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:54 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:55.312475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:55.313196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:55.314213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:55.314816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:55.563566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:55.565150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:55.575812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:55.579273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:55.583091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:55.584051 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:55.691184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:55.691922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:55.695721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lazy-loading 'fault' on Instance uuid 9678c4ac-087e-4c4e-89a8-61fce0d303b5 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:26:55.851194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.864210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-650748e9-fa87-4e47-8554-77b8fd6194e5 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1283 microversion: 2.1 time: 0.305151 Jul 24 01:26:55.876219 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1814/3771] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:55 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1283 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:55.908904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:55.922228 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-884f6f55-9ad2-4f65-b76e-88e1baeb63ac tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.633127 Jul 24 01:26:55.922904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1958/3772] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:55 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:56.306631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:56.308166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:56.316513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:56.317125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:56.344036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.345967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.347214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.348282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.348703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.349097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.349803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.358639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.573777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:56.591453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:56.597868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:56.603308 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab69b3a6-6eb8-449f-b371-51c10482c5cb tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.290718 Jul 24 01:26:56.608532 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1959/3773] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:56 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:26:56.740282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:56.759137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:56.771745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:56.773636 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9309ddd-218b-439f-ac9a-d5d5087b00dd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.473173 Jul 24 01:26:56.774687 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1815/3774] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:56 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:56.888576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:56.889232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:56.913999 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.914896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.915254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.937396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.939904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:56.940817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:56.953722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.956599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.960983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:56.961837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:56.963623 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:57.016772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:57.017502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:57.019866 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lazy-loading 'fault' on Instance uuid 9678c4ac-087e-4c4e-89a8-61fce0d303b5 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:26:57.088600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785eebaf851240da958ed7c13d121121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20fd219605f4e0c8e04a9289764a40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:57.099751 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2688aaaf-56ed-4ad3-9ace-43006ca49dd1 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 200 len: 1283 microversion: 2.1 time: 0.216265 Jul 24 01:26:57.100991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1960/3775] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:56 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 1283 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:57.391908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:57.416429 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2e7b58f7-5ed5-4cde-b47d-89438ba1d815 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.469581 Jul 24 01:26:57.417519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1816/3776] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:56 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:26:57.634559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:57.636305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:57.647683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:57.648740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:57.649818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:57.650649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:57.784265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:57.794723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:57.795558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:57.801459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:57.808400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:57.809126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:57.810670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:57.812651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:57.821229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:57.824820 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dba900b4-a6f1-4615-9041-fb60cdf7fd3d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.195624 Jul 24 01:26:57.839047 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1961/3777] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:57 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:58.122044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:58.122893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] [instance: 9678c4ac-087e-4c4e-89a8-61fce0d303b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:58.130339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:58.131748 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:58.133806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:58.135230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:58.156016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:58.156764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] HTTP exception thrown: Instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 could not be found. Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Request method failure captured: Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 HTTP/1.1 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J7k3YmHSh_F7fq0O4Wbm_G3XcjNMBQwfqk90xQAECQz4QxvrArhF0HPoIerYSeq2t8QrxM6G4AipWrMcrXkwzZm39GuxyEe72kerbdJgZcDWcoTqEE6rCFbNN78s1yFM5pI0hXNpKh7sTqFF7HXH5IpghGu-aBg6l2yhrYCi9k1vQw Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b20fd219605f4e0c8e04a9289764a40d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b20fd219605f4e0c8e04a9289764a40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1916320576 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b20fd219605f4e0c8e04a9289764a40d Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1916320576 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 785eebaf851240da958ed7c13d121121 Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1916320576-project Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 could not be found. Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '9678c4ac-087e-4c4e-89a8-61fce0d303b5'} Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 could not be found. Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 could not be found. Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:58.158566 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 could not be found. Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] Returning 404 to user: Instance 9678c4ac-087e-4c4e-89a8-61fce0d303b5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:26:58.165315 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-08780548-517b-43e5-a3a7-0a130ae9dac3 tempest-ServersTestJSON-1916320576 tempest-ServersTestJSON-1916320576-project] 10.222.0.27 "GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5" status: 404 len: 111 microversion: 2.1 time: 0.046162 Jul 24 01:26:58.166285 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1962/3778] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:58 2022] GET /compute/v2.1/servers/9678c4ac-087e-4c4e-89a8-61fce0d303b5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:26:58.180633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:58.182695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:58.187142 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dbb5c3e5-2f73-441d-8e73-07378eb41ba1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.398582 Jul 24 01:26:58.199622 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1817/3779] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:57 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:26:58.435431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:58.436141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:58.453811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:58.455229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:58.457834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:58.461819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:58.855387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:58.856390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:58.866099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:58.869568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:58.873803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:58.874459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:59.060949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:59.075510 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86d7f3d8-a38e-4edc-b69a-6849528c59fa tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.643297 Jul 24 01:26:59.084930 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1963/3780] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:26:58 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:59.137483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:59.172616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:59.178158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:59.182051 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-404c4e67-3a9b-4afb-8de2-e8f273b0f2f7 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.330457 Jul 24 01:26:59.183467 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1818/3781] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:58 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:26:59.206548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:26:59.207163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:59.222913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:59.223374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:59.224352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:59.224971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:59.434766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-929b45de-5ce2-4140-879e-0bf943533ff7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36baa45b-f0b6-4af5-8cae-ada01d38e1d5"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:26:59.435928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-929b45de-5ce2-4140-879e-0bf943533ff7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:26:59.443628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-929b45de-5ce2-4140-879e-0bf943533ff7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:59.444352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-929b45de-5ce2-4140-879e-0bf943533ff7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:59.447011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-929b45de-5ce2-4140-879e-0bf943533ff7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:26:59.452617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-929b45de-5ce2-4140-879e-0bf943533ff7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:26:59.744391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:59.774985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:59.783742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:26:59.792116 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-84ba4450-dbcb-4633-b1d8-aa4156af0e74 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.589524 Jul 24 01:26:59.796692 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1964/3782] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:26:59 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:26:59.977301 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-929b45de-5ce2-4140-879e-0bf943533ff7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538965 Jul 24 01:26:59.979837 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1819/3783] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:26:59 2022] POST /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:27:00.092585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:00.093198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:00.104169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:00.105233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:00.106523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:00.109983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:00.205352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:00.206108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:00.213706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:00.214573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:00.215940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:00.216690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:00.423973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:00.430098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:00.444886 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a53038c-8a0f-417a-b65f-003ed375f38f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.355751 Jul 24 01:27:00.449398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:00.454871 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1965/3784] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:00 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:00.456454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:00.457767 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0263b436-2ee4-41c1-ac35-06f36b8cae14 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.258823 Jul 24 01:27:00.458347 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1820/3785] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:00 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:00.814816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:00.815581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:00.827182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:00.827790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:00.828599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:00.829041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:01.219170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9cb31f7a-a9b3-4ce9-a764-97d039c99619 req-b1ddb7b3-7503-459c-941f-48697bb9c3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf24f66-1454-40ba-bbf2-f57df2ccc7ca", "name": "network-vif-plugged", "status": "completed", "tag": "89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:01.239181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9cb31f7a-a9b3-4ce9-a764-97d039c99619 req-b1ddb7b3-7503-459c-941f-48697bb9c3f7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:01.239645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9cb31f7a-a9b3-4ce9-a764-97d039c99619 req-b1ddb7b3-7503-459c-941f-48697bb9c3f7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:01.267182 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9cb31f7a-a9b3-4ce9-a764-97d039c99619 req-b1ddb7b3-7503-459c-941f-48697bb9c3f7 service nova] Creating event network-vif-plugged:89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef for instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca on n-h2-master-1 Jul 24 01:27:01.276851 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9cb31f7a-a9b3-4ce9-a764-97d039c99619 req-b1ddb7b3-7503-459c-941f-48697bb9c3f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061404 Jul 24 01:27:01.277599 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1821/3786] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:27:01.463443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:01.464495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:01.471320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:01.472053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:01.473355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:01.473984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:01.766518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:01.782950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:01.792234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:01.793543 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14bd2204-eb2c-4db7-b4fa-e9f6baf05d5b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.982983 Jul 24 01:27:01.813757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1966/3787] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:00 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:01.818952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:01.820459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:01.854829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:01.855298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:01.856476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:01.856801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:02.089607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:02.110798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:02.112667 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:02.117664 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e98d70b-60f6-48cd-b645-06f8943c0780 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.300309 Jul 24 01:27:02.118387 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1967/3788] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:01 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:02.173912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:02.184425 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9043cf5b-60a9-4f4a-bfa9-ba4862f296ff tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.726844 Jul 24 01:27:02.186621 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1822/3789] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:01 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:02.830665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:02.831981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:02.847281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:02.847964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:02.849205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:02.851404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:03.137730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:03.139051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:03.152986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:03.153775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:03.154788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:03.155401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:03.234912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:03.252891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:03.262671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:03.264611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eb51d3ce-360a-4648-bb44-541f6329bb6c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.442986 Jul 24 01:27:03.267186 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1968/3790] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:02 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:03.294873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:03.298715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:03.330171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:03.331173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:03.332214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:03.332842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:03.358310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:03.368937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:03.370521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:03.371759 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c0e09ca-cbf3-4dfb-92fa-44dd7980dbd6 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.238725 Jul 24 01:27:03.394805 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1823/3791] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:03 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:27:03.397390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4bdcf309-3349-4b7d-a4ef-c0287c58c9a5 req-57feeb98-c62e-4e09-b104-cfed6b546577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "name": "network-vif-plugged", "status": "completed", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:03.426268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4bdcf309-3349-4b7d-a4ef-c0287c58c9a5 req-57feeb98-c62e-4e09-b104-cfed6b546577 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:03.426516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4bdcf309-3349-4b7d-a4ef-c0287c58c9a5 req-57feeb98-c62e-4e09-b104-cfed6b546577 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:03.470986 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4bdcf309-3349-4b7d-a4ef-c0287c58c9a5 req-57feeb98-c62e-4e09-b104-cfed6b546577 service nova] Creating event network-vif-plugged:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h2-master-1 Jul 24 01:27:03.484545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4bdcf309-3349-4b7d-a4ef-c0287c58c9a5 req-57feeb98-c62e-4e09-b104-cfed6b546577 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091779 Jul 24 01:27:03.485470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1824/3792] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:27:03.797587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:03.811875 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d6c30544-7d68-44e3-a856-c12a564fa172 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1312 microversion: 2.1 time: 0.543268 Jul 24 01:27:03.812483 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1969/3793] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:03 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1312 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:04.285974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:04.286688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:04.303718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:04.304748 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:04.307344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:04.310253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:04.407198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:04.408379 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:04.417604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:04.418562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:04.419527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:04.420778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:04.618237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:04.643868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:04.650963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:04.662242 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-846edfc8-e567-4fcd-8ce1-6b23d430ba70 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.259796 Jul 24 01:27:04.663716 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1970/3794] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:04 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:04.770685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:04.783956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:04.789808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:04.803027 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5197012-68d1-4ddb-b8c3-6403edeb2860 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 0.515694 Jul 24 01:27:04.808606 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1825/3795] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:04 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:04.847181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:04.847831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:04.871559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:04.872021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:04.872829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:04.873269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:05.238019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:05.268647 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef6241df-8c0a-4349-ae86-27ed19c0f845 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1462 microversion: 2.1 time: 0.434644 Jul 24 01:27:05.269614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1971/3796] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:04 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1462 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:05.286399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a9411807-11d6-42ae-998c-ca48dafcb0dc tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:05.287221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a9411807-11d6-42ae-998c-ca48dafcb0dc tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:05.310816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9411807-11d6-42ae-998c-ca48dafcb0dc tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:05.311138 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9411807-11d6-42ae-998c-ca48dafcb0dc tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:05.311946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9411807-11d6-42ae-998c-ca48dafcb0dc tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:05.312471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a9411807-11d6-42ae-998c-ca48dafcb0dc tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:05.574968 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a9411807-11d6-42ae-998c-ca48dafcb0dc tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1613 microversion: 2.1 time: 0.293916 Jul 24 01:27:05.575561 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1826/3797] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:05 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1613 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:05.592106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:05.592724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:05.601646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:05.602130 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:05.602943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:05.603391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:05.673570 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f05b985e50f44940b352b6148fc10763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4343432978b644a286aa3cf937ba8320', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:05.674203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] flavor_id is None. Assuming migration. {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 24 01:27:05.674658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 01:27:05.688332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:05.688962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:05.699951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:05.702244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:05.704309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:05.709271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:05.786395 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:05.918492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:05.934318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:05.935866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:05.937103 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-833a9041-92e0-42b6-852d-555a8efc852d tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.253786 Jul 24 01:27:05.937703 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1827/3798] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:05 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:05.993357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:05.994314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:06.032752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:06.033221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:06.040833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:06.041112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:06.088329 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-649a2ebf-d20d-4ad8-b7f2-677c0bcc681c tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca/action" status: 202 len: 0 microversion: 2.1 time: 0.499969 Jul 24 01:27:06.090068 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1972/3799] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:27:05 2022] POST /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:27:06.105107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:06.106291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:06.116926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:06.117563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:06.118541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:06.119145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:06.853964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:06.864274 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc4c7e77-d583-45e3-b258-38c5037f345e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1471 microversion: 2.1 time: 0.766905 Jul 24 01:27:06.869357 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1973/3800] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:06 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:06.962812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:06.966425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:06.988270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:06.993438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:06.995695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:07.000054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:07.070521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:07.106343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:07.108964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:07.130023 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0798930c-7d7b-4484-8878-1fc79e24783b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1809 microversion: 2.20 time: 1.149983 Jul 24 01:27:07.133394 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1828/3801] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:05 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1809 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:07.299754 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:07.321512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:07.326509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:07.330827 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69872511-f090-4bd0-8233-2132c06b6949 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.377182 Jul 24 01:27:07.331585 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1974/3802] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:06 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:07.888765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:07.889760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:07.901709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:07.904543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:07.905559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:07.906215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:08.152170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:08.152783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:08.168643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:08.169102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:08.172130 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:08.172587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:08.234462 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:08.837808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:08.843441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:08.853069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:08.854613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:08.863377 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2305da97-d178-47ab-8043-1aa95fdbfc9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1796 microversion: 2.20 time: 0.715912 Jul 24 01:27:08.868908 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4780c1a8-ddff-434b-8614-7c8790143ba0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1471 microversion: 2.1 time: 0.981745 Jul 24 01:27:08.869477 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1975/3803] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:08 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1796 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:08.875051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:08.877308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:08.886927 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1829/3804] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:07 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1471 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:08.892106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:08.892702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:08.893570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:08.894476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:09.069740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:09.090737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:09.094755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:09.096220 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7497b4c-3d5e-4b34-9ab2-7c2619c8cbf2 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.225599 Jul 24 01:27:09.097207 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1976/3805] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:08 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:09.893034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:09.894878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:09.910374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:09.912248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:09.918227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:09.922911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:10.117815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:10.118443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:10.136088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:10.137966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:10.140984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:10.141727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:10.390837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:10.407816 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eba7c445-3b33-4b60-b07c-e9465008157e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1471 microversion: 2.1 time: 0.516822 Jul 24 01:27:10.408668 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1830/3806] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:09 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1471 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:10.448295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:10.461367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:10.463308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:10.464721 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22928fe3-7c7e-410d-9412-07055d27d229 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.352536 Jul 24 01:27:10.477950 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1977/3807] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:10 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:11.424624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:11.425231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:11.437200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:11.447619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:11.449407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:11.450469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:11.485764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:11.486948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:11.496349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:11.502652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:11.503990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:11.504582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:11.767865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:11.786198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:11.787752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:11.790195 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-631f8d7d-b2bb-433c-b4b8-3a13451592f9 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.309474 Jul 24 01:27:11.797541 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1978/3808] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:11 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:27:12.067095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:12.080760 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ae16eb3f-a0d3-4bff-8cff-8c473d1a9111 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1471 microversion: 2.1 time: 0.656465 Jul 24 01:27:12.090172 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1831/3809] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:11 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1471 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:12.816298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:12.817634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:12.834596 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:12.836022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:12.837049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:12.838218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:13.016963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:13.046109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:13.048954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:13.053040 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2caca078-ebdc-4c35-8d50-be936b82b2ed tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.240636 Jul 24 01:27:13.054493 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1979/3810] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:12 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:13.100612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:13.102131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:13.132772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:13.133243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:13.134284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:13.134733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:13.504096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:13.513162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-759d7cbb-692a-41d6-9a34-25ea4627fb5f tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.416440 Jul 24 01:27:13.524619 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1832/3811] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:13 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:14.074056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:14.074707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:14.110081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:14.110544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:14.111357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:14.111802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:14.291025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:14.313027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:14.316790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:14.322870 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-761700ab-bef0-4a3c-afc9-6e42b4759cb1 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.254191 Jul 24 01:27:14.330169 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1980/3812] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:14 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:14.532019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:14.532836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:14.549080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:14.555543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:14.556491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:14.556953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:14.962277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:14.970192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78a4e9a3-6c41-4b66-a7a4-4122093954fb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.442680 Jul 24 01:27:14.981731 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1833/3813] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:14 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:15.071493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1941718989", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "41157fbf-825e-46bc-9e53-c3a4974eed04"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:15.167152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] validate_networks() for [('41157fbf-825e-46bc-9e53-c3a4974eed04', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:27:15.422960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1365659298", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": "none"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:15.499546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:27:15.500330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:27:15.500992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:27:15.501654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:27:15.502374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:27:15.516566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:15.517233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:15.519128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:15.519811 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:15.551836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Getting quotas for project a4fe90029c99433ba86341f96ffc70af. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:27:15.560347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Getting quotas for user f3a842684b4a4020a9e8e6839c2a2748 and project a4fe90029c99433ba86341f96ffc70af. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:27:15.585864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:27:15.593075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:27:15.696596 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61bd391e-6b92-486a-b4d4-81eb2ceee7de tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.445866 Jul 24 01:27:15.702553 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1834/3814] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 24 01:27:15.707556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:15.708193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:15.726851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:15.729836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:15.731825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:15.733167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:16.268027 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.289077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.295456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.298934 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d043e708-4662-4a56-acb7-73a2a73b9399 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.593904 Jul 24 01:27:16.301736 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1835/3815] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:15 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:16.315936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e50eac00-2101-4fc5-8207-ed7cbc6f91be tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:16.317448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e50eac00-2101-4fc5-8207-ed7cbc6f91be tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:16.384596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:27:16.385126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:27:16.385883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:27:16.386549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:27:16.387182 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:27:16.403938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:16.406278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:16.409641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:16.410236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:16.449716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e50eac00-2101-4fc5-8207-ed7cbc6f91be tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.457784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:27:16.457966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e50eac00-2101-4fc5-8207-ed7cbc6f91be tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.464522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e50eac00-2101-4fc5-8207-ed7cbc6f91be tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.465745 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e50eac00-2101-4fc5-8207-ed7cbc6f91be tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1278 microversion: 2.57 time: 0.162927 Jul 24 01:27:16.466324 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1836/3816] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:16 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:16.468969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for user b0f04ff3b36d4b0686c9a68ff55ee99d and project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:27:16.476156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:16.476803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:16.501521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:16.502622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:16.504759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:16.506511 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:27:16.507221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:16.513522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:27:16.656316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba90f143-d13c-4790-ab50-40e248400b82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.123659 Jul 24 01:27:16.680115 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1981/3817] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:27:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:27:16.695828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-07469e5e-c307-445d-bee5-8ca6064fcba1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:16.696482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-07469e5e-c307-445d-bee5-8ca6064fcba1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:16.867636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-07469e5e-c307-445d-bee5-8ca6064fcba1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.875382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-07469e5e-c307-445d-bee5-8ca6064fcba1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1208 microversion: 2.1 time: 0.194077 Jul 24 01:27:16.878677 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1982/3818] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:16 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:16.896685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:16.907218 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75c6455d-3f51-499a-809e-a26807b7fe1b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.439786 Jul 24 01:27:16.908250 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1837/3819] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:16 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:17.322857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:17.323763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:17.337402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:17.342054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:17.343189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:17.346250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:17.437055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:17.449335 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:17.452593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5553b37350644a20b64ce76ebf60b44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d719380c51434683b3dcd83722913f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:17.454180 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac402177-2295-4552-8a37-8e1d3e0fc865 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 200 len: 1604 microversion: 2.42 time: 0.137616 Jul 24 01:27:17.455269 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1983/3820] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:17 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:17.486200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:17.487227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:17.499172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:17.502275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:17.504393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:17.506226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:17.667221 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:17.682038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:17.683575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:17.684735 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bac38564-07c7-42ce-a353-4fd255bc14c4 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1330 microversion: 2.57 time: 0.203974 Jul 24 01:27:17.695966 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1838/3821] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:17 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1330 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:17.899374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:17.900396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:17.926473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:17.927943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:17.930079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:17.930663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:17.931519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:17.931974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:17.974024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:17.993704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:17.999746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:18.005851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:18.367201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:18.388482 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de5eb73d-23d6-47b7-a09c-4bd3f74a47f5 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.465687 Jul 24 01:27:18.389136 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1839/3822] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:17 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:18.416022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:18.429597 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89609bb4-ed87-498c-8c15-72df5c7bc2d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1212 microversion: 2.1 time: 0.537647 Jul 24 01:27:18.432033 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1984/3823] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:17 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1212 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:18.474523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:18.475462 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:18.485628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:18.486317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:18.487581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:18.488257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:18.513115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] HTTP exception thrown: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Request method failure captured: Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b HTTP/1.1 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J5nNIrOgEs3TDY3Vuk_8qj6-2bqMpkKUp6Cb3ZzlwqFg0-JgKX3HPVPQtsAL0jUnLpa1NUx9muy0FkJvWbSRs8mBk4IqekW4_TiQ9f9uFcrju6lsSuvg4GbIZytGwW_iJTtxLsmPWU3_ZQxRG8ZuF19XSDC_TgA_FyLJiez2_ZNfhc Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.42 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 37d719380c51434683b3dcd83722913f Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37d719380c51434683b3dcd83722913f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37d719380c51434683b3dcd83722913f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37d719380c51434683b3dcd83722913f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37d719380c51434683b3dcd83722913f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 37d719380c51434683b3dcd83722913f Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TaggedBootDevicesTest_v242-1045863613-project Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5553b37350644a20b64ce76ebf60b44b Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1045863613-project Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2ccce789-d901-4d4a-a017-774c5d2a5d8b'} Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:18.515805 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:18.518922 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:18.520636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Returning 404 to user: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:27:18.521753 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fdfc353f-c556-45bd-8c95-49732b4ddc05 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 404 len: 111 microversion: 2.42 time: 0.051463 Jul 24 01:27:18.524195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1840/3824] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:18 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:27:18.532082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c180a2d1-a788-421e-8026-24e3e3719c81 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '.version_select at 0x7f05eab8a1f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:18.564429 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c180a2d1-a788-421e-8026-24e3e3719c81 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-171276352" status: 204 len: 0 microversion: 2.42 time: 0.036221 Jul 24 01:27:18.565915 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1985/3825] 10.222.0.27 () {60 vars in 1258 bytes} [Sun Jul 24 01:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-171276352 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:27:18.706857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:18.707525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:18.738165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:18.747404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:18.748446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:18.748909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:18.887476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:18.900806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:18.905508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:18.907665 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5f76c0e0-e969-4f26-8473-d07fd2bbfde6 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1336 microversion: 2.57 time: 0.204391 Jul 24 01:27:18.909185 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1841/3826] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:18 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1336 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:19.407420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:19.408272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:19.419204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:19.423699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:19.425460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:19.426430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:19.453123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:19.457357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:19.497586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:19.501314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:19.506177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:19.506791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:20.074449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:20.090106 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f96c65da-bb4a-4e88-83a1-bbd504ac4b33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1260 microversion: 2.1 time: 0.644529 Jul 24 01:27:20.091809 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1842/3827] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:19 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1260 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:20.096863 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:20.105644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:20.144929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:20.145776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:20.152388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:20.153159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:20.347570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:20.367513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:20.380002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:20.382121 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e2a680ae-4ed5-4201-82e5-c40ee35c8fc9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1336 microversion: 2.57 time: 0.288453 Jul 24 01:27:20.389987 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1843/3828] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:20 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1336 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:20.449649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:20.460201 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e1a3fd1-ab6d-4b99-a458-54a52f93aa00 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 1.056930 Jul 24 01:27:20.470518 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1986/3829] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:19 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:21.108267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:21.108892 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:21.131198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.138822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.139841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.140453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.389705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:21.401408 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04f53b57-1fd7-4705-815d-7de2d5b83525 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1266 microversion: 2.1 time: 0.297430 Jul 24 01:27:21.402712 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1844/3830] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:21 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:21.416684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:21.417855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:21.424438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.430449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.431410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.432052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.488596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:21.489625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:21.507771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.508704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.510903 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.511582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.704855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:21.720123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:21.722365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:21.723874 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df10bf3d-aa76-4ca5-9efd-e9cd64c48907 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1357 microversion: 2.57 time: 0.317219 Jul 24 01:27:21.726952 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1987/3831] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:21 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1357 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:21.746809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:21.748535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:21.755040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.755789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.757317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:21.757955 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:21.882833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:27:21.883190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:27:21.904128 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:27:21.905710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:27:21.906315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:27:22.027030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:22.037473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:22.038455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:22.039489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:22.040081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:22.104051 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98b54959-5fe1-411c-9e90-ba5c8634f174 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "POST /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d/action" status: 202 len: 1138 microversion: 2.57 time: 0.363038 Jul 24 01:27:22.105337 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1988/3832] 10.222.0.27 () {62 vars in 1319 bytes} [Sun Jul 24 01:27:21 2022] POST /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d/action => generated 1138 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 24 01:27:22.120829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:22.121452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:22.137423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:22.137932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:22.138725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:22.139178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:22.231413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:22.244542 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a869fd4-973b-4625-8f4c-9f0be8246225 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.760284 Jul 24 01:27:22.245148 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1845/3833] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:21 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:22.312646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:22.330421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:22.332417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:22.333852 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-486fab69-6eef-4588-a07c-360d90bb1213 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.216991 Jul 24 01:27:22.335458 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1989/3834] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:22 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:22.421957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:22.422726 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:22.452873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:22.453370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:22.454254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:22.461737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:22.529849 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:22.645128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:22.665799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-06847b10-3d0a-43fc-8e93-973c2d4326c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1266 microversion: 2.1 time: 0.248667 Jul 24 01:27:22.666925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1846/3835] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:22 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:23.266163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:23.266928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:23.279967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:23.280435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:23.281238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:23.281726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:23.354172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:23.355476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:23.380240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:23.383053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:23.386666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:23.387397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:24.282787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:24.295554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:24.297333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:24.300858 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2a3cccd-ff41-4ce9-8a64-ebd5aeae1232 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.951267 Jul 24 01:27:24.304931 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1847/3836] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:23 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:27:24.320977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:24.328007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:24.336840 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:24.338975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:24.339423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:24.341309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:24.341966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:24.517359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:24.532310 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32d1176b-29d1-4852-a836-29bf79ef58bc tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 1.273988 Jul 24 01:27:24.533501 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1990/3837] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:23 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:24.718770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:24.734419 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a86f8d21-a641-495f-926b-bc8849346ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1308 microversion: 2.1 time: 0.427899 Jul 24 01:27:24.735042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1848/3838] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:24 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:25.324799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:25.334751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:25.352924 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:25.382890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:25.389963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:25.390940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:25.399845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:25.549729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:25.550593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:25.554158 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:25.574354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:25.574812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:25.575610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:25.578937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:25.593155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:25.609169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:25.611046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:25.612487 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef9acbea-6606-401a-970d-fe6e59a718b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.291682 Jul 24 01:27:25.613782 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1991/3839] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:25 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:25.763483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:25.764415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:25.790366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:25.791521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:25.793564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:25.794465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:26.414632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:26.431129 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38d5d9d9-4127-46be-b503-bb607516e205 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.880004 Jul 24 01:27:26.433049 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:26.434088 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1849/3840] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:25 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:26.514648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:26.521859 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:26.540452 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03816f04-e7bd-4991-b876-0b19d0675a82 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1308 microversion: 2.1 time: 0.788088 Jul 24 01:27:26.543103 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1992/3841] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:25 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1308 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:26.634751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:26.635667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:26.643979 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:26.650718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:26.652482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:26.653504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:26.654233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:26.732634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0ae4e357-0397-4096-b0a1-58d13c9305a6 req-595f5638-a5ee-4e95-ba88-e111414ee9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e248bf7-9673-4759-8bb7-1a966355e4b5", "tag": "dadad03f-db0a-400b-8796-860c02244280"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:26.758975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0ae4e357-0397-4096-b0a1-58d13c9305a6 req-595f5638-a5ee-4e95-ba88-e111414ee9fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:26.761454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0ae4e357-0397-4096-b0a1-58d13c9305a6 req-595f5638-a5ee-4e95-ba88-e111414ee9fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:26.813826 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0ae4e357-0397-4096-b0a1-58d13c9305a6 req-595f5638-a5ee-4e95-ba88-e111414ee9fb service nova] Creating event network-changed:dadad03f-db0a-400b-8796-860c02244280 for instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 on n-h1-master-1 Jul 24 01:27:26.828337 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0ae4e357-0397-4096-b0a1-58d13c9305a6 req-595f5638-a5ee-4e95-ba88-e111414ee9fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100599 Jul 24 01:27:26.830381 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1993/3842] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:27:26.942239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:26.961709 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:26.987141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:26.988498 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d37050e5-8a7b-43e4-a2d9-a4b3e886db27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.360079 Jul 24 01:27:26.995809 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1850/3843] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:26 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:27.453348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:27.454006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:27.454664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:27.458164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:27.465719 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:27.468811 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:27.469822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:27.470985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:27.471573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:27.481423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:27.483593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:27.484566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:27.487546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:27.568090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lazy-loading 'flavor' on Instance uuid 1b442384-e51b-40a2-aa9e-86c1404f7da0 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:27:27.826696 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2b1c5a7-2bf6-4f1b-9fa2-aefdf34be177 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/action" status: 200 len: 32 microversion: 2.1 time: 0.377563 Jul 24 01:27:27.832427 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1994/3844] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:27:27 2022] POST /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/action => generated 32 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:27:27.837585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:27.840044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:27.857527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:27.874754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:27.887076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:27.888753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:27.983960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:28.009636 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-17690440-86a1-4329-a6ee-122bd406ba1e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.557744 Jul 24 01:27:28.011676 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1851/3845] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:27 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:28.020550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:28.023010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:28.037100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:28.038488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:28.044413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:28.046607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:28.293153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:28.312648 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c78620ae-3566-42e1-8a7c-fc1a1baac2d4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1308 microversion: 2.1 time: 0.480944 Jul 24 01:27:28.314644 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1995/3846] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:27 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1308 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:28.325770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:28.327089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:28.342527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:28.343330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:28.345902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:28.346567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:28.529155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:28.555292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:28.556007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:28.558987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:28.565193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31c8bcbb-25c8-4a41-960e-513ebfd6f29a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.249394 Jul 24 01:27:28.566026 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1996/3847] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:28 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:28.597347 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-27c28027-3474-47b5-a031-f4a761cae8e1 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.582538 Jul 24 01:27:28.598835 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1852/3848] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:28 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:29.029665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:29.038197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:29.055080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:29.055790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:29.056756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:29.057362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:29.330993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:29.331870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:29.340051 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:29.340744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:29.341768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:29.342543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:29.921772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:29.941022 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98d349a1-3496-45bc-b118-066501918e38 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.915256 Jul 24 01:27:29.942308 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1997/3849] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:29 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:29.951396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:29.957340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:29.977501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:29.982553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:29.984240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:29.985940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:30.161421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:30.177922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:30.180694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:30.182822 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:30.184877 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f0f18aac-8549-4bc3-a1a0-7afebfbbd3b2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.241179 Jul 24 01:27:30.195902 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1998/3850] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:29 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:30.196090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e8605f78-eed5-4c38-b08c-4602d93b5d8c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1308 microversion: 2.1 time: 0.867373 Jul 24 01:27:30.197247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:30.198077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:30.201925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1853/3851] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:29 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1308 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:30.206079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:30.206538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:30.207507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:30.208107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:30.755295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:30.770412 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3cfcc75b-d9ff-4759-abe3-018daa14132a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.576720 Jul 24 01:27:30.778331 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 1999/3852] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:30 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:30.959204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:30.959969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:30.967374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:30.968143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:30.969173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:30.969863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.206241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:31.206739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:31.216118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.216938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.218274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.218865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.430761 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:31.439510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:31.447746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:31.449285 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b2eacf3-07ec-47c3-830b-164244e107b1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.247738 Jul 24 01:27:31.462704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2000/3853] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:31 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:31.476728 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:31.480111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:31.488773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.489474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.491203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.491907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.645533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:31.668128 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-70a57053-6730-4ec8-9ceb-a51146234039 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.709727 Jul 24 01:27:31.680858 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1854/3854] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:30 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:31.689118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:31.690257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:31.700887 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.701587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.702720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.703304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.741934 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] HTTP exception thrown: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Request method failure captured: Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b HTTP/1.1 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J5nNIrOgEs3TDY3Vuk_8qj6-2bqMpkKUp6Cb3ZzlwqFg0-JgKX3HPVPQtsAL0jUnLpa1NUx9muy0FkJvWbSRs8mBk4IqekW4_TiQ9f9uFcrju6lsSuvg4GbIZytGwW_iJTtxLsmPWU3_ZQxRG8ZuF19XSDC_TgA_FyLJiez2_ZNfhc Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.42 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 37d719380c51434683b3dcd83722913f Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37d719380c51434683b3dcd83722913f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37d719380c51434683b3dcd83722913f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37d719380c51434683b3dcd83722913f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37d719380c51434683b3dcd83722913f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 37d719380c51434683b3dcd83722913f Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TaggedBootDevicesTest_v242-1045863613-project Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5553b37350644a20b64ce76ebf60b44b Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1045863613-project Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2ccce789-d901-4d4a-a017-774c5d2a5d8b'} Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:27:31.744207 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Returning 404 to user: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:27:31.747313 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9031fa00-3c61-4bec-8b8c-84298b95b4d3 tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 404 len: 111 microversion: 2.42 time: 0.062606 Jul 24 01:27:31.749082 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1855/3855] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:27:31 2022] DELETE /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:27:31.774371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:31.776285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] [instance: 2ccce789-d901-4d4a-a017-774c5d2a5d8b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:31.782181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:31.785601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.786261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.787874 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.788527 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.795215 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-034ec00e-ed33-4c45-88e3-ca08f97ac804 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1308 microversion: 2.1 time: 0.330930 Jul 24 01:27:31.801718 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2001/3856] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:31 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:31.805860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:31.807929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:31.821940 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] HTTP exception thrown: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Request method failure captured: Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b HTTP/1.1 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J5nNIrOgEs3TDY3Vuk_8qj6-2bqMpkKUp6Cb3ZzlwqFg0-JgKX3HPVPQtsAL0jUnLpa1NUx9muy0FkJvWbSRs8mBk4IqekW4_TiQ9f9uFcrju6lsSuvg4GbIZytGwW_iJTtxLsmPWU3_ZQxRG8ZuF19XSDC_TgA_FyLJiez2_ZNfhc Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.42 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 37d719380c51434683b3dcd83722913f Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37d719380c51434683b3dcd83722913f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37d719380c51434683b3dcd83722913f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37d719380c51434683b3dcd83722913f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37d719380c51434683b3dcd83722913f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 37d719380c51434683b3dcd83722913f Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1045863613 Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TaggedBootDevicesTest_v242-1045863613-project Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5553b37350644a20b64ce76ebf60b44b Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1045863613-project Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2ccce789-d901-4d4a-a017-774c5d2a5d8b'} Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.824036 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] Returning 404 to user: Instance 2ccce789-d901-4d4a-a017-774c5d2a5d8b could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:27:31.827252 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78d23eb3-623e-4fd7-8292-76c5d0e158fa tempest-TaggedBootDevicesTest_v242-1045863613 tempest-TaggedBootDevicesTest_v242-1045863613-project] 10.222.0.27 "GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b" status: 404 len: 111 microversion: 2.42 time: 0.073330 Jul 24 01:27:31.827774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.827774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.827774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:31.828012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:31.830279 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1856/3857] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:31 2022] GET /compute/v2.1/servers/2ccce789-d901-4d4a-a017-774c5d2a5d8b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:27:32.092307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:32.101964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dc3403c6-53b2-4e39-9b2d-963950843951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.304407 Jul 24 01:27:32.106667 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2002/3858] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:31 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:32.481470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:32.482286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:32.489155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:32.502501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:32.503794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:32.504390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:32.618589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:32.628255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:32.630291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:32.633335 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ab3bfce0-f3a3-42cd-88b2-3d9b7d2ad544 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.155496 Jul 24 01:27:32.634998 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1857/3859] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:32 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:32.688258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:32.689916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:32.710659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:32.711279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:32.712966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:32.713597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:32.811932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:32.813904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:32.826480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:32.830246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:32.831372 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:32.832001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:33.218131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:33.232916 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f482793-2509-496d-8a49-a4c5372ab760 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1308 microversion: 2.1 time: 0.424723 Jul 24 01:27:33.233780 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1858/3860] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:32 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:33.254832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a1845b1b-c783-4b48-ac7d-eb5f63f3b751 req-a1ce9c1c-ea0b-46ce-9cd5-14cdaa9a187b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e248bf7-9673-4759-8bb7-1a966355e4b5", "name": "network-vif-plugged", "status": "completed", "tag": "dadad03f-db0a-400b-8796-860c02244280"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:33.266190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a1845b1b-c783-4b48-ac7d-eb5f63f3b751 req-a1ce9c1c-ea0b-46ce-9cd5-14cdaa9a187b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:33.266762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a1845b1b-c783-4b48-ac7d-eb5f63f3b751 req-a1ce9c1c-ea0b-46ce-9cd5-14cdaa9a187b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:33.285703 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a1845b1b-c783-4b48-ac7d-eb5f63f3b751 req-a1ce9c1c-ea0b-46ce-9cd5-14cdaa9a187b service nova] Creating event network-vif-plugged:dadad03f-db0a-400b-8796-860c02244280 for instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 on n-h1-master-1 Jul 24 01:27:33.293797 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a1845b1b-c783-4b48-ac7d-eb5f63f3b751 req-a1ce9c1c-ea0b-46ce-9cd5-14cdaa9a187b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047374 Jul 24 01:27:33.294753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1859/3861] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:27:33.302242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:33.303713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:33.318209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:33.320319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:33.321183 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:33.321974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:33.340417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:33.349084 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9010ea4d-1f3d-4e1c-aa8c-d201309df6c3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 0.666011 Jul 24 01:27:33.354013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2003/3862] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:32 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:33.653882 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:33.654741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:33.661350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:33.662052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:33.663738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:33.664341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:33.716568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:33.725904 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a4d83da-cefe-44e0-b500-916ccc8396da tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.429898 Jul 24 01:27:33.740082 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1860/3863] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:33 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:33.784143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:33.799037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:33.801319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:33.804188 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e82cbd7-2251-4202-b65d-cc07d5563379 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.153190 Jul 24 01:27:33.805061 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2004/3864] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:33 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:34.253394 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:34.254109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:34.269781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:34.272504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:34.274467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:34.274917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:34.369395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:34.370056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:34.398389 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:34.406773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:34.410513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:34.411731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:35.637303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:35.648054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:35.661792 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86b30097-730a-412e-9173-5b57fd7b7745 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1476 microversion: 2.1 time: 1.295958 Jul 24 01:27:35.666397 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-116c3ecc-a689-45e6-83f7-0f2e456cba23 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1308 microversion: 2.1 time: 1.418990 Jul 24 01:27:35.674162 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2005/3865] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:34 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1476 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:35.676194 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1861/3866] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:34 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1308 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:35.680218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:35.681486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:35.681850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:35.682455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:35.688936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:35.689718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:35.690668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:35.690905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:35.691425 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:35.691704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:35.693188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:35.694445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:35.867217 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:35.886681 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:35.891164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:35.897035 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b63a8f3-f80b-47a5-b8cb-d01fa7367d14 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.217488 Jul 24 01:27:35.900334 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1862/3867] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:35 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:36.103514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:36.111853 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6604ebd-c858-478a-acda-1daea8ec78a3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.436323 Jul 24 01:27:36.121037 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2006/3868] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:35 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:36.502720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c65c99ee-11c5-446d-b429-2fc96c4b31a5 req-7160c841-b9a9-4e28-9859-aa36d613247f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf24f66-1454-40ba-bbf2-f57df2ccc7ca", "name": "network-vif-unplugged", "status": "completed", "tag": "89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:36.518659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c65c99ee-11c5-446d-b429-2fc96c4b31a5 req-7160c841-b9a9-4e28-9859-aa36d613247f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:36.519143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c65c99ee-11c5-446d-b429-2fc96c4b31a5 req-7160c841-b9a9-4e28-9859-aa36d613247f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:36.549036 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c65c99ee-11c5-446d-b429-2fc96c4b31a5 req-7160c841-b9a9-4e28-9859-aa36d613247f service nova] Creating event network-vif-unplugged:89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef for instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca on n-h1-master-1 Jul 24 01:27:36.558807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-c65c99ee-11c5-446d-b429-2fc96c4b31a5 req-7160c841-b9a9-4e28-9859-aa36d613247f service nova] Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:27:36.573705 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c65c99ee-11c5-446d-b429-2fc96c4b31a5 req-7160c841-b9a9-4e28-9859-aa36d613247f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076231 Jul 24 01:27:36.575076 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1863/3869] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:27:36.684211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:36.684896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:36.685272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:36.687727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:36.698066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:36.698763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:36.699731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:36.700409 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:36.705690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:36.706928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:36.707898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:36.708219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.255186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:37.275012 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61ec94b4-0f21-4cfe-bfb3-2b3e76cc0f60 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1489 microversion: 2.1 time: 0.595060 Jul 24 01:27:37.276716 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1864/3870] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:36 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1489 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:37.294543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:37.295183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:37.306983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.307451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.308245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.312386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.325996 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:37.480706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:37.491594 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-56ca243f-07a3-450a-9b8d-0d2f5f67e605 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1475 microversion: 2.1 time: 0.809152 Jul 24 01:27:37.492203 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2007/3871] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:36 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1475 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:37.500014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:37.500644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:37.506515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:37.518949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.519414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.520205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.520655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.526088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:37.530670 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:37.533763 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:37.535712 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2707aefa-6d46-4024-be91-8d8d4e9b8685 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.255101 Jul 24 01:27:37.540227 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1865/3872] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:37 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:37.554895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de7886ad-7630-4071-8667-fdf7f6a5d06b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:37.556961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de7886ad-7630-4071-8667-fdf7f6a5d06b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:37.571807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de7886ad-7630-4071-8667-fdf7f6a5d06b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.573654 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de7886ad-7630-4071-8667-fdf7f6a5d06b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.574202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de7886ad-7630-4071-8667-fdf7f6a5d06b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.576414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de7886ad-7630-4071-8667-fdf7f6a5d06b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.719881 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de7886ad-7630-4071-8667-fdf7f6a5d06b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5/action" status: 202 len: 0 microversion: 2.1 time: 0.178246 Jul 24 01:27:37.721379 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1866/3873] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:27:37 2022] POST /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:27:37.751687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:37.754041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:37.769710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.770379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:37.772188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:37.772945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:38.266471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:38.276440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:38.284501 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6f40d558-b64a-4989-b347-ae52837a69c7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.791193 Jul 24 01:27:38.289846 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2008/3874] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:37 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:38.290356 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1577ce5-05f9-4506-823c-1cc84845d019 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1494 microversion: 2.1 time: 0.552277 Jul 24 01:27:38.291360 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1867/3875] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:37 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1494 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:38.510801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:38.512275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:38.520614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:38.522080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:38.523443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:38.524044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:38.573089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:38.578276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:38.623576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:38.624356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:38.628370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:38.633318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:38.853363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:38.901513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:38.906842 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:38.908359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fbf4ae5f-3e91-41a5-b001-10b2631ef291 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.355361 Jul 24 01:27:38.910367 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1868/3876] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:38 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:38.939504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d7e4a431-2604-4a44-95bf-513cab350597 req-52c425ac-aa1c-4d95-9c1c-17aad1e2e472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf24f66-1454-40ba-bbf2-f57df2ccc7ca", "tag": "89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:38.978985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d7e4a431-2604-4a44-95bf-513cab350597 req-52c425ac-aa1c-4d95-9c1c-17aad1e2e472 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:38.983078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d7e4a431-2604-4a44-95bf-513cab350597 req-52c425ac-aa1c-4d95-9c1c-17aad1e2e472 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.024611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d7e4a431-2604-4a44-95bf-513cab350597 req-52c425ac-aa1c-4d95-9c1c-17aad1e2e472 service nova] Creating event network-changed:89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef for instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca on n-h1-master-1 Jul 24 01:27:39.066695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-d7e4a431-2604-4a44-95bf-513cab350597 req-52c425ac-aa1c-4d95-9c1c-17aad1e2e472 service nova] Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:27:39.144856 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d7e4a431-2604-4a44-95bf-513cab350597 req-52c425ac-aa1c-4d95-9c1c-17aad1e2e472 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230767 Jul 24 01:27:39.158106 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1869/3877] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:27:39.230869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:39.260438 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7fab40bb-f74a-4df0-a5e0-d9a01db33512 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1475 microversion: 2.1 time: 0.754133 Jul 24 01:27:39.263009 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2009/3878] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:38 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1475 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:39.329852 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:39.330902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:39.332425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:39.333285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:39.344356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.345087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.347766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.348947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.349598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.354665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.355740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.356611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.855001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:39.867676 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68d90417-caa1-4b1f-a322-c4ec21b86dbc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 200 len: 1474 microversion: 2.1 time: 0.561691 Jul 24 01:27:39.868252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:39.869865 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2010/3879] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:39 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 1474 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:39.883229 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-67237288-fadf-4ce1-97f5-f58599453fe8 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.580126 Jul 24 01:27:39.883831 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1870/3880] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:39 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:39.888812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-44ab4f59-3565-439c-aff0-11a139c59b1a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1931401514"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:39.890612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-44ab4f59-3565-439c-aff0-11a139c59b1a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:39.899253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44ab4f59-3565-439c-aff0-11a139c59b1a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.900822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44ab4f59-3565-439c-aff0-11a139c59b1a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.902140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44ab4f59-3565-439c-aff0-11a139c59b1a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.902801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44ab4f59-3565-439c-aff0-11a139c59b1a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.929722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:39.930338 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:39.951350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.951875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:39.952684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:39.953124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:40.390053 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-44ab4f59-3565-439c-aff0-11a139c59b1a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5/action" status: 202 len: 0 microversion: 2.1 time: 0.507205 Jul 24 01:27:40.391033 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2011/3881] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:27:39 2022] POST /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:27:40.397318 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:40.398073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:40.405267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:40.405758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:40.406553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:40.406995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:40.573569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:40.583650 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:40.586718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:40.592419 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88abe54b-4417-45e5-bb97-db0dc447b4f9 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.667380 Jul 24 01:27:40.593537 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1871/3882] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:39 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:27:40.608648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be0c21a5-6887-4e89-a6d4-5a3dcdfa49ea tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb03b430>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:40.674341 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be0c21a5-6887-4e89-a6d4-5a3dcdfa49ea tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.079048 Jul 24 01:27:40.675741 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1872/3883] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:40 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:40.794567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:40.806734 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a6b3736-1797-40ff-ad8b-98877e872f18 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1473 microversion: 2.1 time: 0.413760 Jul 24 01:27:40.807540 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2012/3884] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:40 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1473 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:40.906051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:40.908256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:40.918875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:40.919561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:40.925943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:40.926604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:41.308249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:41.316865 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-40385299-d873-4ca0-874f-9bc75c5e30d3 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.420523 Jul 24 01:27:41.318641 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1873/3885] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:40 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:41.613440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:41.615664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:41.626317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:41.627225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:41.628172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:41.628994 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:41.688445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-21c3e045-863b-41aa-b988-d2f9ea1e3cbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaece550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:41.748718 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-21c3e045-863b-41aa-b988-d2f9ea1e3cbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.064071 Jul 24 01:27:41.754758 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1874/3886] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:41 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:41.824514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:41.825145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:41.833396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:41.834865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:41.837990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:41.838500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:41.841742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:41.868919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:41.875517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:41.877591 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a16ee87-85f4-4a2a-9db6-e554e0a13648 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.268942 Jul 24 01:27:41.895893 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2013/3887] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:41 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:42.335148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:42.335779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:42.346302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:42.347954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:42.352147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:42.352670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:42.362226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:42.374307 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a9da0cf-08ea-4caa-8f19-0618ce245b6e tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1470 microversion: 2.1 time: 0.553304 Jul 24 01:27:42.377516 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1875/3888] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:41 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1470 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:42.404348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffd94de1-2838-43fd-b858-041e38725a47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:42.405129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffd94de1-2838-43fd-b858-041e38725a47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:42.427039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffd94de1-2838-43fd-b858-041e38725a47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:42.428090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffd94de1-2838-43fd-b858-041e38725a47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:42.434220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffd94de1-2838-43fd-b858-041e38725a47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:42.438805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffd94de1-2838-43fd-b858-041e38725a47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:42.758693 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffd94de1-2838-43fd-b858-041e38725a47 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "POST /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca/action" status: 202 len: 0 microversion: 2.1 time: 0.366192 Jul 24 01:27:42.759644 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1876/3889] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:27:42 2022] POST /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:27:42.770977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc48b5d0-24d8-44dd-9c69-31c22628a171 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaf20e50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:42.886883 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc48b5d0-24d8-44dd-9c69-31c22628a171 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.123417 Jul 24 01:27:42.895277 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1877/3890] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:42 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:42.904561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:42.910292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:42.925480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:42.926355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:42.927411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:42.928106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:43.248830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:43.262009 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c9988619-31d7-4c00-90d3-f6491aa8766b tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.931230 Jul 24 01:27:43.282058 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2014/3891] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:42 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:43.288753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:43.289594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:43.305732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:43.305732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:43.306973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:43.308354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:43.462013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:43.469964 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9b834d0-bef2-4674-9c1c-a9353ab43611 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 0.573361 Jul 24 01:27:43.481549 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1878/3892] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:42 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:43.538072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:43.555439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:43.557917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:43.559520 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c2e86d32-df26-4918-b149-51fcee27c3ee tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.275504 Jul 24 01:27:43.572909 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2015/3893] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:43 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:43.902755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-602f21f9-3558-41fe-8cb5-c2cdd0e71607 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb801550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:43.981639 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-602f21f9-3558-41fe-8cb5-c2cdd0e71607 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.081961 Jul 24 01:27:43.988415 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1879/3894] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:43 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:44.279108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:44.280302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:44.293805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:44.296360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:44.298119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:44.302419 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:44.488472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:44.490088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:44.518148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:44.522586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:44.526333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:44.527045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:44.737331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:44.749058 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-04e51997-2706-4156-85b8-0f39f6963b90 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.473829 Jul 24 01:27:44.769755 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2016/3895] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:44 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:44.769755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:44.769755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:44.775059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:44.783418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:44.784465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:44.784992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:44.860833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:44.868796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:44.877558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:44.880354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ba73d9d-dfd5-4035-ab7d-d80a2f2496d7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 0.395710 Jul 24 01:27:44.882651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:44.883258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1880/3896] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:44 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:44.884385 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f4bd051-219a-4088-8581-94d06ce68b87 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.120577 Jul 24 01:27:44.887714 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2017/3897] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:44 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:44.995380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b7f3108-9338-4fe1-b40a-d5d8f147da1b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb66adc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:45.059836 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b7f3108-9338-4fe1-b40a-d5d8f147da1b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.067675 Jul 24 01:27:45.060856 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1881/3898] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:44 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:45.779718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:45.780524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:45.790635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:45.791442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:45.792481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:45.793738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:45.900214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:45.900835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:45.914044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:45.914770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:45.917860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:45.918517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:46.145571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:46.170295 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a560051c-a4e0-4449-a131-be8ada6f9c44 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.388535 Jul 24 01:27:46.173725 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2018/3899] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:45 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:46.181223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:46.191619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:46.195615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:46.196130 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6b48186f-cc7b-4da2-a47b-df306a289ce7 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 0.300023 Jul 24 01:27:46.197788 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1882/3900] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:45 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:46.204754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ea72023-4544-4823-a809-2ad7923a84ac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea33b0d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:46.241493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:46.242359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:46.243355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:46.243977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:46.277207 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ea72023-4544-4823-a809-2ad7923a84ac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.077868 Jul 24 01:27:46.278401 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1883/3901] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:46 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:46.341530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:46.351989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:46.353767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:46.355101 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cbaf8be4-76ba-48ca-b7e3-0f971f479b35 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.177872 Jul 24 01:27:46.366622 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2019/3902] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:46 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:47.192258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:47.194037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:47.220319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:47.220944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:47.236646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:47.237107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:47.237998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:47.238420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:47.247938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:47.248392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:47.249188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:47.249897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:47.828521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:47.836979 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5fa8540f-f46a-4e95-8e8d-35942c9875f1 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 0.624297 Jul 24 01:27:47.842738 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2020/3903] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:47 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:47.854840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5432a4d-c4e3-46db-8a3b-0bb6adf580e4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaa979d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:47.956309 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5432a4d-c4e3-46db-8a3b-0bb6adf580e4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.108524 Jul 24 01:27:47.956923 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2021/3904] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:47 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:47.966740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:47.967365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:48.003376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:48.003872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:48.004740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:48.005125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:48.590922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:48.609723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:48.619145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:48.621428 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f618134-5f10-4a62-9162-20738a24ba27 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.663541 Jul 24 01:27:48.624852 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2022/3905] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:47 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:48.647946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-720b3e3f-7611-4634-9c65-51fb205ece0d req-8af58bee-887f-4718-aed6-6c91e81902dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf24f66-1454-40ba-bbf2-f57df2ccc7ca", "tag": "89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:48.687037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-720b3e3f-7611-4634-9c65-51fb205ece0d req-8af58bee-887f-4718-aed6-6c91e81902dc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:48.695830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-720b3e3f-7611-4634-9c65-51fb205ece0d req-8af58bee-887f-4718-aed6-6c91e81902dc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:48.715222 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-720b3e3f-7611-4634-9c65-51fb205ece0d req-8af58bee-887f-4718-aed6-6c91e81902dc service nova] Creating event network-changed:89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef for instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca on n-h2-master-1 Jul 24 01:27:48.735044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-720b3e3f-7611-4634-9c65-51fb205ece0d req-8af58bee-887f-4718-aed6-6c91e81902dc service nova] Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:27:48.772540 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-720b3e3f-7611-4634-9c65-51fb205ece0d req-8af58bee-887f-4718-aed6-6c91e81902dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138289 Jul 24 01:27:48.775534 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2023/3906] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:27:48.824769 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:48.843495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-21876b98-625b-480e-b4e8-f05a33a55646 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 1.653316 Jul 24 01:27:48.853632 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1884/3907] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:47 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:48.860601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:48.861548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:48.876379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:48.877011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:48.877966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:48.878545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:48.969883 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4652207b-2c39-495d-a8bb-a64cc7fd8b87 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb8228b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:49.067192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4652207b-2c39-495d-a8bb-a64cc7fd8b87 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.101382 Jul 24 01:27:49.071421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1885/3908] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:48 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:49.514966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:49.519665 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:49.530814 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3ceb086d-ba08-4259-871b-dd052ff6ee5c tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 0.674926 Jul 24 01:27:49.534851 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2024/3909] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:48 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:49.643482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:49.644290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:49.661497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:49.662661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:49.663645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:49.664236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:49.675846 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:49.861649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:49.862796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:49.874073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:49.874782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:49.875837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:49.882926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:50.129915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:50.144078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:50.145938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:50.148254 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c515191-261f-4701-9343-1bf39d6ad3a2 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.509815 Jul 24 01:27:50.156177 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1886/3910] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:49 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:50.165325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2665215d-7f18-4527-bd0d-5306daf66c7a req-e72fd2da-1b79-469d-b545-5157c8c72019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e248bf7-9673-4759-8bb7-1a966355e4b5", "name": "network-vif-plugged", "status": "completed", "tag": "dadad03f-db0a-400b-8796-860c02244280"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:50.185877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2665215d-7f18-4527-bd0d-5306daf66c7a req-e72fd2da-1b79-469d-b545-5157c8c72019 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:50.186548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2665215d-7f18-4527-bd0d-5306daf66c7a req-e72fd2da-1b79-469d-b545-5157c8c72019 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:50.208589 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2665215d-7f18-4527-bd0d-5306daf66c7a req-e72fd2da-1b79-469d-b545-5157c8c72019 service nova] Creating event network-vif-plugged:dadad03f-db0a-400b-8796-860c02244280 for instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 on n-h1-master-1 Jul 24 01:27:50.230403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2665215d-7f18-4527-bd0d-5306daf66c7a req-e72fd2da-1b79-469d-b545-5157c8c72019 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072695 Jul 24 01:27:50.232823 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1887/3911] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:27:50.238582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a06a5056-d2f6-4d90-99f7-00478ba0b66b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb822550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:50.346740 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a06a5056-d2f6-4d90-99f7-00478ba0b66b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.112100 Jul 24 01:27:50.347518 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1888/3912] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:50 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:50.551135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:50.552898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:50.560445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:50.561323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:50.562354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:50.562996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:50.831920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:50.844792 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6686111-7c9d-4d03-a644-6efe51834d83 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1734 microversion: 2.1 time: 0.986895 Jul 24 01:27:50.855586 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2025/3913] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:49 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1734 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:50.994607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:51.002832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3e376b6e-b53e-48ac-bb08-00564a485df4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 0.455526 Jul 24 01:27:51.014531 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1889/3914] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:50 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:51.169404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:51.170064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:51.178111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:51.178950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:51.180581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:51.181246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:51.364845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38502553-a5ef-4d6a-815a-6d00dd2afffd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea2ad940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:51.453064 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38502553-a5ef-4d6a-815a-6d00dd2afffd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.096198 Jul 24 01:27:51.454469 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1890/3915] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:51 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:51.508958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:51.520800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:51.522439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:51.523680 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b1f74232-962d-4b1f-b934-2a4ef5ac495b tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.358500 Jul 24 01:27:51.537379 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2026/3916] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:51 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:51.863634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:51.864635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:51.876950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:51.882559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:51.883642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:51.884245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:52.021907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:52.022723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:52.033393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:52.035312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:52.036278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:52.036910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:52.491508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:52.504502 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec7a31f9-b312-4630-a7fd-e87251993f42 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1714 microversion: 2.1 time: 0.645717 Jul 24 01:27:52.508404 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1891/3917] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:51 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1714 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:52.526228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4218f04c-8567-42b5-b7a0-d7054ea37a9a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea402040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:52.579981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:52.588504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d0a84da-2153-4616-a8b6-36acbfc7f9a0 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 0.571933 Jul 24 01:27:52.591443 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2027/3918] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:52 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:52.602793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:52.604977 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4218f04c-8567-42b5-b7a0-d7054ea37a9a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.095086 Jul 24 01:27:52.605777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:52.607011 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1892/3919] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:52 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:52.619872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:52.622734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:52.625327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:52.625992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:52.720993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:52.722325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:52.747191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:52.747900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:52.749124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:52.749734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:52.810799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:52.829955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:52.844720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:52.851333 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d1c16b3-52e5-4a91-a056-0d2de529f9ca tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1366 microversion: 2.57 time: 0.257816 Jul 24 01:27:52.856758 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2028/3920] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:52 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:52.977806 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 while it is in vm_state rescued Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments/36baa45b-f0b6-4af5-8cae-ada01d38e1d5 HTTP/1.1 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'detach_volume' instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 while it is in vm_state rescued Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': '1b442384-e51b-40a2-aa9e-86c1404f7da0', 'id': '36baa45b-f0b6-4af5-8cae-ada01d38e1d5'} Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 while it is in vm_state rescued Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:52.981653 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:27:52.984865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:27:52.984865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:27:52.984865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:27:52.984865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:27:52.984865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 while it is in vm_state rescued Jul 24 01:27:52.984865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:27:52.986415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 409 to user: Cannot 'detach_volume' instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 while it is in vm_state rescued {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:27:52.987532 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7fdd1c44-174c-47bb-84cc-87bf2f7bfb13 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments/36baa45b-f0b6-4af5-8cae-ada01d38e1d5" status: 409 len: 152 microversion: 2.1 time: 0.273444 Jul 24 01:27:52.990786 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1893/3921] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:27:52 2022] DELETE /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments/36baa45b-f0b6-4af5-8cae-ada01d38e1d5 => generated 152 bytes in 277 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:27:52.998424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-39c8d75d-f405-4e8d-b565-be97247fac1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:27:52.999268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-39c8d75d-f405-4e8d-b565-be97247fac1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:53.011144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c8d75d-f405-4e8d-b565-be97247fac1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:53.015876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c8d75d-f405-4e8d-b565-be97247fac1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:53.019489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c8d75d-f405-4e8d-b565-be97247fac1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:53.023732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c8d75d-f405-4e8d-b565-be97247fac1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:53.216272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-39c8d75d-f405-4e8d-b565-be97247fac1d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/action" status: 202 len: 0 microversion: 2.1 time: 0.221774 Jul 24 01:27:53.220083 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2029/3922] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:27:52 2022] POST /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:27:53.229407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:53.230071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:53.250103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:53.250571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:53.251391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:53.263144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:53.611111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:53.611985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:53.626355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:53.626812 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:53.627603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:53.633559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:54.665288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:54.687756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b915bee7-5503-471c-b091-efe4e38072a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1722 microversion: 2.1 time: 1.463081 Jul 24 01:27:54.698703 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1894/3923] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:53 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1722 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:54.704559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbed3ff8-df22-4724-9643-64716bec693c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaff6a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:54.765854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:54.778674 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5767f2f9-462d-4613-b6fe-34043b6ef212 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1469 microversion: 2.1 time: 1.173143 Jul 24 01:27:54.784856 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2030/3924] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:53 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1469 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:54.797360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:54.798023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:54.811202 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbed3ff8-df22-4724-9643-64716bec693c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.109854 Jul 24 01:27:54.814437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1895/3925] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:54 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:54.820198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:54.820860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:54.821832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:54.822415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:55.043141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:55.054283 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:55.068732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:55.070248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab61bd49-cc02-4bb4-8563-9d259fbf7ebe tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1372 microversion: 2.57 time: 0.284314 Jul 24 01:27:55.072457 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2031/3926] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:54 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:55.707706 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:55.709606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:55.711772 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=78 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:55.730433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:55.736503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:55.737357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:55.742010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:55.806658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:55.809588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:55.823139 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=80 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:55.830584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:55.835976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:55.838039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:55.842581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.013971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:57.026828 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ab4fb2d-2fea-4a19-a3ce-8d77c78c3250 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1462 microversion: 2.1 time: 1.230500 Jul 24 01:27:57.029319 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2032/3927] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:55 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1462 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:57.039774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f08745e7-635b-4c2e-9b4d-64971993c9e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb6a8e50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:57.045163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:57.059686 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef5318bd-465c-4633-8306-f3280abd1649 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1722 microversion: 2.1 time: 1.357634 Jul 24 01:27:57.073744 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1896/3928] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:55 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1722 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:57.083377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:57.084683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:57.109834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.120284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.124186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.125081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.161018 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f08745e7-635b-4c2e-9b4d-64971993c9e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.129586 Jul 24 01:27:57.162545 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2033/3929] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:57 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:57.171790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e41f5dd-275c-4496-858f-d0177877ea80 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:57.172415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e41f5dd-275c-4496-858f-d0177877ea80 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:57.194814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e41f5dd-275c-4496-858f-d0177877ea80 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.195290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e41f5dd-275c-4496-858f-d0177877ea80 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.196115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e41f5dd-275c-4496-858f-d0177877ea80 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.196559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e41f5dd-275c-4496-858f-d0177877ea80 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.432499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:57.448051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:57.455613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:57.457579 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43b5260f-339e-487e-84f9-733174dd0a43 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1357 microversion: 2.57 time: 0.390401 Jul 24 01:27:57.461071 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1897/3930] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:57 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1357 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:57.488722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:57.489214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:57.500667 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.501131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.501954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.502397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.572302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:27:57.643240 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e41f5dd-275c-4496-858f-d0177877ea80 tempest-MigrationsAdminTest-1581228377 tempest-MigrationsAdminTest-1581228377-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1613 microversion: 2.1 time: 0.479405 Jul 24 01:27:57.646114 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2034/3931] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:57 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1613 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:57.668548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:57.670639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:57.710135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.710891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.711878 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.712497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.801022 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-70dfa0ee-e3d5-4700-941d-5afbd2eac708 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 204 len: 0 microversion: 2.57 time: 0.315887 Jul 24 01:27:57.807294 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1898/3932] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:27:57 2022] DELETE /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:27:57.813988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:27:57.824483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:57.828643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:57.855475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.859966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:57.861020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:57.865934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:58.055926 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b84710da-0735-4b31-a58f-ed716fe0afc3 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 204 len: 0 microversion: 2.1 time: 0.392621 Jul 24 01:27:58.056774 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2035/3933] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:27:57 2022] DELETE /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:27:58.066156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:58.067009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:58.113251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:58.114160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:58.118363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:58.124490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:58.292915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:58.307639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:58.315479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:58.319049 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d7662cb-eddc-4abb-a650-8abd603245a5 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1363 microversion: 2.57 time: 0.504808 Jul 24 01:27:58.319727 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1899/3934] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:57 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:27:58.332341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:58.335826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:58.349856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:58.350322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:58.357351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:58.358294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:59.211074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:59.223672 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-646ccf0e-ee88-4539-975a-fa7f91e3c5eb tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1468 microversion: 2.1 time: 1.159779 Jul 24 01:27:59.225176 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2036/3935] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:58 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1468 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:27:59.241484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-85caffbb-786f-465f-ac80-464684877f00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaaf5160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:59.329347 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-85caffbb-786f-465f-ac80-464684877f00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.099334 Jul 24 01:27:59.330627 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2037/3936] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:59 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:59.337187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:27:59.350826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:27:59.366922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:59.368556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:59.381755 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d552308e-c13e-4a45-b3ec-5e3cbc4c8731 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1722 microversion: 2.1 time: 1.057723 Jul 24 01:27:59.407987 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1900/3937] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:27:58 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1722 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:27:59.408341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:59.415370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:27:59.416245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:27:59.663090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:59.675802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:59.679942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:27:59.683389 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-810cb67a-fc95-4832-a95b-a423dfa6818d tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1363 microversion: 2.57 time: 0.350247 Jul 24 01:27:59.683971 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2038/3938] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:27:59 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:00.243209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:00.244211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:00.260587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:00.261551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:00.262655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:00.263366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:00.343581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-359009e9-bdf5-4618-ba3d-169199b30825 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaaf5160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:00.416109 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-359009e9-bdf5-4618-ba3d-169199b30825 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.076739 Jul 24 01:28:00.416893 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2039/3939] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:00 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:00.422360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:00.435117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:00.448241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:00.455126 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:00.456368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:00.456968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:00.893698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:00.909652 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9083a3bf-0d81-4e13-b143-f5bdebffd1d0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1728 microversion: 2.1 time: 0.490697 Jul 24 01:28:00.912737 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2040/3940] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:00 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1728 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:00.928494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:00.932983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:00.966942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:00.972580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:00.973883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:00.974977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:01.264556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:01.269298 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:01.285125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:01.287353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a842684b4a4020a9e8e6839c2a2748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe90029c99433ba86341f96ffc70af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:01.289209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:01.296600 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dcf2e9a3-486e-4a64-ae9f-8b6bdb326ea1 tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 200 len: 1363 microversion: 2.57 time: 0.382578 Jul 24 01:28:01.297568 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2041/3941] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:00 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:01.313838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b87df7ea-e483-47b1-bc05-8de6964a529d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:01.314433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b87df7ea-e483-47b1-bc05-8de6964a529d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:01.315336 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e655fc53-4d81-4765-8bf6-405bfd756b25 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1468 microversion: 2.1 time: 1.077758 Jul 24 01:28:01.320564 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1901/3942] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:00 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1468 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:01.336238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b87df7ea-e483-47b1-bc05-8de6964a529d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:01.336963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b87df7ea-e483-47b1-bc05-8de6964a529d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:01.338200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b87df7ea-e483-47b1-bc05-8de6964a529d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:01.339000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b87df7ea-e483-47b1-bc05-8de6964a529d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:01.431613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32075c2e-679f-4f5e-830a-d70bf4a7d606 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eafb0310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:01.583775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-32075c2e-679f-4f5e-830a-d70bf4a7d606 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.155696 Jul 24 01:28:01.585540 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1902/3943] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:01 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:01.660141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-17062fbb-2507-4ae2-ada0-b5b5f362ee7f req-c1eaeec1-5aaa-4070-84be-d22a996692bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf24f66-1454-40ba-bbf2-f57df2ccc7ca", "name": "network-vif-deleted", "tag": "89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:01.678681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-17062fbb-2507-4ae2-ada0-b5b5f362ee7f req-c1eaeec1-5aaa-4070-84be-d22a996692bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:01.679275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-17062fbb-2507-4ae2-ada0-b5b5f362ee7f req-c1eaeec1-5aaa-4070-84be-d22a996692bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:01.723405 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-17062fbb-2507-4ae2-ada0-b5b5f362ee7f req-c1eaeec1-5aaa-4070-84be-d22a996692bf service nova] Creating event network-vif-deleted:89d7a78b-70a4-4f96-abfd-a3fd8e9c30ef for instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca on n-h2-master-1 Jul 24 01:28:01.743454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-17062fbb-2507-4ae2-ada0-b5b5f362ee7f req-c1eaeec1-5aaa-4070-84be-d22a996692bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085479 Jul 24 01:28:01.745435 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1903/3944] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:28:01.822352 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b87df7ea-e483-47b1-bc05-8de6964a529d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.523270 Jul 24 01:28:01.824084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2042/3945] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:28:01 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-interface => generated 284 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:02.324167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:02.326044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] [instance: e3b39fd1-c757-43c9-a57c-3a183f98a72d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:02.340672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:02.341457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:02.342421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:02.342924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:02.343366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:02.343551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:02.361246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:02.362433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:02.363245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:02.363690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:02.365361 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] HTTP exception thrown: Instance e3b39fd1-c757-43c9-a57c-3a183f98a72d could not be found. Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Request method failure captured: Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d HTTP/1.1 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_zsK2cmfFk03_eWbRKInjf9GCGz6i3QD7iwQ4MjEqlzO2oIzBdbN_KyhqQeG6Eizi6bb5CkuZ2E4OGu3A1uxIWKLlIaZVQRxsJ5rxTE1C99SeZH5NFa9ghR0wDYmwksPi7yMBkFCQEVGJVTfZDvt2bEslqDyR3ZaU3XYp4aIjPcHU Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.57 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a4fe90029c99433ba86341f96ffc70af Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerShowV257Test-901630489 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a4fe90029c99433ba86341f96ffc70af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4fe90029c99433ba86341f96ffc70af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a4fe90029c99433ba86341f96ffc70af", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4fe90029c99433ba86341f96ffc70af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerShowV257Test-901630489 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a4fe90029c99433ba86341f96ffc70af Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerShowV257Test-901630489 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerShowV257Test-901630489-project Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f3a842684b4a4020a9e8e6839c2a2748 Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerShowV257Test-901630489-project Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: exception: Instance e3b39fd1-c757-43c9-a57c-3a183f98a72d could not be found. Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'e3b39fd1-c757-43c9-a57c-3a183f98a72d'} Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b39fd1-c757-43c9-a57c-3a183f98a72d could not be found. Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b39fd1-c757-43c9-a57c-3a183f98a72d could not be found. Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:02.368085 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:02.371397 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:02.371397 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:02.371397 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:02.371397 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:02.371397 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:02.371397 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b39fd1-c757-43c9-a57c-3a183f98a72d could not be found. Jul 24 01:28:02.371397 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:02.374524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] Returning 404 to user: Instance e3b39fd1-c757-43c9-a57c-3a183f98a72d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:02.378032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb8fb87b-da39-4e0d-b7bf-3f1d6f70aa6a tempest-ServerShowV257Test-901630489 tempest-ServerShowV257Test-901630489-project] 10.222.0.27 "GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d" status: 404 len: 111 microversion: 2.57 time: 0.065212 Jul 24 01:28:02.385123 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1904/3946] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:02 2022] GET /compute/v2.1/servers/e3b39fd1-c757-43c9-a57c-3a183f98a72d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:28:02.471073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:02.472176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:02.472646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lazy-loading 'fault' on Instance uuid bcf24f66-1454-40ba-bbf2-f57df2ccc7ca {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:28:02.600428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76771d84-3898-475a-badc-31f506032162 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb822dc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:02.741696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:02.744268 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76771d84-3898-475a-badc-31f506032162 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.149047 Jul 24 01:28:02.745891 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1905/3947] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:02 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:02.758545 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-53ab13a5-9cc1-4b8c-a375-5cdb861f4970 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 200 len: 1302 microversion: 2.1 time: 0.424952 Jul 24 01:28:02.759471 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2043/3948] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:02 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 1302 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:03.760699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fbf0d3f5-dbea-40b3-8ff3-316d403e1c2f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb5891f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:03.794514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:03.795295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: bcf24f66-1454-40ba-bbf2-f57df2ccc7ca] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:03.823748 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:03.824453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:03.825809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:03.826440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:03.878435 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fbf0d3f5-dbea-40b3-8ff3-316d403e1c2f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.123865 Jul 24 01:28:03.879204 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1906/3949] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:03 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:03.919014 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] HTTP exception thrown: Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca could not be found. Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Request method failure captured: Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca HTTP/1.1 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8BE-kjY8PavSmnIn31T5wf4srb8X-Z2cj3R-4DuClOhhHrAuKHlhdk77QxtV1jM0G4fpHaGTxQPPRZyqqxrB-DTcmSraOetnTQJlcmtFvtgVVX5d-7FXBCRzFzCkA7Jh7WVkrQ7wFCgJoRZteUyx6gmtiOjnxvXmZNJSCKOd2Ui8Q Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74794638ee6a4b18aef9ff780d461b73", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 01e7c66073564bb0b78b2309d281d1f1 Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: exception: Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca could not be found. Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'bcf24f66-1454-40ba-bbf2-f57df2ccc7ca'} Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca could not be found. Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca could not be found. Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:03.925195 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:03.929888 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:03.929888 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:03.929888 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:03.929888 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:03.929888 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:03.929888 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca could not be found. Jul 24 01:28:03.929888 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:03.932936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Returning 404 to user: Instance bcf24f66-1454-40ba-bbf2-f57df2ccc7ca could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:03.934052 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9c2dcad-13c6-41bd-b615-075574151234 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca" status: 404 len: 111 microversion: 2.1 time: 0.160692 Jul 24 01:28:03.941726 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2044/3950] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:03 2022] GET /compute/v2.1/servers/bcf24f66-1454-40ba-bbf2-f57df2ccc7ca => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:28:03.946669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:03.947317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:03.959587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:03.967539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:03.968671 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:03.970620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:04.086189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:28:04.322962 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-66aaaecb-c398-45f2-affa-30bdfe61cfa9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 204 len: 0 microversion: 2.1 time: 0.380685 Jul 24 01:28:04.323814 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1907/3951] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:28:03 2022] DELETE /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:28:04.332742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:04.334239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:04.350028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:04.351179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:04.353937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:04.355470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:04.930938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ed6973b-d2dd-464b-8a7a-67655023e79f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb8228b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:05.010192 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ed6973b-d2dd-464b-8a7a-67655023e79f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.090318 Jul 24 01:28:05.019080 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1908/3952] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:04 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:05.490247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6085292b-055a-40d0-86ed-f8e9beb00ff0 req-371db971-0b58-461b-a8b2-6b87b2ba2be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b442384-e51b-40a2-aa9e-86c1404f7da0", "tag": "9852d3b1-563c-4847-9ab9-41791450fbdb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:05.506846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6085292b-055a-40d0-86ed-f8e9beb00ff0 req-371db971-0b58-461b-a8b2-6b87b2ba2be4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:05.507576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6085292b-055a-40d0-86ed-f8e9beb00ff0 req-371db971-0b58-461b-a8b2-6b87b2ba2be4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:05.535554 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6085292b-055a-40d0-86ed-f8e9beb00ff0 req-371db971-0b58-461b-a8b2-6b87b2ba2be4 service nova] Creating event network-changed:9852d3b1-563c-4847-9ab9-41791450fbdb for instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 on n-h1-master-1 Jul 24 01:28:05.555464 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6085292b-055a-40d0-86ed-f8e9beb00ff0 req-371db971-0b58-461b-a8b2-6b87b2ba2be4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068548 Jul 24 01:28:05.557998 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1909/3953] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:28:05.639805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:05.659145 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b1ab075-1f56-408b-9a6e-59ee0226912d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1532 microversion: 2.1 time: 1.328940 Jul 24 01:28:05.676411 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2045/3954] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:04 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1532 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:06.026668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-383aaf18-accf-4530-b96c-9072c446dbee tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb832d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:06.168830 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-383aaf18-accf-4530-b96c-9072c446dbee tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.149203 Jul 24 01:28:06.169419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1910/3955] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:06 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:06.680806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:06.682170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:06.700191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:06.700974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:06.702654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:06.705523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:07.183543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3330de2c-5cfa-4530-a24e-e83ff41ce922 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb3fb8b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:07.341459 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3330de2c-5cfa-4530-a24e-e83ff41ce922 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.163275 Jul 24 01:28:07.342417 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1911/3956] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:07 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:07.533191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:07.543931 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c8104b7-cc8a-420d-976d-627b6d4f24b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1532 microversion: 2.1 time: 0.868193 Jul 24 01:28:07.551094 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2046/3957] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:06 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1532 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:08.002169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-953cca10-103a-4fad-b944-877c1a0a8707 req-ed70e2d5-aa99-4e6c-8554-75b8a42994df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b442384-e51b-40a2-aa9e-86c1404f7da0", "tag": "9852d3b1-563c-4847-9ab9-41791450fbdb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:08.038528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-953cca10-103a-4fad-b944-877c1a0a8707 req-ed70e2d5-aa99-4e6c-8554-75b8a42994df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:08.052979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-953cca10-103a-4fad-b944-877c1a0a8707 req-ed70e2d5-aa99-4e6c-8554-75b8a42994df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:08.063597 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:08.091744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-953cca10-103a-4fad-b944-877c1a0a8707 req-ed70e2d5-aa99-4e6c-8554-75b8a42994df service nova] Creating event network-changed:9852d3b1-563c-4847-9ab9-41791450fbdb for instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 on n-h1-master-1 Jul 24 01:28:08.109766 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-953cca10-103a-4fad-b944-877c1a0a8707 req-ed70e2d5-aa99-4e6c-8554-75b8a42994df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111588 Jul 24 01:28:08.142279 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1912/3958] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:08.359444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40cc9378-9ec1-4117-937b-539954e0f29c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea915430>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:08.438549 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40cc9378-9ec1-4117-937b-539954e0f29c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.085271 Jul 24 01:28:08.440615 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2047/3959] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:08 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:08.570174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:08.571563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:08.588832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:08.589684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:08.591578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:08.593287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:09.366148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:09.383524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0b632e66-c221-497a-8368-98b67de23dd3 req-f60caf2c-d56d-494c-b33c-5dcb827809b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b48bf29-3067-490d-86df-7d8258aac369", "name": "network-vif-deleted", "tag": "f554a1be-8a87-4df4-b910-86f58f1126fe"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:09.384094 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f5541b0a-3cc9-4004-9d23-99f017daed13 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 200 len: 1532 microversion: 2.1 time: 0.819165 Jul 24 01:28:09.388544 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1913/3960] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:08 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 1532 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:09.406875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0b632e66-c221-497a-8368-98b67de23dd3 req-f60caf2c-d56d-494c-b33c-5dcb827809b6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:09.407423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0b632e66-c221-497a-8368-98b67de23dd3 req-f60caf2c-d56d-494c-b33c-5dcb827809b6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:09.445197 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0b632e66-c221-497a-8368-98b67de23dd3 req-f60caf2c-d56d-494c-b33c-5dcb827809b6 service nova] Creating event network-vif-deleted:f554a1be-8a87-4df4-b910-86f58f1126fe for instance 9b48bf29-3067-490d-86df-7d8258aac369 on n-h1-master-1 Jul 24 01:28:09.453586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-087b4da2-6300-44ca-805a-0aa62b3d89ef tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eacb7dc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:09.461485 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0b632e66-c221-497a-8368-98b67de23dd3 req-f60caf2c-d56d-494c-b33c-5dcb827809b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081732 Jul 24 01:28:09.464142 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2048/3961] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:28:09.531278 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-087b4da2-6300-44ca-805a-0aa62b3d89ef tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.081694 Jul 24 01:28:09.531805 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1914/3962] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:09 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:10.402757 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:10.403470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: 9b48bf29-3067-490d-86df-7d8258aac369] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:10.423135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:10.441560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:10.443510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:10.444119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:10.483583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] HTTP exception thrown: Instance 9b48bf29-3067-490d-86df-7d8258aac369 could not be found. Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Request method failure captured: Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 HTTP/1.1 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8BE-kjY8PavSmnIn31T5wf4srb8X-Z2cj3R-4DuClOhhHrAuKHlhdk77QxtV1jM0G4fpHaGTxQPPRZyqqxrB-DTcmSraOetnTQJlcmtFvtgVVX5d-7FXBCRzFzCkA7Jh7WVkrQ7wFCgJoRZteUyx6gmtiOjnxvXmZNJSCKOd2Ui8Q Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74794638ee6a4b18aef9ff780d461b73", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 01e7c66073564bb0b78b2309d281d1f1 Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 9b48bf29-3067-490d-86df-7d8258aac369 could not be found. Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '9b48bf29-3067-490d-86df-7d8258aac369'} Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b48bf29-3067-490d-86df-7d8258aac369 could not be found. Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b48bf29-3067-490d-86df-7d8258aac369 could not be found. Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:10.495514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:10.499846 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:10.499846 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:10.499846 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:10.499846 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:10.499846 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:10.499846 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b48bf29-3067-490d-86df-7d8258aac369 could not be found. Jul 24 01:28:10.499846 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:10.501009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Returning 404 to user: Instance 9b48bf29-3067-490d-86df-7d8258aac369 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:10.502699 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-72e31184-91c8-4203-ab7d-1d6c85c730a9 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369" status: 404 len: 111 microversion: 2.1 time: 0.104129 Jul 24 01:28:10.509828 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2049/3963] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:10 2022] GET /compute/v2.1/servers/9b48bf29-3067-490d-86df-7d8258aac369 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:28:10.515494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc9d5677-c959-4d53-b17a-cb7b06a60348 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '.version_select at 0x7f05eb5893a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:10.553542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8780f853-649b-4b3d-8682-405c8649c585 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaa954c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:10.568416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc9d5677-c959-4d53-b17a-cb7b06a60348 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530882171" status: 202 len: 0 microversion: 2.1 time: 0.056930 Jul 24 01:28:10.569362 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1915/3964] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530882171 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:28:10.642806 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8780f853-649b-4b3d-8682-405c8649c585 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.101002 Jul 24 01:28:10.648889 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2050/3965] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:10 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:11.657617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb7da533-290e-407e-8326-19279f71abbd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea42db80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:11.736912 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb7da533-290e-407e-8326-19279f71abbd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.084197 Jul 24 01:28:11.737875 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1916/3966] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:11 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:12.587359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-121fc3b6-c24f-424f-ae31-2ca358495069 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:12.588722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-121fc3b6-c24f-424f-ae31-2ca358495069 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:12.624620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-121fc3b6-c24f-424f-ae31-2ca358495069 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:12.625513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-121fc3b6-c24f-424f-ae31-2ca358495069 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:12.626753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-121fc3b6-c24f-424f-ae31-2ca358495069 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:12.628212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-121fc3b6-c24f-424f-ae31-2ca358495069 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:12.740149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-121fc3b6-c24f-424f-ae31-2ca358495069 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments/09c219c0-0772-4311-8377-c711809fe718" status: 200 len: 194 microversion: 2.20 time: 0.157495 Jul 24 01:28:12.744129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2051/3967] 10.222.0.27 () {60 vars in 1453 bytes} [Sun Jul 24 01:28:12 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments/09c219c0-0772-4311-8377-c711809fe718 => generated 194 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:12.754682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2819b0c8-321b-430f-953d-65928fad0ba0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea49a8b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:12.841060 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2819b0c8-321b-430f-953d-65928fad0ba0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.091192 Jul 24 01:28:12.841660 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1917/3968] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:12 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:12.875517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:12.876239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:12.893704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:12.901339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:12.902562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:12.903018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:13.137310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lazy-loading 'services' on Instance uuid 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:28:13.374708 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0ce86b59-adb6-4566-8316-8f801344fa00 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments/09c219c0-0772-4311-8377-c711809fe718" status: 202 len: 0 microversion: 2.20 time: 0.503233 Jul 24 01:28:13.375396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2052/3969] 10.222.0.27 () {60 vars in 1456 bytes} [Sun Jul 24 01:28:12 2022] DELETE /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments/09c219c0-0772-4311-8377-c711809fe718 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:28:13.386096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d0a6c4d-019c-4479-a811-e1035d34ce1e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:13.387048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d0a6c4d-019c-4479-a811-e1035d34ce1e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:13.403474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0a6c4d-019c-4479-a811-e1035d34ce1e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:13.403474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0a6c4d-019c-4479-a811-e1035d34ce1e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:13.416219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0a6c4d-019c-4479-a811-e1035d34ce1e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:13.416731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d0a6c4d-019c-4479-a811-e1035d34ce1e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:13.581012 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d0a6c4d-019c-4479-a811-e1035d34ce1e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.195201 Jul 24 01:28:13.582547 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1918/3970] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:13 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:13.856761 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3de5695-a8f6-4d2b-9546-759f68a121d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb724820>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:13.937919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3de5695-a8f6-4d2b-9546-759f68a121d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.086971 Jul 24 01:28:13.938947 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2053/3971] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:13 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:14.105149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:14.106520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:14.160147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:14.162177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:14.163723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:14.164337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:14.208933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:28:14.377064 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eedbd847-f840-4891-b50f-b7111918a8dd tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 204 len: 0 microversion: 2.1 time: 0.275923 Jul 24 01:28:14.378149 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1919/3972] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:28:14 2022] DELETE /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:28:14.387207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:14.388105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:14.423791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:14.429332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:14.445846 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:14.446819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:14.595465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fea26edd-02e2-4b39-9a49-835327a6b4d5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:14.596662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fea26edd-02e2-4b39-9a49-835327a6b4d5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:14.640734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fea26edd-02e2-4b39-9a49-835327a6b4d5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:14.641491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fea26edd-02e2-4b39-9a49-835327a6b4d5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:14.642366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fea26edd-02e2-4b39-9a49-835327a6b4d5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:14.642812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fea26edd-02e2-4b39-9a49-835327a6b4d5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:14.765472 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fea26edd-02e2-4b39-9a49-835327a6b4d5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170756 Jul 24 01:28:14.769360 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1920/3973] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:14 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:14.952808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-faddbeb2-ea1c-4eef-b93d-573779dcd4af tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea2435e0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:15.046122 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-faddbeb2-ea1c-4eef-b93d-573779dcd4af tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.097327 Jul 24 01:28:15.052207 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1921/3974] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:14 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:15.062395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:15.100790 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8abdbe23-9287-444e-8d07-a0e737a4e5c2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1469 microversion: 2.1 time: 0.718180 Jul 24 01:28:15.105449 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2054/3975] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:14 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1469 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:15.780273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6de18f12-b698-42fa-8118-8de7f6e0e3f2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:15.781273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6de18f12-b698-42fa-8118-8de7f6e0e3f2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:15.797419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6de18f12-b698-42fa-8118-8de7f6e0e3f2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:15.797844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6de18f12-b698-42fa-8118-8de7f6e0e3f2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:15.799347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6de18f12-b698-42fa-8118-8de7f6e0e3f2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:15.811759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6de18f12-b698-42fa-8118-8de7f6e0e3f2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:15.885364 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6de18f12-b698-42fa-8118-8de7f6e0e3f2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107870 Jul 24 01:28:15.887628 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1922/3976] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:15 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:16.061270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea67e635-bb26-4df1-95bf-2d1bf685200a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eacbad30>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:16.204643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea67e635-bb26-4df1-95bf-2d1bf685200a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1414 microversion: 2.1 time: 0.148570 Jul 24 01:28:16.206181 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2055/3977] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:16 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:16.639091 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:16.639901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:16.649231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:16.654468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:16.655357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:16.655818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:16.903102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aed2b4a9-2de7-4479-b2db-4faf86c51682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:16.905129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aed2b4a9-2de7-4479-b2db-4faf86c51682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:16.913919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aed2b4a9-2de7-4479-b2db-4faf86c51682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:16.914796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aed2b4a9-2de7-4479-b2db-4faf86c51682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:16.915808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aed2b4a9-2de7-4479-b2db-4faf86c51682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:16.916468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aed2b4a9-2de7-4479-b2db-4faf86c51682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:17.001634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aed2b4a9-2de7-4479-b2db-4faf86c51682 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106958 Jul 24 01:28:17.011728 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2056/3978] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:16 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:17.219411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-232fa19f-fd29-4d37-8cb4-01c8e05d6816 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaab4a60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:17.331160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-232fa19f-fd29-4d37-8cb4-01c8e05d6816 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1423 microversion: 2.1 time: 0.115879 Jul 24 01:28:17.340458 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2057/3979] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:17 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:17.363029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cde8718f-4972-4697-9193-dc8a1edfdb97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9ff5820>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:17.406862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:17.429324 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e16dfd8a-c67a-4f7c-acb9-31488a2b14b4 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1469 microversion: 2.1 time: 1.302065 Jul 24 01:28:17.441168 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1923/3980] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:16 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1469 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:17.493325 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cde8718f-4972-4697-9193-dc8a1edfdb97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 200 len: 1423 microversion: 2.1 time: 0.141999 Jul 24 01:28:17.499676 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2058/3981] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:17 2022] GET /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 1423 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:17.506436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbf0898a-e20e-4020-91cd-c090629e4fd4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb59f310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:18.026212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a375c30-f502-4e8d-b4b6-3fdb0f9fbbc4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:18.030638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5a375c30-f502-4e8d-b4b6-3fdb0f9fbbc4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:18.086832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a375c30-f502-4e8d-b4b6-3fdb0f9fbbc4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:18.092245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a375c30-f502-4e8d-b4b6-3fdb0f9fbbc4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:18.098181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a375c30-f502-4e8d-b4b6-3fdb0f9fbbc4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:18.100028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a375c30-f502-4e8d-b4b6-3fdb0f9fbbc4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:18.255727 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5a375c30-f502-4e8d-b4b6-3fdb0f9fbbc4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.235452 Jul 24 01:28:18.261477 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2059/3982] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:18 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:18.460924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:18.463763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:18.482301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:18.482777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:18.486332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:18.486798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:18.619879 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbf0898a-e20e-4020-91cd-c090629e4fd4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 204 len: 0 microversion: 2.1 time: 1.118724 Jul 24 01:28:18.620904 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1924/3983] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:17 2022] DELETE /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:28:18.629074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:18.630615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:18.641474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:18.642211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:18.644286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:18.646618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:18.704636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:18.713969 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b1104fb-a8e4-4097-b47f-55a09c2adf01 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 200 len: 1427 microversion: 2.1 time: 0.264833 Jul 24 01:28:18.714564 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2060/3984] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:18 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 1427 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:18.726081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:28:18.959594 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f3170f4-c09f-4c85-9d24-449b24db329d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 204 len: 0 microversion: 2.1 time: 0.334220 Jul 24 01:28:18.973139 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1925/3985] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:28:18 2022] DELETE /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:28:19.221243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-668484565", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "41157fbf-825e-46bc-9e53-c3a4974eed04"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:19.273665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42afeaf0-af20-48cb-8010-dfc0342b0747 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:19.274870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42afeaf0-af20-48cb-8010-dfc0342b0747 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:19.289130 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42afeaf0-af20-48cb-8010-dfc0342b0747 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:19.292172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42afeaf0-af20-48cb-8010-dfc0342b0747 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:19.293080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42afeaf0-af20-48cb-8010-dfc0342b0747 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:19.297192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42afeaf0-af20-48cb-8010-dfc0342b0747 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:19.377221 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] validate_networks() for [('41157fbf-825e-46bc-9e53-c3a4974eed04', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:28:19.408971 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42afeaf0-af20-48cb-8010-dfc0342b0747 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141428 Jul 24 01:28:19.414562 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1926/3986] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:19 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:19.457205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-36bc44f5-d494-4a17-9b49-15dab9180ffb req-67e7cca0-aa9d-4579-92a6-7c53c4b56fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dbeb3c-a904-46e7-8403-8f1474e89a29", "name": "network-vif-deleted", "tag": "ad6e6c9c-6133-4e8a-98f0-d89f0796a812"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:19.496458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-36bc44f5-d494-4a17-9b49-15dab9180ffb req-67e7cca0-aa9d-4579-92a6-7c53c4b56fe5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:19.508353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-36bc44f5-d494-4a17-9b49-15dab9180ffb req-67e7cca0-aa9d-4579-92a6-7c53c4b56fe5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:19.538236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-36bc44f5-d494-4a17-9b49-15dab9180ffb req-67e7cca0-aa9d-4579-92a6-7c53c4b56fe5 service nova] Creating event network-vif-deleted:ad6e6c9c-6133-4e8a-98f0-d89f0796a812 for instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 on n-h2-master-1 Jul 24 01:28:19.545339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-36bc44f5-d494-4a17-9b49-15dab9180ffb req-67e7cca0-aa9d-4579-92a6-7c53c4b56fe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101635 Jul 24 01:28:19.546685 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1927/3987] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:19.732357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:19.733915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: e9dbeb3c-a904-46e7-8403-8f1474e89a29] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:19.744441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:19.746832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:19.748893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:19.750225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:19.796078 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] HTTP exception thrown: Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 could not be found. Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Request method failure captured: Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 HTTP/1.1 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8BE-kjY8PavSmnIn31T5wf4srb8X-Z2cj3R-4DuClOhhHrAuKHlhdk77QxtV1jM0G4fpHaGTxQPPRZyqqxrB-DTcmSraOetnTQJlcmtFvtgVVX5d-7FXBCRzFzCkA7Jh7WVkrQ7wFCgJoRZteUyx6gmtiOjnxvXmZNJSCKOd2Ui8Q Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74794638ee6a4b18aef9ff780d461b73", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 01e7c66073564bb0b78b2309d281d1f1 Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: exception: Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 could not be found. Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'e9dbeb3c-a904-46e7-8403-8f1474e89a29'} Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 could not be found. Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 could not be found. Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:19.804818 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:19.809073 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:19.809073 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:19.809073 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:19.809073 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:19.809073 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:19.809073 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 could not be found. Jul 24 01:28:19.809073 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:19.810379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Returning 404 to user: Instance e9dbeb3c-a904-46e7-8403-8f1474e89a29 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:19.813560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0679bd39-5550-421f-b9a8-03e0bbd0907b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29" status: 404 len: 111 microversion: 2.1 time: 0.084721 Jul 24 01:28:19.818630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1928/3988] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:19 2022] GET /compute/v2.1/servers/e9dbeb3c-a904-46e7-8403-8f1474e89a29 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:28:19.828656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:19.834745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:19.854844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:19.855648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:19.858053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:19.861407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:19.931326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:28:20.096924 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-febece66-f65a-49f9-b101-e9982bd9814b tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 204 len: 0 microversion: 2.1 time: 0.276309 Jul 24 01:28:20.101858 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1929/3989] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:28:19 2022] DELETE /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:28:20.115792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:20.116526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:20.129664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:20.132706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:20.133810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:20.134588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:20.847245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:20.855985 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-672028ba-090c-4ba0-8e45-8f5154004275 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1469 microversion: 2.1 time: 0.752445 Jul 24 01:28:20.856843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1930/3990] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:20 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1469 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:20.871134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf352457-3f71-426e-a708-e4d11b3037f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:20.877323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf352457-3f71-426e-a708-e4d11b3037f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:20.889340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf352457-3f71-426e-a708-e4d11b3037f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:20.890324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf352457-3f71-426e-a708-e4d11b3037f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:20.891325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf352457-3f71-426e-a708-e4d11b3037f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:20.893143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf352457-3f71-426e-a708-e4d11b3037f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:20.975534 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:20.978893 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf352457-3f71-426e-a708-e4d11b3037f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.120888 Jul 24 01:28:20.979804 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1931/3991] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:20 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:21.460783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:28:21.461958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:28:21.462656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:28:21.463279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:28:21.463927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:28:21.482064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:21.482795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:21.485951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:21.489120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:21.539066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:28:21.546894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for user b0f04ff3b36d4b0686c9a68ff55ee99d and project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:28:21.563575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:28:21.566390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:28:21.678014 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d8b019ca-36c7-43bb-9850-9f2b2db80350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.461298 Jul 24 01:28:21.678908 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2061/3992] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:28:21.689554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2850ad2c-4c13-4c26-b7f0-8f0edbb10d3c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:21.690353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2850ad2c-4c13-4c26-b7f0-8f0edbb10d3c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:21.873284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:21.873947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:21.883028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:21.883499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:21.884291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:21.884724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:22.447285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2850ad2c-4c13-4c26-b7f0-8f0edbb10d3c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:22.456649 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2850ad2c-4c13-4c26-b7f0-8f0edbb10d3c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1207 microversion: 2.1 time: 0.771613 Jul 24 01:28:22.468731 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1932/3993] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:21 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1207 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:22.482135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-22654762-cbfa-448b-bbae-575a5e9cb77c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:22.487515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-22654762-cbfa-448b-bbae-575a5e9cb77c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:22.522068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22654762-cbfa-448b-bbae-575a5e9cb77c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:22.524623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22654762-cbfa-448b-bbae-575a5e9cb77c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:22.527670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22654762-cbfa-448b-bbae-575a5e9cb77c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:22.528139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-22654762-cbfa-448b-bbae-575a5e9cb77c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:22.622051 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-22654762-cbfa-448b-bbae-575a5e9cb77c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151423 Jul 24 01:28:22.627075 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1933/3994] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:22 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:28:22.782790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a56c1275-8749-47d4-8db3-7de98310d255 req-79a6331e-4e69-47b9-ae42-f4c8963911c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e248bf7-9673-4759-8bb7-1a966355e4b5", "name": "network-vif-unplugged", "status": "completed", "tag": "dadad03f-db0a-400b-8796-860c02244280"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:22.811337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a56c1275-8749-47d4-8db3-7de98310d255 req-79a6331e-4e69-47b9-ae42-f4c8963911c7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:22.812121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a56c1275-8749-47d4-8db3-7de98310d255 req-79a6331e-4e69-47b9-ae42-f4c8963911c7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:22.843147 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a56c1275-8749-47d4-8db3-7de98310d255 req-79a6331e-4e69-47b9-ae42-f4c8963911c7 service nova] Creating event network-vif-unplugged:dadad03f-db0a-400b-8796-860c02244280 for instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 on n-h1-master-1 Jul 24 01:28:22.855141 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a56c1275-8749-47d4-8db3-7de98310d255 req-79a6331e-4e69-47b9-ae42-f4c8963911c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077119 Jul 24 01:28:22.859211 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1934/3995] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:28:23.487086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:23.488775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:23.517948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:23.518884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:23.519753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:23.521337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:24.047547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:24.064121 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-35282367-82c2-4925-a504-49d4b8ea0ac7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1267 microversion: 2.1 time: 0.582571 Jul 24 01:28:24.065084 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1935/3996] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:23 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1267 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:24.111677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5aa4f71-2ccc-4eb8-8648-7a316b83f0a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:24.113751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d5aa4f71-2ccc-4eb8-8648-7a316b83f0a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:24.125084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5aa4f71-2ccc-4eb8-8648-7a316b83f0a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:24.128307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5aa4f71-2ccc-4eb8-8648-7a316b83f0a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:24.132379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5aa4f71-2ccc-4eb8-8648-7a316b83f0a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:24.133947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5aa4f71-2ccc-4eb8-8648-7a316b83f0a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:24.148798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:24.165149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d921f63b-8ac0-4373-99a7-2ed83cfdf38d tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1469 microversion: 2.1 time: 2.293585 Jul 24 01:28:24.166499 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2062/3997] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:21 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1469 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:24.228190 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5aa4f71-2ccc-4eb8-8648-7a316b83f0a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.161261 Jul 24 01:28:24.229409 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1936/3998] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:28:24 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e/os-volume_attachments => generated 25 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:24.305709 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:24.306224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:24.323546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:24.324510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:24.325351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:24.325882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:24.373198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:28:24.525924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b705c8b0-f2f2-4627-a21f-142a0d7c6c65 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 204 len: 0 microversion: 2.20 time: 0.224459 Jul 24 01:28:24.529987 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2063/3999] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:28:24 2022] DELETE /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:28:24.536433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:24.538017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:24.555385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:24.556238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:24.557951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:24.558824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:25.085494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:25.086266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:25.101397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:25.102386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:25.103207 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:25.103659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:25.306413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:25.323164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:25.327160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:25.328435 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52b31b46-47f8-4912-b7a3-03812ecfeb32 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 0.796958 Jul 24 01:28:25.345766 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1937/4000] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:24 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:25.351872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:25.352499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:25.370552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:25.371800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:25.374628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:25.375303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:25.440208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:25.500137 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:25.506919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-782abfeb-a679-4a7c-8aaa-a9c18e7b107e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1265 microversion: 2.1 time: 0.428006 Jul 24 01:28:25.521067 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2064/4001] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:25 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1265 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:25.715497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e7c66073564bb0b78b2309d281d1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74794638ee6a4b18aef9ff780d461b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:25.734258 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7294efab-0528-4f61-b673-11779f99fac2 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 200 len: 1427 microversion: 2.1 time: 0.387179 Jul 24 01:28:25.735718 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1938/4002] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:25 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 1427 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:25.820181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ce1e1048-eba1-4b6f-b845-ddba43b042f9 req-71634ba8-7aad-4437-885c-8f17bed34856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e248bf7-9673-4759-8bb7-1a966355e4b5", "name": "network-vif-deleted", "tag": "dadad03f-db0a-400b-8796-860c02244280"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:25.847148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ce1e1048-eba1-4b6f-b845-ddba43b042f9 req-71634ba8-7aad-4437-885c-8f17bed34856 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:25.849294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ce1e1048-eba1-4b6f-b845-ddba43b042f9 req-71634ba8-7aad-4437-885c-8f17bed34856 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:25.898606 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ce1e1048-eba1-4b6f-b845-ddba43b042f9 req-71634ba8-7aad-4437-885c-8f17bed34856 service nova] Creating event network-vif-deleted:dadad03f-db0a-400b-8796-860c02244280 for instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 on n-h1-master-1 Jul 24 01:28:25.917137 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ce1e1048-eba1-4b6f-b845-ddba43b042f9 req-71634ba8-7aad-4437-885c-8f17bed34856 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099764 Jul 24 01:28:25.920046 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2065/4003] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:26.347572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:26.349169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:26.352826 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:26.386995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:26.387690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:26.388343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:26.388883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:26.529436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:26.531121 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:26.542244 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:26.544028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:26.544494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:26.568366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:26.570146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:27.293590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:27.309298 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e59708a-22c9-4c28-ac38-3a91e957c7ba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1265 microversion: 2.1 time: 0.783907 Jul 24 01:28:27.318412 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2066/4004] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:26 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1265 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:27.333472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:27.334137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] [instance: cbf89b5b-4b91-403f-b73a-10e217ea471e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:27.352669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:27.354054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:27.359609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:27.360258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:27.413985 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] HTTP exception thrown: Instance cbf89b5b-4b91-403f-b73a-10e217ea471e could not be found. Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Request method failure captured: Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e HTTP/1.1 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8BE-kjY8PavSmnIn31T5wf4srb8X-Z2cj3R-4DuClOhhHrAuKHlhdk77QxtV1jM0G4fpHaGTxQPPRZyqqxrB-DTcmSraOetnTQJlcmtFvtgVVX5d-7FXBCRzFzCkA7Jh7WVkrQ7wFCgJoRZteUyx6gmtiOjnxvXmZNJSCKOd2Ui8Q Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74794638ee6a4b18aef9ff780d461b73", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74794638ee6a4b18aef9ff780d461b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 74794638ee6a4b18aef9ff780d461b73 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-MigrationsAdminTest-759482588 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 01e7c66073564bb0b78b2309d281d1f1 Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-MigrationsAdminTest-759482588-project Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: exception: Instance cbf89b5b-4b91-403f-b73a-10e217ea471e could not be found. Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'cbf89b5b-4b91-403f-b73a-10e217ea471e'} Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbf89b5b-4b91-403f-b73a-10e217ea471e could not be found. Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbf89b5b-4b91-403f-b73a-10e217ea471e could not be found. Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:27.415667 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbf89b5b-4b91-403f-b73a-10e217ea471e could not be found. Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] Returning 404 to user: Instance cbf89b5b-4b91-403f-b73a-10e217ea471e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-abd23e74-1553-42b4-8411-bcc1c813e861 tempest-MigrationsAdminTest-759482588 tempest-MigrationsAdminTest-759482588-project] 10.222.0.27 "GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e" status: 404 len: 111 microversion: 2.1 time: 0.097440 Jul 24 01:28:27.423350 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2067/4005] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:27 2022] GET /compute/v2.1/servers/cbf89b5b-4b91-403f-b73a-10e217ea471e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:28:27.587362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1547129177", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:27.704573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] validate_networks() for [('2909a66d-cdd3-4b87-b889-9aac3ab2e97c', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:28:28.085637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:28.109313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:28.110878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:28.112093 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47ce7777-6af8-4844-83cc-d1f87d5f88da tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1724 microversion: 2.20 time: 1.769112 Jul 24 01:28:28.150087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1939/4006] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:26 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1724 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:28.150087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4bc580d1-e40f-44cd-9813-0cb48583a2f3 req-8fbd4c20-0028-463a-bb6e-4b755362613b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf89b5b-4b91-403f-b73a-10e217ea471e", "name": "network-vif-deleted", "tag": "4f462090-d02a-49fd-a851-148c8dc7cb4d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:28.156040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4bc580d1-e40f-44cd-9813-0cb48583a2f3 req-8fbd4c20-0028-463a-bb6e-4b755362613b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:28.156652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4bc580d1-e40f-44cd-9813-0cb48583a2f3 req-8fbd4c20-0028-463a-bb6e-4b755362613b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:28.179351 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4bc580d1-e40f-44cd-9813-0cb48583a2f3 req-8fbd4c20-0028-463a-bb6e-4b755362613b service nova] Creating event network-vif-deleted:4f462090-d02a-49fd-a851-148c8dc7cb4d for instance cbf89b5b-4b91-403f-b73a-10e217ea471e on n-h1-master-1 Jul 24 01:28:28.187752 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4bc580d1-e40f-44cd-9813-0cb48583a2f3 req-8fbd4c20-0028-463a-bb6e-4b755362613b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046809 Jul 24 01:28:28.189045 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1940/4007] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:28.331466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:28.332282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:28.357116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:28.359385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:28.364538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:28.365688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:30.256301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:30.267407 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2635d35c-ef5d-43ac-8cf2-5fd02ef5f481 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1307 microversion: 2.1 time: 1.944665 Jul 24 01:28:30.268167 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1941/4008] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:28 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1307 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:30.275754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:30.278778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:30.286813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:30.287274 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:30.288254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:30.288732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:31.261034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:31.274353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:31.280149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:31.287507 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9e77fc7-8362-4639-b058-8ce9d1eeb57d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1657 microversion: 2.20 time: 1.013216 Jul 24 01:28:31.299667 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1942/4009] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:30 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1657 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:31.307340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-eea2c8e9-6e28-4444-8e68-e40132136086 req-ac3f2fc3-934f-40ae-aaf2-dd74a4c2a6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "name": "network-vif-unplugged", "status": "completed", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:31.325417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eea2c8e9-6e28-4444-8e68-e40132136086 req-ac3f2fc3-934f-40ae-aaf2-dd74a4c2a6d1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:31.338034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eea2c8e9-6e28-4444-8e68-e40132136086 req-ac3f2fc3-934f-40ae-aaf2-dd74a4c2a6d1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:31.372073 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-eea2c8e9-6e28-4444-8e68-e40132136086 req-ac3f2fc3-934f-40ae-aaf2-dd74a4c2a6d1 service nova] Creating event network-vif-unplugged:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h2-master-1 Jul 24 01:28:31.387770 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-eea2c8e9-6e28-4444-8e68-e40132136086 req-ac3f2fc3-934f-40ae-aaf2-dd74a4c2a6d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086356 Jul 24 01:28:31.388421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1943/4010] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:31.401563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:31.417567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:31.435926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:31.436381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:31.437209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:31.437659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:31.512280 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:31.558734 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:31.818756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:28:31.819470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:28:31.820210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:28:31.820840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:28:31.821418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:28:31.850479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:31.851409 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:31.854029 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:31.854718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:31.909359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Getting quotas for project da60c4b9da1b4445a038238d0db2927e. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:28:31.927633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Getting quotas for user 014d9b85786b4a22b71463e346159fc4 and project da60c4b9da1b4445a038238d0db2927e. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:28:32.005697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:28:32.018679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:28:32.196631 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6ab9864-88dd-4425-8677-1618197ae99b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.774299 Jul 24 01:28:32.201178 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2068/4011] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:28:32.219860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-288639c3-d5cc-4ab6-b518-ec7de688f88a req-da3866ca-00b4-451f-9a82-4d5c28819713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b6d77e-7536-4c72-9de6-622af5973970", "tag": "3927349b-217d-404f-84d0-744aa506677c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:32.256680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-288639c3-d5cc-4ab6-b518-ec7de688f88a req-da3866ca-00b4-451f-9a82-4d5c28819713 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:32.257386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-288639c3-d5cc-4ab6-b518-ec7de688f88a req-da3866ca-00b4-451f-9a82-4d5c28819713 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:32.290070 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-288639c3-d5cc-4ab6-b518-ec7de688f88a req-da3866ca-00b4-451f-9a82-4d5c28819713 service nova] Creating event network-changed:3927349b-217d-404f-84d0-744aa506677c for instance 06b6d77e-7536-4c72-9de6-622af5973970 on n-h2-master-1 Jul 24 01:28:32.306028 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-288639c3-d5cc-4ab6-b518-ec7de688f88a req-da3866ca-00b4-451f-9a82-4d5c28819713 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097366 Jul 24 01:28:32.309757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2069/4012] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:32.332701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c23a8f27-cba9-4354-9361-3e549a3e0da0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:32.335898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c23a8f27-cba9-4354-9361-3e549a3e0da0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:32.454145 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:33.176339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c23a8f27-cba9-4354-9361-3e549a3e0da0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:33.206372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c23a8f27-cba9-4354-9361-3e549a3e0da0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1217 microversion: 2.1 time: 0.893393 Jul 24 01:28:33.208514 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2070/4013] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:32 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1217 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:33.222417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:33.223518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:33.251667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:33.258063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:33.260092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:33.260751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:33.400159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:33.408881 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0aa39121-7774-4e2f-ba9a-bf900eb02698 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1307 microversion: 2.1 time: 2.019155 Jul 24 01:28:33.414166 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1944/4014] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:31 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1307 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:33.721507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:33.744252 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:33.754512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:33.755983 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c5f0ad7-49b8-432d-9d19-42389ef2e1b3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1657 microversion: 2.20 time: 0.544596 Jul 24 01:28:33.767765 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2071/4015] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:33 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1657 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:34.228941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:34.230053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:34.265756 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:34.279339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:34.280374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:34.281640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:34.429308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:34.429990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:34.437930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:34.438599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:34.441078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:34.445229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:34.950504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:34.969150 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-70b4b1e5-14e7-481f-90b1-a2fa588ad8fa tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1277 microversion: 2.1 time: 0.746380 Jul 24 01:28:34.976351 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1945/4016] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:34 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1277 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:34.985283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:34.987889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:35.006366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:35.008262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:35.012699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:35.013158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:35.503107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:35.526428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:35.544462 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:35.573715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-757cf541-0ead-4d7e-8ca2-6077879d885c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 200 len: 1657 microversion: 2.20 time: 0.592788 Jul 24 01:28:35.579580 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1946/4017] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:34 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 1657 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:35.599300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:35.614859 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1bc4f35f-b6ce-4b2a-a6c1-14bda8e5d92b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1307 microversion: 2.1 time: 1.190657 Jul 24 01:28:35.624028 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2072/4018] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:34 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1307 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:35.626360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:35.630394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:35.653654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:35.654154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:35.654951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:35.655532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:35.863949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lazy-loading 'services' on Instance uuid 1b442384-e51b-40a2-aa9e-86c1404f7da0 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:28:36.143326 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a79a8706-cb38-4967-af9d-7aa473e8915d tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments/36baa45b-f0b6-4af5-8cae-ada01d38e1d5" status: 202 len: 0 microversion: 2.1 time: 0.525045 Jul 24 01:28:36.143945 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2073/4019] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:28:35 2022] DELETE /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments/36baa45b-f0b6-4af5-8cae-ada01d38e1d5 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:28:36.163448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f4419b0f-e49a-40af-8266-1d22d7bcbc18 req-ec88331f-f833-4ae3-ae46-6d182517202b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ecad8-dbf6-42db-bcc4-3b6e613e022e", "name": "network-vif-deleted", "tag": "e44603dd-cbd0-4e95-9b1e-104ea90efc6a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:36.205499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f4419b0f-e49a-40af-8266-1d22d7bcbc18 req-ec88331f-f833-4ae3-ae46-6d182517202b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:36.206888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f4419b0f-e49a-40af-8266-1d22d7bcbc18 req-ec88331f-f833-4ae3-ae46-6d182517202b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:36.248196 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f4419b0f-e49a-40af-8266-1d22d7bcbc18 req-ec88331f-f833-4ae3-ae46-6d182517202b service nova] Creating event network-vif-deleted:e44603dd-cbd0-4e95-9b1e-104ea90efc6a for instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e on n-h2-master-1 Jul 24 01:28:36.258115 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f4419b0f-e49a-40af-8266-1d22d7bcbc18 req-ec88331f-f833-4ae3-ae46-6d182517202b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111207 Jul 24 01:28:36.259818 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2074/4020] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:36.269135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:36.271445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:36.282011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:36.282696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:36.284031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:36.284727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:36.326300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-323487523", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "5ed977ac-fb5d-4b74-9a46-f27d449626ba"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:36.458633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] validate_networks() for [('5ed977ac-fb5d-4b74-9a46-f27d449626ba', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:28:36.938035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:36.946843 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f66afb0d-4b49-44ee-97ad-3922ea6cceb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1275 microversion: 2.1 time: 0.685299 Jul 24 01:28:36.950841 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2075/4021] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:36 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1275 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:36.963710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-afea057c-2ebf-4ecb-8ec8-8df158fa32e0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:36.966763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-afea057c-2ebf-4ecb-8ec8-8df158fa32e0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:36.982751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afea057c-2ebf-4ecb-8ec8-8df158fa32e0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:36.983291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afea057c-2ebf-4ecb-8ec8-8df158fa32e0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:36.984224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afea057c-2ebf-4ecb-8ec8-8df158fa32e0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:36.991438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afea057c-2ebf-4ecb-8ec8-8df158fa32e0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:37.058022 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-afea057c-2ebf-4ecb-8ec8-8df158fa32e0 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105884 Jul 24 01:28:37.069774 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2076/4022] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:28:36 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:37.393473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3dea409-e00c-4e90-9f8c-cdfbc4d60427 tempest-NetworksTest-2090931257 tempest-NetworksTest-2090931257-project-admin] Calling method '.version_select at 0x7f05eb6a8af0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:38.152056 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3dea409-e00c-4e90-9f8c-cdfbc4d60427 tempest-NetworksTest-2090931257 tempest-NetworksTest-2090931257-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 8767 microversion: 2.1 time: 1.080034 Jul 24 01:28:38.152738 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2077/4023] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:28:37 2022] GET /compute/v2.1/os-networks => generated 8767 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:38.157803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:38.158427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:38.177604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:38.178382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:38.180232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:38.180854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:38.214634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] HTTP exception thrown: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Request method failure captured: Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e HTTP/1.1 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8wjXIPqI3Vs_zE1UFzaGu_3eOu25uVnXSYJQR4trMUzUShBIUbTVHtpAUHI-V0I_vQ3yGiie44C6ZES7Df8PXLRhaK5lutEZU9PwZ9v42ADphRhuClVG3wBNZ6A8dPcnwMRtievMeqvWZ0xLIKu2J2mZXkM85XOquT8P9wmyBHo_4 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8eb99dbda38447a8ff7721744633469", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 472ff2bf65fb473ba60274de014b08a9 Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '5a9ecad8-dbf6-42db-bcc4-3b6e613e022e'} Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:38.216584 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:28:38.220742 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:38.225479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Returning 404 to user: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:38.226757 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-379390c3-ae68-4063-a3f6-7ce02bc20e56 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 404 len: 111 microversion: 2.20 time: 0.073000 Jul 24 01:28:38.228199 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2078/4024] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:38 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:28:38.236158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:38.242768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:38.267049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:38.267511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:38.268308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:38.268754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:39.181031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:39.193348 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb284c0a-b721-4fe0-bd90-5fc8d2b36b1f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1307 microversion: 2.1 time: 0.962008 Jul 24 01:28:39.194209 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2079/4025] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:38 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1307 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:39.214326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:39.215427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:39.234000 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:28:39.235226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:28:39.236087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:28:39.236878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:28:39.237586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:28:39.244746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:39.250162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:39.251377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:39.256155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:39.267986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:39.270448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:39.271408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:39.273645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:39.382802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Getting quotas for project 217f2c9b33dc4d63a778c93abc91f70f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:28:39.415584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Getting quotas for user a1e6810811b14037afc8e2891be22039 and project 217f2c9b33dc4d63a778c93abc91f70f. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:28:39.453022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:28:39.472650 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:28:39.632699 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f864036-839d-4e52-ab70-bc6589bac444 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.047071 Jul 24 01:28:39.644954 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1947/4026] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:28:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:28:39.655321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19032c4e-4fdb-4b31-85b9-7fe9e555c154 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:39.656563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-19032c4e-4fdb-4b31-85b9-7fe9e555c154 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:39.678594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19032c4e-4fdb-4b31-85b9-7fe9e555c154 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:39.679412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19032c4e-4fdb-4b31-85b9-7fe9e555c154 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:39.681094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19032c4e-4fdb-4b31-85b9-7fe9e555c154 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:39.681883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19032c4e-4fdb-4b31-85b9-7fe9e555c154 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:39.781876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-19032c4e-4fdb-4b31-85b9-7fe9e555c154 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125595 Jul 24 01:28:39.784166 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1948/4027] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:28:39 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:39.789665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b15cc947-d8ab-4c4f-90af-536d8a76e654 tempest-NetworksTest-2090931257 tempest-NetworksTest-2090931257-project-admin] Calling method '.version_select at 0x7f05eadd44c0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:40.598033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:40.608635 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7268ed84-5358-400d-83a4-7d488a7b4667 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 1.412246 Jul 24 01:28:40.612973 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2080/4028] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:39 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:40.632372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c9ac8b3-d4c7-4035-88e5-9c3277f528c1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '.version_select at 0x7f05eacbfca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:40.667941 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c9ac8b3-d4c7-4035-88e5-9c3277f528c1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865003904" status: 204 len: 0 microversion: 2.20 time: 0.050153 Jul 24 01:28:40.669849 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2081/4029] 10.222.0.27 () {60 vars in 1261 bytes} [Sun Jul 24 01:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865003904 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:28:40.678413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:40.679391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:40.690454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:40.692006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:40.693279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:40.694114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:40.948204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:40.958672 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c7421f5-e66f-4f2a-91e1-b70483e0b48e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1220 microversion: 2.1 time: 0.285689 Jul 24 01:28:40.970151 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2082/4030] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:40 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1220 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:40.982565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:40.983674 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:41.004379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:41.005073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:41.006063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:41.006704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:41.201481 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b15cc947-d8ab-4c4f-90af-536d8a76e654 tempest-NetworksTest-2090931257 tempest-NetworksTest-2090931257-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/61d246aa-98fb-42b3-a4f9-8547b5bbd4e2" status: 200 len: 652 microversion: 2.1 time: 1.416025 Jul 24 01:28:41.209370 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1949/4031] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:28:39 2022] GET /compute/v2.1/os-networks/61d246aa-98fb-42b3-a4f9-8547b5bbd4e2 => generated 652 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:41.214671 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4639758d-d18e-4ffc-bdd9-c0e19b2f2128 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:41.215872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4639758d-d18e-4ffc-bdd9-c0e19b2f2128 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:41.236342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4639758d-d18e-4ffc-bdd9-c0e19b2f2128 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:41.236976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4639758d-d18e-4ffc-bdd9-c0e19b2f2128 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:41.238070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4639758d-d18e-4ffc-bdd9-c0e19b2f2128 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:41.239001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4639758d-d18e-4ffc-bdd9-c0e19b2f2128 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:41.293054 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4639758d-d18e-4ffc-bdd9-c0e19b2f2128 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082217 Jul 24 01:28:41.309778 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1950/4032] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:28:41 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:41.312734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5a1de10-5b44-45c6-b831-96ebd156db9b tempest-NetworksTest-2090931257 tempest-NetworksTest-2090931257-project-admin] Calling method '.version_select at 0x7f05eb642ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:41.655738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:41.666360 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16aa193f-c87d-4638-bdf4-93d2abb25515 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1307 microversion: 2.1 time: 0.694727 Jul 24 01:28:41.670417 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2083/4033] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:40 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1307 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:41.689385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:41.690304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:41.709635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:41.710630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:41.711642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:41.712367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:41.882093 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:41.978602 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5a1de10-5b44-45c6-b831-96ebd156db9b tempest-NetworksTest-2090931257 tempest-NetworksTest-2090931257-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 8077 microversion: 2.1 time: 0.670491 Jul 24 01:28:41.979205 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1951/4034] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:28:41 2022] GET /compute/v2.1/os-networks => generated 8077 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:41.991556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:41.992183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:42.018858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:42.021343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:42.030012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:42.030702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:42.427534 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:42.435963 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78395eb1-9294-4d3e-b63f-981b94608b72 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1274 microversion: 2.1 time: 0.448310 Jul 24 01:28:42.442330 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1952/4035] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:41 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1274 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:42.458595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ab1be675-2f70-40d4-9182-023a26318863 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:42.468915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ab1be675-2f70-40d4-9182-023a26318863 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:42.491883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab1be675-2f70-40d4-9182-023a26318863 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:42.497566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab1be675-2f70-40d4-9182-023a26318863 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:42.498600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab1be675-2f70-40d4-9182-023a26318863 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:42.499123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab1be675-2f70-40d4-9182-023a26318863 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:42.598204 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ab1be675-2f70-40d4-9182-023a26318863 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145175 Jul 24 01:28:42.598669 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1953/4036] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:28:42 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:42.687775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:42.688412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:42.703667 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:42.704131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:42.704930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:42.705543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:42.764246 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:42.779587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:42.821515 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e42602f-2d96-484b-9fd2-1159e47b01c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 1.149181 Jul 24 01:28:42.823597 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2084/4037] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:41 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:43.379516 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:43.385065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9f3b102c-2b7d-42c2-ac23-178de0e28c0f req-5b81ca6e-5cd1-4173-bcd1-8a945e5a50d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6d77e-7536-4c72-9de6-622af5973970", "name": "network-vif-plugged", "status": "completed", "tag": "3927349b-217d-404f-84d0-744aa506677c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:43.395515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f3b102c-2b7d-42c2-ac23-178de0e28c0f req-5b81ca6e-5cd1-4173-bcd1-8a945e5a50d3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:43.396348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9f3b102c-2b7d-42c2-ac23-178de0e28c0f req-5b81ca6e-5cd1-4173-bcd1-8a945e5a50d3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:43.410433 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9f3b102c-2b7d-42c2-ac23-178de0e28c0f req-5b81ca6e-5cd1-4173-bcd1-8a945e5a50d3 service nova] Creating event network-vif-plugged:3927349b-217d-404f-84d0-744aa506677c for instance 06b6d77e-7536-4c72-9de6-622af5973970 on n-h2-master-1 Jul 24 01:28:43.417091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9f3b102c-2b7d-42c2-ac23-178de0e28c0f req-5b81ca6e-5cd1-4173-bcd1-8a945e5a50d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038790 Jul 24 01:28:43.418455 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2085/4038] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:28:43.462574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:43.463697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:43.481411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:43.482492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:43.484354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:43.489758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:43.621098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:43.639351 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-532bda3b-9a33-489e-b0f7-fbeaa3d311d8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1307 microversion: 2.1 time: 0.955456 Jul 24 01:28:43.639957 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1954/4039] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:42 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1307 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:43.654944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf2296e7-bfd9-4163-a046-bd0b97003055 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:43.659610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf2296e7-bfd9-4163-a046-bd0b97003055 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:43.672903 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf2296e7-bfd9-4163-a046-bd0b97003055 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:43.677144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf2296e7-bfd9-4163-a046-bd0b97003055 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:43.678247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf2296e7-bfd9-4163-a046-bd0b97003055 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:43.678858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf2296e7-bfd9-4163-a046-bd0b97003055 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:43.711593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:43.719695 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-35faf413-4a28-4c98-8164-28614e38037e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1274 microversion: 2.1 time: 0.264683 Jul 24 01:28:43.740210 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2086/4040] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:43 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1274 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:43.758942 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf2296e7-bfd9-4163-a046-bd0b97003055 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112093 Jul 24 01:28:43.760214 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1955/4041] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:28:43 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:43.840407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:43.841181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:43.862932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:43.865124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:43.867863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:43.869557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:44.548457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c933066c-8860-4ea1-a038-84ce457e9186 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'create', calling method: .version_select at 0x7f05ea49a8b0>, body: {"keypair": {"name": "tempest-keypair-17601749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSpTooQcQcLd+7y2YA8V82Nlqyjr1fRzse1KHytRFRnpNKCguMJXrECg9UOjycntw4nhLm4r+cDIJnnh4ml/G5ZYu1h+T0ij0+XffBLrhPAy1NGqMHt7lQTqjZZ5tT1wA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:44.584424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c933066c-8860-4ea1-a038-84ce457e9186 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for project b8eb99dbda38447a8ff7721744633469. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:28:44.593519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c933066c-8860-4ea1-a038-84ce457e9186 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for user 472ff2bf65fb473ba60274de014b08a9 and project b8eb99dbda38447a8ff7721744633469. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:28:44.646158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c933066c-8860-4ea1-a038-84ce457e9186 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.102662 Jul 24 01:28:44.654639 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1956/4042] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:28:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 24 01:28:44.661056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-63bc0691-1690-4795-8903-4d755c872b80 req-88fd7ea3-de0e-48ff-8f46-80b60fb783db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1cd906-b406-46dd-bd65-fe0292f7c9de", "tag": "aa20a123-c219-46a0-959b-811824ea97c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:44.692078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-63bc0691-1690-4795-8903-4d755c872b80 req-88fd7ea3-de0e-48ff-8f46-80b60fb783db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:44.692815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-63bc0691-1690-4795-8903-4d755c872b80 req-88fd7ea3-de0e-48ff-8f46-80b60fb783db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:44.709434 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-63bc0691-1690-4795-8903-4d755c872b80 req-88fd7ea3-de0e-48ff-8f46-80b60fb783db service nova] Creating event network-changed:aa20a123-c219-46a0-959b-811824ea97c7 for instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de on n-h1-master-1 Jul 24 01:28:44.715487 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-63bc0691-1690-4795-8903-4d755c872b80 req-88fd7ea3-de0e-48ff-8f46-80b60fb783db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058654 Jul 24 01:28:44.718416 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1957/4043] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:44.735327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:44.736544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:44.755015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:44.755492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:44.759235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:44.759953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:44.838892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:44.870932 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-57368a1a-89d0-4084-b36e-4650e501b497 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 1.023926 Jul 24 01:28:44.883468 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2087/4044] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:43 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:44.907003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:44.908245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:44.937330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:44.937816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:44.943560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:44.944264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:44.964937 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:45.561859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:45.572249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b34b1955-f756-409d-b2ea-16d0954479b0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1307 microversion: 2.1 time: 0.852321 Jul 24 01:28:45.584767 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1958/4045] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:44 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1307 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:45.584767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-38a24049-4209-48f8-a657-57d3d73cd084 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:45.584767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-38a24049-4209-48f8-a657-57d3d73cd084 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:45.588848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38a24049-4209-48f8-a657-57d3d73cd084 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.589427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38a24049-4209-48f8-a657-57d3d73cd084 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.590347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38a24049-4209-48f8-a657-57d3d73cd084 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.590915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-38a24049-4209-48f8-a657-57d3d73cd084 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.624629 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-38a24049-4209-48f8-a657-57d3d73cd084 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050040 Jul 24 01:28:45.626604 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1959/4046] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:28:45 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:28:45.710451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:45.711415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:45.717375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.717863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.718641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.719079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.749492 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Cannot 'reboot' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action HTTP/1.1 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 28 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: {"reboot": {"type": "HARD"}} Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'reboot' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '17729231-087d-479b-8bd2-ac9d0f8f19df', 'body': {'reboot': {'type': 'HARD'}}} Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:28:45.751251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 409 to user: Cannot 'reboot' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:45.758504 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2f790b97-e9dd-4790-ad28-fca0f12abbf7 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action" status: 409 len: 145 microversion: 2.1 time: 0.047568 Jul 24 01:28:45.759297 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1960/4047] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:28:45 2022] POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action => generated 145 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:28:45.764311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:45.765823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:45.772519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.772935 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.773803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.774507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.803841 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Cannot 'rebuild' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action HTTP/1.1 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 65 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'rebuild' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '17729231-087d-479b-8bd2-ac9d0f8f19df', 'body': {'rebuild': {'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08'}}} Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:45.805598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 409 to user: Cannot 'rebuild' instance 17729231-087d-479b-8bd2-ac9d0f8f19df while it is in vm_state rescued {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:45.809145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f5e87db2-1d0d-44e5-a25f-bd003a29dc28 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action" status: 409 len: 146 microversion: 2.1 time: 0.046715 Jul 24 01:28:45.811532 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1961/4048] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:28:45 2022] POST /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df/action => generated 146 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:28:45.817709 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:45.818231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:45.824681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.825136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.826173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.826609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.856420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:28:45.962484 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e639efb1-ad4e-4bb0-8ba3-00d5d8246f67 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 204 len: 0 microversion: 2.1 time: 0.149224 Jul 24 01:28:45.966848 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1962/4049] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:28:45 2022] DELETE /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:28:45.974253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:45.975176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:45.982685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.983514 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:45.984396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:45.985088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:46.089306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:46.098178 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d4685254-db6f-4323-b874-2fcae4d1bf8e tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1316 microversion: 2.1 time: 1.213437 Jul 24 01:28:46.098784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2088/4050] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:44 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1316 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:46.103970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:46.104879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:46.111966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:46.113411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:46.114446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:46.115037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:46.720366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:46.732021 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fd910fd2-13b5-47d3-9ba1-13373fb6c96a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 0.763597 Jul 24 01:28:46.736423 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1963/4051] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:45 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:46.750692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:46.751559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:46.763644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:46.764228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:46.767371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:46.767963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:46.857518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:46.869297 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-56befa7f-c076-40ae-a276-5f303ba1f6ed tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1688 microversion: 2.1 time: 0.769291 Jul 24 01:28:46.872723 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2089/4052] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:46 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1688 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:47.115819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:47.117146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:47.138312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:47.139884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:47.156015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:47.157658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:47.474555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:47.496808 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c45c5af-2727-428c-8820-cb461ef4614e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1487 microversion: 2.1 time: 0.756623 Jul 24 01:28:47.508786 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1964/4053] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:46 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1487 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:47.515798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1850208062", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "904f3614-5f61-426a-96da-4b8965aeacb8"}], "security_groups": [{"name": "tempest-securitygroup--597751132"}], "key_name": "tempest-keypair-17601749", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:47.698328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:47.714218 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67cdcfe2-ecb5-4cc2-8dd0-901a47b9d61c tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1316 microversion: 2.1 time: 0.598364 Jul 24 01:28:47.724901 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2090/4054] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:47 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:47.732461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-84c20dd8-3f74-4785-aa5b-69b4ac7bd0b1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:47.751203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84c20dd8-3f74-4785-aa5b-69b4ac7bd0b1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:47.751937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84c20dd8-3f74-4785-aa5b-69b4ac7bd0b1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:47.758903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] validate_networks() for [('904f3614-5f61-426a-96da-4b8965aeacb8', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:28:47.805060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-84c20dd8-3f74-4785-aa5b-69b4ac7bd0b1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Going to try to stop instance {{(pid=119561) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:28:47.886125 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-84c20dd8-3f74-4785-aa5b-69b4ac7bd0b1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970/action" status: 202 len: 0 microversion: 2.1 time: 0.159316 Jul 24 01:28:47.886920 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2091/4055] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:28:47 2022] POST /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:28:47.912825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:47.915233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:47.937103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:47.937635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:47.938578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:47.939018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:48.367901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:48.376477 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4eb88c04-f853-4d9d-b9c3-94009c5c8683 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 0.484805 Jul 24 01:28:48.377152 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2092/4056] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:47 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:48.382577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d5a0c358-0c5e-472b-bb8d-1c84fd89f354 req-1757338e-5f1f-40e8-9fa8-d6a2474560fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c955e115-af02-4f3e-828f-73823c89484c", "tag": "826f1421-4de2-41cd-9948-a229cb459876"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:48.420660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d5a0c358-0c5e-472b-bb8d-1c84fd89f354 req-1757338e-5f1f-40e8-9fa8-d6a2474560fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:48.421239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d5a0c358-0c5e-472b-bb8d-1c84fd89f354 req-1757338e-5f1f-40e8-9fa8-d6a2474560fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:48.450260 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d5a0c358-0c5e-472b-bb8d-1c84fd89f354 req-1757338e-5f1f-40e8-9fa8-d6a2474560fa service nova] Creating event network-changed:826f1421-4de2-41cd-9948-a229cb459876 for instance c955e115-af02-4f3e-828f-73823c89484c on n-h2-master-1 Jul 24 01:28:48.457506 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d5a0c358-0c5e-472b-bb8d-1c84fd89f354 req-1757338e-5f1f-40e8-9fa8-d6a2474560fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077304 Jul 24 01:28:48.458873 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2093/4057] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:48.464292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:48.465278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:48.474986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:48.475749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:48.476722 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:48.477314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.047465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:49.059825 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fbb557bd-797c-4d8f-8e1a-3260a135fe03 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1688 microversion: 2.1 time: 0.599745 Jul 24 01:28:49.063036 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2094/4058] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:48 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1688 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:49.069593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:49.070375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:49.078709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.079533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.080560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.081458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.331957 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:49.594306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:28:49.594823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:28:49.595429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:28:49.595906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:28:49.599459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:28:49.616062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.616594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.617948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.620093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.677226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for project b8eb99dbda38447a8ff7721744633469. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:28:49.684209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Getting quotas for user 472ff2bf65fb473ba60274de014b08a9 and project b8eb99dbda38447a8ff7721744633469. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:28:49.702699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:49.713440 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-754841ba-0c12-44ca-bfda-978731856f7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.648617 Jul 24 01:28:49.714065 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2095/4059] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:49 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:49.719936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:28:49.723201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:28:49.727216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:49.727845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:49.739874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.740340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.741149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.741567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.844361 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3286800-6588-43be-ae8e-49c0454f3776 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.344201 Jul 24 01:28:49.854619 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1965/4060] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:28:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:28:49.866431 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:49.870030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:49.886391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.890308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:49.892066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:49.895039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:50.058217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:50.071975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6294d04a-190e-496e-9281-f243b56b8289 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1316 microversion: 2.1 time: 0.352699 Jul 24 01:28:50.073165 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2096/4061] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:49 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:50.084734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00716ab3-ac63-4b0b-aed7-0bda63b31d54 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:50.088893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00716ab3-ac63-4b0b-aed7-0bda63b31d54 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:50.313117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00716ab3-ac63-4b0b-aed7-0bda63b31d54 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:50.325333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00716ab3-ac63-4b0b-aed7-0bda63b31d54 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:50.327014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00716ab3-ac63-4b0b-aed7-0bda63b31d54 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:50.328060 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00716ab3-ac63-4b0b-aed7-0bda63b31d54 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1280 microversion: 2.20 time: 0.253497 Jul 24 01:28:50.328615 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2097/4062] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:50 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:50.349953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:50.350813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:50.359923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:50.366916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:50.368350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:50.369019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:50.608895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:50.620147 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ccb6403-47ee-4f92-a4c2-6361a22aba71 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 0.761482 Jul 24 01:28:50.620981 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1966/4063] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:49 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:50.734809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:50.735443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:50.750180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:50.751076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:50.752145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:50.752852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:51.352969 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:51.372081 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3174a0ce-01ec-4a12-a44c-084810141640 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1688 microversion: 2.1 time: 1.029530 Jul 24 01:28:51.382793 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2098/4064] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:50 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1688 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:51.388050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:51.388684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:51.402680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:51.403406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:51.404591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:51.405200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:51.755014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:51.766096 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d9ac8173-e571-4ffc-9878-31d7b13ea5ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 1.035417 Jul 24 01:28:51.766710 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1967/4065] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:50 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:51.771543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:51.772165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:51.789721 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:51.791449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:51.792120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:51.796776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:51.797409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:52.075370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:52.084992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:52.099141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:52.100360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fcf9e355-574c-416a-9b9d-9d2b3aa63868 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1338 microversion: 2.20 time: 0.332720 Jul 24 01:28:52.100961 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1968/4066] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:51 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1338 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:52.115761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:52.116397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:52.138521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:52.138984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:52.139784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:52.140231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:52.239283 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:52.254321 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3bbfee39-4db2-42cf-8591-0dcb82ce45f4 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1316 microversion: 2.1 time: 0.869788 Jul 24 01:28:52.255533 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2099/4067] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:51 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1316 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:52.392594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:52.394617 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:52.418240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:52.419060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:52.420071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:52.420739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:52.924583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:52.947878 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-68f558c5-e67f-43b6-9651-33febd2cc2a8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 0.845847 Jul 24 01:28:52.949006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1969/4068] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:52 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:52.955070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:52.955893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:52.967366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:52.967823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:52.968850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:52.969030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.012698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:53.038015 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3c6d8224-0db0-4f5a-b7f2-2eaf1cd99fcf tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1688 microversion: 2.1 time: 0.650842 Jul 24 01:28:53.040012 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2100/4069] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:52 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1688 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:53.119826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:53.120451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:53.139793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.141928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.142960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.147582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.391240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:53.410721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:53.414420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:53.416565 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-42bed6e7-02be-467a-91a9-b968ee8366e4 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1338 microversion: 2.20 time: 0.301304 Jul 24 01:28:53.420346 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2101/4070] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:53 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:53.435324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:53.435973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:53.447970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:53.450803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.455121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.458314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.458941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.462354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d44b461c-c9fb-4b45-96ef-6832ae8af196 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.510767 Jul 24 01:28:53.466548 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1970/4071] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:52 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:53.853186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Action: 'update', calling method: .version_select at 0x7f05eb1eb700>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:53.855615 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:53.855615 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:28:53.857282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.861237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.898872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.899854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.917704 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] HTTP exception thrown: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Request method failure captured: Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a HTTP/1.1 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 56 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KBVVC4ncZ4d3Zvz6MjvE8TfNO8Khf_jm72ixQcELT0lp0KJ5B9vzlae81q4XLD7_BbOPXxYBmk63dEVQzUsHNw2VGnqcWejXiGpjt2vMRAEPyrOpydGBolbCGjpIqCto3X5S6x7_mkiWDvptR6qeLYC0znmi49k5U4C7tPWTEsq6p8 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.53 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: d4c3ad7c12984998a8f74b1c652ca5af Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4c3ad7c12984998a8f74b1c652ca5af", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: d4c3ad7c12984998a8f74b1c652ca5af Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: bfa1d3bd352044b4912bf491a594f167 Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: exception: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:28:53.920177 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:53.926193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Returning 404 to user: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:53.927900 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3272d9e-57bf-4e6a-a34d-012731daa684 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a" status: 404 len: 110 microversion: 2.53 time: 0.342647 Jul 24 01:28:53.928740 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1971/4072] 10.222.0.27 () {62 vars in 1308 bytes} [Sun Jul 24 01:28:53 2022] PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a => generated 110 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:28:53.936580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b8f239f4-d01f-496a-a583-e485246ecfa1 req-1f3ff4b6-b834-40ef-90d3-2a4dffda07eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1cd906-b406-46dd-bd65-fe0292f7c9de", "name": "network-vif-plugged", "status": "completed", "tag": "aa20a123-c219-46a0-959b-811824ea97c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:53.949101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b8f239f4-d01f-496a-a583-e485246ecfa1 req-1f3ff4b6-b834-40ef-90d3-2a4dffda07eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.949822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b8f239f4-d01f-496a-a583-e485246ecfa1 req-1f3ff4b6-b834-40ef-90d3-2a4dffda07eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:53.951884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:53.964238 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b8f239f4-d01f-496a-a583-e485246ecfa1 req-1f3ff4b6-b834-40ef-90d3-2a4dffda07eb service nova] Creating event network-vif-plugged:aa20a123-c219-46a0-959b-811824ea97c7 for instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de on n-h1-master-1 Jul 24 01:28:53.965201 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9e871ac4-c826-42c3-863d-980e1b77a593 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1316 microversion: 2.1 time: 0.538749 Jul 24 01:28:53.970748 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2102/4073] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:53 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:53.972080 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b8f239f4-d01f-496a-a583-e485246ecfa1 req-1f3ff4b6-b834-40ef-90d3-2a4dffda07eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041638 Jul 24 01:28:53.973161 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1972/4074] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:53.984803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:53.985943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:53.993595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:53.995059 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.006374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Action: 'update', calling method: .version_select at 0x7f05eac49790>, body: {"status": "disabled"} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:54.007823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.008033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.013714 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:54.013714 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:28:54.020061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.020527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.030646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.031738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.069954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] HTTP exception thrown: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Request method failure captured: Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a HTTP/1.1 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 22 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KBVVC4ncZ4d3Zvz6MjvE8TfNO8Khf_jm72ixQcELT0lp0KJ5B9vzlae81q4XLD7_BbOPXxYBmk63dEVQzUsHNw2VGnqcWejXiGpjt2vMRAEPyrOpydGBolbCGjpIqCto3X5S6x7_mkiWDvptR6qeLYC0znmi49k5U4C7tPWTEsq6p8 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.53 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: d4c3ad7c12984998a8f74b1c652ca5af Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4c3ad7c12984998a8f74b1c652ca5af", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: d4c3ad7c12984998a8f74b1c652ca5af Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bfa1d3bd352044b4912bf491a594f167 Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: {"status": "disabled"} Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: exception: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a', 'body': {'status': 'disabled'}} Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:28:54.073885 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.081520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Returning 404 to user: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:54.082450 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:54.082535 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6deedc62-d423-465a-bf11-9ef9468d501d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a" status: 404 len: 110 microversion: 2.53 time: 0.102714 Jul 24 01:28:54.082535 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2103/4075] 10.222.0.27 () {62 vars in 1308 bytes} [Sun Jul 24 01:28:53 2022] PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a => generated 110 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:28:54.094718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:54.096319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:54.114702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.118600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.121474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.123601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.384713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:54.396449 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f2a87660-4781-4345-98ff-75a0e757f1c9 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1621 microversion: 2.1 time: 0.318088 Jul 24 01:28:54.407597 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2104/4076] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:54 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1621 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:54.414249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Action: 'update', calling method: .version_select at 0x7f05eacbfca0>, body: {"status": "enabled"} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:54.417428 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:54.417428 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:28:54.419040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.419696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.427496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.428505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.434907 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] HTTP exception thrown: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Request method failure captured: Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a HTTP/1.1 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 21 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KBVVC4ncZ4d3Zvz6MjvE8TfNO8Khf_jm72ixQcELT0lp0KJ5B9vzlae81q4XLD7_BbOPXxYBmk63dEVQzUsHNw2VGnqcWejXiGpjt2vMRAEPyrOpydGBolbCGjpIqCto3X5S6x7_mkiWDvptR6qeLYC0znmi49k5U4C7tPWTEsq6p8 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.53 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: d4c3ad7c12984998a8f74b1c652ca5af Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4c3ad7c12984998a8f74b1c652ca5af", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4c3ad7c12984998a8f74b1c652ca5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: d4c3ad7c12984998a8f74b1c652ca5af Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: bfa1d3bd352044b4912bf491a594f167 Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: {"status": "enabled"} Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: exception: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a', 'body': {'status': 'enabled'}} Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:28:54.437644 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. Jul 24 01:28:54.441483 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:28:54.443944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Returning 404 to user: Service c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:54.445010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-219391f3-fcc3-45fa-ab54-99e263ff060d tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a" status: 404 len: 110 microversion: 2.53 time: 0.036107 Jul 24 01:28:54.446115 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2105/4077] 10.222.0.27 () {62 vars in 1308 bytes} [Sun Jul 24 01:28:54 2022] PUT /compute/v2.1/os-services/c9c00ca3-4140-40d5-8e63-fc1b10bb2f3a => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:28:54.451380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:54.452208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:54.463348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.464520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.465490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.466141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.834680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:54.847303 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-874c95fb-c608-4e71-9c52-01838cf39bc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 0.867667 Jul 24 01:28:54.863674 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1973/4078] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:53 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:54.870020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-798da9b1-3a27-469b-8f64-97862e0319f3 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:54.872125 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:54.872125 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:28:54.873392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-798da9b1-3a27-469b-8f64-97862e0319f3 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.873886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-798da9b1-3a27-469b-8f64-97862e0319f3 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.874711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-798da9b1-3a27-469b-8f64-97862e0319f3 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.875157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-798da9b1-3a27-469b-8f64-97862e0319f3 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.906764 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-798da9b1-3a27-469b-8f64-97862e0319f3 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041556 Jul 24 01:28:54.908257 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1974/4079] 10.222.0.27 () {60 vars in 1177 bytes} [Sun Jul 24 01:28:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:54.914885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:54.917979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:54.919214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:54.928127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.928715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.929604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:54.930185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:54.931345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:54.933955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:54.935670 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c2526917-916a-4c05-9c3b-6fff3e9d10f5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 0.488364 Jul 24 01:28:54.936484 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2106/4080] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:54 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:55.088680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b005983b-43ad-4c1e-85d1-407aa51fb9a7 req-f8297ada-636d-4608-aaa0-6f51b7ff88fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b442384-e51b-40a2-aa9e-86c1404f7da0", "name": "network-vif-deleted", "tag": "9852d3b1-563c-4847-9ab9-41791450fbdb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:55.106668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b005983b-43ad-4c1e-85d1-407aa51fb9a7 req-f8297ada-636d-4608-aaa0-6f51b7ff88fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.107106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b005983b-43ad-4c1e-85d1-407aa51fb9a7 req-f8297ada-636d-4608-aaa0-6f51b7ff88fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.119156 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:55.123663 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b005983b-43ad-4c1e-85d1-407aa51fb9a7 req-f8297ada-636d-4608-aaa0-6f51b7ff88fc service nova] Creating event network-vif-deleted:9852d3b1-563c-4847-9ab9-41791450fbdb for instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 on n-h1-master-1 Jul 24 01:28:55.132896 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b005983b-43ad-4c1e-85d1-407aa51fb9a7 req-f8297ada-636d-4608-aaa0-6f51b7ff88fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194731 Jul 24 01:28:55.134499 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2107/4081] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:55.147414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6acb6566-5270-4fad-a0c3-2af8b86c8c47 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.152241 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:55.152241 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:28:55.155312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6acb6566-5270-4fad-a0c3-2af8b86c8c47 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.156058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6acb6566-5270-4fad-a0c3-2af8b86c8c47 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.157155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6acb6566-5270-4fad-a0c3-2af8b86c8c47 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.158076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6acb6566-5270-4fad-a0c3-2af8b86c8c47 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.187095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:55.197259 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c365ed0-781e-43b9-9c5e-924d6971d9d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.287675 Jul 24 01:28:55.197479 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:55.198751 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1975/4082] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:54 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:55.207325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.207561 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6acb6566-5270-4fad-a0c3-2af8b86c8c47 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.068937 Jul 24 01:28:55.208493 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2108/4083] 10.222.0.27 () {60 vars in 1210 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:55.209187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:55.218860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.219775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.220847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.221347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.226936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-687b3b28-0d73-4f4c-85d5-a4c6b5c1296a tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.228137 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:55.228137 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:28:55.229372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-687b3b28-0d73-4f4c-85d5-a4c6b5c1296a tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.229864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-687b3b28-0d73-4f4c-85d5-a4c6b5c1296a tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.230838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-687b3b28-0d73-4f4c-85d5-a4c6b5c1296a tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.231545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-687b3b28-0d73-4f4c-85d5-a4c6b5c1296a tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.280421 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-687b3b28-0d73-4f4c-85d5-a4c6b5c1296a tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.058793 Jul 24 01:28:55.282061 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2109/4084] 10.222.0.27 () {60 vars in 1177 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:55.296044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60c38981-2852-45c3-bf9e-8666e69b5b35 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.298233 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:55.298233 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:28:55.302400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60c38981-2852-45c3-bf9e-8666e69b5b35 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.303348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60c38981-2852-45c3-bf9e-8666e69b5b35 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.305488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60c38981-2852-45c3-bf9e-8666e69b5b35 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.307330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60c38981-2852-45c3-bf9e-8666e69b5b35 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.387983 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60c38981-2852-45c3-bf9e-8666e69b5b35 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.099212 Jul 24 01:28:55.388872 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2110/4085] 10.222.0.27 () {60 vars in 1234 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:55.399565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b8fb25a4-1cd3-469d-8a26-5ae5b420221e tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.401466 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:55.401466 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:28:55.402781 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8fb25a4-1cd3-469d-8a26-5ae5b420221e tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.403245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8fb25a4-1cd3-469d-8a26-5ae5b420221e tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.406889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8fb25a4-1cd3-469d-8a26-5ae5b420221e tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.407758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8fb25a4-1cd3-469d-8a26-5ae5b420221e tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.447052 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b8fb25a4-1cd3-469d-8a26-5ae5b420221e tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.051023 Jul 24 01:28:55.461905 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2111/4086] 10.222.0.27 () {60 vars in 1177 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:28:55.467829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.468932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:55.469924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:55.477353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.478026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.479025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.479474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.486261 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3cae671-4bcc-40ec-99e8-2d4381533769 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1316 microversion: 2.1 time: 0.285926 Jul 24 01:28:55.488232 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1976/4087] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:55.497472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15c88190-5c47-487d-b9fa-b145da4f0e89 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.500075 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:55.500075 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:28:55.501702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15c88190-5c47-487d-b9fa-b145da4f0e89 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.502402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15c88190-5c47-487d-b9fa-b145da4f0e89 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.504325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15c88190-5c47-487d-b9fa-b145da4f0e89 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.505017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15c88190-5c47-487d-b9fa-b145da4f0e89 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.536808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.537190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.537663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lazy-loading 'fault' on Instance uuid 1b442384-e51b-40a2-aa9e-86c1404f7da0 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:28:55.543207 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15c88190-5c47-487d-b9fa-b145da4f0e89 tempest-ServicesAdminNegativeV253TestJSON-598434412 tempest-ServicesAdminNegativeV253TestJSON-598434412-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.049850 Jul 24 01:28:55.544445 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1977/4088] 10.222.0.27 () {60 vars in 1238 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:55.607678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:55.617010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14ab1dc2-e83b-495e-bc41-d02c326515fb tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 200 len: 1335 microversion: 2.1 time: 0.153622 Jul 24 01:28:55.631079 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2112/4089] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 1335 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:55.732794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24e5bcad-09c5-4612-a937-acc580328211 tempest-ServicesAdminNegativeV253TestJSON-565166224 tempest-ServicesAdminNegativeV253TestJSON-565166224-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.735070 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:28:55.735070 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:28:55.742284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-24e5bcad-09c5-4612-a937-acc580328211 tempest-ServicesAdminNegativeV253TestJSON-565166224 tempest-ServicesAdminNegativeV253TestJSON-565166224-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b684b719c4b34bfb991a7c733119e59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e6215a8c094ed88817fabac5138511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24e5bcad-09c5-4612-a937-acc580328211 tempest-ServicesAdminNegativeV253TestJSON-565166224 tempest-ServicesAdminNegativeV253TestJSON-565166224-project] Request method failure captured: Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KBU26FvG1QeBIIRHLGdPylyqTQLSnaNLaPlbJByv5RsulosV2XFbTCWklzACLvQ5GkwnU3Ar5OIp4nRFJMaB8OCQmUDfdO21iSH_oXz0e96M-JRltlzZUVfQTY7qYF5wOnqNYzHZJ0VfMOCHyDn4iQ3lhu9WVWwZcsXIbrPuB4Z7vM Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.53 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 29e6215a8c094ed88817fabac5138511 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-565166224 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29e6215a8c094ed88817fabac5138511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29e6215a8c094ed88817fabac5138511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29e6215a8c094ed88817fabac5138511", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29e6215a8c094ed88817fabac5138511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-565166224 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 29e6215a8c094ed88817fabac5138511 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-565166224 Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServicesAdminNegativeV253TestJSON-565166224-project Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b684b719c4b34bfb991a7c733119e59a Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-565166224-project Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: action_args: {} Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise self.value Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 24 01:28:55.744153 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 24 01:28:55.747542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:55.751877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24e5bcad-09c5-4612-a937-acc580328211 tempest-ServicesAdminNegativeV253TestJSON-565166224 tempest-ServicesAdminNegativeV253TestJSON-565166224-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:55.753993 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-24e5bcad-09c5-4612-a937-acc580328211 tempest-ServicesAdminNegativeV253TestJSON-565166224 tempest-ServicesAdminNegativeV253TestJSON-565166224-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.201048 Jul 24 01:28:55.758934 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1978/4090] 10.222.0.27 () {60 vars in 1177 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/os-services => generated 112 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:28:55.868315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.869207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:55.889766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.892938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.898039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.900638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.958629 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:55.960145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:55.981462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.985638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:55.991433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:55.992000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:56.508942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:56.522542 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-db8dbeee-97a8-43de-b0b2-e630565e74b5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1317 microversion: 2.1 time: 0.660220 Jul 24 01:28:56.523504 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2113/4091] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:56.548457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-63ac7093-a06a-4304-a9d6-22e35d6b3e9a req-55077c5a-9029-40ee-b060-587b03b5bf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c955e115-af02-4f3e-828f-73823c89484c", "name": "network-vif-plugged", "status": "completed", "tag": "826f1421-4de2-41cd-9948-a229cb459876"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:56.579042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-63ac7093-a06a-4304-a9d6-22e35d6b3e9a req-55077c5a-9029-40ee-b060-587b03b5bf59 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:56.579767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-63ac7093-a06a-4304-a9d6-22e35d6b3e9a req-55077c5a-9029-40ee-b060-587b03b5bf59 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:56.605698 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-63ac7093-a06a-4304-a9d6-22e35d6b3e9a req-55077c5a-9029-40ee-b060-587b03b5bf59 service nova] Creating event network-vif-plugged:826f1421-4de2-41cd-9948-a229cb459876 for instance c955e115-af02-4f3e-828f-73823c89484c on n-h2-master-1 Jul 24 01:28:56.614195 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-63ac7093-a06a-4304-a9d6-22e35d6b3e9a req-55077c5a-9029-40ee-b060-587b03b5bf59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089145 Jul 24 01:28:56.615591 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2114/4092] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:56.623647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:56.624976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:56.655038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:56.655884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:56.656938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:56.657536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:56.678948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:56.700757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:56.705246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:56.713491 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a5c2463-4c07-4ac0-9e67-20ac3e159f12 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 0.755993 Jul 24 01:28:56.714685 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1979/4093] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:55 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:28:56.724827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:56.725557 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:56.747177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:56.756903 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:56.757962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:56.758500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:57.903898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:57.917390 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df72b512-ba96-477e-9ba6-d768becde3bb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 1.299897 Jul 24 01:28:57.918381 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2115/4094] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:56 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:57.920250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:57.924333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f2672234-2268-4e7e-830a-caa2a2d49a4b req-392db36e-0e73-47fc-9dbd-0ec6e585232f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3e0006-7485-440e-9282-2f6f982cc604", "tag": "4e29293a-0608-4f8c-903a-03bc61e05c91"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:57.936933 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ececaea-f729-46f4-9a13-742dd0509afb tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1316 microversion: 2.1 time: 1.220723 Jul 24 01:28:57.939275 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1980/4095] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:56 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1316 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:57.943024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f2672234-2268-4e7e-830a-caa2a2d49a4b req-392db36e-0e73-47fc-9dbd-0ec6e585232f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:57.943712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f2672234-2268-4e7e-830a-caa2a2d49a4b req-392db36e-0e73-47fc-9dbd-0ec6e585232f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:57.948040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:57.949003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 1b442384-e51b-40a2-aa9e-86c1404f7da0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:57.972738 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f2672234-2268-4e7e-830a-caa2a2d49a4b req-392db36e-0e73-47fc-9dbd-0ec6e585232f service nova] Creating event network-changed:4e29293a-0608-4f8c-903a-03bc61e05c91 for instance 6e3e0006-7485-440e-9282-2f6f982cc604 on n-h1-master-1 Jul 24 01:28:57.975441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:57.976197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:57.977469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:57.978381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:57.999736 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f2672234-2268-4e7e-830a-caa2a2d49a4b req-392db36e-0e73-47fc-9dbd-0ec6e585232f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074453 Jul 24 01:28:58.000551 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2116/4096] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:28:58.018106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:58.018923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:58.024498 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 could not be found. Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 HTTP/1.1 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 could not be found. Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1b442384-e51b-40a2-aa9e-86c1404f7da0'} Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 could not be found. Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 could not be found. Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:28:58.027193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:58.030694 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:28:58.030694 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:28:58.030694 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:28:58.030694 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:28:58.030694 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:28:58.030694 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 could not be found. Jul 24 01:28:58.030694 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:28:58.036868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 404 to user: Instance 1b442384-e51b-40a2-aa9e-86c1404f7da0 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:28:58.038236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3aaab355-afed-427a-8832-506f58998951 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0" status: 404 len: 111 microversion: 2.1 time: 0.097827 Jul 24 01:28:58.040690 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1981/4097] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:57 2022] GET /compute/v2.1/servers/1b442384-e51b-40a2-aa9e-86c1404f7da0 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:28:58.047363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:58.049074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:58.050756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:58.051924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:58.052708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:58.053545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:58.062251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:58.063884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:58.067823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:58.068628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:58.551780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:58.567942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:58.575877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:58.577352 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f779f13-8685-4ae4-8e53-cabac1cba504 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 0.535403 Jul 24 01:28:58.590102 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1982/4098] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:28:58 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:28:58.602505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a4e94e2f-c713-4d5f-88c5-5a0d433fe619 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '.version_select at 0x7f05eb1f0280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:58.643359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a4e94e2f-c713-4d5f-88c5-5a0d433fe619 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-241046294" status: 202 len: 0 microversion: 2.1 time: 0.052055 Jul 24 01:28:58.644554 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1983/4099] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:28:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-241046294 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:28:58.723907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:58.736921 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d4a87f2-c131-4ea8-ae93-7176bf7f68a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.730056 Jul 24 01:28:58.741000 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2117/4100] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:58 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:28:58.899673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1112090314", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:28:58.936248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:58.937562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:58.948442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:58.952125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:58.953098 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:58.954501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:59.002723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] validate_networks() for [('2909a66d-cdd3-4b87-b889-9aac3ab2e97c', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:28:59.622901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:28:59.636654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1b9bbfd-5a8d-44b5-aa5c-9bcab8ca9a62 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.704302 Jul 24 01:28:59.648865 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2118/4101] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:58 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:28:59.654651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:28:59.655609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:28:59.667656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:59.668113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:59.669725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:28:59.670169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:28:59.708364 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=16 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:00.267858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:00.276518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5bb0627a-f8d0-485c-ad00-f26462d7a88f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1505 microversion: 2.1 time: 0.626412 Jul 24 01:29:00.282628 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2119/4102] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:28:59 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:00.288513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:00.293949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:00.324979 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:00.327479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:00.328375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:00.333736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:00.334540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:00.987215 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:29:00.988386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:29:00.988875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:29:00.989326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:29:00.990049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:29:01.009285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.010744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.012835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.014211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.065403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Getting quotas for project da60c4b9da1b4445a038238d0db2927e. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:01.075387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Getting quotas for user 014d9b85786b4a22b71463e346159fc4 and project da60c4b9da1b4445a038238d0db2927e. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:01.110531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:29:01.116362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:29:01.247402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f60241bf-6b24-4443-9855-746b33b2c6da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.354898 Jul 24 01:29:01.254967 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1984/4103] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:29:01.260063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:01.260618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:01.298009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.301214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.302450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.303071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.365550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:01.367226 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58ca63ff-c9b0-4b53-89f6-35c933ca6fbe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c/os-instance-actions/req-1f864036-839d-4e52-ab70-bc6589bac444" status: 200 len: 313 microversion: 2.1 time: 0.111150 Jul 24 01:29:01.368427 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1985/4104] 10.222.0.27 () {58 vars in 1418 bytes} [Sun Jul 24 01:29:01 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c/os-instance-actions/req-1f864036-839d-4e52-ab70-bc6589bac444 => generated 313 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:01.379367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:01.380231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:01.387068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.387895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.388954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.389655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.531254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:01.540129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:01.547675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:01.548870 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8531f8d-4eb6-42df-bab1-96ed82d112b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 1.264864 Jul 24 01:29:01.549456 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2120/4105] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:00 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:01.564681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae987d07-a7f6-45c2-b922-044ab4f5aaa8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:01.565503 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae987d07-a7f6-45c2-b922-044ab4f5aaa8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:01.674183 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ae987d07-a7f6-45c2-b922-044ab4f5aaa8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:01.682549 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae987d07-a7f6-45c2-b922-044ab4f5aaa8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1217 microversion: 2.1 time: 0.127638 Jul 24 01:29:01.686867 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2121/4106] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:01 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:01.707719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45d0fb0d-e0c4-4b68-b515-13b0e30d32f7 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:01.709310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45d0fb0d-e0c4-4b68-b515-13b0e30d32f7 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:01.725473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0fb0d-e0c4-4b68-b515-13b0e30d32f7 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.726293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0fb0d-e0c4-4b68-b515-13b0e30d32f7 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.730562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0fb0d-e0c4-4b68-b515-13b0e30d32f7 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.731532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0fb0d-e0c4-4b68-b515-13b0e30d32f7 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.775206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:01.790628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-27a03b28-bbe8-4109-a594-618af83aaac1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.420832 Jul 24 01:29:01.791635 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1986/4107] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:01 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:01.879257 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45d0fb0d-e0c4-4b68-b515-13b0e30d32f7 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "POST /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c/action" status: 202 len: 0 microversion: 2.1 time: 0.190696 Jul 24 01:29:01.891536 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2122/4108] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:29:01 2022] POST /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:29:01.906718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:01.909576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:01.923851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.924377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:01.931624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:01.932108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:02.155190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-231c2b2f-73ea-47f5-ac3e-4f19e0340eee tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Calling method '.version_select at 0x7f05eb5450d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:02.194997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-231c2b2f-73ea-47f5-ac3e-4f19e0340eee tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] HTTP exception thrown: Image not found. Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-231c2b2f-73ea-47f5-ac3e-4f19e0340eee tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Request method failure captured: Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/images/ad045b07-e8de-4cf1-b79a-ce35ce293b4a/metadata/os_distro HTTP/1.1 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KBdM23IDwInqYl81uIoICk-iUjQsXbEdyzyt_WkfSTQ6pcK9qaMXcIIWL3H7R_x4o6UGmQXg1viDDHQeeZOd6JSDpTaJog4oAeaIDsgYUMj6BtFfPpz-5gq6APDp9wpD2WpB96cn5kdcTdEunwvBz7L7-vETp90yClNInJS1sRvtVE Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa9a45e048e2414e8e6bf26604ad85d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 09bd196b3fa749229907457ebf0030b2 Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: action_args: {'image_id': 'ad045b07-e8de-4cf1-b79a-ce35ce293b4a', 'id': 'os_distro'} Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ad045b07-e8de-4cf1-b79a-ce35ce293b4a Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:29:02.204237 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ad045b07-e8de-4cf1-b79a-ce35ce293b4a could not be found. Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.208911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-231c2b2f-73ea-47f5-ac3e-4f19e0340eee tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:02.223402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-231c2b2f-73ea-47f5-ac3e-4f19e0340eee tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] 10.222.0.27 "DELETE /compute/v2.1/images/ad045b07-e8de-4cf1-b79a-ce35ce293b4a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.418893 Jul 24 01:29:02.223402 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1987/4109] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:29:01 2022] DELETE /compute/v2.1/images/ad045b07-e8de-4cf1-b79a-ce35ce293b4a/metadata/os_distro => generated 62 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:29:02.228441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1cd1569-ace7-47ae-92fc-7a4232e36a16 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Calling method '.version_select at 0x7f05eb1a61f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:02.241574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:02.252118 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-15de7b7a-0dcb-492a-9f44-6905e401c3f9 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1507 microversion: 2.1 time: 0.359047 Jul 24 01:29:02.255890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2123/4110] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:01 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:02.263542 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-e1cd1569-ace7-47ae-92fc-7a4232e36a16 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] HTTP exception thrown: Image not found. Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1cd1569-ace7-47ae-92fc-7a4232e36a16 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Request method failure captured: Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/images/08590975-4bfb-4ef9-a7b8-77a505d44f27/metadata/os_version HTTP/1.1 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KBdM23IDwInqYl81uIoICk-iUjQsXbEdyzyt_WkfSTQ6pcK9qaMXcIIWL3H7R_x4o6UGmQXg1viDDHQeeZOd6JSDpTaJog4oAeaIDsgYUMj6BtFfPpz-5gq6APDp9wpD2WpB96cn5kdcTdEunwvBz7L7-vETp90yClNInJS1sRvtVE Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa9a45e048e2414e8e6bf26604ad85d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 09bd196b3fa749229907457ebf0030b2 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: action_args: {'image_id': '08590975-4bfb-4ef9-a7b8-77a505d44f27', 'id': 'os_version'} Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 08590975-4bfb-4ef9-a7b8-77a505d44f27 Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:29:02.265598 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 08590975-4bfb-4ef9-a7b8-77a505d44f27 could not be found. Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.271769 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1cd1569-ace7-47ae-92fc-7a4232e36a16 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:02.277826 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1cd1569-ace7-47ae-92fc-7a4232e36a16 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] 10.222.0.27 "GET /compute/v2.1/images/08590975-4bfb-4ef9-a7b8-77a505d44f27/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.053333 Jul 24 01:29:02.280372 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1988/4111] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:29:02 2022] GET /compute/v2.1/images/08590975-4bfb-4ef9-a7b8-77a505d44f27/metadata/os_version => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:29:02.284133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9926efa1-914c-4190-9750-e11dd7989dd9 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Calling method '.version_select at 0x7f05eaee2550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:02.322950 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9926efa1-914c-4190-9750-e11dd7989dd9 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] HTTP exception thrown: Image not found. Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9926efa1-914c-4190-9750-e11dd7989dd9 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Request method failure captured: Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/images/d44d646b-b63e-4ba7-ae79-4bfd68d8575a/metadata HTTP/1.1 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KBdM23IDwInqYl81uIoICk-iUjQsXbEdyzyt_WkfSTQ6pcK9qaMXcIIWL3H7R_x4o6UGmQXg1viDDHQeeZOd6JSDpTaJog4oAeaIDsgYUMj6BtFfPpz-5gq6APDp9wpD2WpB96cn5kdcTdEunwvBz7L7-vETp90yClNInJS1sRvtVE Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa9a45e048e2414e8e6bf26604ad85d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 09bd196b3fa749229907457ebf0030b2 Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: action_args: {'image_id': 'd44d646b-b63e-4ba7-ae79-4bfd68d8575a'} Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d44d646b-b63e-4ba7-ae79-4bfd68d8575a Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:29:02.325616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d44d646b-b63e-4ba7-ae79-4bfd68d8575a could not be found. Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:29:02.329026 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.335368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9926efa1-914c-4190-9750-e11dd7989dd9 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:02.335777 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9926efa1-914c-4190-9750-e11dd7989dd9 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] 10.222.0.27 "GET /compute/v2.1/images/d44d646b-b63e-4ba7-ae79-4bfd68d8575a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055878 Jul 24 01:29:02.336550 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2124/4112] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:29:02 2022] GET /compute/v2.1/images/d44d646b-b63e-4ba7-ae79-4bfd68d8575a/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:29:02.350184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3dc1e741-df11-46c4-8c7f-e188aa406104 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Action: 'update_all', calling method: .version_select at 0x7f05eb819ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:02.384760 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3dc1e741-df11-46c4-8c7f-e188aa406104 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] HTTP exception thrown: Image not found. Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3dc1e741-df11-46c4-8c7f-e188aa406104 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Request method failure captured: Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/images/46a026ab-b014-4bf6-816c-d6c9e0f48a66/metadata HTTP/1.1 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 57 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KBdM23IDwInqYl81uIoICk-iUjQsXbEdyzyt_WkfSTQ6pcK9qaMXcIIWL3H7R_x4o6UGmQXg1viDDHQeeZOd6JSDpTaJog4oAeaIDsgYUMj6BtFfPpz-5gq6APDp9wpD2WpB96cn5kdcTdEunwvBz7L7-vETp90yClNInJS1sRvtVE Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa9a45e048e2414e8e6bf26604ad85d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 09bd196b3fa749229907457ebf0030b2 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: action_args: {'image_id': '46a026ab-b014-4bf6-816c-d6c9e0f48a66', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 46a026ab-b014-4bf6-816c-d6c9e0f48a66 Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:29:02.387193 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46a026ab-b014-4bf6-816c-d6c9e0f48a66 could not be found. Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:29:02.391859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.399032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3dc1e741-df11-46c4-8c7f-e188aa406104 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:02.400180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3dc1e741-df11-46c4-8c7f-e188aa406104 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] 10.222.0.27 "PUT /compute/v2.1/images/46a026ab-b014-4bf6-816c-d6c9e0f48a66/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057571 Jul 24 01:29:02.400972 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1989/4113] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:29:02 2022] PUT /compute/v2.1/images/46a026ab-b014-4bf6-816c-d6c9e0f48a66/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:29:02.412327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad36c073-e407-4208-8291-b4363dc8c3b4 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Action: 'update', calling method: .version_select at 0x7f05eabf03a0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:02.444622 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-ad36c073-e407-4208-8291-b4363dc8c3b4 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] HTTP exception thrown: Image not found. Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad36c073-e407-4208-8291-b4363dc8c3b4 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Request method failure captured: Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/images/9ff856d3-dff4-4e21-8557-48ff7d7e1ad3/metadata/os_distro HTTP/1.1 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 30 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KBdM23IDwInqYl81uIoICk-iUjQsXbEdyzyt_WkfSTQ6pcK9qaMXcIIWL3H7R_x4o6UGmQXg1viDDHQeeZOd6JSDpTaJog4oAeaIDsgYUMj6BtFfPpz-5gq6APDp9wpD2WpB96cn5kdcTdEunwvBz7L7-vETp90yClNInJS1sRvtVE Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa9a45e048e2414e8e6bf26604ad85d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 09bd196b3fa749229907457ebf0030b2 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: {"meta": {"os_distro": "alt"}} Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: action_args: {'image_id': '9ff856d3-dff4-4e21-8557-48ff7d7e1ad3', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9ff856d3-dff4-4e21-8557-48ff7d7e1ad3 Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:29:02.449016 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ff856d3-dff4-4e21-8557-48ff7d7e1ad3 could not be found. Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:29:02.452372 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.463080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad36c073-e407-4208-8291-b4363dc8c3b4 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:02.464570 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad36c073-e407-4208-8291-b4363dc8c3b4 tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] 10.222.0.27 "PUT /compute/v2.1/images/9ff856d3-dff4-4e21-8557-48ff7d7e1ad3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.057859 Jul 24 01:29:02.466981 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2125/4114] 10.222.0.27 () {60 vars in 1309 bytes} [Sun Jul 24 01:29:02 2022] PUT /compute/v2.1/images/9ff856d3-dff4-4e21-8557-48ff7d7e1ad3/metadata/os_distro => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:29:02.484937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80404715-561e-46f9-bcf9-0585801bc2af tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Action: 'create', calling method: .version_select at 0x7f05eb0994c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:02.522882 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-80404715-561e-46f9-bcf9-0585801bc2af tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] HTTP exception thrown: Image not found. Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80404715-561e-46f9-bcf9-0585801bc2af tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Request method failure captured: Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/images/c3f44e45-d409-47f0-82da-70b6347bc5bd/metadata HTTP/1.1 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 57 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KBdM23IDwInqYl81uIoICk-iUjQsXbEdyzyt_WkfSTQ6pcK9qaMXcIIWL3H7R_x4o6UGmQXg1viDDHQeeZOd6JSDpTaJog4oAeaIDsgYUMj6BtFfPpz-5gq6APDp9wpD2WpB96cn5kdcTdEunwvBz7L7-vETp90yClNInJS1sRvtVE Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa9a45e048e2414e8e6bf26604ad85d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa9a45e048e2414e8e6bf26604ad85d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: fa9a45e048e2414e8e6bf26604ad85d5 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-331457027 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 09bd196b3fa749229907457ebf0030b2 Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-331457027-project Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: action_args: {'image_id': 'c3f44e45-d409-47f0-82da-70b6347bc5bd', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c3f44e45-d409-47f0-82da-70b6347bc5bd Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:29:02.528861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3f44e45-d409-47f0-82da-70b6347bc5bd could not be found. Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:29:02.535902 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:02.540365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80404715-561e-46f9-bcf9-0585801bc2af tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:02.543625 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80404715-561e-46f9-bcf9-0585801bc2af tempest-ImagesMetadataNegativeTestJSON-331457027 tempest-ImagesMetadataNegativeTestJSON-331457027-project] 10.222.0.27 "POST /compute/v2.1/images/c3f44e45-d409-47f0-82da-70b6347bc5bd/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068451 Jul 24 01:29:02.548419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1990/4115] 10.222.0.27 () {60 vars in 1280 bytes} [Sun Jul 24 01:29:02 2022] POST /compute/v2.1/images/c3f44e45-d409-47f0-82da-70b6347bc5bd/metadata => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:29:02.569274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:02.569919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:02.588833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:02.589291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:02.590108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:02.590546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:02.705535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:02.707402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:02.721853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:02.723364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:02.724460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:02.727477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:02.880600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:02.908271 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6934fe15-ca8e-4e09-bdaa-463457ae095d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1213 microversion: 2.1 time: 0.198575 Jul 24 01:29:02.911124 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1991/4116] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:02 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1213 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:02.927490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:02.930275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:02.947028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:02.947479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:02.948257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:02.948695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:02.971067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:02.984595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:02.986873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:02.988654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-877fdfc9-5fd4-41f1-9ca5-84b8dd23416e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 0.424424 Jul 24 01:29:03.001382 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2126/4117] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:02 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:03.272710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:03.274233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:03.281360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:03.282169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:03.284737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:03.286835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:03.495180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:03.504126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11d3c532-6ee2-4039-bba0-47622482c0e2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.591408 Jul 24 01:29:03.509934 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1992/4118] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:02 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:03.660944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:03.674238 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f2b915a0-6588-467a-b78f-4bdab5dd6ae1 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1507 microversion: 2.1 time: 0.402098 Jul 24 01:29:03.684232 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2127/4119] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:03 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:03.927146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:03.928126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:03.945417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:03.946218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:03.947256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:03.947898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:04.006958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:04.007696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:04.020503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:04.021259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:04.023606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:04.024260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:04.063536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:04.071894 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f671801a-cbb3-4593-af1e-744c33d40297 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1275 microversion: 2.1 time: 0.148738 Jul 24 01:29:04.075130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1993/4120] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:03 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:04.526173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:04.526839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:04.534856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:04.541664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:04.542905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:04.543506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:04.917924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:04.930526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:04.932708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:04.939594 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63a0744c-80fa-460e-98a7-fd734f5d361e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 0.931492 Jul 24 01:29:04.941362 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2128/4121] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:04 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:04.946269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a1d8cd4c-da73-4ddd-82c3-d290adb2bbd3 req-ce02c946-0def-4a76-85b9-092a0c6dab00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3e0006-7485-440e-9282-2f6f982cc604", "name": "network-vif-plugged", "status": "completed", "tag": "4e29293a-0608-4f8c-903a-03bc61e05c91"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:05.013762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a1d8cd4c-da73-4ddd-82c3-d290adb2bbd3 req-ce02c946-0def-4a76-85b9-092a0c6dab00 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.014721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a1d8cd4c-da73-4ddd-82c3-d290adb2bbd3 req-ce02c946-0def-4a76-85b9-092a0c6dab00 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.046598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a1d8cd4c-da73-4ddd-82c3-d290adb2bbd3 req-ce02c946-0def-4a76-85b9-092a0c6dab00 service nova] Creating event network-vif-plugged:4e29293a-0608-4f8c-903a-03bc61e05c91 for instance 6e3e0006-7485-440e-9282-2f6f982cc604 on n-h1-master-1 Jul 24 01:29:05.059342 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a1d8cd4c-da73-4ddd-82c3-d290adb2bbd3 req-ce02c946-0def-4a76-85b9-092a0c6dab00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116187 Jul 24 01:29:05.060519 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2129/4122] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:05.075800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:05.076529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:05.100101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.100555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.104625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.105329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.408680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:05.421870 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0154aaf4-af04-42e7-9c6c-04ec23ccfdb8 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.899604 Jul 24 01:29:05.422260 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:05.427312 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1994/4123] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:04 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:05.468167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:05.468802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:05.501165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.501641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.502505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.503767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.520536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:05.530785 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:05.544692 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6649944-d538-4441-8914-ff93ce3f5e26 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1505 microversion: 2.1 time: 0.481116 Jul 24 01:29:05.548684 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2130/4124] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:05 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:05.583125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7a957f5-bcb5-4578-a36b-b9b16d176d11 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '.version_select at 0x7f05eaeac670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:05.586447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7a957f5-bcb5-4578-a36b-b9b16d176d11 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:05.610136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a957f5-bcb5-4578-a36b-b9b16d176d11 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.614555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a957f5-bcb5-4578-a36b-b9b16d176d11 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.615674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a957f5-bcb5-4578-a36b-b9b16d176d11 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.616357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7a957f5-bcb5-4578-a36b-b9b16d176d11 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.653915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:05.664065 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-36059dc2-022e-4658-acdb-a285ce2e72a5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1275 microversion: 2.1 time: 0.235307 Jul 24 01:29:05.667112 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1995/4125] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:05 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:05.753919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7a957f5-bcb5-4578-a36b-b9b16d176d11 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.187249 Jul 24 01:29:05.758172 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2131/4126] 10.222.0.27 () {58 vars in 1295 bytes} [Sun Jul 24 01:29:05 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c/os-instance-actions => generated 611 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:05.769115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:05.769621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:05.779355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.779791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.786728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.787305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.896408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:29:05.958822 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:05.959630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:05.971293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.975443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:05.983026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:05.983633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:06.145189 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-67062640-0cc1-4397-91b8-aee524a09554 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 204 len: 0 microversion: 2.1 time: 0.380202 Jul 24 01:29:06.152905 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1996/4127] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:29:05 2022] DELETE /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:29:06.161837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:06.175494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:06.195650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:06.196321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:06.197319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:06.198032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:06.247780 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:06.310789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:06.327659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:06.334467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:06.336066 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3c85c400-b845-49c5-9076-ec31021f098a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 0.382297 Jul 24 01:29:06.341825 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2132/4128] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:05 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:06.459835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:06.460548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:06.485877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:06.486338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:06.491223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:06.491694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:06.551969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:06.582901 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b972a41-c712-4a33-afa6-a99ffe8feffe tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1511 microversion: 2.1 time: 0.405112 Jul 24 01:29:06.595801 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1997/4129] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:06 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:06.680604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:06.682056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:06.691566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:06.692403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:06.695738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:06.696503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:06.751584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:06.762193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-129ff885-9dc6-4d15-92b0-1d42f007cff3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.316657 Jul 24 01:29:06.776278 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2133/4130] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:06 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:07.025263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:07.039987 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e0807dc1-ca6d-4ec4-bb93-9b65afe3a2a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.362647 Jul 24 01:29:07.039987 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1998/4131] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:06 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:07.085321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58daec6a-d8ae-4c67-8ed1-6481fdbff329 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Action: 'create', calling method: .version_select at 0x7f05eabf0160>, body: {"keypair": {"name": "tempest-keypair-614239883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEm7r6NML+kh6wSVqE6y5PhDW4rsrxyEozjzoshcyUZcgL9Ry98vLuoObiyY28ue1nEs1nBwQnGdEU6HomkekN8Q3aCHVG4EG0l/egl4TAuCayn6ram9Ah3HgX1gOttng=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:07.128753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-58daec6a-d8ae-4c67-8ed1-6481fdbff329 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:07.148328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-58daec6a-d8ae-4c67-8ed1-6481fdbff329 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for user b6eafce876174eb5a438f02cd62e8129 and project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:07.224322 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58daec6a-d8ae-4c67-8ed1-6481fdbff329 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.445590 Jul 24 01:29:07.232167 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2134/4132] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:29:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:07.235477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-346f91e1-e2de-4b75-afa7-6fc8cb6a5d78 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eb420d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:07.260050 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-346f91e1-e2de-4b75-afa7-6fc8cb6a5d78 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-614239883" status: 200 len: 497 microversion: 2.1 time: 0.028524 Jul 24 01:29:07.270405 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 1999/4133] 10.222.0.27 () {58 vars in 1214 bytes} [Sun Jul 24 01:29:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-614239883 => generated 497 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:29:07.273073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60c33dca-e62a-4f9c-9288-b5914ec110b3 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eaac3940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:07.322017 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60c33dca-e62a-4f9c-9288-b5914ec110b3 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614239883" status: 202 len: 0 microversion: 2.1 time: 0.052767 Jul 24 01:29:07.328767 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2135/4134] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614239883 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:29:07.343044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94be59c9-01b0-4536-9d07-d5a5f4be0c6c tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Action: 'create', calling method: .version_select at 0x7f05eb05d8b0>, body: {"keypair": {"name": "tempest-keypair-768506678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Ff9fxHhoCD8pDnXN1fGP2NebdYA1jQopW0PXraQLXwQofygh/TCE5tS7I8lbo3DjjUT0lYC6+5sS9bucXsA/jcTIi70480Ree0ddai2n4D30nTM0FfN6bPnt9OWKVHQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:07.367916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:07.368536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:07.404237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:07.404704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:07.405515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:07.405996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:07.411242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-94be59c9-01b0-4536-9d07-d5a5f4be0c6c tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:07.423615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-94be59c9-01b0-4536-9d07-d5a5f4be0c6c tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for user b6eafce876174eb5a438f02cd62e8129 and project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:07.526745 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94be59c9-01b0-4536-9d07-d5a5f4be0c6c tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187866 Jul 24 01:29:07.527612 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2000/4135] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:29:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:07.543222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fada9178-3812-4bf3-ac89-f000bebb0883 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eb35faf0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:07.655103 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fada9178-3812-4bf3-ac89-f000bebb0883 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768506678" status: 202 len: 0 microversion: 2.1 time: 0.115702 Jul 24 01:29:07.655960 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2001/4136] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768506678 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:29:07.668884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:07.674923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:07.704966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:07.706902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:07.726673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:07.727392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:08.038006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:08.053772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:08.056055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:08.059105 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ced1006d-3f11-44c5-abad-d5be9f4392d0 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1405 microversion: 2.20 time: 0.703819 Jul 24 01:29:08.061792 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2136/4137] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:07 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1405 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:29:08.072603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-84907559-c8cb-4a56-a802-6a23dcd40a7e tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Action: 'create', calling method: .version_select at 0x7f05eaac31f0>, body: {"keypair": {"name": "tempest-keypair-277015039", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:08.140954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-84907559-c8cb-4a56-a802-6a23dcd40a7e tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:08.152713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-84907559-c8cb-4a56-a802-6a23dcd40a7e tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for user b6eafce876174eb5a438f02cd62e8129 and project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:08.225149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-84907559-c8cb-4a56-a802-6a23dcd40a7e tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.141527 Jul 24 01:29:08.227356 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2137/4138] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:29:08 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:08.243311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:08.246644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:08.256579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:08.257299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:08.258416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:08.259013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:08.507108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:08.515476 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2bef03af-56de-41ad-9b60-9b1c7b03dd2f tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1511 microversion: 2.1 time: 0.858300 Jul 24 01:29:08.528839 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2002/4139] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:07 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1511 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:08.539389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:08.543513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:08.570197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:08.570661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:08.571470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:08.571916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:09.086159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:09.110910 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a1b270c0-09b2-4e3e-968c-357c8b03a39e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.882181 Jul 24 01:29:09.111540 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2138/4140] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:08 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:09.152911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b7ad86-449a-4791-9d2c-ba1e6fd5943a tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eaac3f70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:09.230253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c1b7ad86-449a-4791-9d2c-ba1e6fd5943a tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-277015039" status: 202 len: 0 microversion: 2.1 time: 0.100417 Jul 24 01:29:09.231132 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2139/4141] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-277015039 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:29:09.237784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:09.240132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:09.252020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:09.253503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:09.255108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:09.255778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:09.289042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:09.297628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac39870b-7195-4a22-bffa-b5310c8d2574 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.767588 Jul 24 01:29:09.314088 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2003/4142] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:08 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:09.321404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-06a674af-410d-4318-bd03-1272728ced0f tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Action: 'create', calling method: .version_select at 0x7f05ea4db280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-10315263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYI+MtwaQS7DTlM7vU2jdg+U/jTW0gDdkD6nInybIkdcyUcwnW09FGsyJbvOn89TQTaix31687eaEzkbaQ2jPaOZalKbsKqWNvfh5YUTh+r00eXuasjkWj8e4OLwUyaFQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:09.350666 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:09.374604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-06a674af-410d-4318-bd03-1272728ced0f tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:09.406166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-06a674af-410d-4318-bd03-1272728ced0f tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for user b6eafce876174eb5a438f02cd62e8129 and project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:09.448975 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-06a674af-410d-4318-bd03-1272728ced0f tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.131881 Jul 24 01:29:09.450297 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2004/4143] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:29:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:09.469790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1fb782a3-3a07-402a-894f-cebecf05d106 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Action: 'create', calling method: .version_select at 0x7f05eb9358b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1850795691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjSbvzrJUOmqod5MTdk4HWZyQIrGA2IhUkyP2khU88XAQB2XH0v/1ZV0oDq13X94jy3ygTWFL5gAZHjmCZQdT2lKDYkon0lkkwnZrI3sbmOquGzr+fem1Nx4dkCvufRbA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:09.509045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1fb782a3-3a07-402a-894f-cebecf05d106 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:09.524794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-1fb782a3-3a07-402a-894f-cebecf05d106 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for user b6eafce876174eb5a438f02cd62e8129 and project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:09.585777 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1fb782a3-3a07-402a-894f-cebecf05d106 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.124685 Jul 24 01:29:09.594294 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2005/4144] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:29:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:09.606852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:09.607550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:09.621455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:09.624959 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:09.625984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:09.626620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:10.058496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:10.078699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:10.085533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:10.086982 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1d503338-57ba-4232-816c-e5f17e42ae57 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1597 microversion: 2.20 time: 0.854285 Jul 24 01:29:10.093641 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2140/4145] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:09 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1597 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:10.098956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-95033759-60ac-44c6-a190-5f66f8dcdd52 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Action: 'create', calling method: .version_select at 0x7f05ea287790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1624814429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzLpcUiA/WLQ2DTPusJRpJEACyzvE5JMwNvb06JzePIj3I1DOXVuTH4iVLb7p7BGLPHIwq+c6Vz/aNg8yJTQ3XSF5Iu8PSZsjBvEX8rIQYt0t0RYzzdo2qbWb5OBWqvFg=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:10.206645 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-95033759-60ac-44c6-a190-5f66f8dcdd52 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:10.214298 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:10.244844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-95033759-60ac-44c6-a190-5f66f8dcdd52 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Getting quotas for user b6eafce876174eb5a438f02cd62e8129 and project 717a2a132e4e4f1096c3093b564dd125. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:10.318110 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-95033759-60ac-44c6-a190-5f66f8dcdd52 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.222712 Jul 24 01:29:10.319314 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2141/4146] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:29:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:10.324463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-668a7e0e-b26a-435b-bd81-e9ea99d6e2b5 req-20971117-02ac-4457-8df7-257f2d5d1667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3adf5d-740b-4b11-a7cb-6656c7160ab2", "tag": "630cd8e8-d9a3-4ca7-82c0-5ee8158c8e4b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:10.357267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-668a7e0e-b26a-435b-bd81-e9ea99d6e2b5 req-20971117-02ac-4457-8df7-257f2d5d1667 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:10.358237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-668a7e0e-b26a-435b-bd81-e9ea99d6e2b5 req-20971117-02ac-4457-8df7-257f2d5d1667 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:10.383543 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-668a7e0e-b26a-435b-bd81-e9ea99d6e2b5 req-20971117-02ac-4457-8df7-257f2d5d1667 service nova] Creating event network-changed:630cd8e8-d9a3-4ca7-82c0-5ee8158c8e4b for instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 on n-h2-master-1 Jul 24 01:29:10.393729 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-668a7e0e-b26a-435b-bd81-e9ea99d6e2b5 req-20971117-02ac-4457-8df7-257f2d5d1667 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072256 Jul 24 01:29:10.394704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2142/4147] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:10.427442 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f68ceaa6-392b-4d08-bbc6-68a0e9939ef3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:10.428259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f68ceaa6-392b-4d08-bbc6-68a0e9939ef3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:10.481828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f68ceaa6-392b-4d08-bbc6-68a0e9939ef3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:10.482754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f68ceaa6-392b-4d08-bbc6-68a0e9939ef3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:10.491427 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f68ceaa6-392b-4d08-bbc6-68a0e9939ef3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:10.493405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f68ceaa6-392b-4d08-bbc6-68a0e9939ef3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:10.637958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e6810811b14037afc8e2891be22039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217f2c9b33dc4d63a778c93abc91f70f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:10.670678 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-00ddf462-d0bb-49d5-8141-670989d6b22a tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 200 len: 1511 microversion: 2.1 time: 1.073900 Jul 24 01:29:10.682520 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2006/4148] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:09 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 1511 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:10.714904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:10.718384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:10.747990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:10.748581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:10.756740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:10.758962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:10.970368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f68ceaa6-392b-4d08-bbc6-68a0e9939ef3 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.574147 Jul 24 01:29:10.971041 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2143/4149] 10.222.0.27 () {60 vars in 1315 bytes} [Sun Jul 24 01:29:10 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-interface => generated 284 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:29:10.991012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:10.991652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:11.012099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:11.012583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:11.014542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:11.018950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:11.042941 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:11.334148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:11.343842 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-83893786-5232-40d9-9279-285b61bd8d25 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 0.658207 Jul 24 01:29:11.347980 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2007/4150] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:10 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:11.360817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c9a089e-a75b-417d-93bf-2b235405a9cf tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eaf140d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:11.372177 n-d-master-1 devstack@n-api.service[119562]: WARNING oslo_db.sqlalchemy.utils [None req-3c9a089e-a75b-417d-93bf-2b235405a9cf tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 24 01:29:11.388515 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c9a089e-a75b-417d-93bf-2b235405a9cf tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.038618 Jul 24 01:29:11.389521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2008/4151] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:29:11 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:11.397040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-fc38d6fb-7494-4fbe-abb5-3d1cbbf4226d req-1f43662a-2ebd-498a-9c28-a9dc008788f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c955e115-af02-4f3e-828f-73823c89484c", "name": "network-vif-deleted", "tag": "826f1421-4de2-41cd-9948-a229cb459876"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:11.419103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fc38d6fb-7494-4fbe-abb5-3d1cbbf4226d req-1f43662a-2ebd-498a-9c28-a9dc008788f2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:11.419798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fc38d6fb-7494-4fbe-abb5-3d1cbbf4226d req-1f43662a-2ebd-498a-9c28-a9dc008788f2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:11.450332 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-fc38d6fb-7494-4fbe-abb5-3d1cbbf4226d req-1f43662a-2ebd-498a-9c28-a9dc008788f2 service nova] Creating event network-vif-deleted:826f1421-4de2-41cd-9948-a229cb459876 for instance c955e115-af02-4f3e-828f-73823c89484c on n-h2-master-1 Jul 24 01:29:11.460192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:11.466766 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-fc38d6fb-7494-4fbe-abb5-3d1cbbf4226d req-1f43662a-2ebd-498a-9c28-a9dc008788f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075684 Jul 24 01:29:11.475779 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad715140-afec-4297-9bdd-86048a871a78 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.492726 Jul 24 01:29:11.476770 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2009/4152] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:11.484981 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2144/4153] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:10 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:11.492044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-54b33577-b4db-4e1d-9dae-b8c4b27262e1 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eadcf8b0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:11.525797 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-54b33577-b4db-4e1d-9dae-b8c4b27262e1 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1624814429" status: 202 len: 0 microversion: 2.1 time: 0.047264 Jul 24 01:29:11.526588 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2010/4154] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 01:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1624814429 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:29:11.549383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d45c322b-e98a-4b9e-82f4-f202ff13fcf7 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eae4cc10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:11.592399 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d45c322b-e98a-4b9e-82f4-f202ff13fcf7 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1850795691" status: 202 len: 0 microversion: 2.1 time: 0.061208 Jul 24 01:29:11.594538 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2145/4155] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 01:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1850795691 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:29:11.603595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9bb4d326-018c-48d4-8ead-e547585a4893 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] Calling method '.version_select at 0x7f05eb3ad9d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:11.635604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9bb4d326-018c-48d4-8ead-e547585a4893 tempest-KeyPairsV2TestJSON-877208263 tempest-KeyPairsV2TestJSON-877208263-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-10315263" status: 202 len: 0 microversion: 2.1 time: 0.035588 Jul 24 01:29:11.638142 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2011/4156] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-10315263 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:29:11.701923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:11.703293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] [instance: c955e115-af02-4f3e-828f-73823c89484c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:11.722181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:11.723148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:11.726454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:11.728008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:11.766572 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] HTTP exception thrown: Instance c955e115-af02-4f3e-828f-73823c89484c could not be found. Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Request method failure captured: Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c HTTP/1.1 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KBC7pzIZIAGzftNT5StXBuEIhM4V8NqvDTc8AOLbYZ0ZxCYQ7lGVH-Xbe2naWKLFTeW9HRofLClgBovbdSWpV7GauuHqKDsdufAJ3rdARDkrGxar8FXNlvU4g90T09vdmvgna63nBnoeH1IlgYSn2pk1ZU3QMli7i-f7sIv6yNP9pE Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 217f2c9b33dc4d63a778c93abc91f70f Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-InstanceActionsTestJSON-1829953891 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/217f2c9b33dc4d63a778c93abc91f70f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/217f2c9b33dc4d63a778c93abc91f70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_217f2c9b33dc4d63a778c93abc91f70f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/217f2c9b33dc4d63a778c93abc91f70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-InstanceActionsTestJSON-1829953891 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 217f2c9b33dc4d63a778c93abc91f70f Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1829953891 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-InstanceActionsTestJSON-1829953891-project Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: a1e6810811b14037afc8e2891be22039 Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-InstanceActionsTestJSON-1829953891-project Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: exception: Instance c955e115-af02-4f3e-828f-73823c89484c could not be found. Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c955e115-af02-4f3e-828f-73823c89484c'} Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c955e115-af02-4f3e-828f-73823c89484c could not be found. Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c955e115-af02-4f3e-828f-73823c89484c could not be found. Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:11.768290 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:11.772519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:11.772519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:11.772519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:11.772519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:11.772519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:11.772519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c955e115-af02-4f3e-828f-73823c89484c could not be found. Jul 24 01:29:11.772519 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:11.776999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] Returning 404 to user: Instance c955e115-af02-4f3e-828f-73823c89484c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:11.783039 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-129a2bf5-8c5b-4a1d-b9ae-d5df2aa70e50 tempest-InstanceActionsTestJSON-1829953891 tempest-InstanceActionsTestJSON-1829953891-project] 10.222.0.27 "GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c" status: 404 len: 111 microversion: 2.1 time: 0.086999 Jul 24 01:29:11.787902 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2146/4157] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:11 2022] GET /compute/v2.1/servers/c955e115-af02-4f3e-828f-73823c89484c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:29:12.366478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:12.367934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:12.391097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:12.391560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:12.395853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:12.396403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:12.493860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:12.495073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:12.507600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:12.510833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:12.511879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:12.512331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:13.555983 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:13.564915 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e7a8a753-f782-4fbb-9d05-4bc191164d6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1497 microversion: 2.1 time: 1.204440 Jul 24 01:29:13.567135 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2012/4158] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:12 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1497 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:13.582589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:13.583511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:13.592682 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:13.593571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:13.594691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:13.595281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:13.643829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:13.664068 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bcff4022-a231-4760-9fdb-b3e2d0a59c68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 1.171100 Jul 24 01:29:13.664902 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2147/4159] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:12 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:13.667350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:29:13.835593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fc24f388-2976-4973-8d91-57bb767ef9d4 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 204 len: 0 microversion: 2.1 time: 0.266819 Jul 24 01:29:13.836518 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2013/4160] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:29:13 2022] DELETE /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:29:13.844642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:13.845946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:13.852611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:13.853430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:13.854481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:13.855141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:13.987302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a5b02071-62e8-45df-add9-e6e41ce2f807 req-a1fa22a1-d6ba-4f19-a9e7-cd97960b619b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3e0006-7485-440e-9282-2f6f982cc604", "tag": "4e29293a-0608-4f8c-903a-03bc61e05c91"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:14.008498 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a5b02071-62e8-45df-add9-e6e41ce2f807 req-a1fa22a1-d6ba-4f19-a9e7-cd97960b619b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:14.008988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a5b02071-62e8-45df-add9-e6e41ce2f807 req-a1fa22a1-d6ba-4f19-a9e7-cd97960b619b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:14.057787 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a5b02071-62e8-45df-add9-e6e41ce2f807 req-a1fa22a1-d6ba-4f19-a9e7-cd97960b619b service nova] Creating event network-changed:4e29293a-0608-4f8c-903a-03bc61e05c91 for instance 6e3e0006-7485-440e-9282-2f6f982cc604 on n-h1-master-1 Jul 24 01:29:14.075323 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a5b02071-62e8-45df-add9-e6e41ce2f807 req-a1fa22a1-d6ba-4f19-a9e7-cd97960b619b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101799 Jul 24 01:29:14.076654 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2014/4161] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:29:14.440941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:14.457514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2c9da57-5725-4014-801b-e6e7cb0db02c tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1508 microversion: 2.1 time: 0.614321 Jul 24 01:29:14.467755 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2148/4162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:13 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1508 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:14.584884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:14.585607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:14.599240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:14.604689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:14.605645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:14.606091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:14.688823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:14.689444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:14.726269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:14.726730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:14.727526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:14.727969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:14.935662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:14.945657 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73ae33c9-40ba-41e7-a797-ab77809db886 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 200 len: 1474 microversion: 2.1 time: 0.366482 Jul 24 01:29:14.947363 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2015/4163] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:14 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 1474 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:14.971251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dafd6a11-1189-4a30-9f41-9abdfcc082c1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-336551005"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:14.976347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dafd6a11-1189-4a30-9f41-9abdfcc082c1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:15.002095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dafd6a11-1189-4a30-9f41-9abdfcc082c1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:15.003770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dafd6a11-1189-4a30-9f41-9abdfcc082c1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:15.008270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dafd6a11-1189-4a30-9f41-9abdfcc082c1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:15.012639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dafd6a11-1189-4a30-9f41-9abdfcc082c1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:15.234643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:15.247915 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31219d79-ff24-4906-a0ae-e218273a5a51 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.563269 Jul 24 01:29:15.255288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2149/4164] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:14 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:15.474935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:15.475564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:15.501846 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:15.502273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:15.503094 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:15.503540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:15.619363 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dafd6a11-1189-4a30-9f41-9abdfcc082c1 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970/action" status: 202 len: 0 microversion: 2.1 time: 0.658456 Jul 24 01:29:15.621042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2016/4165] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:29:14 2022] POST /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 24 01:29:15.636230 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94ede2d3-5790-4b74-b161-cd1ca9e0cf45 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb1b7ca0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:15.699955 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94ede2d3-5790-4b74-b161-cd1ca9e0cf45 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.072562 Jul 24 01:29:15.701112 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2017/4166] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:15 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:16.057275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:16.067562 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25d818af-87cf-4a77-8738-5035330c13ee tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1508 microversion: 2.1 time: 0.597134 Jul 24 01:29:16.078344 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2150/4167] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:15 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:16.264594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:16.265337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:16.279175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:16.279872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:16.280839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:16.281279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:16.716498 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d305b3ec-36d4-4754-8e66-9e15f0216996 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb0029d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:16.823516 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d305b3ec-36d4-4754-8e66-9e15f0216996 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.113066 Jul 24 01:29:16.831325 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2151/4168] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:16 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:16.997621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:17.010186 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c98f91a-976a-45d8-b297-6aadada89ce9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.749449 Jul 24 01:29:17.011155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2018/4169] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:16 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:17.086059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:17.087367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:17.098660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:17.102671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:17.103771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:17.105154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:17.837051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bba7d640-fe0a-42b6-ab02-3e902e98eef3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb562670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:17.900494 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bba7d640-fe0a-42b6-ab02-3e902e98eef3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.067393 Jul 24 01:29:17.901480 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2019/4170] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:17 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:18.026946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:18.029079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:18.030438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:18.035589 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-59661572-7ec9-403c-8f89-2800d38cef8a tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1508 microversion: 2.1 time: 0.954590 Jul 24 01:29:18.036211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2152/4171] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:17 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1508 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:18.040099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:18.040793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:18.041832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:18.042631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:18.512261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4136bcee-94b5-4c34-bc12-68b311223c63 req-14904a90-3725-4523-949a-27102d68d69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17729231-087d-479b-8bd2-ac9d0f8f19df", "name": "network-vif-deleted", "tag": "596a0dd6-a686-48e0-963c-333ae11b4af5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:18.529357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4136bcee-94b5-4c34-bc12-68b311223c63 req-14904a90-3725-4523-949a-27102d68d69c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:18.530093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4136bcee-94b5-4c34-bc12-68b311223c63 req-14904a90-3725-4523-949a-27102d68d69c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:18.552314 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4136bcee-94b5-4c34-bc12-68b311223c63 req-14904a90-3725-4523-949a-27102d68d69c service nova] Creating event network-vif-deleted:596a0dd6-a686-48e0-963c-333ae11b4af5 for instance 17729231-087d-479b-8bd2-ac9d0f8f19df on n-h1-master-1 Jul 24 01:29:18.559782 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4136bcee-94b5-4c34-bc12-68b311223c63 req-14904a90-3725-4523-949a-27102d68d69c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051766 Jul 24 01:29:18.561339 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2153/4172] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:29:18.612169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:18.632078 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-46eeddf4-c50f-4259-ae3d-a48997d1879c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.608444 Jul 24 01:29:18.632966 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2020/4173] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:18 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:18.917507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e925bc76-8e83-484c-a39a-b436e3a2b0c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaeacca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:18.974776 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e925bc76-8e83-484c-a39a-b436e3a2b0c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.063182 Jul 24 01:29:18.976008 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2154/4174] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:18 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:19.053031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:19.053661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:19.086375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:19.088240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:19.089739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:19.093871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:19.233650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:19.234337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:19.234927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lazy-loading 'fault' on Instance uuid 17729231-087d-479b-8bd2-ac9d0f8f19df {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:29:19.369453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:19.373216 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:19.378673 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-475915cf-aa9e-473a-aac0-3afa4dd5a4a2 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 200 len: 1312 microversion: 2.1 time: 0.330114 Jul 24 01:29:19.388549 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2021/4175] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:19 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 1312 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:19.653706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:19.655473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:19.675682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:19.677445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:19.689507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6e5ea683-850c-4c38-a6e0-38ded365eea9 req-0aeb5774-6dd3-4be2-864a-86beb9a98064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3adf5d-740b-4b11-a7cb-6656c7160ab2", "name": "network-vif-plugged", "status": "completed", "tag": "630cd8e8-d9a3-4ca7-82c0-5ee8158c8e4b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:19.695685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:19.698005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:19.700112 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=18 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:19.732525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6e5ea683-850c-4c38-a6e0-38ded365eea9 req-0aeb5774-6dd3-4be2-864a-86beb9a98064 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:19.732908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6e5ea683-850c-4c38-a6e0-38ded365eea9 req-0aeb5774-6dd3-4be2-864a-86beb9a98064 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:19.776301 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6e5ea683-850c-4c38-a6e0-38ded365eea9 req-0aeb5774-6dd3-4be2-864a-86beb9a98064 service nova] Creating event network-vif-plugged:630cd8e8-d9a3-4ca7-82c0-5ee8158c8e4b for instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 on n-h2-master-1 Jul 24 01:29:19.790577 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6e5ea683-850c-4c38-a6e0-38ded365eea9 req-0aeb5774-6dd3-4be2-864a-86beb9a98064 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106747 Jul 24 01:29:19.796204 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2022/4176] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:19.991584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-670d9565-1b6c-4062-b8be-0f56cd636e30 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eadd43a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:20.093147 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-670d9565-1b6c-4062-b8be-0f56cd636e30 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.108346 Jul 24 01:29:20.094782 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2023/4177] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:19 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:20.273906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:20.278206 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:20.290480 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e9275444-e045-41de-bfe4-fcb7b5bf6cbd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.641504 Jul 24 01:29:20.291788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2155/4178] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:19 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:20.400272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:20.401105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: 17729231-087d-479b-8bd2-ac9d0f8f19df] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:20.412648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:20.418179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:20.419325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:20.422521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:20.458242 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df could not be found. Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df HTTP/1.1 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df could not be found. Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '17729231-087d-479b-8bd2-ac9d0f8f19df'} Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df could not be found. Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df could not be found. Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:20.460211 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df could not be found. Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 404 to user: Instance 17729231-087d-479b-8bd2-ac9d0f8f19df could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d59fa349-15b8-4400-858d-f13574834cf6 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df" status: 404 len: 111 microversion: 2.1 time: 0.069439 Jul 24 01:29:20.463959 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2024/4179] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:20 2022] GET /compute/v2.1/servers/17729231-087d-479b-8bd2-ac9d0f8f19df => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:29:20.472636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:20.473449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:20.491311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:20.497621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:20.507234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:20.511313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:20.595492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:29:20.669999 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:20.753090 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-52fda9c0-b1c2-405a-a2df-446ebb05ee73 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 204 len: 0 microversion: 2.1 time: 0.284403 Jul 24 01:29:20.755175 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2156/4180] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:29:20 2022] DELETE /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:29:20.763276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:20.764246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:20.773165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:20.775151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:20.777496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:20.779252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:21.111308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad99b784-4e4b-46c9-a854-654e2490e71e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9ff53a0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:21.190789 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad99b784-4e4b-46c9-a854-654e2490e71e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.086604 Jul 24 01:29:21.192450 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2157/4181] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:21 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:21.204032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:21.215059 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c5ddee36-c052-4fd2-8718-825ca6bd1757 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.455930 Jul 24 01:29:21.220208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2025/4182] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:20 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:21.312463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:21.313278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:21.334346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:21.336794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:21.338173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:21.339160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:21.686662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:21.700894 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e1862562-cfe3-476f-8e87-313aa112894c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 0.392121 Jul 24 01:29:21.704502 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2158/4183] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:21 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:22.207941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-348b9722-eae4-4665-b7c8-7b5032c7ee45 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaf14a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:22.237348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:22.238019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:22.260222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:22.261022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:22.262280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:22.262958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:22.326861 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-348b9722-eae4-4665-b7c8-7b5032c7ee45 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.119556 Jul 24 01:29:22.328049 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2026/4184] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:22 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:22.661509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:22.670405 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b3c8f3f-c3d0-4295-b215-d5ee5c753d26 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.438842 Jul 24 01:29:22.691082 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2159/4185] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:22 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:22.719212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:22.719796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:22.732631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:22.733097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:22.733944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:22.734394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:23.277724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-629ad4a9-1a45-4c04-aad7-b76a1eedd47e req-655269a7-56aa-4284-ba64-47804a8295e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6d77e-7536-4c72-9de6-622af5973970", "name": "network-vif-plugged", "status": "completed", "tag": "3927349b-217d-404f-84d0-744aa506677c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:23.287221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-629ad4a9-1a45-4c04-aad7-b76a1eedd47e req-655269a7-56aa-4284-ba64-47804a8295e1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:23.287669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-629ad4a9-1a45-4c04-aad7-b76a1eedd47e req-655269a7-56aa-4284-ba64-47804a8295e1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:23.320720 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-629ad4a9-1a45-4c04-aad7-b76a1eedd47e req-655269a7-56aa-4284-ba64-47804a8295e1 service nova] Creating event network-vif-plugged:3927349b-217d-404f-84d0-744aa506677c for instance 06b6d77e-7536-4c72-9de6-622af5973970 on n-h2-master-1 Jul 24 01:29:23.330621 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-629ad4a9-1a45-4c04-aad7-b76a1eedd47e req-655269a7-56aa-4284-ba64-47804a8295e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324445 Jul 24 01:29:23.332151 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2160/4186] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:23.345365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88709fe8-ec7d-4009-89e0-a8c8ba3b6c44 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea287550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:23.405237 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88709fe8-ec7d-4009-89e0-a8c8ba3b6c44 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.065270 Jul 24 01:29:23.405900 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2161/4187] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:23 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:23.688491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:23.689362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:23.703229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:23.704535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:23.707145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:23.707863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:23.839116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:23.849639 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9179659d-8b21-4e72-a400-99086eb3d3d4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1317 microversion: 2.1 time: 1.134325 Jul 24 01:29:23.860997 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2027/4188] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:22 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1317 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:24.267107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:24.276517 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-55784ee5-0c83-4093-a5f2-ccd47e914122 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.592417 Jul 24 01:29:24.293042 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2162/4189] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:23 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:24.419788 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49042da8-04e7-4259-95af-356abe0ca0ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb158a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:24.507472 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-49042da8-04e7-4259-95af-356abe0ca0ca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.092163 Jul 24 01:29:24.508909 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2028/4190] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:24 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:24.867987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:24.868609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:24.881996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:24.882649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:24.883652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:24.884097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:25.301782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:25.303736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:25.327007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:25.329180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:25.334097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:25.338101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:25.473587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:25.496018 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6c31c46f-5f36-4a84-b6d7-8b1da5a64fbf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1505 microversion: 2.1 time: 0.630663 Jul 24 01:29:25.504294 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2163/4191] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:24 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:25.523616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:25.525633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:25.536696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:25.537154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:25.549468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:25.551991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:25.648398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:29:25.835939 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:25.848388 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3701b4b3-ba16-41e0-a59a-6ea0655f67af tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1523 microversion: 2.1 time: 0.550436 Jul 24 01:29:25.851896 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2029/4192] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:25 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:25.862188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1bf13b9-cfd0-45e8-bed0-939a2b49d08d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb589550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:25.870132 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-51d8a822-0998-430a-b130-fd20e8aa913a tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 204 len: 0 microversion: 2.1 time: 0.347825 Jul 24 01:29:25.872614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2164/4193] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:29:25 2022] DELETE /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:29:25.887918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:25.888634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:25.903501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:25.903954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:25.910538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:25.911220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:26.034061 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1bf13b9-cfd0-45e8-bed0-939a2b49d08d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.180689 Jul 24 01:29:26.035034 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2030/4194] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:25 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:26.436821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:26.452694 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7c3dea19-af0d-4350-ba5a-a561e8d1dce4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1511 microversion: 2.1 time: 0.569740 Jul 24 01:29:26.474163 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2165/4195] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:25 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:26.868384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:26.869010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:26.881037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:26.884369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:26.885462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:26.888207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:27.195296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5abebb25-450d-4a85-a3c0-fc3191f67d6b req-edc94bf6-adc2-4fd0-9dac-ec2123190a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb80ae4d-7c53-4ac1-a20d-c9a603f08253", "name": "network-vif-deleted", "tag": "18f0aab4-c772-4204-bb69-e7056d19fa6a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:27.242831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5abebb25-450d-4a85-a3c0-fc3191f67d6b req-edc94bf6-adc2-4fd0-9dac-ec2123190a5a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:27.245254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5abebb25-450d-4a85-a3c0-fc3191f67d6b req-edc94bf6-adc2-4fd0-9dac-ec2123190a5a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:27.315430 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5abebb25-450d-4a85-a3c0-fc3191f67d6b req-edc94bf6-adc2-4fd0-9dac-ec2123190a5a service nova] Creating event network-vif-deleted:18f0aab4-c772-4204-bb69-e7056d19fa6a for instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 on n-h2-master-1 Jul 24 01:29:27.335196 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5abebb25-450d-4a85-a3c0-fc3191f67d6b req-edc94bf6-adc2-4fd0-9dac-ec2123190a5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453602 Jul 24 01:29:27.340084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2166/4196] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:29:27.352454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e7ba098e-4024-4692-ba6a-d8340602ac32 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eac41dc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:27.462182 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e7ba098e-4024-4692-ba6a-d8340602ac32 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.119056 Jul 24 01:29:27.464731 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2167/4197] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:27 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:27.475965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:27.477862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:27.490152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:27.491040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:27.492922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:27.494984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:27.601510 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab27e46e8534384abea2875fb9946df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff39f2632ca408e9795b48dbcefc815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:27.617084 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d69ced43-4451-4df5-8396-cc70f73e4d16 tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 200 len: 1481 microversion: 2.1 time: 0.753642 Jul 24 01:29:27.624144 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2031/4198] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:26 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 1481 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:27.866756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:27.882476 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a5a2570-1fc5-43ba-911e-8a9d3fb36d00 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1511 microversion: 2.1 time: 0.409515 Jul 24 01:29:27.893287 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2168/4199] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:27 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:28.486019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2083978b-df09-4fda-9ecc-0983ae208aba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea458d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:28.570043 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2083978b-df09-4fda-9ecc-0983ae208aba tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.096988 Jul 24 01:29:28.570846 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2032/4200] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:28 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:28.641494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:28.642055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] [instance: cb80ae4d-7c53-4ac1-a20d-c9a603f08253] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:28.661462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:28.664933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:28.666791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:28.667023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:28.726601 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] HTTP exception thrown: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 could not be found. Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Request method failure captured: Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 HTTP/1.1 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8wXQ2V3isVXgoxVEbDkbiesCjw4yme7e2ItBhfY5gNH7CqPZtTWYhMfFN61asgz-ba1ShalyyDv_FkIXaT1fjD9jysA9Zg37wLB_OxvbNYpDx_iRBtxMuUbI3-6iD6ipEwjv5h4WIshadHYks0JugP_PiziyRcGLZKhfS3IUb8sFg Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ff39f2632ca408e9795b48dbcefc815", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ff39f2632ca408e9795b48dbcefc815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 2ff39f2632ca408e9795b48dbcefc815 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-144579022 Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 5ab27e46e8534384abea2875fb9946df Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerRescueNegativeTestJSON-144579022-project Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: exception: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 could not be found. Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'cb80ae4d-7c53-4ac1-a20d-c9a603f08253'} Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 could not be found. Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 could not be found. Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:28.734855 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:28.739286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:28.739286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:28.739286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:28.739286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:28.739286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:28.739286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 could not be found. Jul 24 01:29:28.739286 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:28.740590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] Returning 404 to user: Instance cb80ae4d-7c53-4ac1-a20d-c9a603f08253 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:28.741638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-61aef3b1-7416-4ebc-8ad3-0d5029cb8c8e tempest-ServerRescueNegativeTestJSON-144579022 tempest-ServerRescueNegativeTestJSON-144579022-project] 10.222.0.27 "GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253" status: 404 len: 111 microversion: 2.1 time: 0.104987 Jul 24 01:29:28.742811 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2169/4201] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:28 2022] GET /compute/v2.1/servers/cb80ae4d-7c53-4ac1-a20d-c9a603f08253 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:29:28.900174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:28.900711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:28.923160 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:28.923643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:28.924453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:28.924949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:29.585651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b24295f-89e5-4122-bcbf-b484286fa1ff tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eac49790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:29.769417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5b24295f-89e5-4122-bcbf-b484286fa1ff tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.190228 Jul 24 01:29:29.775813 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2170/4202] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:29 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:30.253870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:30.264668 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0db8be51-2add-4f74-8c4b-582f2cb825fb tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1511 microversion: 2.1 time: 1.368619 Jul 24 01:29:30.274760 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2033/4203] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:28 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1511 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:30.787622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9d92b812-01ea-4b0a-9834-63ca366701d6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eae269d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:30.889025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-36fecfcd-9838-45d1-b386-2782df8cc8bd req-f842b162-55e6-482b-9fc0-055ba7170508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3adf5d-740b-4b11-a7cb-6656c7160ab2", "name": "network-vif-deleted", "tag": "630cd8e8-d9a3-4ca7-82c0-5ee8158c8e4b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:30.898795 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9d92b812-01ea-4b0a-9834-63ca366701d6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.118258 Jul 24 01:29:30.914856 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2171/4204] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:30 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:30.924521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-36fecfcd-9838-45d1-b386-2782df8cc8bd req-f842b162-55e6-482b-9fc0-055ba7170508 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:30.925650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-36fecfcd-9838-45d1-b386-2782df8cc8bd req-f842b162-55e6-482b-9fc0-055ba7170508 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:30.941609 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-36fecfcd-9838-45d1-b386-2782df8cc8bd req-f842b162-55e6-482b-9fc0-055ba7170508 service nova] Creating event network-vif-deleted:630cd8e8-d9a3-4ca7-82c0-5ee8158c8e4b for instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 on n-h2-master-1 Jul 24 01:29:30.967356 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-36fecfcd-9838-45d1-b386-2782df8cc8bd req-f842b162-55e6-482b-9fc0-055ba7170508 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083203 Jul 24 01:29:30.971432 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2034/4205] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:31.288505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:31.289123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:31.304916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:31.305712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:31.311449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:31.312358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:31.411464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:31.411951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:31.412560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lazy-loading 'fault' on Instance uuid cf3adf5d-740b-4b11-a7cb-6656c7160ab2 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:29:31.916717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c668327-1f2a-4c38-a621-080c0eb8f677 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eae30670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:31.997620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c668327-1f2a-4c38-a621-080c0eb8f677 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.085981 Jul 24 01:29:32.021608 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2035/4206] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:31 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:32.264407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:32.279774 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8b3565c-9bdf-4aaf-b8fa-6b73ee2f4195 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 200 len: 1307 microversion: 2.1 time: 0.995028 Jul 24 01:29:32.280277 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2172/4207] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:31 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 1307 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:32.520141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37345656-c9c2-4ee7-9fba-c25b1bf040b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'create', calling method: .version_select at 0x7f05eaff6a60>, body: {"keypair": {"name": "tempest-keypair-931508585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6XjFgmXgYcpRh5SITZPEZ0+Z2RW4Ge7KFrce8TdHZmrnFii0THmH3yHm4Eror5tQXK2dS0XCPLkEqv4MQBaWpFIT/1CAve3UQ+GmacXI9iqW03yFsq/XYybJhYziSpPg=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:32.540928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-37345656-c9c2-4ee7-9fba-c25b1bf040b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for project b97b2217fca247759ee6e9f15d150866. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:32.547656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-37345656-c9c2-4ee7-9fba-c25b1bf040b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for user f6a5e8716f324b53b51e8d34cb704321 and project b97b2217fca247759ee6e9f15d150866. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:32.602611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-37345656-c9c2-4ee7-9fba-c25b1bf040b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181353 Jul 24 01:29:32.603465 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2036/4208] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:29:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:33.031775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f971cad9-6ecf-465e-a365-c5d730517eb6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb0ea040>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:33.118490 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f971cad9-6ecf-465e-a365-c5d730517eb6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.091286 Jul 24 01:29:33.119904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2173/4209] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:33 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:33.298216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:33.299710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:33.324001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:33.324449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:33.333923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:33.336700 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:33.407262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 HTTP/1.1 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: exception: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'cf3adf5d-740b-4b11-a7cb-6656c7160ab2'} Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:33.413888 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:33.422357 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-867ad5e1-d141-4bb4-87ae-fe016e5fc95d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 404 len: 111 microversion: 2.1 time: 0.122042 Jul 24 01:29:33.425856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:33.426538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:33.439492 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2037/4210] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:33 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:29:33.442650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:33.443099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:33.450375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:33.451032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:34.135990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3312563-bbc3-4390-8fa5-c044c8ace94d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb115ee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:34.193057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:34.201687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3ed8626c-6962-4af6-ac5d-bccf65bc645e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.780656 Jul 24 01:29:34.211962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2174/4211] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:33 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:34.242829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3312563-bbc3-4390-8fa5-c044c8ace94d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.109827 Jul 24 01:29:34.248891 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2038/4212] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:34 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:34.438512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5954fe41-2bc1-473c-8f22-4da1161b5dec tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5954fe41-2bc1-473c-8f22-4da1161b5dec tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 163 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": 12345, "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 12345 Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:29:34.449435 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5954fe41-2bc1-473c-8f22-4da1161b5dec tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:34.453248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5954fe41-2bc1-473c-8f22-4da1161b5dec tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.016404 Jul 24 01:29:34.464033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:34.464839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:34.477917 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2175/4213] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:34 2022] POST /compute/v2.1/servers => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:29:34.482086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:34.482559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:34.483346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:34.483846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:35.257700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c10f45f-eb9c-4f41-b25a-dd74a2a698ef tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9ffa160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:35.416493 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c10f45f-eb9c-4f41-b25a-dd74a2a698ef tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.163113 Jul 24 01:29:35.418682 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2176/4214] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:35 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:35.463270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:35.489339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ef0fa21-4acf-4454-966b-768daacd2ce5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.031403 Jul 24 01:29:35.509525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:35.512065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:35.519699 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2039/4215] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:34 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:35.530584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:35.531059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:35.538419 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:35.538895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:36.434238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3febf57c-91f6-41a1-86fb-fd17a096ef72 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb35f700>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:36.547191 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3febf57c-91f6-41a1-86fb-fd17a096ef72 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.119622 Jul 24 01:29:36.547982 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2040/4216] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:36 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:36.567262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:36.582299 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-53b90396-64e7-45fe-bac3-6dfb33d3ce89 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.075149 Jul 24 01:29:36.605099 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2177/4217] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:35 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:37.566572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae7dfe6a-5ad5-4baf-8f20-2d278719299f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb935a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:37.645828 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ae7dfe6a-5ad5-4baf-8f20-2d278719299f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.087858 Jul 24 01:29:37.654235 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2041/4218] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:37 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:38.659314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6ee20d9-3469-46c5-a116-fdc3295315c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea2e14c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:38.744823 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6ee20d9-3469-46c5-a116-fdc3295315c3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.089440 Jul 24 01:29:38.745422 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2178/4219] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:38 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:39.759535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e00d0b1-685b-4181-85d7-58e6e4d707cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea411280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:39.919692 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e00d0b1-685b-4181-85d7-58e6e4d707cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.157978 Jul 24 01:29:39.934772 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2042/4220] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:39 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:40.648917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-537701266", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27a9c0f0-0057-4e7d-b288-37b58950f9cd"}], "security_groups": [{"name": "tempest-securitygroup--629668709"}], "key_name": "tempest-keypair-931508585", "user_data": "}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:40.683105 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:40.934234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c83fafcc-0556-47c5-95e0-126602e177fd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eae30b80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:41.038262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c83fafcc-0556-47c5-95e0-126602e177fd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.109428 Jul 24 01:29:41.042070 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2043/4221] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:40 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:41.050765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] validate_networks() for [('27a9c0f0-0057-4e7d-b288-37b58950f9cd', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:29:41.123813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fef6287b-d206-447d-87b3-15f773be648e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-756447821", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7bcce995-343b-4f81-bb1b-886dbc720fe3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:41.145917 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:41.232873 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fef6287b-d206-447d-87b3-15f773be648e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Block Device 7bcce995-343b-4f81-bb1b-886dbc720fe3 is not bootable. Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fef6287b-d206-447d-87b3-15f773be648e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 357 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-756447821", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7bcce995-343b-4f81-bb1b-886dbc720fe3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: exception: Block Device 7bcce995-343b-4f81-bb1b-886dbc720fe3 is not bootable. Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-756447821', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '7bcce995-343b-4f81-bb1b-886dbc720fe3'}], 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 7bcce995-343b-4f81-bb1b-886dbc720fe3 is not bootable. Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:41.242342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 7bcce995-343b-4f81-bb1b-886dbc720fe3 is not bootable. Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 7bcce995-343b-4f81-bb1b-886dbc720fe3 is not bootable. Jul 24 01:29:41.246541 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:41.250099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fef6287b-d206-447d-87b3-15f773be648e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Block Device 7bcce995-343b-4f81-bb1b-886dbc720fe3 is not bootable. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:41.251226 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fef6287b-d206-447d-87b3-15f773be648e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.132443 Jul 24 01:29:41.252753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2044/4222] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:41 2022] POST /compute/v2.1/servers => generated 110 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:29:41.262328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:41.262869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:41.278147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:41.280113 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:41.283823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:41.284831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:42.444603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:42.455897 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88076ec9-227b-44b8-b130-f6e89ed638f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.198382 Jul 24 01:29:42.457301 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2045/4223] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:41 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:42.465815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c89a85a-4355-412f-99a4-417a34f08113 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:42.468271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c89a85a-4355-412f-99a4-417a34f08113 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:42.502268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c89a85a-4355-412f-99a4-417a34f08113 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:42.502875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c89a85a-4355-412f-99a4-417a34f08113 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:42.505437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c89a85a-4355-412f-99a4-417a34f08113 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:42.505986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c89a85a-4355-412f-99a4-417a34f08113 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:42.561961 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:42.577887 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c89a85a-4355-412f-99a4-417a34f08113 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/ips" status: 200 len: 152 microversion: 2.20 time: 0.119101 Jul 24 01:29:42.580906 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2046/4224] 10.222.0.27 () {60 vars in 1288 bytes} [Sun Jul 24 01:29:42 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/ips => generated 152 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:29:42.594466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a698946a-50ee-4e4d-aa33-aaeac25ad0b7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb5450d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:42.706862 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a698946a-50ee-4e4d-aa33-aaeac25ad0b7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.122587 Jul 24 01:29:42.708016 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2047/4225] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:42 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:42.721639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:42.722733 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:42.733975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:42.737892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:42.738988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:42.740236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:43.416979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:29:43.418025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:29:43.418674 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:29:43.419238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:29:43.419823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:29:43.434902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:43.436885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:43.438042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:43.441027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:43.475603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:43.488808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for user f6a5e8716f324b53b51e8d34cb704321 and project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:43.508830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:29:43.511197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:29:43.544074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:43.573700 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18bab10b-3b11-48b3-91e9-59a48dfa2bf5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.863961 Jul 24 01:29:43.575182 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2048/4226] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:42 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:43.620547 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4b6808c2-1147-4ca0-8138-c1650f76a486 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.980941 Jul 24 01:29:43.621903 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2179/4227] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 2983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:29:43.643425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b8a02da-bb11-47d4-90ef-5e2440879b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:43.643966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b8a02da-bb11-47d4-90ef-5e2440879b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:43.722833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0474e543-87e1-43fa-b83a-2f5331008141 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9f8eca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:43.820801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0474e543-87e1-43fa-b83a-2f5331008141 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.103900 Jul 24 01:29:43.826547 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2180/4228] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:43 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:44.035008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b8a02da-bb11-47d4-90ef-5e2440879b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:44.044720 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b8a02da-bb11-47d4-90ef-5e2440879b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1237 microversion: 2.1 time: 0.416142 Jul 24 01:29:44.052039 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2049/4229] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:43 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1237 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:44.835132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93e663de-0070-4813-bc1d-5fef8e2844d2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9fb8f70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:44.973903 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93e663de-0070-4813-bc1d-5fef8e2844d2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.143842 Jul 24 01:29:44.974500 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2181/4230] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:44 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:45.066739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ba89118-3230-4667-ab49-1300e815c783 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:45.068249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5ba89118-3230-4667-ab49-1300e815c783 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:45.354742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5ba89118-3230-4667-ab49-1300e815c783 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:45.378152 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5ba89118-3230-4667-ab49-1300e815c783 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1237 microversion: 2.1 time: 0.316009 Jul 24 01:29:45.389730 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2050/4231] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:45 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1237 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:45.991131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4985177f-4884-4de3-8d53-586c73f49703 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9f8ee50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:46.070347 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4985177f-4884-4de3-8d53-586c73f49703 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.085935 Jul 24 01:29:46.077346 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2182/4232] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:45 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:46.098646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:46.099199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:46.110972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:46.114166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:46.123071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:46.123878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:46.169492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lazy-loading 'flavor' on Instance uuid 6e3e0006-7485-440e-9282-2f6f982cc604 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:29:46.406928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:46.415615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:46.460047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:46.460690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:46.470640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:46.471634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:46.750854 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b5b6386-0861-4d67-bbc9-583314f651e8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/action" status: 202 len: 0 microversion: 2.20 time: 0.656582 Jul 24 01:29:46.752068 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2051/4233] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:29:46 2022] POST /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:29:46.764936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:46.766140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:46.779381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:46.780136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:46.781316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:46.782136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:46.811095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:46.822966 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25dd6bde-05a1-4220-8daa-13f7b8a34d3c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1297 microversion: 2.1 time: 0.430464 Jul 24 01:29:46.823576 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2183/4234] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:46 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1297 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:47.084702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a1395c6-d036-4c6c-999f-ff11a2c03418 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9f8e1f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:47.229316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a1395c6-d036-4c6c-999f-ff11a2c03418 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.148450 Jul 24 01:29:47.231129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2184/4235] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:47 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:47.239636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:47.252172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:47.254091 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:47.258680 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2fc9eb0b-9e3d-48fc-8812-b21fef6f0dc8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.499299 Jul 24 01:29:47.260528 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2052/4236] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:46 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:47.840246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:47.840884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:47.871602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:47.875656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:47.877639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:47.878133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:47.986373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:48.012108 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-37f89cb0-6774-451d-a18b-7478948d4cde tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1295 microversion: 2.1 time: 0.176003 Jul 24 01:29:48.013784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2185/4237] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:47 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1295 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:48.057548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7fbd6b7-4ade-401b-b005-1bdcbb8595c3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-740485475", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "destination_type": "local"}, {"source_type": "volume", "uuid": "3085bef5-2cce-41b5-b36b-55db1c15d880", "destination_type": "invalid"}], "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7fbd6b7-4ade-401b-b005-1bdcbb8595c3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 494 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-740485475", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "destination_type": "local"}, {"source_type": "volume", "uuid": "3085bef5-2cce-41b5-b36b-55db1c15d880", "destination_type": "invalid"}], "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-740485475', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3085bef5-2cce-41b5-b36b-55db1c15d880', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'invalid' Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:48.060644 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:48.064107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7fbd6b7-4ade-401b-b005-1bdcbb8595c3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:48.065549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c7fbd6b7-4ade-401b-b005-1bdcbb8595c3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.015109 Jul 24 01:29:48.066951 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2053/4238] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:48 2022] POST /compute/v2.1/servers => generated 155 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:29:48.074895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:48.078716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:48.086182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:48.087388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:48.088795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:48.089499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:48.123780 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:48.245199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed5e2c61-1e6f-4931-9543-34234ff21cd6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb5621f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:48.320428 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed5e2c61-1e6f-4931-9543-34234ff21cd6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.079749 Jul 24 01:29:48.325161 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2054/4239] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:48 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:48.335917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:48.337069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:48.344615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:48.346062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:48.347262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:48.348073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:48.983663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:49.000964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:49.002889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:49.004866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-789d5d9a-f3e9-4a74-9cac-9fe70b2fff8d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.673650 Jul 24 01:29:49.017853 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2055/4240] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:48 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:49.039326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:49.043378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:49.053468 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c34b2f81-5ba6-4c69-a6b3-e3fe85a2f1d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.982512 Jul 24 01:29:49.055392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:49.060106 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2186/4241] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:48 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:49.078573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:49.081853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:49.083905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:49.085023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:49.086143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:49.090154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:49.109240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:49.115585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:49.120238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:49.121456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:49.351558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:49.361238 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6dbd47d-42c9-477f-90fc-f53893eb6082 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1295 microversion: 2.1 time: 0.329401 Jul 24 01:29:49.379484 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2056/4242] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:49 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1295 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:49.399548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1d3fd5f-e82c-4e92-a291-521c675f8f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ead81820>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:49.509827 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1d3fd5f-e82c-4e92-a291-521c675f8f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.128869 Jul 24 01:29:49.510443 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2057/4243] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:49 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:49.695540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:49.703526 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5601a537-2bac-4c9c-a144-b00419517389 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.629104 Jul 24 01:29:49.707640 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2187/4244] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:49 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:29:50.030848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:50.031478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:50.036071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0456e9fb-1fcf-45bc-ba44-710ae2035dde tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-613506267", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0456e9fb-1fcf-45bc-ba44-710ae2035dde tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 491 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-613506267", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-613506267', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 24 01:29:50.038801 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0456e9fb-1fcf-45bc-ba44-710ae2035dde tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:50.042363 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0456e9fb-1fcf-45bc-ba44-710ae2035dde tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017329 Jul 24 01:29:50.056073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:50.057310 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2188/4245] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:50 2022] POST /compute/v2.1/servers => generated 624 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:29:50.062196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:50.062816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:50.064985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:50.065848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:50.066286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:50.114604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:50.115496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:50.118484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:50.122324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:50.136007 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:50.729018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:50.738542 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64f14660-2ad3-4b4a-9ca4-4cfe4744b1a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.680059 Jul 24 01:29:50.767213 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2189/4246] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:50 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:50.779393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:50.780016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:50.798747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:50.815111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:50.815993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:50.816414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:51.378778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:51.388967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:51.390516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:51.391780 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f04c6ff3-2f44-4ecd-b1c6-7141e54d306f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 1.364765 Jul 24 01:29:51.405721 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2058/4247] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:50 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:51.446400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17057849-05ee-4331-a673-8e05e8717041 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea2d8a60>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:51.462366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:51.471757 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ae6c914-ffba-4d88-a1ba-9e7c5fe5e747 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1362 microversion: 2.1 time: 0.703237 Jul 24 01:29:51.483456 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2190/4248] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:50 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1362 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:51.649374 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-17057849-05ee-4331-a673-8e05e8717041 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.228692 Jul 24 01:29:51.650008 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2059/4249] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:51 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:51.665435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:51.666088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:51.699709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:51.700157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:51.700945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:51.701383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:52.428086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1061289986", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "a7c2a0b3-514f-486e-a7c9-6c41486474f4"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:52.558107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] validate_networks() for [('a7c2a0b3-514f-486e-a7c9-6c41486474f4', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:29:52.832713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:52.849421 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-acc5e118-b4eb-4b63-a76d-56967d64f941 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.196654 Jul 24 01:29:52.852677 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2060/4250] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:51 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:52.866814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0485de78-066d-4ed7-ae99-a86a23f0fb5a req-48df83f2-c78a-4e04-9306-bbf965fca2db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:52.889378 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0485de78-066d-4ed7-ae99-a86a23f0fb5a req-48df83f2-c78a-4e04-9306-bbf965fca2db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:52.889896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0485de78-066d-4ed7-ae99-a86a23f0fb5a req-48df83f2-c78a-4e04-9306-bbf965fca2db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:52.926657 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0485de78-066d-4ed7-ae99-a86a23f0fb5a req-48df83f2-c78a-4e04-9306-bbf965fca2db service nova] Creating event network-changed:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:29:52.940200 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0485de78-066d-4ed7-ae99-a86a23f0fb5a req-48df83f2-c78a-4e04-9306-bbf965fca2db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085913 Jul 24 01:29:52.943951 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2061/4251] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:29:52.958941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:52.962408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:52.992412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:52.992870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:52.994134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:52.996579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:53.455647 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:53.500637 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:54.884765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:29:54.885448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:29:54.885750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:29:54.886536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:29:54.886966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:29:54.891080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:54.926824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:54.934563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:54.936593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bfd8dd29-a43b-47a0-9ba5-415a68677fb6 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 1.991114 Jul 24 01:29:54.938010 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2062/4252] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:52 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:54.941340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:54.944337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:54.945337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:54.947194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:54.948475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:54.949958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:54.963598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:54.966877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:54.967923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:54.968720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:54.995045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Getting quotas for project 972661c3565a4312b050c50083f3c91f. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:55.006526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Getting quotas for user 803ee2ed518446dc8953a707f171cbc4 and project 972661c3565a4312b050c50083f3c91f. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:55.046443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:29:55.053229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:29:55.276776 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45002642-2f1b-4dc6-951e-81cf18ced313 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.791865 Jul 24 01:29:55.281988 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2191/4253] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:29:55.296375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5849a63e-71ad-46d9-b7fe-fe8aef37f3be tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eac16dc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:55.372398 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:55.424899 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5849a63e-71ad-46d9-b7fe-fe8aef37f3be tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1413 microversion: 2.1 time: 0.141000 Jul 24 01:29:55.428675 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2192/4254] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:55 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:55.441020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-673934ff-8a0f-4715-b975-c2cabcc9070d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-673934ff-8a0f-4715-b975-c2cabcc9070d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 416 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:55.443980 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:29:55.457569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:55.464096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-673934ff-8a0f-4715-b975-c2cabcc9070d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:55.465292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-673934ff-8a0f-4715-b975-c2cabcc9070d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.035373 Jul 24 01:29:55.466659 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2193/4255] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:55 2022] POST /compute/v2.1/servers => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:29:55.470380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:55.485209 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e47953fc-3ffd-4436-9f45-e7375f608040 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1362 microversion: 2.1 time: 0.545855 Jul 24 01:29:55.494678 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2063/4256] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:54 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1362 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:55.503267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4654194-ee76-494f-aafd-ab33796ad084 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:55.504123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d4654194-ee76-494f-aafd-ab33796ad084 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:55.696039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d4654194-ee76-494f-aafd-ab33796ad084 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:55.704085 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d4654194-ee76-494f-aafd-ab33796ad084 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1225 microversion: 2.1 time: 0.216407 Jul 24 01:29:55.719767 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2064/4257] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:55 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1225 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:55.738789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:55.744535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:55.769837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:55.776222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:55.777175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:55.777628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:55.857274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-821563142", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": "none"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:56.058217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:29:56.058834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:29:56.069836 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:29:56.070703 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:29:56.071776 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:29:56.107219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:56.109713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:56.113089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:56.118254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:56.177556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:56.184423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Getting quotas for project b70a645a17fa4e0597bdff92b8011131. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:56.193931 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-069ed14a-d919-4a32-bf1d-c9f329e3acd6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.472183 Jul 24 01:29:56.196265 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2065/4258] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:55 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:56.200050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Getting quotas for user 0a7378d2a7a949ddaa2265cc1c49f6f3 and project b70a645a17fa4e0597bdff92b8011131. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:56.210148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:56.211827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:56.231578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:56.232365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:56.236781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:56.238701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:56.249420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:29:56.262665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: ebcfe250-aa9e-452c-b333-93cec9fc8e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:29:56.404369 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-899ec4e8-7673-42a7-a0c2-bdc24fb60487 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.931179 Jul 24 01:29:56.406368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2194/4259] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:29:56.430683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:56.436083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:56.464627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:56.465581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:56.469877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:56.472095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:56.617293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:56.630925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:56.637094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:56.641034 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f004d10-987e-43f0-aa16-4796a8c1a8cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.442605 Jul 24 01:29:56.643090 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2066/4260] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:56 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:56.653476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f76a7f8f-c0e1-4a87-a642-f00a000b8e3d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:56.656132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f76a7f8f-c0e1-4a87-a642-f00a000b8e3d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: ebcfe250-aa9e-452c-b333-93cec9fc8e44] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:56.817954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f76a7f8f-c0e1-4a87-a642-f00a000b8e3d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:56.830704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f76a7f8f-c0e1-4a87-a642-f00a000b8e3d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:56.837038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f76a7f8f-c0e1-4a87-a642-f00a000b8e3d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:56.842787 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f76a7f8f-c0e1-4a87-a642-f00a000b8e3d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44" status: 200 len: 1277 microversion: 2.47 time: 0.198483 Jul 24 01:29:56.848509 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2067/4261] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:56 2022] GET /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:56.868206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-21edadc7-6716-47f1-9f3c-1274904fe0c9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaf3e550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:56.973289 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-21edadc7-6716-47f1-9f3c-1274904fe0c9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1422 microversion: 2.1 time: 0.123594 Jul 24 01:29:56.979739 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2068/4262] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:56 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:57.000261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:57.000946 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:57.022473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.022852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:57.023657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.030173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:57.034814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:57.045492 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8eaae665-4ae0-44be-ac97-e673a11e2100 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.636513 Jul 24 01:29:57.050750 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2195/4263] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:56 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:57.065185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:57.065841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:57.086332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.086887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:57.087743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.088192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:57.293225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:57.301308 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3a07eac9-1ed5-4545-aad2-43bb1d90589d tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1277 microversion: 2.1 time: 0.249530 Jul 24 01:29:57.301938 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2196/4264] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:57 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:57.322794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2090783981", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": "none"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:57.346627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:57.367566 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c8672de-6365-4e10-9c74-e20757d069ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1362 microversion: 2.1 time: 0.379338 Jul 24 01:29:57.373807 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2069/4265] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:56 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:57.393099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-792c9ef0-7a2b-4f32-8e72-bb1348391df0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eb133550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:57.531671 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-792c9ef0-7a2b-4f32-8e72-bb1348391df0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 200 len: 1422 microversion: 2.1 time: 0.156160 Jul 24 01:29:57.531898 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2070/4266] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:57 2022] GET /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 1422 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:57.551166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f317621d-2c92-45d3-9b34-c9c7697fddc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1202885760", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": -1, "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:57.552893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:29:57.555782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:29:57.556656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:29:57.557904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:29:57.560046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:29:57.582337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.584009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:57.584266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f317621d-2c92-45d3-9b34-c9c7697fddc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Flavor -1 could not be found. Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f317621d-2c92-45d3-9b34-c9c7697fddc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 206 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1202885760", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": -1, "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: exception: Flavor -1 could not be found. Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1202885760', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': -1, 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:57.588173 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 24 01:29:57.592648 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:29:57.595428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.596730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:57.597145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f317621d-2c92-45d3-9b34-c9c7697fddc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:57.598076 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f317621d-2c92-45d3-9b34-c9c7697fddc6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.064646 Jul 24 01:29:57.598802 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2071/4267] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:57 2022] POST /compute/v2.1/servers => generated 73 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:57.609414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a72b208e-6410-4370-a788-afaae097cbfb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaf3e280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:57.674749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Getting quotas for project b70a645a17fa4e0597bdff92b8011131. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:29:57.693218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Getting quotas for user 0a7378d2a7a949ddaa2265cc1c49f6f3 and project b70a645a17fa4e0597bdff92b8011131. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:29:57.726582 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:29:57.734697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:29:57.859043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ada4cb8a-fa74-46ae-b7f1-3260c53d7b5d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.540114 Jul 24 01:29:57.859981 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2197/4268] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:29:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 24 01:29:57.882354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:57.882825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:57.902806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.903277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:57.904714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:57.904714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:58.384660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:58.423670 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2aafa171-0eb7-4454-a619-19a33aa557c8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.562589 Jul 24 01:29:58.424431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2198/4269] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:57 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:58.477400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:58.478432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:58.511191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:58.511651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:58.512479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:58.512842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:58.871545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a72b208e-6410-4370-a788-afaae097cbfb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 204 len: 0 microversion: 2.1 time: 1.267998 Jul 24 01:29:58.872949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2072/4270] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:57 2022] DELETE /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 0 bytes in 1274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:29:58.881083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-344e67af-9d2b-4380-9c84-aaed4c951441 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:58.885368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-344e67af-9d2b-4380-9c84-aaed4c951441 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:58.899603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-344e67af-9d2b-4380-9c84-aaed4c951441 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:58.900310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-344e67af-9d2b-4380-9c84-aaed4c951441 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:58.901841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-344e67af-9d2b-4380-9c84-aaed4c951441 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:58.902620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-344e67af-9d2b-4380-9c84-aaed4c951441 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:58.974983 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-344e67af-9d2b-4380-9c84-aaed4c951441 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "PUT /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 992 microversion: 2.47 time: 0.100354 Jul 24 01:29:58.985755 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2073/4271] 10.222.0.27 () {62 vars in 1296 bytes} [Sun Jul 24 01:29:58 2022] PUT /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 992 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:29:58.985755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:58.985755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:58.993525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:58.994212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:58.995079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:58.995529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.036421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:59.045918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:59.047438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:59.063452 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f5174eea-9343-4272-b945-8cc3ae343e1c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.618656 Jul 24 01:29:59.064808 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2199/4272] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:58 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:29:59.071054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:59.072110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:59.083188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.083960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.085000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.085629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.189922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:59.221189 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5fcbd408-84b0-4570-9449-6d1659494cc4 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1283 microversion: 2.1 time: 0.228664 Jul 24 01:29:59.221884 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2074/4273] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:58 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:59.247231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:59.248323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:59.273978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.275838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.276941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.279113 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.536663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:59.544360 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e81ef31f-8db0-4145-be13-328014d98057 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1362 microversion: 2.1 time: 0.478312 Jul 24 01:29:59.560625 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2200/4274] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:59 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:59.575425 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:59.576195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:59.597249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.597733 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.598541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.598983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.670766 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:29:59.712945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:29:59.733655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b5767de-60d2-40f9-a82b-f37fcdb4d284 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.504353 Jul 24 01:29:59.737643 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2075/4275] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:59 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:29:59.788062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:59.789116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:59.837081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.837608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.841956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.842489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.856925 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d55fac4-05fc-4a28-8b27-3a135fffeed2 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 204 len: 0 microversion: 2.1 time: 0.293903 Jul 24 01:29:59.858393 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2201/4276] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:29:59 2022] DELETE /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:29:59.892407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78d51a7c-1992-40ba-ad3c-280f80a04a9d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1625959368", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78d51a7c-1992-40ba-ad3c-280f80a04a9d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 173 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1625959368", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1625959368', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi -1 Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:29:59.903992 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 24 01:29:59.908493 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:29:59.914467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78d51a7c-1992-40ba-ad3c-280f80a04a9d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:29:59.925983 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78d51a7c-1992-40ba-ad3c-280f80a04a9d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.038170 Jul 24 01:29:59.930991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2202/4277] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:29:59 2022] POST /compute/v2.1/servers => generated 145 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:29:59.936237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:29:59.950386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:29:59.977407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.978220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:29:59.979295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:29:59.979942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:00.148692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:00.166867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:00.178936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:00.188007 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-353f2522-ef4c-431b-8960-5686a5798055 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1338 microversion: 2.47 time: 0.427194 Jul 24 01:30:00.189506 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2076/4278] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:29:59 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1338 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:00.194626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:00.195539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:00.209599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:00.210490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:00.211478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:00.213056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:00.441402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:00.453267 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e310bd9-ca6e-4f34-8fa5-3ad0dcbdcd86 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.520728 Jul 24 01:30:00.457794 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2203/4279] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:29:59 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:00.469167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-169f7bc9-77d4-46a7-8b24-c3745197d2ed req-16e66183-96f7-44fe-9825-fab196171e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-plugged", "status": "completed", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:00.495892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-169f7bc9-77d4-46a7-8b24-c3745197d2ed req-16e66183-96f7-44fe-9825-fab196171e74 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:00.496439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-169f7bc9-77d4-46a7-8b24-c3745197d2ed req-16e66183-96f7-44fe-9825-fab196171e74 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:00.516647 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-169f7bc9-77d4-46a7-8b24-c3745197d2ed req-16e66183-96f7-44fe-9825-fab196171e74 service nova] Creating event network-vif-plugged:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:30:00.538854 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-169f7bc9-77d4-46a7-8b24-c3745197d2ed req-16e66183-96f7-44fe-9825-fab196171e74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079209 Jul 24 01:30:00.540273 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2204/4280] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:00.555060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-91601490", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "41157fbf-825e-46bc-9e53-c3a4974eed04"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:00.576100 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:00.587109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:00.597448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:00.599725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:00.601707 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1876fdb8-8521-4a46-87c4-070f75c60840 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.410656 Jul 24 01:30:00.603321 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2077/4281] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:00 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:00.609295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:00.610999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:00.618789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:00.619672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:00.620955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:00.621595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:00.658760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] validate_networks() for [('41157fbf-825e-46bc-9e53-c3a4974eed04', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:30:01.102116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:01.135327 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-119c3f2c-def9-438a-b5f3-9f44793371ec tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 0.530591 Jul 24 01:30:01.140759 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2078/4282] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:00 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:01.146288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:01.162121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:01.204282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:01.206154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:01.216987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:01.218275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:01.945936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:01.957829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-995422da-6eed-4570-b565-0e62dc11815c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.814937 Jul 24 01:30:01.970296 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2079/4283] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:01 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:01.987117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:01.988179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:01.999848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.000678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:02.002685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.003361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:02.749885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:30:02.750404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:30:02.751571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:30:02.752061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:30:02.752495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:30:02.772985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.773527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:02.774279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.774725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:02.809301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:30:02.823194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for user b0f04ff3b36d4b0686c9a68ff55ee99d and project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:30:02.823412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:02.831537 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01f610ac-a5a2-40d9-ac63-875f16100659 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1362 microversion: 2.1 time: 0.855092 Jul 24 01:30:02.834730 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2080/4284] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:01 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1362 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:02.841038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:30:02.844042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:02.844746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:02.851599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:30:02.862005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.862675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:02.865040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.865885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:02.911187 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-606c6466-01b0-4813-a36a-f24ebde1adac tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369650 Jul 24 01:30:02.912283 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2205/4285] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:30:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:30:02.917296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:02.918285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:02.926923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.927729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:02.929896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:02.930562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:03.151239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:03.166497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:03.172970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:03.174739 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-caf7bcfb-372a-46d3-b030-db5858f26080 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1336 microversion: 2.47 time: 0.338956 Jul 24 01:30:03.192454 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2081/4286] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:02 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1336 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:03.197587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4319d66e-4057-4512-99a7-58f9712832b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1698689544", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:03.203115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4319d66e-4057-4512-99a7-58f9712832b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4319d66e-4057-4512-99a7-58f9712832b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 216 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1698689544", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1698689544', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:03.205822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:03.209309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:03.209309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:03.209309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:03.209309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:03.209309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:03.209309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 24 01:30:03.209309 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:03.212823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4319d66e-4057-4512-99a7-58f9712832b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:03.214227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4319d66e-4057-4512-99a7-58f9712832b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.020671 Jul 24 01:30:03.215196 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2082/4287] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:30:03 2022] POST /compute/v2.1/servers => generated 123 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:30:03.226220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:03.227141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:03.236595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:03.237199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:03.238097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:03.238753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:03.843515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:03.861704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:03.863785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:03.868643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c32426d2-8c7e-472a-b091-bb5f5a41f51a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1743 microversion: 2.20 time: 0.952952 Jul 24 01:30:03.869813 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2206/4288] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:02 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1743 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:03.879546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-da0b790e-9b52-45b2-9ae3-b952aad07086 req-e6629256-9261-4e7f-a256-f06b8363b4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2000bbbc-331b-44c0-a73b-f9399a076517", "tag": "6ca0c646-5628-4a96-901d-e3b1491aec78"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:03.899802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-da0b790e-9b52-45b2-9ae3-b952aad07086 req-e6629256-9261-4e7f-a256-f06b8363b4bd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:03.900259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-da0b790e-9b52-45b2-9ae3-b952aad07086 req-e6629256-9261-4e7f-a256-f06b8363b4bd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:03.934769 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-da0b790e-9b52-45b2-9ae3-b952aad07086 req-e6629256-9261-4e7f-a256-f06b8363b4bd service nova] Creating event network-changed:6ca0c646-5628-4a96-901d-e3b1491aec78 for instance 2000bbbc-331b-44c0-a73b-f9399a076517 on n-h1-master-1 Jul 24 01:30:03.945503 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-da0b790e-9b52-45b2-9ae3-b952aad07086 req-e6629256-9261-4e7f-a256-f06b8363b4bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070644 Jul 24 01:30:03.946718 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2207/4289] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:03.960327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2fdb6cf3-0332-4448-8c79-ee7b4dffb941 req-e20ba7d5-17ab-42a3-ac86-ae7f33b256a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6d77e-7536-4c72-9de6-622af5973970", "name": "network-vif-unplugged", "status": "completed", "tag": "3927349b-217d-404f-84d0-744aa506677c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:03.979169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:03.996494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2fdb6cf3-0332-4448-8c79-ee7b4dffb941 req-e20ba7d5-17ab-42a3-ac86-ae7f33b256a7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:03.997290 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:03.997487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2fdb6cf3-0332-4448-8c79-ee7b4dffb941 req-e20ba7d5-17ab-42a3-ac86-ae7f33b256a7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.011496 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2fdb6cf3-0332-4448-8c79-ee7b4dffb941 req-e20ba7d5-17ab-42a3-ac86-ae7f33b256a7 service nova] Creating event network-vif-unplugged:3927349b-217d-404f-84d0-744aa506677c for instance 06b6d77e-7536-4c72-9de6-622af5973970 on n-h2-master-1 Jul 24 01:30:04.014845 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-174018eb-78a5-4cc0-9fe3-b9ab5b9f07a1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 0.796614 Jul 24 01:30:04.017199 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2083/4290] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:03 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:04.026851 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2fdb6cf3-0332-4448-8c79-ee7b4dffb941 req-e20ba7d5-17ab-42a3-ac86-ae7f33b256a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069152 Jul 24 01:30:04.028085 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2208/4291] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:04.037568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:04.038477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:04.043298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:04.044380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:04.055938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.056818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.059031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.061854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.069039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.072167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.073166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.075595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.362702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:04.373085 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-deeead38-362f-4ebe-ba74-1310a0a28645 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1210 microversion: 2.1 time: 0.352615 Jul 24 01:30:04.378036 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2084/4292] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:04 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1210 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:04.383633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:04.384785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:04.394224 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.394785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.395596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.396535 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.810015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:04.825281 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ab882a6-dc4e-402a-b0f5-440aa0813b69 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.795794 Jul 24 01:30:04.840175 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2209/4293] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:04 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:04.845867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:04.862615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:04.870373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.870982 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.872024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:04.872606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:04.918784 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:04.979303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:04.989571 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b96d1ce9-68f3-478b-921e-b3d25b087fd9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1362 microversion: 2.1 time: 0.609990 Jul 24 01:30:04.995150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.004362 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2085/4294] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:04 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1362 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:05.008738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.012386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:05.013197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:05.019100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.019779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.020384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.020524 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5551fd78-17f9-4138-998b-d1e7fbc70616 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1336 microversion: 2.47 time: 0.178875 Jul 24 01:30:05.021209 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2210/4295] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:04 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1336 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:05.021601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.022284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.045494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:05.048941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:05.064864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.065251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.069138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.074495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.293378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.304692 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1fc2b37-e0dd-41be-a795-f9608b54b822 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.298010 Jul 24 01:30:05.323010 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2086/4296] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:05 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:05.338958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:05.340854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:05.349573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.351505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.353067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.353888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.490661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.507736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.509269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.518690 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bfec3dac-23ca-4809-be11-5c7365781039 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.494510 Jul 24 01:30:05.519299 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2211/4297] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:05 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:05.529075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:05.529978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:05.544161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.549639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.551375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:05.552034 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:05.717774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.742719 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7dd19c56-0d16-496b-844e-0959861623ec tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1258 microversion: 2.1 time: 0.222147 Jul 24 01:30:05.752988 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2212/4298] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:05 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1258 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:05.770199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6e41242-774e-47c7-b7f0-70007c5b31d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-300677087", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-key-215104342", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:05.902249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:05.911410 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f5b188ec-18a1-452d-a262-cd1d875d7778 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 0.587250 Jul 24 01:30:05.931811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-d6e41242-774e-47c7-b7f0-70007c5b31d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] validate_networks() for [('2909a66d-cdd3-4b87-b889-9aac3ab2e97c', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:30:05.936788 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2087/4299] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:05 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:05.982864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b3791c47-0ae3-4e58-b516-88d276545f62 req-8442bc58-a1a6-4a22-ab36-3c4bece096b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6d77e-7536-4c72-9de6-622af5973970", "name": "network-vif-deleted", "tag": "3927349b-217d-404f-84d0-744aa506677c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:06.010690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3791c47-0ae3-4e58-b516-88d276545f62 req-8442bc58-a1a6-4a22-ab36-3c4bece096b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:06.011400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3791c47-0ae3-4e58-b516-88d276545f62 req-8442bc58-a1a6-4a22-ab36-3c4bece096b9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:06.029548 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b3791c47-0ae3-4e58-b516-88d276545f62 req-8442bc58-a1a6-4a22-ab36-3c4bece096b9 service nova] Creating event network-vif-deleted:3927349b-217d-404f-84d0-744aa506677c for instance 06b6d77e-7536-4c72-9de6-622af5973970 on n-h2-master-1 Jul 24 01:30:06.050232 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b3791c47-0ae3-4e58-b516-88d276545f62 req-8442bc58-a1a6-4a22-ab36-3c4bece096b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070293 Jul 24 01:30:06.051371 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2088/4300] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:30:06.059176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:06.060190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:06.069240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:06.070088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:06.071314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:06.072195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:06.823000 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:06.838770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:06.848372 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7662ac55-20c8-4857-86e2-6dc0947fd6b7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1549 microversion: 2.1 time: 0.795650 Jul 24 01:30:06.858794 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2089/4301] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:06 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1549 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:06.874123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:06.880745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:06.894701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:06.895163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:06.895958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:06.896388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:06.969984 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-d6e41242-774e-47c7-b7f0-70007c5b31d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Invalid key_name provided. Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6e41242-774e-47c7-b7f0-70007c5b31d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 245 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-300677087", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-key-215104342", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid key_name provided. Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-300677087', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'key_name': 'tempest-key-215104342', 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-215104342 not found for user 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:06.972071 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 24 01:30:06.979657 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:06.989070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6e41242-774e-47c7-b7f0-70007c5b31d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid key_name provided. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:06.990144 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d6e41242-774e-47c7-b7f0-70007c5b31d5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.235626 Jul 24 01:30:06.990951 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2213/4302] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:30:05 2022] POST /compute/v2.1/servers => generated 70 bytes in 1237 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 24 01:30:06.999610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:07.000513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:07.007186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:07.007964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:07.008956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:07.009606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:07.601898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:07.622252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:07.624531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:07.631247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c7f45514-926b-4c0f-90b3-91effb13d203 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1357 microversion: 2.47 time: 0.766907 Jul 24 01:30:07.632421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2090/4303] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:06 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1357 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:07.637591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:07.638424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:07.650350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:07.651097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:07.652217 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:07.652960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:07.913014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:07.930766 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de814549-4ac5-4ba8-8cf2-5980b028e205 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1264 microversion: 2.1 time: 0.296106 Jul 24 01:30:07.940100 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2091/4304] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:07 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1264 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:07.945200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-409e3878-1949-42fa-9f40-c0a9c2674f29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:07.946245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-409e3878-1949-42fa-9f40-c0a9c2674f29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:07.959900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-409e3878-1949-42fa-9f40-c0a9c2674f29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:07.964914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-409e3878-1949-42fa-9f40-c0a9c2674f29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:07.967123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-409e3878-1949-42fa-9f40-c0a9c2674f29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:07.974281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-409e3878-1949-42fa-9f40-c0a9c2674f29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:08.374746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:08.383804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:08.393839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:08.395077 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-efb02f73-71eb-4086-b29f-cbd44ab2e6a5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 1.403019 Jul 24 01:30:08.412735 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2214/4305] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:06 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:08.420244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:08.428199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:08.440024 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-409e3878-1949-42fa-9f40-c0a9c2674f29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.498392 Jul 24 01:30:08.441580 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2092/4306] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:30:07 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/os-interface => generated 284 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:08.446988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:08.447443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:08.448233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:08.448723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:08.456025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:08.456857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:08.471418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:08.478605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:08.479657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:08.480318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:09.543696 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:09.552819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-545572c4-5288-40aa-9118-334c84623505 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.109930 Jul 24 01:30:09.553397 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2093/4307] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:08 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:09.569919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:09.573998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:09.598336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:09.603632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:09.605067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:09.605803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:09.634482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:09.648548 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f22ce185-403e-4ce7-9699-40fafec7ecc2 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 1.230245 Jul 24 01:30:09.649658 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2215/4308] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:08 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:09.661199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f7c036cc-13b1-45b8-8400-c6642c30ec6a req-0e052458-d57e-46c4-b57d-50ed403a2217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3e0006-7485-440e-9282-2f6f982cc604", "name": "network-vif-plugged", "status": "completed", "tag": "4e29293a-0608-4f8c-903a-03bc61e05c91"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:09.680536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f7c036cc-13b1-45b8-8400-c6642c30ec6a req-0e052458-d57e-46c4-b57d-50ed403a2217 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:09.684830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f7c036cc-13b1-45b8-8400-c6642c30ec6a req-0e052458-d57e-46c4-b57d-50ed403a2217 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:09.720580 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f7c036cc-13b1-45b8-8400-c6642c30ec6a req-0e052458-d57e-46c4-b57d-50ed403a2217 service nova] Creating event network-vif-plugged:4e29293a-0608-4f8c-903a-03bc61e05c91 for instance 6e3e0006-7485-440e-9282-2f6f982cc604 on n-h1-master-1 Jul 24 01:30:09.736323 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f7c036cc-13b1-45b8-8400-c6642c30ec6a req-0e052458-d57e-46c4-b57d-50ed403a2217 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081466 Jul 24 01:30:09.739633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2216/4309] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:09.752494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:09.758225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:09.795798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:09.802378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:09.806881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:09.811871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:09.850970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:30:09.851410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:30:09.859222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:30:09.861173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:30:09.865037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:30:10.025664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:10.045813 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3644e7bb-c6f0-4724-86f5-c9858951710c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1264 microversion: 2.1 time: 0.303595 Jul 24 01:30:10.046646 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2217/4310] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:09 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:10.059677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:10.073931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:10.074964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:10.099422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.099891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.101363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.102127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.103416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.104054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.111817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.112378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.195858 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1096502-b5a0-4fe2-b249-bef4f0b02185 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "POST /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0/action" status: 202 len: 1079 microversion: 2.47 time: 0.633292 Jul 24 01:30:10.209311 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2094/4311] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:30:09 2022] POST /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0/action => generated 1079 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 24 01:30:10.227612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:10.228679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:10.285150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.286426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.287453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.288123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.820487 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:10.832570 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:10.835794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:10.837055 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-671de1ac-cb41-40c8-b0b9-d5ea348871af tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.787951 Jul 24 01:30:10.837631 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2218/4312] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:10 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:10.847312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:10.857536 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-05eb4a4e-17e3-4890-94a8-a415147cfe5b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.643593 Jul 24 01:30:10.862247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:10.862804 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2095/4313] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:10 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:10.862928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:10.881028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.881500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.886380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:10.887513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:10.897210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.901600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.913470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.918823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:10.923269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:10.926471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:11.305077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:11.331153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:11.332588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:11.345119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05c042c5-1cdc-498d-9637-f5bce8ca0abf tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.490639 Jul 24 01:30:11.348974 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2219/4314] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:10 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:11.367271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-228470d3-21db-47c0-ad8a-01c2429da783 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1150581068", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:11.422548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:11.439009 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a581ba41-fb53-46c3-bfe5-aa345a6cae77 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 0.570482 Jul 24 01:30:11.439902 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2096/4315] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:10 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:11.468560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:11.471537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:11.484099 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:11.487975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:11.491360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:11.492314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:11.493499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:11.597775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.security_group_api [None req-228470d3-21db-47c0-ad8a-01c2429da783 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Neutron security group does_not_exist not found {{(pid=119561) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 24 01:30:11.598624 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-228470d3-21db-47c0-ad8a-01c2429da783 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-228470d3-21db-47c0-ad8a-01c2429da783 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 258 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1150581068", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1150581068', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 24 01:30:11.605256 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 24 01:30:11.610393 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:11.616274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-228470d3-21db-47c0-ad8a-01c2429da783 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:11.617515 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-228470d3-21db-47c0-ad8a-01c2429da783 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.267069 Jul 24 01:30:11.618665 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2220/4316] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:30:11 2022] POST /compute/v2.1/servers => generated 106 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:30:11.629056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:11.630064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:11.650206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:11.650980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:11.651971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:11.655726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:12.232488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:12.243924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-836655a8-77ab-4da2-b207-308331b9964e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.620456 Jul 24 01:30:12.252541 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2221/4317] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:11 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:30:12.272569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:12.282782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:12.288615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:12.306009 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-37482016-bb46-4747-ad52-9afaffd920e6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 0.864675 Jul 24 01:30:12.311268 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:12.312590 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2097/4318] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:11 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:12.328479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:12.333279 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:12.335848 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:12.339129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:12.347945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:12.383617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:12.390067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:12.398405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:12.401445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:12.794315 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:12.832747 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=24 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:13.182356 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:13.216782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:13.226981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:13.230761 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1ea22da3-3b6f-4521-962f-7769bdebcced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.976933 Jul 24 01:30:13.242211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2222/4319] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:12 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:13.260953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:13.263495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:13.307578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:13.308171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:13.311012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:13.314344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:13.584981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:13.593166 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c5bfad8b-8534-4049-8083-3b012cf53d14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.275186 Jul 24 01:30:13.595772 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2098/4320] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:12 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:13.615911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:13.622522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:13.663765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:13.667832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:13.670605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:13.673291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:13.673484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:13.699015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:13.701005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:13.710937 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7e18c82-9de9-4d46-a7ce-71df97975087 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.467535 Jul 24 01:30:13.711762 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2223/4321] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:13 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:13.739957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-74381c97-67d6-4198-81fe-a9f72f58d0fb req-6359cc9d-4d86-4d8c-b168-cb3f314663fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:13.778749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-74381c97-67d6-4198-81fe-a9f72f58d0fb req-6359cc9d-4d86-4d8c-b168-cb3f314663fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:13.780764 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-74381c97-67d6-4198-81fe-a9f72f58d0fb req-6359cc9d-4d86-4d8c-b168-cb3f314663fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:13.812960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-74381c97-67d6-4198-81fe-a9f72f58d0fb req-6359cc9d-4d86-4d8c-b168-cb3f314663fe service nova] Creating event network-changed:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:30:13.851830 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-74381c97-67d6-4198-81fe-a9f72f58d0fb req-6359cc9d-4d86-4d8c-b168-cb3f314663fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132799 Jul 24 01:30:13.853691 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2224/4322] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:13.874952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:13.892899 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:13.901118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:13.970793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:13.980696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:13.988260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:13.998115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:14.873787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:14.882330 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e902b469-d3e5-4071-9902-03e5f5cbcede tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 1.285294 Jul 24 01:30:14.890165 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2099/4323] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:13 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:14.905487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2749bd2e-00d4-44ad-8b4f-f1b8b003516c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:14.906039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2749bd2e-00d4-44ad-8b4f-f1b8b003516c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cccbef09-7b18-4657-b368-f89ec45ac14a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:14.928483 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-2749bd2e-00d4-44ad-8b4f-f1b8b003516c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance cccbef09-7b18-4657-b368-f89ec45ac14a could not be found. Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2749bd2e-00d4-44ad-8b4f-f1b8b003516c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/cccbef09-7b18-4657-b368-f89ec45ac14a HTTP/1.1 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: exception: Instance cccbef09-7b18-4657-b368-f89ec45ac14a could not be found. Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'cccbef09-7b18-4657-b368-f89ec45ac14a'} Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cccbef09-7b18-4657-b368-f89ec45ac14a could not be found. Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cccbef09-7b18-4657-b368-f89ec45ac14a could not be found. Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:14.932428 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cccbef09-7b18-4657-b368-f89ec45ac14a could not be found. Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2749bd2e-00d4-44ad-8b4f-f1b8b003516c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance cccbef09-7b18-4657-b368-f89ec45ac14a could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:14.936984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2749bd2e-00d4-44ad-8b4f-f1b8b003516c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cccbef09-7b18-4657-b368-f89ec45ac14a" status: 404 len: 111 microversion: 2.1 time: 0.041889 Jul 24 01:30:14.949720 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2100/4324] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:30:14 2022] DELETE /compute/v2.1/servers/cccbef09-7b18-4657-b368-f89ec45ac14a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:14.967950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:14.983486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:14.998845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.000121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.002861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.005785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.060465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.075492 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c78ab59-ce05-49d2-aaed-fbcc9c2bfd28 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 1.208091 Jul 24 01:30:15.080460 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2225/4325] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:13 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:15.104026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:15.104798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:15.123597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.123597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.124218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.124652 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.333767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.351207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.353023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.354433 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22f32a42-4f7c-4bec-8e1d-e4404a6f4937 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.272810 Jul 24 01:30:15.361225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2226/4326] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:15 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:15.366090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:15.366874 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:15.391315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.391882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.402139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.402905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.696265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.706435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.716540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.719574 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-099501b1-5bc6-4db7-9693-907ada30ecaa tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.767264 Jul 24 01:30:15.722030 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2101/4327] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:14 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:15.744415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1c58254e-3e95-4e51-88c0-d776079e8797 req-94cb62d1-ac65-4a9a-8cfe-72789044eb24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d83bd7f-0a9a-4866-967c-0faffbacfc2c", "tag": "48909aad-4d32-4cce-be4f-2bd647d3a01e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:15.759071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1c58254e-3e95-4e51-88c0-d776079e8797 req-94cb62d1-ac65-4a9a-8cfe-72789044eb24 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.761715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1c58254e-3e95-4e51-88c0-d776079e8797 req-94cb62d1-ac65-4a9a-8cfe-72789044eb24 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.787958 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1c58254e-3e95-4e51-88c0-d776079e8797 req-94cb62d1-ac65-4a9a-8cfe-72789044eb24 service nova] Creating event network-changed:48909aad-4d32-4cce-be4f-2bd647d3a01e for instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c on n-h2-master-1 Jul 24 01:30:15.799631 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1c58254e-3e95-4e51-88c0-d776079e8797 req-94cb62d1-ac65-4a9a-8cfe-72789044eb24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058840 Jul 24 01:30:15.808014 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2102/4328] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:30:15.866434 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:15.875071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b393f234-4263-4edb-b0c8-22e1be2d66b4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.512463 Jul 24 01:30:15.882523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2227/4329] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:15 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:15.903955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:15.904573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:15.913765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:15.916930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:15.926296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.933128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.937140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.938504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.939338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.940439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:15.941209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:15.944673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:16.644499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:16.656612 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-448f40f6-1589-4f2d-acd3-559fb3e29057 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.756264 Jul 24 01:30:16.680851 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2228/4330] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:15 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:16.685960 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:16.686808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:16.707695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:16.708149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:16.708931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:16.709555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:16.956369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:16.971234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fbc1f6b2-3e22-438b-a77c-6fb0899e011e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 1.072268 Jul 24 01:30:16.971825 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2103/4331] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:15 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:16.985394 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c45f5441-5f20-49c1-834c-db5aa069ad34 req-455ed9f1-93f9-4a67-9c0d-4f06c16ae813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2000bbbc-331b-44c0-a73b-f9399a076517", "name": "network-vif-plugged", "status": "completed", "tag": "6ca0c646-5628-4a96-901d-e3b1491aec78"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:17.029940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c45f5441-5f20-49c1-834c-db5aa069ad34 req-455ed9f1-93f9-4a67-9c0d-4f06c16ae813 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:17.030622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c45f5441-5f20-49c1-834c-db5aa069ad34 req-455ed9f1-93f9-4a67-9c0d-4f06c16ae813 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:17.069761 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c45f5441-5f20-49c1-834c-db5aa069ad34 req-455ed9f1-93f9-4a67-9c0d-4f06c16ae813 service nova] Creating event network-vif-plugged:6ca0c646-5628-4a96-901d-e3b1491aec78 for instance 2000bbbc-331b-44c0-a73b-f9399a076517 on n-h1-master-1 Jul 24 01:30:17.091563 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c45f5441-5f20-49c1-834c-db5aa069ad34 req-455ed9f1-93f9-4a67-9c0d-4f06c16ae813 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118482 Jul 24 01:30:17.097082 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2104/4332] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:17.102714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:17.115114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:17.137586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:17.138348 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:17.139295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:17.142229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:17.853765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:17.885127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:17.886679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:17.887866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0c4315ea-ff34-4b75-911f-935c6f275899 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.789379 Jul 24 01:30:17.888437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2105/4333] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:17 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:17.912114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a329b220-a1fb-4606-b921-ac75003cd192 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:17.912773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a329b220-a1fb-4606-b921-ac75003cd192 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 24 01:30:17.913458 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a329b220-a1fb-4606-b921-ac75003cd192 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a329b220-a1fb-4606-b921-ac75003cd192 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 9223372036854775808 could not be found. Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9223372036854775808'} Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:17.915229 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:17.919884 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:17.919884 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:17.919884 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:17.919884 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 24 01:30:17.919884 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:17.926272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a329b220-a1fb-4606-b921-ac75003cd192 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:17.927959 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a329b220-a1fb-4606-b921-ac75003cd192 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.030519 Jul 24 01:30:17.935776 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2106/4334] 10.222.0.27 () {58 vars in 1187 bytes} [Sun Jul 24 01:30:17 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:30:17.942993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:17.944009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:17.956586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:17.957701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:17.958659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:17.959256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.196550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:18.214820 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-057405aa-7fc4-424b-8736-191f04859ce5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 1.532554 Jul 24 01:30:18.223685 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2229/4335] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:16 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:18.232579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:18.233307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:18.249819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.250848 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.251831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.252237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.290528 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:18.303913 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:18.315794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:18.326342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:18.331838 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef080071-2b56-4a80-8eab-4e4ca5898323 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.394727 Jul 24 01:30:18.338335 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2107/4336] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:17 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:18.351128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:18.352707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:18.372477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.378134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.382564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.383231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.622025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:18.633262 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22b4f480-4b23-4fea-9b14-56ec8c3b0216 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.410281 Jul 24 01:30:18.638278 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2230/4337] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:18 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:18.660181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:18.663735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:18.685138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.689185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.694590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.695269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.729364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:18.743681 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79951a5a-94ac-4989-9fe5-17b12494d0d3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1325 microversion: 2.1 time: 0.399823 Jul 24 01:30:18.744704 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2108/4338] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:18 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1325 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:18.906895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:18.908009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:18.919590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.923302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:18.926848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:18.930033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.008300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:19.018408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dbf3c48-f00a-4d6e-99a7-ef5f083b79c5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.370860 Jul 24 01:30:19.027148 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2231/4339] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:18 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:19.034694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1cd891b6-8848-47c1-a61b-4d620bbb76ef tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:19.035482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1cd891b6-8848-47c1-a61b-4d620bbb76ef tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Failed to fetch instance by id -1 {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 24 01:30:19.036214 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1cd891b6-8848-47c1-a61b-4d620bbb76ef tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance -1 could not be found. Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1cd891b6-8848-47c1-a61b-4d620bbb76ef tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: exception: Instance -1 could not be found. Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '-1'} Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:19.038068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:19.044278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:19.044278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:19.044278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 24 01:30:19.044278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:19.048823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1cd891b6-8848-47c1-a61b-4d620bbb76ef tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:19.049719 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1cd891b6-8848-47c1-a61b-4d620bbb76ef tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018806 Jul 24 01:30:19.054201 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2232/4340] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:30:19 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:30:19.073999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:19.074979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:19.083837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.084412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.085299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.085874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.121868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:19.138364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:19.143934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:19.145385 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb7fd2a8-9164-4dc6-b239-0ff506a80d5b tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.242818 Jul 24 01:30:19.173327 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2109/4341] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:18 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:19.240335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:19.241167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:19.260973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.261656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.262925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.263544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.389859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:19.398477 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-35d902a5-48c7-4e6f-ac5c-0ae50d01ec59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.341177 Jul 24 01:30:19.412655 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2233/4342] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:19 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:19.424495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:19.425137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:19.440169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.454771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.455653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.456102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.679894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:19.692795 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47d07d7b-deee-4e1b-b851-e70290995167 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 0.456446 Jul 24 01:30:19.706992 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2110/4343] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:19 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:19.730360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:19.732227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:19.763162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.768122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.771384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:19.772034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:19.990579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.012972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.022468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.028357 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0368de05-0a5f-4da6-ad46-1514f991698f tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.622982 Jul 24 01:30:20.030424 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2234/4344] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:19 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:20.056355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:20.058959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:20.096095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.103418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:20.104252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.104668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:20.211796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.224391 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58a41158-ddc1-49ca-b5ab-930ba36c9a3b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.515996 Jul 24 01:30:20.239255 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2111/4345] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:19 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:20.255549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:20.256770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:20.278164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.279011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:20.280846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.282198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:20.541063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.555049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.556582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.557809 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac90804a-253f-481d-9b35-520440553127 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.317135 Jul 24 01:30:20.566126 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2112/4346] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:20 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:20.584995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ba97b392-9509-4415-aed2-aa98ccb71b1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:20.588276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ba97b392-9509-4415-aed2-aa98ccb71b1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 11ca457a-62bc-449d-a2d0-49b05bbdeab9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:20.607018 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ba97b392-9509-4415-aed2-aa98ccb71b1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 11ca457a-62bc-449d-a2d0-49b05bbdeab9 could not be found. Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ba97b392-9509-4415-aed2-aa98ccb71b1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/11ca457a-62bc-449d-a2d0-49b05bbdeab9/action HTTP/1.1 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 19 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: {"forceDelete": {}} Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 11ca457a-62bc-449d-a2d0-49b05bbdeab9 could not be found. Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '11ca457a-62bc-449d-a2d0-49b05bbdeab9', 'body': {'forceDelete': {}}} Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ca457a-62bc-449d-a2d0-49b05bbdeab9 could not be found. Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ca457a-62bc-449d-a2d0-49b05bbdeab9 could not be found. Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:20.613346 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:20.617790 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:20.617790 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:20.617790 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ca457a-62bc-449d-a2d0-49b05bbdeab9 could not be found. Jul 24 01:30:20.617790 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:20.617790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ba97b392-9509-4415-aed2-aa98ccb71b1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 11ca457a-62bc-449d-a2d0-49b05bbdeab9 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:20.617790 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ba97b392-9509-4415-aed2-aa98ccb71b1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/11ca457a-62bc-449d-a2d0-49b05bbdeab9/action" status: 404 len: 111 microversion: 2.1 time: 0.047059 Jul 24 01:30:20.620050 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2113/4347] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:20 2022] POST /compute/v2.1/servers/11ca457a-62bc-449d-a2d0-49b05bbdeab9/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:20.624814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:20.626010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:20.650950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.651647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:20.652644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.656708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:20.756068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:20.764192 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-255b5db3-352c-451d-99d8-f3b3d5ac2d92 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1521 microversion: 2.1 time: 0.727097 Jul 24 01:30:20.771556 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2235/4348] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:20 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1521 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:20.780764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:20.793286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:20.842218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.846235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:20.848695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:20.852911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:21.213234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:21.223819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd29bb61-1fb1-4fce-a4d8-7353a285dfd7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.602619 Jul 24 01:30:21.231863 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2114/4349] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:20 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:21.252635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:21.254760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:21.314427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:21.326341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:21.327494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:21.331601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:21.366673 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] HTTP exception thrown: Action 999 not found Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Request method failure captured: Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517/os-instance-actions/999 HTTP/1.1 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KCO1oAaIhRgNF0LFkBwHBINyzHpiFn58fv6sqnf0jKczgyXmsYJMxjBAQflkUlXZRUGIHL1hUAVcvpLT9LaKLjEalx1FZVUIGBcBTtfrsa1JPTto8KBdOhdWsy4AbkMqJAUwELiEpvxEPVPFFnA5B6r-C6SBHzrtU_jyp4elOw9ZQI Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 972661c3565a4312b050c50083f3c91f Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/972661c3565a4312b050c50083f3c91f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/972661c3565a4312b050c50083f3c91f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_972661c3565a4312b050c50083f3c91f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/972661c3565a4312b050c50083f3c91f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 972661c3565a4312b050c50083f3c91f Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-InstanceActionsNegativeTestJSON-1070949262-project Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 803ee2ed518446dc8953a707f171cbc4 Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1070949262-project Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: exception: Action 999 not found Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': '2000bbbc-331b-44c0-a73b-f9399a076517', 'id': '999'} Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 24 01:30:21.375585 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:21.379608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Returning 404 to user: Action 999 not found {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:21.380655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72389735-56aa-45a7-ab78-87c684b1b94e tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.141299 Jul 24 01:30:21.381751 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2115/4350] 10.222.0.27 () {58 vars in 1307 bytes} [Sun Jul 24 01:30:21 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517/os-instance-actions/999 => generated 66 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:30:21.388799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:21.404085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:21.419236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:21.428611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:21.429821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:21.430490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:21.494177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:21.503753 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-416a7a66-a91f-4acd-a282-74a771ff6fe9 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 0.730961 Jul 24 01:30:21.512029 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2236/4351] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:20 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:21.520030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:21.520653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:21.554968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:21.555450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:21.556257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:21.557148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:22.751956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:22.769875 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6c64b454-6dd7-4018-910d-02ca0ac0472f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.255449 Jul 24 01:30:22.770071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:22.773204 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2237/4352] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:21 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:22.780844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9b7183c-a7a3-488e-9fec-3c481fb285b1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '.version_select at 0x7f05ead55940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:22.782106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a9b7183c-a7a3-488e-9fec-3c481fb285b1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 4e5b3cbf-3a51-470b-be09-86b2055177cf] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:22.800886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:22.805075 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a9b7183c-a7a3-488e-9fec-3c481fb285b1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] HTTP exception thrown: Instance 4e5b3cbf-3a51-470b-be09-86b2055177cf could not be found. Jul 24 01:30:22.807271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9b7183c-a7a3-488e-9fec-3c481fb285b1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Request method failure captured: Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/4e5b3cbf-3a51-470b-be09-86b2055177cf/os-instance-actions HTTP/1.1 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KCO1oAaIhRgNF0LFkBwHBINyzHpiFn58fv6sqnf0jKczgyXmsYJMxjBAQflkUlXZRUGIHL1hUAVcvpLT9LaKLjEalx1FZVUIGBcBTtfrsa1JPTto8KBdOhdWsy4AbkMqJAUwELiEpvxEPVPFFnA5B6r-C6SBHzrtU_jyp4elOw9ZQI Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 972661c3565a4312b050c50083f3c91f Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/972661c3565a4312b050c50083f3c91f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/972661c3565a4312b050c50083f3c91f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_972661c3565a4312b050c50083f3c91f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/972661c3565a4312b050c50083f3c91f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 972661c3565a4312b050c50083f3c91f Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-InstanceActionsNegativeTestJSON-1070949262-project Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 803ee2ed518446dc8953a707f171cbc4 Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1070949262-project Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 4e5b3cbf-3a51-470b-be09-86b2055177cf could not be found. Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': '4e5b3cbf-3a51-470b-be09-86b2055177cf'} Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5b3cbf-3a51-470b-be09-86b2055177cf could not be found. Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:22.807601 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5b3cbf-3a51-470b-be09-86b2055177cf could not be found. Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5b3cbf-3a51-470b-be09-86b2055177cf could not be found. Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9b7183c-a7a3-488e-9fec-3c481fb285b1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Returning 404 to user: Instance 4e5b3cbf-3a51-470b-be09-86b2055177cf could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a9b7183c-a7a3-488e-9fec-3c481fb285b1 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/4e5b3cbf-3a51-470b-be09-86b2055177cf/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.034285 Jul 24 01:30:22.814126 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2238/4353] 10.222.0.27 () {58 vars in 1295 bytes} [Sun Jul 24 01:30:22 2022] GET /compute/v2.1/servers/4e5b3cbf-3a51-470b-be09-86b2055177cf/os-instance-actions => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:22.818941 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c2cbeb0-046d-4711-b142-cc878055f149 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 1.434455 Jul 24 01:30:22.819784 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2116/4354] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:21 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:22.822995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:22.825604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:22.844208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:22.845240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:22.845569 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:22.846997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:22.847801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:22.850599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:22.873652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:22.878061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:22.886686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:22.891072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.107025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:23.126361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:23.129154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:23.133595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a17ce3a-9ae1-4997-91eb-b67eb5be2a81 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.318522 Jul 24 01:30:23.137475 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2239/4355] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:22 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:23.150045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3c4f51b-0c1a-4c64-89d1-3940e35e22f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:23.153983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e3c4f51b-0c1a-4c64-89d1-3940e35e22f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 37b34ccd-3250-4826-bdf5-1e4a3ba2a968] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:23.172038 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-e3c4f51b-0c1a-4c64-89d1-3940e35e22f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 37b34ccd-3250-4826-bdf5-1e4a3ba2a968 could not be found. Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3c4f51b-0c1a-4c64-89d1-3940e35e22f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/37b34ccd-3250-4826-bdf5-1e4a3ba2a968/action HTTP/1.1 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 39 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: {"os-getConsoleOutput": {"length": 10}} Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 37b34ccd-3250-4826-bdf5-1e4a3ba2a968 could not be found. Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '37b34ccd-3250-4826-bdf5-1e4a3ba2a968', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b34ccd-3250-4826-bdf5-1e4a3ba2a968 could not be found. Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b34ccd-3250-4826-bdf5-1e4a3ba2a968 could not be found. Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.191161 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b34ccd-3250-4826-bdf5-1e4a3ba2a968 could not be found. Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3c4f51b-0c1a-4c64-89d1-3940e35e22f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 37b34ccd-3250-4826-bdf5-1e4a3ba2a968 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e3c4f51b-0c1a-4c64-89d1-3940e35e22f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/37b34ccd-3250-4826-bdf5-1e4a3ba2a968/action" status: 404 len: 111 microversion: 2.1 time: 0.053842 Jul 24 01:30:23.197414 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2240/4356] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:23 2022] POST /compute/v2.1/servers/37b34ccd-3250-4826-bdf5-1e4a3ba2a968/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:23.206437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:23.206955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:23.243379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.244791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.246050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.246740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.255545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:23.265133 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01eb3701-3cc3-4549-a093-744aa5b12e00 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 0.443935 Jul 24 01:30:23.266298 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2117/4357] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:22 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:23.284167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:30:23.286777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:23.287411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:23.300174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.300633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.301447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.301910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.397306 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e353f8fe-5c09-4377-bb42-07cf90ac7828 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 204 len: 0 microversion: 2.1 time: 0.202363 Jul 24 01:30:23.398343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2241/4358] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:30:23 2022] DELETE /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:30:23.410116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:23.411215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:23.419286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.420132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.423137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.424124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.630624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:23.651670 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3fcccd8-4667-4290-b4df-a8a441b248dd tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.372715 Jul 24 01:30:23.652818 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2118/4359] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:23 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:23.669774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:23.670673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:23.672962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:23.680492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.683119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.683609 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-249b182e-6f67-477b-ad5d-5f023d268637 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1527 microversion: 2.1 time: 0.279749 Jul 24 01:30:23.683986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.685784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2242/4360] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:23 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1527 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:30:23.685943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.837603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:23.838941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:23.851934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.854388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.855443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:23.857965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:23.943404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:23.958764 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7dad604c-4af7-401c-89df-f3e02d722f70 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.290612 Jul 24 01:30:23.961145 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2119/4361] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:23 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:30:23.976402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-daed339d-1091-49af-b4ae-73c4ce493470 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:23.977033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-daed339d-1091-49af-b4ae-73c4ce493470 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 20898819-7fe2-4a27-a62e-45e090ddc67a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:23.991221 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-daed339d-1091-49af-b4ae-73c4ce493470 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 20898819-7fe2-4a27-a62e-45e090ddc67a could not be found. Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-daed339d-1091-49af-b4ae-73c4ce493470 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/20898819-7fe2-4a27-a62e-45e090ddc67a HTTP/1.1 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 20898819-7fe2-4a27-a62e-45e090ddc67a could not be found. Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '20898819-7fe2-4a27-a62e-45e090ddc67a'} Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20898819-7fe2-4a27-a62e-45e090ddc67a could not be found. Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20898819-7fe2-4a27-a62e-45e090ddc67a could not be found. Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:23.992861 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20898819-7fe2-4a27-a62e-45e090ddc67a could not be found. Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-daed339d-1091-49af-b4ae-73c4ce493470 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 20898819-7fe2-4a27-a62e-45e090ddc67a could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-daed339d-1091-49af-b4ae-73c4ce493470 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/20898819-7fe2-4a27-a62e-45e090ddc67a" status: 404 len: 111 microversion: 2.1 time: 0.022018 Jul 24 01:30:23.998924 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2120/4362] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:23 2022] GET /compute/v2.1/servers/20898819-7fe2-4a27-a62e-45e090ddc67a => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:24.014645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:24.015296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:24.035749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.036448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.037476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.038509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.064762 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:24.364988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.384140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.385731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.386960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a7582dda-0634-49ab-ab67-dc4854421b0b tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.553612 Jul 24 01:30:24.387726 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2243/4363] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:23 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:24.408786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:24.409970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:24.418219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.418677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.419461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.419897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.422920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.434734 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f98098d-fefe-44f3-94f9-712c84b0110c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.432753 Jul 24 01:30:24.435902 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2121/4364] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:23 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:24.444307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:24.445491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:24.454586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.455269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.456287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.456870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.535022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.544972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.546546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.547881 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5cdb196b-51ac-43cf-96f0-2cc36a582d98 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.159395 Jul 24 01:30:24.548457 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2244/4365] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:24 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:24.566892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:24.567513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:24.569515 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:24.585964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.586422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.587221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.587662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.867418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:24.876439 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b6a9598-1b62-4745-a97d-7b75c523ed4e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 0.439235 Jul 24 01:30:24.883874 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2122/4366] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:24 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:24.890708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:24.893364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:24.910678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.911423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:24.912369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:24.914169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.478122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.490196 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e113cfe3-8653-4822-9390-a9fd7d76d1a6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.927130 Jul 24 01:30:25.491548 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2245/4367] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:24 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:25.499043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4b4dca0d-4a07-49f1-b3b6-53409d849499 req-21971e4b-d26e-47a5-8199-d51c3cb00fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d83bd7f-0a9a-4866-967c-0faffbacfc2c", "name": "network-vif-plugged", "status": "completed", "tag": "48909aad-4d32-4cce-be4f-2bd647d3a01e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:25.519638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4b4dca0d-4a07-49f1-b3b6-53409d849499 req-21971e4b-d26e-47a5-8199-d51c3cb00fc8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:25.520520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4b4dca0d-4a07-49f1-b3b6-53409d849499 req-21971e4b-d26e-47a5-8199-d51c3cb00fc8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.541605 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4b4dca0d-4a07-49f1-b3b6-53409d849499 req-21971e4b-d26e-47a5-8199-d51c3cb00fc8 service nova] Creating event network-vif-plugged:48909aad-4d32-4cce-be4f-2bd647d3a01e for instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c on n-h2-master-1 Jul 24 01:30:25.553610 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4b4dca0d-4a07-49f1-b3b6-53409d849499 req-21971e4b-d26e-47a5-8199-d51c3cb00fc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058929 Jul 24 01:30:25.555038 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2246/4368] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:25.563904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:25.565244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:25.582316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:25.582842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.583641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:25.585036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.661392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.673427 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9e84a9d-80ab-42ff-b5cc-712204803a7c tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1527 microversion: 2.1 time: 0.787873 Jul 24 01:30:25.677315 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2123/4369] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:24 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1527 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:25.684236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:25.696435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:25.710559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:25.712581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.715891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:25.716520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.868157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.884131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.887499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.889091 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-914d4543-5dad-4b4f-a459-106a55626756 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.210626 Jul 24 01:30:25.891802 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2124/4370] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:25 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:25.898505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9686ff22-393f-40bb-a42c-d1c0a19b456c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-122991301", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9686ff22-393f-40bb-a42c-d1c0a19b456c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 237 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-122991301", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-122991301', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:30:25.901640 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 24 01:30:25.905533 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:25.910253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9686ff22-393f-40bb-a42c-d1c0a19b456c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:25.911592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9686ff22-393f-40bb-a42c-d1c0a19b456c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017948 Jul 24 01:30:25.913216 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2125/4371] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:30:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:30:25.923972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:25.925022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:25.935459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:25.936506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.938185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:25.939775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:25.951823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.964964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.974345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:25.975869 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13f17998-7454-46d8-a1db-70c5f8d3b555 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.419388 Jul 24 01:30:25.977100 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2247/4372] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:25 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:25.986839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:25.988010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:26.013971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:26.017965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:26.019077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:26.019746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:26.284072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:26.292027 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-771cefd4-3bc9-461e-b624-67b45288b6df tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 0.377190 Jul 24 01:30:26.298040 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2126/4373] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:25 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:26.434072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:26.445689 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:26.448727 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ce80cbaf-528a-4636-a71e-fedc23b7064d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.470262 Jul 24 01:30:26.449958 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2248/4374] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:25 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:26.475433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:26.477276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:26.486375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:26.487163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:26.488651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:26.489250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:26.696740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:26.697380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:26.710997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:26.716391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:26.723097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:26.724237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:26.724846 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:26.731764 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa9690dc-c18c-4596-b421-4cebf8a8f8e7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.264888 Jul 24 01:30:26.732419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2127/4375] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:26 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:26.829934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-70f77ddb-e4d1-4106-a141-94ca33cf625e req-820b05bb-f397-456f-bda2-a614153785cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2000bbbc-331b-44c0-a73b-f9399a076517", "name": "network-vif-deleted", "tag": "6ca0c646-5628-4a96-901d-e3b1491aec78"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:26.889733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-70f77ddb-e4d1-4106-a141-94ca33cf625e req-820b05bb-f397-456f-bda2-a614153785cc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:26.890745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-70f77ddb-e4d1-4106-a141-94ca33cf625e req-820b05bb-f397-456f-bda2-a614153785cc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:26.951555 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-70f77ddb-e4d1-4106-a141-94ca33cf625e req-820b05bb-f397-456f-bda2-a614153785cc service nova] Creating event network-vif-deleted:6ca0c646-5628-4a96-901d-e3b1491aec78 for instance 2000bbbc-331b-44c0-a73b-f9399a076517 on n-h1-master-1 Jul 24 01:30:26.982907 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-70f77ddb-e4d1-4106-a141-94ca33cf625e req-820b05bb-f397-456f-bda2-a614153785cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168109 Jul 24 01:30:26.985738 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2128/4376] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:26.988248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803ee2ed518446dc8953a707f171cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972661c3565a4312b050c50083f3c91f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.002033 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14c61a47-2ed4-43f6-9902-2637f468b5c3 tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 200 len: 1485 microversion: 2.1 time: 0.311373 Jul 24 01:30:27.002548 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2249/4377] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:26 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 1485 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:27.004088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:27.007580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:27.028140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.030160 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.033222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.034229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.035424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:27.036052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:27.089205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.091443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.095390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.095935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.349123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.368526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.390290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.392184 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffcb2fb6-beb1-42e6-8346-19e4f4d8b7a1 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.405063 Jul 24 01:30:27.414898 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2129/4378] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:26 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:27.428411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f981425a-f5fa-4694-86ed-0a6f513e85c4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-514323803", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f981425a-f5fa-4694-86ed-0a6f513e85c4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 234 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-514323803", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-514323803', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:27.454622 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f981425a-f5fa-4694-86ed-0a6f513e85c4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:27.458802 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f981425a-f5fa-4694-86ed-0a6f513e85c4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.040213 Jul 24 01:30:27.460669 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2130/4379] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:30:27 2022] POST /compute/v2.1/servers => generated 133 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:30:27.472975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:27.473595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:27.522751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.523221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.524001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.525300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.767584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.783205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.785631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.793862 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9560c9e6-7623-453b-ab65-9ae4c25b77a2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.779121 Jul 24 01:30:27.796260 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2250/4380] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:27 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:27.809989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:27.810848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:27.831315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.833570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.836852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:27.840979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:27.942799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:27.963708 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18b23fdf-6232-4fb8-b8f5-118565414a69 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1306 microversion: 2.1 time: 0.502188 Jul 24 01:30:27.976438 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2131/4381] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:27 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1306 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:28.020314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:28.021324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] [instance: 2000bbbc-331b-44c0-a73b-f9399a076517] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:28.032466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.033382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.034599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.035257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.057264 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] HTTP exception thrown: Instance 2000bbbc-331b-44c0-a73b-f9399a076517 could not be found. Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Request method failure captured: Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 HTTP/1.1 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KCO1oAaIhRgNF0LFkBwHBINyzHpiFn58fv6sqnf0jKczgyXmsYJMxjBAQflkUlXZRUGIHL1hUAVcvpLT9LaKLjEalx1FZVUIGBcBTtfrsa1JPTto8KBdOhdWsy4AbkMqJAUwELiEpvxEPVPFFnA5B6r-C6SBHzrtU_jyp4elOw9ZQI Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 972661c3565a4312b050c50083f3c91f Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/972661c3565a4312b050c50083f3c91f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/972661c3565a4312b050c50083f3c91f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_972661c3565a4312b050c50083f3c91f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/972661c3565a4312b050c50083f3c91f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 972661c3565a4312b050c50083f3c91f Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1070949262 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-InstanceActionsNegativeTestJSON-1070949262-project Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 803ee2ed518446dc8953a707f171cbc4 Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1070949262-project Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 2000bbbc-331b-44c0-a73b-f9399a076517 could not be found. Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2000bbbc-331b-44c0-a73b-f9399a076517'} Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2000bbbc-331b-44c0-a73b-f9399a076517 could not be found. Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2000bbbc-331b-44c0-a73b-f9399a076517 could not be found. Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.059859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2000bbbc-331b-44c0-a73b-f9399a076517 could not be found. Jul 24 01:30:28.064822 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.066325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] Returning 404 to user: Instance 2000bbbc-331b-44c0-a73b-f9399a076517 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:28.068069 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d1737da7-089d-4f9f-b137-8a439f6256af tempest-InstanceActionsNegativeTestJSON-1070949262 tempest-InstanceActionsNegativeTestJSON-1070949262-project] 10.222.0.27 "GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517" status: 404 len: 111 microversion: 2.1 time: 0.052834 Jul 24 01:30:28.073963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2132/4382] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:28 2022] GET /compute/v2.1/servers/2000bbbc-331b-44c0-a73b-f9399a076517 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:28.214793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:28.226388 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9442c2b8-82a8-444a-8fca-ba3f2a35bfa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.425671 Jul 24 01:30:28.233932 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2251/4383] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:27 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:28.249040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:28.253814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:28.268386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.276202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.280598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.285152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.425084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:28.426143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:28.440671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.444259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.447832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.448580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.638661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:28.657919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:28.660163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:28.665558 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45b2cb95-28cd-4a5b-a314-100e8bc3ae1c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.243325 Jul 24 01:30:28.680688 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2252/4384] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:28 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:28.814870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:28.816292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:28.832842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.835596 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.836672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:28.841586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:28.898549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:28.929288 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78a46247-b313-4133-b0a7-f8b5b3607992 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.668398 Jul 24 01:30:28.948209 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2133/4385] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:28 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:28.965284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-736ed387-4ea4-46aa-9b17-b8f8a3f937ee tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:28.966483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-736ed387-4ea4-46aa-9b17-b8f8a3f937ee tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6fda2a41-5a52-4077-8a77-fe4458dfabe2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:28.986560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-736ed387-4ea4-46aa-9b17-b8f8a3f937ee tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 6fda2a41-5a52-4077-8a77-fe4458dfabe2 could not be found. Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-736ed387-4ea4-46aa-9b17-b8f8a3f937ee tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/6fda2a41-5a52-4077-8a77-fe4458dfabe2/action HTTP/1.1 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 13 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: {"pause": {}} Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 6fda2a41-5a52-4077-8a77-fe4458dfabe2 could not be found. Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6fda2a41-5a52-4077-8a77-fe4458dfabe2', 'body': {'pause': {}}} Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fda2a41-5a52-4077-8a77-fe4458dfabe2 could not be found. Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fda2a41-5a52-4077-8a77-fe4458dfabe2 could not be found. Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:28.995267 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:29.000968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:29.000968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:29.000968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fda2a41-5a52-4077-8a77-fe4458dfabe2 could not be found. Jul 24 01:30:29.000968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:29.004111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-736ed387-4ea4-46aa-9b17-b8f8a3f937ee tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 6fda2a41-5a52-4077-8a77-fe4458dfabe2 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:29.006777 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-736ed387-4ea4-46aa-9b17-b8f8a3f937ee tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6fda2a41-5a52-4077-8a77-fe4458dfabe2/action" status: 404 len: 111 microversion: 2.1 time: 0.056695 Jul 24 01:30:29.012406 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2134/4386] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:28 2022] POST /compute/v2.1/servers/6fda2a41-5a52-4077-8a77-fe4458dfabe2/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:29.028056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:29.035710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:29.074106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.075547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.076535 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.077140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.416673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:29.431247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:29.439632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:29.446094 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-baddfd19-3df5-40ce-8d93-3cb76205abdf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 0.636617 Jul 24 01:30:29.447057 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2253/4387] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:28 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:29.460799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:29.462644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:29.480605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.482974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.485449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.488308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.647582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:29.659853 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1ea20f8e-140d-4d11-b452-129d6f74308b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1487 microversion: 2.1 time: 0.642470 Jul 24 01:30:29.671969 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2135/4388] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:29 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1487 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:29.693041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:29.697120 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:29.717444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.720076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.722333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.724585 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.808807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lazy-loading 'flavor' on Instance uuid 9d83bd7f-0a9a-4866-967c-0faffbacfc2c {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:30:29.898735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:29.912786 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2bf16cff-7bdc-41ce-aec5-386282f0c916 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.463446 Jul 24 01:30:29.914977 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2254/4389] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:29 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:29.935360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:29.938241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:29.966459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.967988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.970317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:29.971013 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dcbc8bb3-4695-4489-9d28-aa9ab5fd5373 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.285548 Jul 24 01:30:29.972411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:29.974436 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2136/4390] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:29 2022] POST /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:30:30.002682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:30.003838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:30.026412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:30.033647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:30.034774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:30.039877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:30.417200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:30.439574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:30.441150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:30.445302 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-66da9de0-e56d-4859-919e-3beee04743d7 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.528224 Jul 24 01:30:30.453147 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2255/4391] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:29 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:30.464491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:30.465543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:30.494713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:30.498459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:30.499659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:30.502925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:30.681253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:30.700906 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7f72614-79f5-4d40-9694-9295ad456b59 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.724969 Jul 24 01:30:30.707934 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2137/4392] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:29 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:30.724832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:30.728427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:30.755416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:30.758519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:30.761526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:30.762658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:31.646579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:31.667980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1e17b092-b694-49bb-8018-aa08a8f39e6b tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1495 microversion: 2.1 time: 1.213284 Jul 24 01:30:31.672760 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2256/4393] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:30 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1495 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:31.699140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f7be33e-4a30-48fc-9385-f7124ef9b48d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:31.700330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f7be33e-4a30-48fc-9385-f7124ef9b48d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:31.726910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f7be33e-4a30-48fc-9385-f7124ef9b48d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:31.727281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f7be33e-4a30-48fc-9385-f7124ef9b48d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:31.739460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f7be33e-4a30-48fc-9385-f7124ef9b48d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:31.740479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f7be33e-4a30-48fc-9385-f7124ef9b48d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:31.902511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:31.917996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:31.919999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:31.923948 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-00690ad0-cbbc-4995-98d9-0ec17779face tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 1.212670 Jul 24 01:30:31.928117 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2138/4394] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:30 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:31.944788 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:31.947291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:31.957863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:31.958895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:31.960003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:31.960862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:32.067343 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f7be33e-4a30-48fc-9385-f7124ef9b48d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 202 len: 0 microversion: 2.1 time: 0.390920 Jul 24 01:30:32.079174 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2257/4395] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:31 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:30:32.096765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:32.099174 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:32.164741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:32.169457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:32.173448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:32.174524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:32.499418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:32.511013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:32.520423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:32.522403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63ed506d-e865-4d28-bd5d-d059709751d0 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.592963 Jul 24 01:30:32.523224 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2139/4396] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:31 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:32.689253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:32.689989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:32.698487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:32.698953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:32.699754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:32.700198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:32.841616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:32.858092 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cd1583ea-e047-4d0c-b3bb-034c336a1483 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1510 microversion: 2.1 time: 0.777035 Jul 24 01:30:32.873209 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2258/4397] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:32 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1510 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:32.949903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:32.950522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:32.963270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:32.967173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:32.968440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:32.971305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:33.937733 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:33.943983 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:33.951732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a5a56ff4-ed14-4c06-96c1-5b9ffe1cbf4c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 200 len: 1478 microversion: 2.1 time: 1.267079 Jul 24 01:30:33.955520 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2140/4398] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:32 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 1478 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:30:33.964665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:33.965519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:33.975377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:33.995323 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:33.996736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:33.997203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:33.998860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.001129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.007045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:34.013240 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4d387304-9efe-44ce-94be-ade4a44d883a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1738 microversion: 2.20 time: 1.069825 Jul 24 01:30:34.028342 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2259/4399] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:32 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1738 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:34.041491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:34.046151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:34.065207 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.072518 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.073650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.074426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.239889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:34.255699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:34.257234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:34.258453 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a200ca74-286e-45e3-bf62-2a2b22d001b6 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.301938 Jul 24 01:30:34.259019 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2141/4400] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:33 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:34.267193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f8bdd1d0-408a-4ec4-8806-1716bbc2c022 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1991335240"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:34.279371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f8bdd1d0-408a-4ec4-8806-1716bbc2c022 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:34.286599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bdd1d0-408a-4ec4-8806-1716bbc2c022 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.287046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bdd1d0-408a-4ec4-8806-1716bbc2c022 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.287839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bdd1d0-408a-4ec4-8806-1716bbc2c022 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.288455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bdd1d0-408a-4ec4-8806-1716bbc2c022 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.357041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:34.368803 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d8d459ef-935b-4c4e-8f7e-cad02fe5df58 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1490 microversion: 2.1 time: 0.338942 Jul 24 01:30:34.369390 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2260/4401] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:34 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1490 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:34.392426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:34.392986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:34.408376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.408833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.409620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.411485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.443252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Cannot 'pause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state paused Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action HTTP/1.1 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 13 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: {"pause": {}} Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: exception: Cannot 'pause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state paused Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'pause': {}}} Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de in vm_state paused. Cannot pause while the instance is in this state. Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state paused Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:34.445866 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:34.449876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:34.449876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:34.449876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:34.449876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state paused Jul 24 01:30:34.449876 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:34.451824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 409 to user: Cannot 'pause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state paused {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:34.454034 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab5a60ae-11e0-4467-946e-ddfea0807ffe tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 409 len: 143 microversion: 2.1 time: 0.067303 Jul 24 01:30:34.455294 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2261/4402] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:34 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 143 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:30:34.469936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-37f2d415-f21a-426e-8178-6f20e42c5db8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:34.470940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-37f2d415-f21a-426e-8178-6f20e42c5db8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:34.478561 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f2d415-f21a-426e-8178-6f20e42c5db8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.479395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f2d415-f21a-426e-8178-6f20e42c5db8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.480467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f2d415-f21a-426e-8178-6f20e42c5db8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.481167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37f2d415-f21a-426e-8178-6f20e42c5db8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.577327 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-37f2d415-f21a-426e-8178-6f20e42c5db8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 202 len: 0 microversion: 2.1 time: 0.112386 Jul 24 01:30:34.579869 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2262/4403] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:34 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:30:34.594025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:34.595538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:34.606497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.607320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.608717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:34.609528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:34.871973 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f8bdd1d0-408a-4ec4-8806-1716bbc2c022 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.611411 Jul 24 01:30:34.878585 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2142/4404] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:34 2022] POST /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:30:34.884648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8d3ee024-1d2d-4f95-9ca2-402141380c94 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1d0310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:34.904733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:34.916784 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:34.920861 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f75a759-ee20-4098-adb6-e9f4cda205f1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1497 microversion: 2.1 time: 0.336282 Jul 24 01:30:34.936490 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2263/4405] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:34 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1497 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:34.977526 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8d3ee024-1d2d-4f95-9ca2-402141380c94 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.097244 Jul 24 01:30:34.987521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2143/4406] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:34 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:35.036204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:35.036820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:35.051277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:35.051987 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:35.052952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:35.053397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:35.277331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:35.278902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:35.297949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:35.298532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:35.299386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:35.303084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:35.568082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:35.587497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:35.591550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:35.596715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-abc77796-7040-401e-994a-9ac9e9a9f052 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.323950 Jul 24 01:30:35.598701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:35.618886 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2144/4407] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:35 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:35.620531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:35.633069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:35.636545 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d794d66b-5cc0-4de3-b9fc-9a0c76b77aa8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1720 microversion: 2.20 time: 0.605729 Jul 24 01:30:35.637317 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2264/4408] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:35 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1720 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:35.943327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:35.946240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:35.956629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:35.964161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:35.965368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:35.966401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:35.995443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eab1383c-9067-4285-acb9-b14cd6e78a88 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9e0f670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:36.082735 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eab1383c-9067-4285-acb9-b14cd6e78a88 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.086599 Jul 24 01:30:36.084709 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2265/4409] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:35 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:36.359823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:36.371653 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e8453ef6-9f69-48ba-848a-aca934eae22d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.432619 Jul 24 01:30:36.375563 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2145/4410] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:35 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:36.404609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:36.405313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:36.454797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.455248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.459648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.463417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.634638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:36.635361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:36.649503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.649987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.669168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.669725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.828716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:36.840799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:36.849474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:36.852105 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52abad84-61fe-480c-8a77-e06ba0e35702 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1366 microversion: 2.47 time: 0.223528 Jul 24 01:30:36.859995 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2146/4411] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:36 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:36.874652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:36.879800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:36.882384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:36.887131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.887936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.888877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.889466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.894386 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-66443029-ab5d-4fc5-b1a6-555c8db0d6bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.499197 Jul 24 01:30:36.898870 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2266/4412] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:36 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:36.924112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:36.925193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:36.957624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.958157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.959015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:36.959400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:36.998287 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2/action HTTP/1.1 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 28 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: {"reboot": {"type": "SOFT"}} Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: exception: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'cf3adf5d-740b-4b11-a7cb-6656c7160ab2', 'body': {'reboot': {'type': 'SOFT'}}} Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:37.003455 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:37.007494 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.025219 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:37.027594 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a33ba72-a978-4ee4-8004-f59ef231e567 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2/action" status: 404 len: 111 microversion: 2.1 time: 0.117417 Jul 24 01:30:37.028439 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2267/4413] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:36 2022] POST /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2/action => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:37.043336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:37.047623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:37.067758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.068267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:37.069127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.069575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:37.316062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:37.331743 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:37.336908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:37.339433 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2bec8f1-3bb9-4541-a6cd-7855654e4b3c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1720 microversion: 2.20 time: 0.478163 Jul 24 01:30:37.340395 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2147/4414] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:36 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1720 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:37.369083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d394b35b-c2b3-4070-bdba-ab937145144a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1d0310>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:37.379104 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:37.403583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-045e253f-16d8-42ed-85bf-9a5d0b5fd91e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.370083 Jul 24 01:30:37.405385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2268/4415] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:37 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:37.435360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:37.436699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:37.488084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.488552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:37.489336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.492293 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d394b35b-c2b3-4070-bdba-ab937145144a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.137830 Jul 24 01:30:37.496415 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2148/4416] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:37 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:37.497659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:37.842346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:37.852613 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-26b031bb-f2bd-4580-ab61-09b1603e05ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.427790 Jul 24 01:30:37.853067 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2269/4417] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:37 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:37.870621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3445928f-82d1-4ebe-af08-36ddb182d78b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:37.871657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3445928f-82d1-4ebe-af08-36ddb182d78b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 1b358d6a-0b59-448b-aae0-e462dc5c1657] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:37.880618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:37.881491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:37.896644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.902681 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3445928f-82d1-4ebe-af08-36ddb182d78b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 1b358d6a-0b59-448b-aae0-e462dc5c1657 could not be found. Jul 24 01:30:37.907350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3445928f-82d1-4ebe-af08-36ddb182d78b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/1b358d6a-0b59-448b-aae0-e462dc5c1657/action HTTP/1.1 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 28 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: {"reboot": {"type": "SOFT"}} Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 1b358d6a-0b59-448b-aae0-e462dc5c1657 could not be found. Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1b358d6a-0b59-448b-aae0-e462dc5c1657', 'body': {'reboot': {'type': 'SOFT'}}} Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b358d6a-0b59-448b-aae0-e462dc5c1657 could not be found. Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b358d6a-0b59-448b-aae0-e462dc5c1657 could not be found. Jul 24 01:30:37.907911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b358d6a-0b59-448b-aae0-e462dc5c1657 could not be found. Jul 24 01:30:37.912021 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:37.912541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.912541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:37.914052 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3445928f-82d1-4ebe-af08-36ddb182d78b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 1b358d6a-0b59-448b-aae0-e462dc5c1657 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:37.914994 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3445928f-82d1-4ebe-af08-36ddb182d78b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/1b358d6a-0b59-448b-aae0-e462dc5c1657/action" status: 404 len: 111 microversion: 2.1 time: 0.048731 Jul 24 01:30:37.915702 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2149/4418] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:37 2022] POST /compute/v2.1/servers/1b358d6a-0b59-448b-aae0-e462dc5c1657/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:37.937915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:37.944376 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:37.956200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.959375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:37.961554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:37.962443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:38.185914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:38.201826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:38.211295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:38.215037 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f473d2c3-5d8e-468f-8f68-96f53b8257b8 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1372 microversion: 2.47 time: 0.338703 Jul 24 01:30:38.234079 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2270/4419] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:37 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:38.247192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a066ba86-89dc-468b-8a46-c5555374f90f req-6d5accf6-f56e-4a4c-9469-bd257aa58e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3e0006-7485-440e-9282-2f6f982cc604", "name": "network-vif-unplugged", "status": "completed", "tag": "4e29293a-0608-4f8c-903a-03bc61e05c91"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:38.268904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a066ba86-89dc-468b-8a46-c5555374f90f req-6d5accf6-f56e-4a4c-9469-bd257aa58e30 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:38.269541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a066ba86-89dc-468b-8a46-c5555374f90f req-6d5accf6-f56e-4a4c-9469-bd257aa58e30 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:38.311344 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a066ba86-89dc-468b-8a46-c5555374f90f req-6d5accf6-f56e-4a4c-9469-bd257aa58e30 service nova] Creating event network-vif-unplugged:4e29293a-0608-4f8c-903a-03bc61e05c91 for instance 6e3e0006-7485-440e-9282-2f6f982cc604 on n-h1-master-1 Jul 24 01:30:38.333897 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a066ba86-89dc-468b-8a46-c5555374f90f req-6d5accf6-f56e-4a4c-9469-bd257aa58e30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096916 Jul 24 01:30:38.336589 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2271/4420] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:38.362766 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:38.363743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:38.386915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:38.390601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:38.392742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:38.393388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:38.450762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:38.465189 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5ba78d03-258e-44e1-be25-395afb89ff60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.544648 Jul 24 01:30:38.478889 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2150/4421] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:37 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:38.498007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:38.498683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:38.523179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:38.527846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:38.529081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:38.531945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:38.935879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:38.948472 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44941719-9eb9-4ed9-99bb-8e30c0e0a11e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.456749 Jul 24 01:30:38.954662 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2151/4422] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:38 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:38.976423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0dfcde7d-4b16-4e2e-bf4c-da28c22712b5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea21f040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:39.059288 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0dfcde7d-4b16-4e2e-bf4c-da28c22712b5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.091124 Jul 24 01:30:39.059872 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2152/4423] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:38 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:39.066202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:39.068066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:39.070392 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:39.078569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.079142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.080044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.080714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.102158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2/action HTTP/1.1 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 65 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: exception: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'cf3adf5d-740b-4b11-a7cb-6656c7160ab2', 'body': {'rebuild': {'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08'}}} Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 24 01:30:39.104356 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:30:39.108225 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:39.111281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:39.112800 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c952fb07-b37a-4a45-9e62-c2eebacc210b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2/action" status: 404 len: 111 microversion: 2.1 time: 0.051401 Jul 24 01:30:39.117356 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2153/4424] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:39 2022] POST /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:39.135706 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:39.137483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:39.157509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.158304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.159501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.160413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.177401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:39.204808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:39.210946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:39.214609 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c75449b9-5845-4d39-8303-0758c7eae71d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1723 microversion: 2.20 time: 0.858909 Jul 24 01:30:39.215773 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2272/4425] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:38 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1723 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:39.240446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e5f36054-b9a7-4a3f-9ea7-41dfecb494ed tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac461e77-4b17-4dc8-8d73-6ca86e8d2cf7"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:39.242157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e5f36054-b9a7-4a3f-9ea7-41dfecb494ed tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:39.251132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5f36054-b9a7-4a3f-9ea7-41dfecb494ed tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.252051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5f36054-b9a7-4a3f-9ea7-41dfecb494ed tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.253177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5f36054-b9a7-4a3f-9ea7-41dfecb494ed tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.253888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e5f36054-b9a7-4a3f-9ea7-41dfecb494ed tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.791258 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e5f36054-b9a7-4a3f-9ea7-41dfecb494ed tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.560419 Jul 24 01:30:39.793456 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2273/4426] 10.222.0.27 () {62 vars in 1363 bytes} [Sun Jul 24 01:30:39 2022] POST /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-volume_attachments => generated 188 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:30:39.803523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:39.804804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:39.816176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.817815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.819730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.821023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.872294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:39.891341 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7fc65a20-c7ad-43fa-8af2-5100a72feb01 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.761730 Jul 24 01:30:39.893036 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2154/4427] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:39 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:39.926754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:39.927381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:39.944691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.945149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:39.948286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:39.948750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:40.039997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:40.054922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:40.057363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:40.059215 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d55e99b0-225c-4d06-bba1-7b2a7d454c2e tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1372 microversion: 2.47 time: 0.263865 Jul 24 01:30:40.071139 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2274/4428] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:39 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:40.090410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af8e3e30-8e12-4fb8-a412-a015dbac8ced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:40.091134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af8e3e30-8e12-4fb8-a412-a015dbac8ced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:40.105240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8e3e30-8e12-4fb8-a412-a015dbac8ced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:40.106110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8e3e30-8e12-4fb8-a412-a015dbac8ced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:40.107341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8e3e30-8e12-4fb8-a412-a015dbac8ced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:40.114729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8e3e30-8e12-4fb8-a412-a015dbac8ced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:40.418767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:40.445333 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2011e679-481b-48f1-b3de-d1a51ddc24f9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.536214 Jul 24 01:30:40.466332 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2155/4429] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:39 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:40.471817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b74b4db5-46be-407f-b489-b521d7518af7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea232670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:40.575139 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b74b4db5-46be-407f-b489-b521d7518af7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.107419 Jul 24 01:30:40.576602 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2156/4430] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:40 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:40.594207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa960574-d04d-419a-8534-742dfb4022f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:40.595876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa960574-d04d-419a-8534-742dfb4022f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 3596ca79-76f3-4eb4-a59c-45ef1e77923e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:40.611832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-fa960574-d04d-419a-8534-742dfb4022f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 3596ca79-76f3-4eb4-a59c-45ef1e77923e could not be found. Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa960574-d04d-419a-8534-742dfb4022f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/3596ca79-76f3-4eb4-a59c-45ef1e77923e/action HTTP/1.1 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 65 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 3596ca79-76f3-4eb4-a59c-45ef1e77923e could not be found. Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '3596ca79-76f3-4eb4-a59c-45ef1e77923e', 'body': {'rebuild': {'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08'}}} Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3596ca79-76f3-4eb4-a59c-45ef1e77923e could not be found. Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 24 01:30:40.615684 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3596ca79-76f3-4eb4-a59c-45ef1e77923e could not be found. Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3596ca79-76f3-4eb4-a59c-45ef1e77923e could not be found. Jul 24 01:30:40.619300 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:40.625129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa960574-d04d-419a-8534-742dfb4022f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 3596ca79-76f3-4eb4-a59c-45ef1e77923e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:40.639077 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa960574-d04d-419a-8534-742dfb4022f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/3596ca79-76f3-4eb4-a59c-45ef1e77923e/action" status: 404 len: 111 microversion: 2.1 time: 0.043128 Jul 24 01:30:40.642705 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2157/4431] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:40 2022] POST /compute/v2.1/servers/3596ca79-76f3-4eb4-a59c-45ef1e77923e/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:40.659914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:40.665581 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:40.673724 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af8e3e30-8e12-4fb8-a412-a015dbac8ced tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-volume_attachments/ac461e77-4b17-4dc8-8d73-6ca86e8d2cf7" status: 202 len: 0 microversion: 2.20 time: 0.609486 Jul 24 01:30:40.678483 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2275/4432] 10.222.0.27 () {60 vars in 1456 bytes} [Sun Jul 24 01:30:40 2022] DELETE /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-volume_attachments/ac461e77-4b17-4dc8-8d73-6ca86e8d2cf7 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:30:40.703178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:40.706086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:40.714159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:40.714862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:40.817586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8e94b026-dde8-4d05-8f93-93c7ac9eedbd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:40.821209 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8e94b026-dde8-4d05-8f93-93c7ac9eedbd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:40.885104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e94b026-dde8-4d05-8f93-93c7ac9eedbd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:40.886097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e94b026-dde8-4d05-8f93-93c7ac9eedbd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:40.889559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e94b026-dde8-4d05-8f93-93c7ac9eedbd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:40.891005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e94b026-dde8-4d05-8f93-93c7ac9eedbd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:41.056036 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:41.084436 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8e94b026-dde8-4d05-8f93-93c7ac9eedbd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "POST /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/action" status: 202 len: 0 microversion: 2.20 time: 0.290925 Jul 24 01:30:41.085629 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2276/4433] 10.222.0.27 () {62 vars in 1318 bytes} [Sun Jul 24 01:30:40 2022] POST /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:30:41.091179 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:41.091993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:41.100430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:41.101080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:41.102051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:41.102651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:41.259525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:41.271584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:41.275804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:41.279466 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40649c54-5e82-47c7-830f-8f812004781c tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1372 microversion: 2.47 time: 0.191114 Jul 24 01:30:41.282275 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2277/4434] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:41 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:41.293596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:41.294396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:41.307962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:41.309717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:41.314972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:41.316137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:41.611677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:41.628484 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-87c106dc-0932-45f4-817e-f721b4f05a7b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.979332 Jul 24 01:30:41.629805 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2158/4435] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:40 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:41.637775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4678f36c-87de-41dd-a5ad-c3d24419ef6b req-70647169-423a-4910-ada4-680a0584153f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d83bd7f-0a9a-4866-967c-0faffbacfc2c", "name": "network-vif-plugged", "status": "completed", "tag": "48909aad-4d32-4cce-be4f-2bd647d3a01e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:41.668129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4678f36c-87de-41dd-a5ad-c3d24419ef6b req-70647169-423a-4910-ada4-680a0584153f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:41.674379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4678f36c-87de-41dd-a5ad-c3d24419ef6b req-70647169-423a-4910-ada4-680a0584153f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:41.715633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4678f36c-87de-41dd-a5ad-c3d24419ef6b req-70647169-423a-4910-ada4-680a0584153f service nova] Creating event network-vif-plugged:48909aad-4d32-4cce-be4f-2bd647d3a01e for instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c on n-h2-master-1 Jul 24 01:30:41.762680 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4678f36c-87de-41dd-a5ad-c3d24419ef6b req-70647169-423a-4910-ada4-680a0584153f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129280 Jul 24 01:30:41.763843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2159/4436] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:30:41.787914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e214ba00-0073-43bd-b228-92a7d08a1d57 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea232b80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:41.864526 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e214ba00-0073-43bd-b228-92a7d08a1d57 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.098962 Jul 24 01:30:41.868337 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2160/4437] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:41 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:41.884258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:41.885182 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:41.893895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:41.894577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:41.895521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:41.896109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:42.078907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.087390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.088928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.090155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-438a6485-b351-42f3-8b42-d402b80432e2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1671 microversion: 2.20 time: 0.806679 Jul 24 01:30:42.098438 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2278/4438] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:41 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1671 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:42.303736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:42.304640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:42.316045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:42.318554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:42.319583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:42.321066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:42.372732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.381215 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-67a6fc77-e957-43c9-9c59-3640f5baa046 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.505726 Jul 24 01:30:42.382434 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2161/4439] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:41 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:42.398824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56b3019e-d359-493e-9b8e-014efa474dcc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:42.399998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56b3019e-d359-493e-9b8e-014efa474dcc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: e92f6d79-0d76-476c-ab6e-1216b68341be] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:42.409150 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-56b3019e-d359-493e-9b8e-014efa474dcc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance e92f6d79-0d76-476c-ab6e-1216b68341be could not be found. Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56b3019e-d359-493e-9b8e-014efa474dcc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/e92f6d79-0d76-476c-ab6e-1216b68341be/action HTTP/1.1 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 15 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: {"restore": {}} Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: exception: Instance e92f6d79-0d76-476c-ab6e-1216b68341be could not be found. Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'e92f6d79-0d76-476c-ab6e-1216b68341be', 'body': {'restore': {}}} Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92f6d79-0d76-476c-ab6e-1216b68341be could not be found. Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92f6d79-0d76-476c-ab6e-1216b68341be could not be found. Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:42.411049 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:42.414748 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:42.414748 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:42.414748 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92f6d79-0d76-476c-ab6e-1216b68341be could not be found. Jul 24 01:30:42.414748 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:42.414748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56b3019e-d359-493e-9b8e-014efa474dcc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance e92f6d79-0d76-476c-ab6e-1216b68341be could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:42.414748 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56b3019e-d359-493e-9b8e-014efa474dcc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/e92f6d79-0d76-476c-ab6e-1216b68341be/action" status: 404 len: 111 microversion: 2.1 time: 0.018840 Jul 24 01:30:42.417043 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2162/4440] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:42 2022] POST /compute/v2.1/servers/e92f6d79-0d76-476c-ab6e-1216b68341be/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:30:42.422449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:42.423123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:42.431289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:42.431751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:42.432605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:42.432990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:42.502505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.515592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.525622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.526794 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43e8d608-7437-48e2-bbb2-acb45422bf3f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1372 microversion: 2.47 time: 0.228605 Jul 24 01:30:42.527375 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2279/4441] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:42 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:42.665379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:42.682680 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8aebdecc-bfca-4861-ad84-1020733425bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.262300 Jul 24 01:30:42.683247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2163/4442] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:42 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:42.703231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:42.704099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:42.717871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:42.718509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:42.723087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:42.723613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:42.881688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e7e426e-a436-4351-bb15-67d358abe350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea181af0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:42.946825 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e7e426e-a436-4351-bb15-67d358abe350 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.069942 Jul 24 01:30:42.950518 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2164/4443] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:42 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:30:43.097935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:43.107131 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9db9ffb-7ee1-483a-b9bd-db8ec7d2c814 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.409307 Jul 24 01:30:43.107704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2280/4444] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:42 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:43.131947 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:43.132932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:43.158905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:43.161578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:43.162973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:43.165620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:43.167535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:43.168131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:43.207214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:43.208290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:43.209249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:43.215959 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:43.291539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Cannot 'restore' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action HTTP/1.1 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 15 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: {"restore": {}} Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: exception: Cannot 'restore' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'restore': {}}} Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de in vm_state active. Cannot restore while the instance is in this state. Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:43.293603 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 409 to user: Cannot 'restore' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-170c3d93-c328-45f6-9f83-30a7ab72df4f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 409 len: 145 microversion: 2.1 time: 0.157276 Jul 24 01:30:43.298547 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2281/4445] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:43 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 145 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:30:43.304853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:43.305954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:43.316308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:43.317081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:43.318301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:43.318837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:44.258813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.273942 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bed562dc-fc04-4f13-ab22-41d23df8f4a9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.968917 Jul 24 01:30:44.274572 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2282/4446] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:43 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:44.308122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:44.309352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:44.334709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:44.335443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:44.337334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:44.339058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:44.508648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.522624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.532818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.534738 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f134931-201e-43fd-adee-fe26bb6fbb1d tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1357 microversion: 2.47 time: 0.247962 Jul 24 01:30:44.537396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2283/4447] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:44 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:44.559741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-91e341bc-57a2-4722-8bf0-9672d084dcb0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eabbdee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:44.589341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.604896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.612436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.615520 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e23bdd6c-b1b9-4ee9-a6ff-3420d834c418 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1671 microversion: 2.20 time: 1.502491 Jul 24 01:30:44.627447 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2165/4448] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:43 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1671 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:44.627447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:44.627962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:44.648439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:44.651164 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-91e341bc-57a2-4722-8bf0-9672d084dcb0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.107965 Jul 24 01:30:44.651383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:44.652491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:44.655685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:44.658601 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2284/4449] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:44 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:44.663794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:44.675038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:44.676967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Searching by: {'deleted': False, 'project_id': 'b70a645a17fa4e0597bdff92b8011131'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:30:44.688634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:44.689086 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:44.689895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:44.694416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:44.696072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:44.879681 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:30:45.014349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.024379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.025484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.044146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.046013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.121595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d155ec2-4fce-4521-a702-84eb6c8d056f tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.461656 Jul 24 01:30:45.135412 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2285/4450] 10.222.0.27 () {60 vars in 1186 bytes} [Sun Jul 24 01:30:44 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:45.146551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:45.147070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:45.148907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.163636 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ebe85571-7224-4198-95ad-cd3d6055444e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.544326 Jul 24 01:30:45.164285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.165028 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2166/4451] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:44 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:45.178475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.183697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.185240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.188042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1a3bf485-a58b-4bb4-bbbe-56ba3d38b929 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:45.189326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1a3bf485-a58b-4bb4-bbbe-56ba3d38b929 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: c9023c1a-31d5-49ef-b073-6aea0eb42f57] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:45.203040 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-1a3bf485-a58b-4bb4-bbbe-56ba3d38b929 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance c9023c1a-31d5-49ef-b073-6aea0eb42f57 could not be found. Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1a3bf485-a58b-4bb4-bbbe-56ba3d38b929 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/c9023c1a-31d5-49ef-b073-6aea0eb42f57/action HTTP/1.1 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 14 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: {"resume": {}} Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c9023c1a-31d5-49ef-b073-6aea0eb42f57 could not be found. Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c9023c1a-31d5-49ef-b073-6aea0eb42f57', 'body': {'resume': {}}} Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9023c1a-31d5-49ef-b073-6aea0eb42f57 could not be found. Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9023c1a-31d5-49ef-b073-6aea0eb42f57 could not be found. Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:45.215612 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:45.220763 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:45.220763 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:45.220763 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9023c1a-31d5-49ef-b073-6aea0eb42f57 could not be found. Jul 24 01:30:45.220763 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:45.220763 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1a3bf485-a58b-4bb4-bbbe-56ba3d38b929 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance c9023c1a-31d5-49ef-b073-6aea0eb42f57 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:45.220763 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1a3bf485-a58b-4bb4-bbbe-56ba3d38b929 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/c9023c1a-31d5-49ef-b073-6aea0eb42f57/action" status: 404 len: 111 microversion: 2.1 time: 0.035558 Jul 24 01:30:45.222662 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2167/4452] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:45 2022] POST /compute/v2.1/servers/c9023c1a-31d5-49ef-b073-6aea0eb42f57/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:30:45.231638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:45.235078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:45.261664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.262224 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.263573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.264041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.290192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:30:45.500382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60fccbe1-13bb-47e9-a9d4-820e7272e320 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 204 len: 0 microversion: 2.47 time: 0.356996 Jul 24 01:30:45.504924 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2286/4453] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:30:45 2022] DELETE /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:30:45.516901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:45.517655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:45.530886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.531337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.538162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.539112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.585387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.599684 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f70d5148-3404-49af-919d-8ea4158e4cea tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.374917 Jul 24 01:30:45.601228 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2168/4454] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:45 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:45.618603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:45.619675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:45.631572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.632328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.633296 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.637006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.768693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.783040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.787878 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:45.791113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30c90876-2c1c-4af7-a35c-1633af8a7d87 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1363 microversion: 2.47 time: 0.284751 Jul 24 01:30:45.791714 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2287/4455] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:45 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:45.802586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:45.819039 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:45.846271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.848913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:45.849851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:45.852693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.120010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:46.132234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90e302d3-5213-4342-83bf-bcfa4d469167 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.517332 Jul 24 01:30:46.138536 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2169/4456] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:45 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:46.144335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-14fa0f19-e0cc-4c40-b351-9ca7470bfb34 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1e23a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:46.224562 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-14fa0f19-e0cc-4c40-b351-9ca7470bfb34 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1440 microversion: 2.1 time: 0.084182 Jul 24 01:30:46.228983 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2170/4457] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:46 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:46.247954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:46.248513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:46.278061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.279528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.280366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.281419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.387385 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Cannot 'resume' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action HTTP/1.1 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 14 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: {"resume": {}} Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'resume' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'resume': {}}} Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de in vm_state active. Cannot resume while the instance is in this state. Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:46.390831 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:46.395632 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:46.395632 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:46.395632 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:46.395632 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:30:46.395632 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:46.395632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 409 to user: Cannot 'resume' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:46.396085 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b30bf6bb-3d06-477b-bf82-8ff982696bda tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 409 len: 144 microversion: 2.1 time: 0.165933 Jul 24 01:30:46.404923 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2171/4458] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:46 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 144 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:30:46.413942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:46.414568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:46.444747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.447956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.450076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.452139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.520359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:46.533320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:46.537698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:46.540104 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31e39cd0-bf2a-4d73-ba23-51c88137c7f1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.747428 Jul 24 01:30:46.542185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2288/4459] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:45 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:46.820743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:46.821398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:46.837009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:46.843738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.843738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.845952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.846765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.847727 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eca43eab-2702-43e8-906c-3e1460a83c77 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.437797 Jul 24 01:30:46.860080 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2172/4460] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:46 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:46.865350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:46.866009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:46.886967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.888597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:46.893871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:46.894493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:47.137598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:47.147584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:47.152659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:47.161620 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f61ff40-0748-4f36-bb6c-35372c3d5384 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 200 len: 1363 microversion: 2.47 time: 0.355179 Jul 24 01:30:47.162424 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2289/4461] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:46 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:30:47.240146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ad6fc5c-dd47-4153-a1f7-835dfe159e31 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9e3d700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:47.300075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:47.316643 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-84e99ebb-6c98-450f-91b4-ceab123af11d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.455158 Jul 24 01:30:47.317245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2173/4462] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:46 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:30:47.539019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-704c9aa9-f005-44b4-ab17-4a7e3c7970ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-704c9aa9-f005-44b4-ab17-4a7e3c7970ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 160 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2909a66d-cdd3-4b87-b889-9aac3ab2e97c"}]}} Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': '', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'networks': [{'uuid': '2909a66d-cdd3-4b87-b889-9aac3ab2e97c'}]}}} Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi '' Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:30:47.542542 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:30:47.546660 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:47.553505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-704c9aa9-f005-44b4-ab17-4a7e3c7970ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:47.554605 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-704c9aa9-f005-44b4-ab17-4a7e3c7970ce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021741 Jul 24 01:30:47.558075 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2174/4463] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:30:47 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:30:47.586820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:47.587738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:47.614344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:47.617006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:47.622295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:47.623031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:48.369589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:48.381987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:48.394320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:48.396838 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ce9fe52f-a206-495a-bce0-30b2387fcc4a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.837421 Jul 24 01:30:48.402110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2175/4464] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:47 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:48.438389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:48.440597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:48.464467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:48.484192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:48.487287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:48.494291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:48.941725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:48.950895 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ec8e3b2-1f54-45c6-9920-ad6749117a94 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.545969 Jul 24 01:30:48.953584 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2176/4465] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:48 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:48.959942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:48.960713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: 1bd9211b-9166-4666-8389-4ad481f2b8f0] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:48.971481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:48.972193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:48.973168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:48.973781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:48.991008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] HTTP exception thrown: Instance 1bd9211b-9166-4666-8389-4ad481f2b8f0 could not be found. Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Request method failure captured: Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 HTTP/1.1 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KCRrb7oTNFM3wdmYY-X08a2OD3abWzrHTPZj3rUPYenCEo_GVCKGfUMzTRrA5ipdkVl9fjnF4nl23bmOVnRBekZdkNiC5mChq1OwMQY_nTN8guBWFUJYPo-ezpafpNCmNLGZ5fHy8VzaCPn_9Cx2HQlz-SuFAZrGVc1KHLOH4MDq1A Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.47 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b70a645a17fa4e0597bdff92b8011131 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerShowV247Test-1967661475 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b70a645a17fa4e0597bdff92b8011131"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b70a645a17fa4e0597bdff92b8011131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b70a645a17fa4e0597bdff92b8011131", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b70a645a17fa4e0597bdff92b8011131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerShowV247Test-1967661475 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b70a645a17fa4e0597bdff92b8011131 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerShowV247Test-1967661475 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerShowV247Test-1967661475-project Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 0a7378d2a7a949ddaa2265cc1c49f6f3 Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerShowV247Test-1967661475-project Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 1bd9211b-9166-4666-8389-4ad481f2b8f0 could not be found. Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1bd9211b-9166-4666-8389-4ad481f2b8f0'} Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd9211b-9166-4666-8389-4ad481f2b8f0 could not be found. Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd9211b-9166-4666-8389-4ad481f2b8f0 could not be found. Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:48.994095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:48.998774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:48.998774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:48.998774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:48.998774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:48.998774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:48.998774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd9211b-9166-4666-8389-4ad481f2b8f0 could not be found. Jul 24 01:30:48.998774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:49.002150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Returning 404 to user: Instance 1bd9211b-9166-4666-8389-4ad481f2b8f0 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:49.003201 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-004d9827-4da5-46a6-925f-ea177c002831 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0" status: 404 len: 111 microversion: 2.47 time: 0.048353 Jul 24 01:30:49.007376 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2177/4466] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:48 2022] GET /compute/v2.1/servers/1bd9211b-9166-4666-8389-4ad481f2b8f0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:30:49.013599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:49.014505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:49.022802 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:49.023543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:49.024507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:49.025097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:49.321715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:49.343346 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5032a8ab-3d14-4186-8211-78a90da9ce8f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.329926 Jul 24 01:30:49.361435 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2178/4467] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:49 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:49.387803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:49.392277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: ebcfe250-aa9e-452c-b333-93cec9fc8e44] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:49.417045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:49.424946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:49.427719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:49.433459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:49.499526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: ebcfe250-aa9e-452c-b333-93cec9fc8e44] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:30:49.764978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-714b28b4-9fe2-4fae-a082-c1664e939c58 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44" status: 204 len: 0 microversion: 2.47 time: 0.399165 Jul 24 01:30:49.766959 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2179/4468] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:30:49 2022] DELETE /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:30:49.786584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49c6c0f2-6bd1-4b5e-ad15-e09743cc5349 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:49.789521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-49c6c0f2-6bd1-4b5e-ad15-e09743cc5349 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 463e67d1-859c-45fa-b234-5d338135b798] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:49.807168 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-49c6c0f2-6bd1-4b5e-ad15-e09743cc5349 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 463e67d1-859c-45fa-b234-5d338135b798 could not be found. Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49c6c0f2-6bd1-4b5e-ad15-e09743cc5349 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/463e67d1-859c-45fa-b234-5d338135b798/action HTTP/1.1 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 14 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: {"shelve": {}} Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 463e67d1-859c-45fa-b234-5d338135b798 could not be found. Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '463e67d1-859c-45fa-b234-5d338135b798', 'body': {'shelve': {}}} Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 463e67d1-859c-45fa-b234-5d338135b798 could not be found. Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 463e67d1-859c-45fa-b234-5d338135b798 could not be found. Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:30:49.822320 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:30:49.827390 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:30:49.827390 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:30:49.827390 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 463e67d1-859c-45fa-b234-5d338135b798 could not be found. Jul 24 01:30:49.827390 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:30:49.828756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49c6c0f2-6bd1-4b5e-ad15-e09743cc5349 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 463e67d1-859c-45fa-b234-5d338135b798 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:30:49.830180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-49c6c0f2-6bd1-4b5e-ad15-e09743cc5349 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/463e67d1-859c-45fa-b234-5d338135b798/action" status: 404 len: 111 microversion: 2.1 time: 0.058958 Jul 24 01:30:49.831469 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2180/4469] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:49 2022] POST /compute/v2.1/servers/463e67d1-859c-45fa-b234-5d338135b798/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:49.837196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:49.838084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:49.848270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:49.849039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:49.850538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:49.851335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:50.148134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:50.214976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:50.219640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:50.221336 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2a12408a-e909-4efa-8186-8bb703c6b1ce tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.388671 Jul 24 01:30:50.255099 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2181/4470] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:49 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:50.284647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:50.284870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: ebcfe250-aa9e-452c-b333-93cec9fc8e44] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:50.315672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:50.316563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:50.316936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:50.332530 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:50.525513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:50.542249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:50.544302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a7378d2a7a949ddaa2265cc1c49f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70a645a17fa4e0597bdff92b8011131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:50.545524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2bd8d3c5-d2c3-4b11-8ad8-c46f60787272 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44" status: 200 len: 1362 microversion: 2.47 time: 0.286272 Jul 24 01:30:50.560566 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2182/4471] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:50 2022] GET /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:50.575735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:50.576391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:50.611563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:50.612065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:50.612879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:50.613315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:50.955304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:50.963945 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d1b45a7-5c12-414d-bcbb-321a975ae432 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.402028 Jul 24 01:30:50.964720 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2183/4472] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:50 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:50.987388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:50.988142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:51.012710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:51.013169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:51.017301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:51.017952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:51.434029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:51.448865 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-07162e6c-35e7-4450-b538-688e6daeaaa3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.468902 Jul 24 01:30:51.456039 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2184/4473] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:30:50 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:30:51.475408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:30:51.486435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:51.506846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:51.510569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:51.511929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:51.514291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:51.933005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:51.955685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:51.957992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:30:51.960363 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb4716ec-3e17-426c-9d11-819999f0930c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.488227 Jul 24 01:30:51.963588 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2185/4474] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:30:51 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:30:51.992759 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:30:51.995127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:30:52.064086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:52.065128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:52.066351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:30:52.067039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:30:52.095687 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:52.115633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lazy-loading 'flavor' on Instance uuid 6a1cd906-b406-46dd-bd65-fe0292f7c9de {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:30:54.774414 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:55.011516 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:56.827648 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:57.143464 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=82,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:02.063266 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:02.361727 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:05.563385 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1ad6fc5c-dd47-4153-a1f7-835dfe159e31 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1449 microversion: 2.1 time: 18.327742 Jul 24 01:31:05.571039 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2290/4475] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:47 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1449 bytes in 18337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:05.576066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:05.581810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] [instance: ebcfe250-aa9e-452c-b333-93cec9fc8e44] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:05.593053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:05.597839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:05.598971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:05.599633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:05.629839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] HTTP exception thrown: Instance ebcfe250-aa9e-452c-b333-93cec9fc8e44 could not be found. Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Request method failure captured: Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44 HTTP/1.1 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KCRrb7oTNFM3wdmYY-X08a2OD3abWzrHTPZj3rUPYenCEo_GVCKGfUMzTRrA5ipdkVl9fjnF4nl23bmOVnRBekZdkNiC5mChq1OwMQY_nTN8guBWFUJYPo-ezpafpNCmNLGZ5fHy8VzaCPn_9Cx2HQlz-SuFAZrGVc1KHLOH4MDq1A Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.47 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b70a645a17fa4e0597bdff92b8011131 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerShowV247Test-1967661475 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b70a645a17fa4e0597bdff92b8011131"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b70a645a17fa4e0597bdff92b8011131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b70a645a17fa4e0597bdff92b8011131", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b70a645a17fa4e0597bdff92b8011131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerShowV247Test-1967661475 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b70a645a17fa4e0597bdff92b8011131 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerShowV247Test-1967661475 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerShowV247Test-1967661475-project Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 0a7378d2a7a949ddaa2265cc1c49f6f3 Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerShowV247Test-1967661475-project Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ebcfe250-aa9e-452c-b333-93cec9fc8e44 could not be found. Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ebcfe250-aa9e-452c-b333-93cec9fc8e44'} Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebcfe250-aa9e-452c-b333-93cec9fc8e44 could not be found. Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebcfe250-aa9e-452c-b333-93cec9fc8e44 could not be found. Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:05.633666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:05.637622 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:05.637622 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:05.637622 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:05.637622 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:05.637622 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:05.637622 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebcfe250-aa9e-452c-b333-93cec9fc8e44 could not be found. Jul 24 01:31:05.637622 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:05.643543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] Returning 404 to user: Instance ebcfe250-aa9e-452c-b333-93cec9fc8e44 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:05.647179 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a641adf5-c197-47cc-a70b-af228d95e0e3 tempest-ServerShowV247Test-1967661475 tempest-ServerShowV247Test-1967661475-project] 10.222.0.27 "GET /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44" status: 404 len: 111 microversion: 2.47 time: 0.074870 Jul 24 01:31:05.647969 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2291/4476] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:05 2022] GET /compute/v2.1/servers/ebcfe250-aa9e-452c-b333-93cec9fc8e44 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:31:05.662696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:05.663433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:05.687733 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:05.695282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:05.696489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:05.697153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:06.006533 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-961b2cba-acb3-41e4-9f0b-f41ac83299ba tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 202 len: 0 microversion: 2.1 time: 14.041287 Jul 24 01:31:06.013305 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2186/4477] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:30:51 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 0 bytes in 14048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:31:06.056440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:06.065592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:06.079462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:06.089823 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b5a8f889-c874-4aa9-92b0-7982f03ad2b2 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.437411 Jul 24 01:31:06.092890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2292/4478] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:05 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:06.105763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c1d86e5-b564-48c9-bc42-f0536b9ab169 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9e3d3a0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:06.203589 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c1d86e5-b564-48c9-bc42-f0536b9ab169 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 200 len: 1449 microversion: 2.1 time: 0.109561 Jul 24 01:31:06.204505 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2293/4479] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:06 2022] GET /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 1449 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:06.228336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:06.230388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:06.269102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:06.277063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:06.284466 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:06.287346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:06.580058 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1365529806", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:06.686420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] validate_networks() for [('5b0ed4ca-04a4-47a3-893a-532a219f9041', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:31:06.938306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:06.948252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ed30107-0f0c-41e1-9117-6ed318d08bc5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1511 microversion: 2.1 time: 0.742493 Jul 24 01:31:06.951562 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2294/4480] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:06 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1511 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:06.964025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36672602-d51a-491b-958d-f0aaef7fd717 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05eaac34c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:08.309698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:31:08.310230 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:31:08.310632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:31:08.311619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:31:08.312385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:31:08.346322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:08.349136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:08.350163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:08.351691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:08.414077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Getting quotas for project 4136a7dd7cdb4d84a9ec2aae5a9601d2. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:31:08.431225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Getting quotas for user 1ffc6952f95b4fbc9281bb3557fb5842 and project 4136a7dd7cdb4d84a9ec2aae5a9601d2. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:31:08.477952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:31:08.489962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:31:08.598673 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dc831a29-afca-421a-876d-a98ba3422f43 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.583372 Jul 24 01:31:08.600521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2187/4481] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:31:08.621771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:08.624110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:08.645533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:08.676814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:08.678721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:08.679182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:09.057139 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36672602-d51a-491b-958d-f0aaef7fd717 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 204 len: 0 microversion: 2.1 time: 2.096722 Jul 24 01:31:09.057932 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2295/4482] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:06 2022] DELETE /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 0 bytes in 2099 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:31:09.067142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:09.067788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:09.095740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:09.096208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:09.097021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:09.097547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:09.202985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:09.222427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:09.240525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:09.242672 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ab016d7-9d1f-4bb0-a375-5dbcc430593c tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.637935 Jul 24 01:31:09.249693 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2188/4483] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:08 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:09.292687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa1fe8ae-0085-4748-86b8-5db51087c712 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:09.298238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa1fe8ae-0085-4748-86b8-5db51087c712 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:09.596542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa1fe8ae-0085-4748-86b8-5db51087c712 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:09.604929 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa1fe8ae-0085-4748-86b8-5db51087c712 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1224 microversion: 2.1 time: 0.353682 Jul 24 01:31:09.606593 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2189/4484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:09 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1224 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:09.618495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:09.631856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:09.651136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:09.656644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:09.657643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:09.677038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:09.714839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:09.733424 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f180f036-0a26-424f-ac04-1fe8211fce1c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1511 microversion: 2.1 time: 0.671303 Jul 24 01:31:09.734987 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2296/4485] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:09 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:09.745976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:31:10.002833 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c5bc6093-752d-4eb3-825b-be7920a968f7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 204 len: 0 microversion: 2.1 time: 0.390441 Jul 24 01:31:10.008994 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2190/4486] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:31:09 2022] DELETE /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:31:10.155463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1776932554", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "41157fbf-825e-46bc-9e53-c3a4974eed04"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:10.248870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] validate_networks() for [('41157fbf-825e-46bc-9e53-c3a4974eed04', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:31:10.268327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:10.268998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:10.286750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:10.290398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:10.291818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:10.294284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:10.624557 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:10.636662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:10.643126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:10.654817 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f6d987c-7eb1-475f-851f-2ae5ccc48e62 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.391519 Jul 24 01:31:10.655639 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2191/4487] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:10 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:10.681045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d9593ca4-04e6-4f54-809a-0376c8361935 req-98dbd9a0-1b43-4f1d-8b6f-e71077e43293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d83bd7f-0a9a-4866-967c-0faffbacfc2c", "name": "network-vif-unplugged", "status": "completed", "tag": "48909aad-4d32-4cce-be4f-2bd647d3a01e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:10.691485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d9593ca4-04e6-4f54-809a-0376c8361935 req-98dbd9a0-1b43-4f1d-8b6f-e71077e43293 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:10.692141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d9593ca4-04e6-4f54-809a-0376c8361935 req-98dbd9a0-1b43-4f1d-8b6f-e71077e43293 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:10.710246 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d9593ca4-04e6-4f54-809a-0376c8361935 req-98dbd9a0-1b43-4f1d-8b6f-e71077e43293 service nova] Creating event network-vif-unplugged:48909aad-4d32-4cce-be4f-2bd647d3a01e for instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c on n-h2-master-1 Jul 24 01:31:10.722114 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d9593ca4-04e6-4f54-809a-0376c8361935 req-98dbd9a0-1b43-4f1d-8b6f-e71077e43293 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054399 Jul 24 01:31:10.723451 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2192/4488] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:10.729335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:10.730359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:10.739749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:10.740463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:10.741444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:10.742095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:10.895897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:10.903641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-33322e31-c459-4276-bd66-cfb1eb353ff1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1220 microversion: 2.1 time: 0.178751 Jul 24 01:31:10.905894 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2193/4489] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:10 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:10.916972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:10.917747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:10.928566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:10.934443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:10.935681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:10.937524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:11.424193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:11.432919 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f607493-881e-43fc-a1b9-d40ca6fa20f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1511 microversion: 2.1 time: 0.525573 Jul 24 01:31:11.433732 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2194/4490] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:10 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1511 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:11.471746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:31:11.472223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:31:11.472641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:31:11.473055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:31:11.473472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:31:11.488339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:11.488799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:11.489605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:11.490079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:11.535407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:31:11.542864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Getting quotas for user b0f04ff3b36d4b0686c9a68ff55ee99d and project e39cbca23eba4208a1c160cfb5aef490. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:31:11.587110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:31:11.589835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:31:11.674215 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:11.675456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:11.685599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:11.686092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:11.686890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:11.687336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:11.694246 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4b5a9f6-994e-4d85-a7b5-db595806563f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544346 Jul 24 01:31:11.695098 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2297/4491] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:31:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:31:11.706022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1cb73206-eb2f-41b0-9c45-445cbcda4034 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:11.706673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1cb73206-eb2f-41b0-9c45-445cbcda4034 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:11.908404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1cb73206-eb2f-41b0-9c45-445cbcda4034 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:11.915841 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1cb73206-eb2f-41b0-9c45-445cbcda4034 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1208 microversion: 2.1 time: 0.214601 Jul 24 01:31:11.926189 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2298/4492] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:11 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1208 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:11.940173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:11.941090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:11.966541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:11.969595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:11.971765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:11.973098 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:12.400161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:12.424697 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e759f99e-e988-49d3-afc1-4ceba918aeac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1284 microversion: 2.1 time: 0.497104 Jul 24 01:31:12.426123 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2299/4493] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:11 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1284 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:12.447032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:12.447933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:12.455906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:12.456465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:12.457406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:12.458067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:13.282725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:13.298160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:13.315173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:13.326458 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3116564-27b5-40ed-ac23-357f061d40a1 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 1.651815 Jul 24 01:31:13.327643 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2195/4494] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:11 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:31:13.336190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:13.339856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:13.371391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:13.371945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:13.374300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:13.374835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:14.086113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:14.131385 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7077e4d-5f89-4808-baf1-4fb1a4a7efb5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 1.689976 Jul 24 01:31:14.134313 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2300/4495] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:12 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:14.140203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:14.141148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:14.156177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:14.157055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:14.158148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:14.158848 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:14.456098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:14.469774 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93745427-3eed-46ea-a2fd-6cfa1bcc74cc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1266 microversion: 2.1 time: 0.334026 Jul 24 01:31:14.471761 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2301/4496] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:14 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:14.486788 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:14.495332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:14.503397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:14.509104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e4ab8452-15c7-4314-8f8a-6310ec906091 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1511 microversion: 2.1 time: 1.176890 Jul 24 01:31:14.510344 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2196/4497] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:13 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1511 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:14.528098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:14.528745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:14.532705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:14.540866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:14.542064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:14.542945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:14.550407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:14.550872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:14.551673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:14.561953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:15.507680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:15.519045 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-928a635b-0290-420e-b923-f613897920c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 1.006975 Jul 24 01:31:15.536156 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2197/4498] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:14 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:15.536402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:15.537533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:15.553919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:15.557444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:15.558639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:15.560416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:15.925613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:15.942311 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30871d8f-15fa-4696-b1c0-6fe38833a8c6 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1324 microversion: 2.1 time: 1.466333 Jul 24 01:31:15.943273 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2302/4499] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:14 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1324 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:15.957741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-62690a2b-81c6-4bec-b517-c5d8b0700def req-19431eea-f914-461a-b4c3-9321d8b9bf9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d83bd7f-0a9a-4866-967c-0faffbacfc2c", "name": "network-vif-deleted", "tag": "48909aad-4d32-4cce-be4f-2bd647d3a01e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:15.972605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-62690a2b-81c6-4bec-b517-c5d8b0700def req-19431eea-f914-461a-b4c3-9321d8b9bf9f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:15.975017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-62690a2b-81c6-4bec-b517-c5d8b0700def req-19431eea-f914-461a-b4c3-9321d8b9bf9f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:16.010499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-62690a2b-81c6-4bec-b517-c5d8b0700def req-19431eea-f914-461a-b4c3-9321d8b9bf9f service nova] Creating event network-vif-deleted:48909aad-4d32-4cce-be4f-2bd647d3a01e for instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c on n-h2-master-1 Jul 24 01:31:16.034160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-62690a2b-81c6-4bec-b517-c5d8b0700def req-19431eea-f914-461a-b4c3-9321d8b9bf9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089385 Jul 24 01:31:16.035474 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2303/4500] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:16.049272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:16.050068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:16.073581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:16.073581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:16.079440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:16.083173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:16.145474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:16.250807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:16.257096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:16.263176 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e8bd5127-d768-4595-9bb5-1ba5dd13e7a8 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.733070 Jul 24 01:31:16.267554 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2198/4501] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:15 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:16.304715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:16.305340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:16.313959 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:16.314634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:16.315442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:16.315895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:16.351150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:16.362570 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f936d1d-cfb0-42bf-85e1-efcb141ce059 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1266 microversion: 2.1 time: 0.325881 Jul 24 01:31:16.364559 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2304/4502] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:16 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:16.380267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:16.382152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:16.401332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:16.403258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:16.405015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:16.406586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.002248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:17.017269 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b45108c9-53a4-4584-85d4-73d3919112ac tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1511 microversion: 2.1 time: 0.748212 Jul 24 01:31:17.033376 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2199/4503] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:16 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1511 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:17.038700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d7770f72-542b-40a3-a337-397ddb477b69 req-eb69ad6d-f807-4a28-b4ca-3d4555f8b853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3e0006-7485-440e-9282-2f6f982cc604", "name": "network-vif-plugged", "status": "completed", "tag": "4e29293a-0608-4f8c-903a-03bc61e05c91"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:17.064433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d7770f72-542b-40a3-a337-397ddb477b69 req-eb69ad6d-f807-4a28-b4ca-3d4555f8b853 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.064804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d7770f72-542b-40a3-a337-397ddb477b69 req-eb69ad6d-f807-4a28-b4ca-3d4555f8b853 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.091081 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d7770f72-542b-40a3-a337-397ddb477b69 req-eb69ad6d-f807-4a28-b4ca-3d4555f8b853 service nova] Creating event network-vif-plugged:4e29293a-0608-4f8c-903a-03bc61e05c91 for instance 6e3e0006-7485-440e-9282-2f6f982cc604 on n-h1-master-1 Jul 24 01:31:17.100867 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d7770f72-542b-40a3-a337-397ddb477b69 req-eb69ad6d-f807-4a28-b4ca-3d4555f8b853 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065988 Jul 24 01:31:17.101334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:17.109713 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2200/4504] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:17.126912 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0aba6710-a9ed-45f2-8d6e-3e8b8dc1452b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.756412 Jul 24 01:31:17.127753 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2305/4505] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:16 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:17.136783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:17.137509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:17.148972 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3952f0a-73eb-461d-a1a7-05f662a91d07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1317286245"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:17.150983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e3952f0a-73eb-461d-a1a7-05f662a91d07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:17.177430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.180526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3952f0a-73eb-461d-a1a7-05f662a91d07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.184601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3952f0a-73eb-461d-a1a7-05f662a91d07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.185599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3952f0a-73eb-461d-a1a7-05f662a91d07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.186278 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.187298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3952f0a-73eb-461d-a1a7-05f662a91d07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.187442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.188103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.819454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:17.850330 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d68700e2-73e1-48d9-9813-1551e964f800 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1324 microversion: 2.1 time: 0.737459 Jul 24 01:31:17.852613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2201/4506] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:17 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1324 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:17.863406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-66bd382f-7cc4-4f96-ad46-4e4e3166d9f3 req-04d2670b-5e5e-4f90-87e3-88e55a6e0b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83ad84e-7f36-42f4-89a5-ad2786f991eb", "tag": "7aaf550b-d44f-45ee-aae8-618b13212b66"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:17.886263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-66bd382f-7cc4-4f96-ad46-4e4e3166d9f3 req-04d2670b-5e5e-4f90-87e3-88e55a6e0b45 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.888507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-66bd382f-7cc4-4f96-ad46-4e4e3166d9f3 req-04d2670b-5e5e-4f90-87e3-88e55a6e0b45 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.908139 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e3952f0a-73eb-461d-a1a7-05f662a91d07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.759696 Jul 24 01:31:17.909178 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2306/4507] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:31:17 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 24 01:31:17.918889 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-66bd382f-7cc4-4f96-ad46-4e4e3166d9f3 req-04d2670b-5e5e-4f90-87e3-88e55a6e0b45 service nova] Creating event network-changed:7aaf550b-d44f-45ee-aae8-618b13212b66 for instance a83ad84e-7f36-42f4-89a5-ad2786f991eb on n-h1-master-1 Jul 24 01:31:17.921483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:17.924059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:17.933008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-66bd382f-7cc4-4f96-ad46-4e4e3166d9f3 req-04d2670b-5e5e-4f90-87e3-88e55a6e0b45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079140 Jul 24 01:31:17.934940 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2202/4508] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:17.939488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.940713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.941977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.942749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.946723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:17.947620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:17.958462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.960216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:17.961343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:17.961971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:18.356025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:18.365239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:18.367138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:18.368593 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de9b469b-220b-4457-806d-6754d2485cbf tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 0.458004 Jul 24 01:31:18.380311 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2307/4509] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:17 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:18.382404 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:18.387483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:18.388428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:18.395002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:18.395743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:18.396772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:18.397435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:18.446075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:18.455419 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1ce9875-256c-4ab0-b666-a77b5b3ccceb tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.518521 Jul 24 01:31:18.465812 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2203/4510] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:17 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:18.870052 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:18.870759 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:18.885365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:18.885789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:18.886604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:18.887049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:18.908599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:18.929775 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cb34ca97-ffe9-4da7-ab06-ca9d9cb27ac3 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1532 microversion: 2.1 time: 0.548021 Jul 24 01:31:18.930888 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2308/4511] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:18 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1532 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:19.363118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:19.372218 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7acef29-02c3-4c55-a77f-80d4c33e8582 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1324 microversion: 2.1 time: 0.506087 Jul 24 01:31:19.374126 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2204/4512] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:18 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:19.391968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:19.392690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:19.408174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:19.408636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:19.409457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:19.409933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:19.474713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:19.477173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:19.489480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:19.490227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:19.493489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:19.494180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:19.555506 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:19.609267 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:20.330940 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:20.349918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb17a09e-9a40-4925-8c60-d7aa071b7d66 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.876327 Jul 24 01:31:20.350993 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2205/4513] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:19 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:20.375478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:20.378992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:20.402177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:20.402589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:20.409568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:20.410030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:20.453393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:20.481992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:20.484144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:20.492034 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8fc2ea9-a95e-4daf-8d86-a303f98e1933 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1729 microversion: 2.20 time: 1.102793 Jul 24 01:31:20.496361 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2309/4514] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:19 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1729 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:20.519041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0edf6c22-8fdb-47a6-bae5-f51531c39155 req-0b3ed151-5a28-4130-b0c4-8d646be8dcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0852dbf4-63fa-425c-ac23-ad365e48a816", "tag": "47feb688-97a4-4fb0-a7d1-54bc281fd10b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:20.556738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0edf6c22-8fdb-47a6-bae5-f51531c39155 req-0b3ed151-5a28-4130-b0c4-8d646be8dcd2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:20.560799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0edf6c22-8fdb-47a6-bae5-f51531c39155 req-0b3ed151-5a28-4130-b0c4-8d646be8dcd2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:20.599532 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0edf6c22-8fdb-47a6-bae5-f51531c39155 req-0b3ed151-5a28-4130-b0c4-8d646be8dcd2 service nova] Creating event network-changed:47feb688-97a4-4fb0-a7d1-54bc281fd10b for instance 0852dbf4-63fa-425c-ac23-ad365e48a816 on n-h2-master-1 Jul 24 01:31:20.615514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0edf6c22-8fdb-47a6-bae5-f51531c39155 req-0b3ed151-5a28-4130-b0c4-8d646be8dcd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117455 Jul 24 01:31:20.616133 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2310/4515] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:20.643521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:20.644794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:20.661747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:20.667137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:20.673540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:20.674250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:21.256675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:21.277572 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-256d85a4-b5c5-4f07-9345-8d60d87f13a0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.922159 Jul 24 01:31:21.278362 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2206/4516] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:20 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:21.341127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:21.346106 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:21.353087 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fa935112-1aa9-416c-bbe2-1281f635cce1 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1324 microversion: 2.1 time: 0.733244 Jul 24 01:31:21.363302 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2311/4517] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:20 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1324 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:21.368035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:21.368948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:21.390516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:21.390990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:21.391851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:21.392305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:21.518623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:21.521548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:21.538394 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:21.545260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:21.545931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:21.546871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:21.547459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:21.915268 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:22.050373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:22.078241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:22.079992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:22.098387 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-328d82d9-4d30-4b94-97e3-b4a228d73fdd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1716 microversion: 2.20 time: 0.587200 Jul 24 01:31:22.098994 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2312/4518] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:21 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1716 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:31:22.195187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:22.218869 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ee1503d-6398-461b-9f1c-878194a211d5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.854786 Jul 24 01:31:22.236955 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2207/4519] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:21 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:22.298198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:22.303020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:22.320373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:22.320831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:22.321619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:22.322091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:22.387385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:22.388021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:22.439158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:22.439634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:22.440420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:22.440863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:23.258145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:23.258790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:23.288583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33a2be8f-3585-40a8-b560-b438a41019f2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.995956 Jul 24 01:31:23.289620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4968ee81-7e79-4915-81a2-fabe685f0807 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1324 microversion: 2.1 time: 0.913583 Jul 24 01:31:23.296258 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2313/4520] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:22 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:23.297941 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2208/4521] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:22 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1324 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:23.307707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:23.310544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ba621c87-0ffe-4f22-874a-f45995887bd6 req-af8a064f-8178-4df1-bc4c-e1eac786ba7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1cd906-b406-46dd-bd65-fe0292f7c9de", "name": "network-vif-plugged", "status": "completed", "tag": "aa20a123-c219-46a0-959b-811824ea97c7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:23.319321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:23.344707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ba621c87-0ffe-4f22-874a-f45995887bd6 req-af8a064f-8178-4df1-bc4c-e1eac786ba7e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:23.345643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ba621c87-0ffe-4f22-874a-f45995887bd6 req-af8a064f-8178-4df1-bc4c-e1eac786ba7e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:23.346884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:23.349924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:23.354689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:23.355625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:23.384539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ba621c87-0ffe-4f22-874a-f45995887bd6 req-af8a064f-8178-4df1-bc4c-e1eac786ba7e service nova] Creating event network-vif-plugged:aa20a123-c219-46a0-959b-811824ea97c7 for instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de on n-h1-master-1 Jul 24 01:31:23.402708 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ba621c87-0ffe-4f22-874a-f45995887bd6 req-af8a064f-8178-4df1-bc4c-e1eac786ba7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101708 Jul 24 01:31:23.403849 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2314/4522] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:23.817559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:23.827810 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2bfee34c-e9fa-4899-b01e-f0aececc6e2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.528170 Jul 24 01:31:23.839407 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2209/4523] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:23 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:24.332464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:24.335556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:24.337233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:24.338702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:24.373836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:24.377501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:24.380990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:24.382225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:24.382819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:24.383591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:24.393762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:24.398429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:24.893850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:24.912320 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78dc8a61-6cb0-4571-9c91-7e1fe8b18f5e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.593242 Jul 24 01:31:24.915258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2210/4524] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:24 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:24.923776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:24.927293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:24.942532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:24.945318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:24.948532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:24.949316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:25.027766 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:25.041149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-66e5a473-b94e-470c-9ff0-07a652bf8973 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1324 microversion: 2.1 time: 0.721315 Jul 24 01:31:25.063088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2315/4525] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:24 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1324 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:25.196356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:25.209128 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0bc83421-212c-4b1c-9946-c4e60c7bc597 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.292364 Jul 24 01:31:25.222213 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2211/4526] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:24 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:25.446409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-603e3698-ec87-4a80-be7a-6550dde21cae req-2b81cf8a-210c-415c-bb76-9e7e15fc5448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83ad84e-7f36-42f4-89a5-ad2786f991eb", "name": "network-vif-plugged", "status": "completed", "tag": "7aaf550b-d44f-45ee-aae8-618b13212b66"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:25.478307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-603e3698-ec87-4a80-be7a-6550dde21cae req-2b81cf8a-210c-415c-bb76-9e7e15fc5448 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:25.478770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-603e3698-ec87-4a80-be7a-6550dde21cae req-2b81cf8a-210c-415c-bb76-9e7e15fc5448 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:25.522485 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-603e3698-ec87-4a80-be7a-6550dde21cae req-2b81cf8a-210c-415c-bb76-9e7e15fc5448 service nova] Creating event network-vif-plugged:7aaf550b-d44f-45ee-aae8-618b13212b66 for instance a83ad84e-7f36-42f4-89a5-ad2786f991eb on n-h1-master-1 Jul 24 01:31:25.532167 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-603e3698-ec87-4a80-be7a-6550dde21cae req-2b81cf8a-210c-415c-bb76-9e7e15fc5448 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090356 Jul 24 01:31:25.532788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2316/4527] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:25.932492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:25.933137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:25.949899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:25.950670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:25.952342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:25.954954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:26.058790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:26.059890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:26.070077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:26.075223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:26.084859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:26.085881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:26.568228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:26.582011 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7988ae48-3787-4175-83bd-c12709693d79 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.653079 Jul 24 01:31:26.584236 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2212/4528] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:25 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:26.601952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:26.602916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:26.622798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:26.624492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:26.644408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:26.646067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:26.657959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:26.681802 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29235016-6880-4805-9fd1-155013efb3f9 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1324 microversion: 2.1 time: 0.616165 Jul 24 01:31:26.683262 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2317/4529] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:26 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:26.941432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:26.952513 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad3e0c1a-9e35-428a-b05e-7a8f01551f33 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.364470 Jul 24 01:31:26.953484 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2213/4530] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:26 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:27.582907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fa4ab129-e15d-451e-a609-4a7a6dfbf42f req-a636df80-cc1f-4077-877a-6d52f52053e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-plugged", "status": "completed", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:27.600785 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:27.603117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fa4ab129-e15d-451e-a609-4a7a6dfbf42f req-a636df80-cc1f-4077-877a-6d52f52053e7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:27.604367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:27.605044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fa4ab129-e15d-451e-a609-4a7a6dfbf42f req-a636df80-cc1f-4077-877a-6d52f52053e7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:27.605843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:27.618232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:27.619898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:27.620765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:27.624666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:27.633203 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fa4ab129-e15d-451e-a609-4a7a6dfbf42f req-a636df80-cc1f-4077-877a-6d52f52053e7 service nova] Creating event network-vif-plugged:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:31:27.652284 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fa4ab129-e15d-451e-a609-4a7a6dfbf42f req-a636df80-cc1f-4077-877a-6d52f52053e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073614 Jul 24 01:31:27.656736 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2318/4531] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:27.699834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:27.700671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:27.718969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:27.719459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:27.720295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:27.720751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:28.243807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:28.267386 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a611f13-1098-4bf8-9162-177d2cd2afb5 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.670714 Jul 24 01:31:28.273777 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2214/4532] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:27 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:28.311375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:28.315683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:28.327700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:28.343489 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1519 microversion: 2.1 time: 0.647481 Jul 24 01:31:28.344630 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2319/4533] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:27 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1519 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:28.345862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:28.347187 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-430b020a-06a4-4959-9a64-51401adfcc86 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001299 Jul 24 01:31:28.347942 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2320/4534] 10.222.0.27 () {56 vars in 885 bytes} [Sun Jul 24 01:31:28 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 24 01:31:28.355819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:28.357512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:28.360936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:28.384580 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:28.493941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-174ff92c-4a9b-4f5b-a33f-b71a27d028e2 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-509059622", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-174ff92c-4a9b-4f5b-a33f-b71a27d028e2 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 242 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-509059622", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-509059622', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5b0ed4ca-04a4-47a3-893a-532a219f9041'}]}}} Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:31:28.497111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.501983 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.504646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-174ff92c-4a9b-4f5b-a33f-b71a27d028e2 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:28.507541 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-174ff92c-4a9b-4f5b-a33f-b71a27d028e2 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018211 Jul 24 01:31:28.510800 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2321/4535] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:31:28 2022] POST /compute/v2.1/servers => generated 175 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:31:28.524546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a629b764-fce4-4a47-b196-89c02a5ebe41 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:28.530323 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a629b764-fce4-4a47-b196-89c02a5ebe41 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: ef0e037c-1f60-4daa-8dda-d84e6738bc46] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:28.541422 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a629b764-fce4-4a47-b196-89c02a5ebe41 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] HTTP exception thrown: Instance ef0e037c-1f60-4daa-8dda-d84e6738bc46 could not be found. Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a629b764-fce4-4a47-b196-89c02a5ebe41 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ef0e037c-1f60-4daa-8dda-d84e6738bc46/metadata HTTP/1.1 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ef0e037c-1f60-4daa-8dda-d84e6738bc46 could not be found. Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': 'ef0e037c-1f60-4daa-8dda-d84e6738bc46'} Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0e037c-1f60-4daa-8dda-d84e6738bc46 could not be found. Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0e037c-1f60-4daa-8dda-d84e6738bc46 could not be found. Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.551285 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.555706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:28.555706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:28.555706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0e037c-1f60-4daa-8dda-d84e6738bc46 could not be found. Jul 24 01:31:28.555706 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.556869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a629b764-fce4-4a47-b196-89c02a5ebe41 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 404 to user: Instance ef0e037c-1f60-4daa-8dda-d84e6738bc46 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:28.557978 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a629b764-fce4-4a47-b196-89c02a5ebe41 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/ef0e037c-1f60-4daa-8dda-d84e6738bc46/metadata" status: 404 len: 111 microversion: 2.1 time: 0.038496 Jul 24 01:31:28.559063 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2322/4536] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:31:28 2022] GET /compute/v2.1/servers/ef0e037c-1f60-4daa-8dda-d84e6738bc46/metadata => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:28.703528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93ac0b55-f805-4db9-af68-ff3519b8960c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1829518051", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93ac0b55-f805-4db9-af68-ff3519b8960c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 499 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1829518051", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1829518051', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5b0ed4ca-04a4-47a3-893a-532a219f9041'}]}}} Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 24 01:31:28.707301 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.710773 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.714284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93ac0b55-f805-4db9-af68-ff3519b8960c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:28.715553 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93ac0b55-f805-4db9-af68-ff3519b8960c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.016330 Jul 24 01:31:28.716991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2323/4537] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:31:28 2022] POST /compute/v2.1/servers => generated 687 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:31:28.936383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5423700f-6f8d-482e-9984-c46e803077ac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1008907955", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:28.954921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5423700f-6f8d-482e-9984-c46e803077ac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 500 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1008907955", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1008907955', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5b0ed4ca-04a4-47a3-893a-532a219f9041'}]}}} Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 24 01:31:28.955954 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5423700f-6f8d-482e-9984-c46e803077ac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:28.958916 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5423700f-6f8d-482e-9984-c46e803077ac tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025771 Jul 24 01:31:28.962979 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dbcbb2e4-9728-4261-8be0-44ba39622cb3 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.687358 Jul 24 01:31:28.967658 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2215/4538] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:28 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:28.980530 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2324/4539] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:31:28 2022] POST /compute/v2.1/servers => generated 689 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:31:29.152066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd1701c7-4db8-4eda-8fa8-70f22977148b tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-629651745", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd1701c7-4db8-4eda-8fa8-70f22977148b tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 753 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-629651745", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-629651745', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5b0ed4ca-04a4-47a3-893a-532a219f9041'}]}}} Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:29.157277 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:29.159770 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:29.162066 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.162066 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.163764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd1701c7-4db8-4eda-8fa8-70f22977148b tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:29.166195 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd1701c7-4db8-4eda-8fa8-70f22977148b tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.018312 Jul 24 01:31:29.167907 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2216/4540] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:31:29 2022] POST /compute/v2.1/servers => generated 1197 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 24 01:31:29.254865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a673a7fa-c226-489b-9375-0b6d80c0ac8d tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-952652749", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a673a7fa-c226-489b-9375-0b6d80c0ac8d tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 1265 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-952652749", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5b0ed4ca-04a4-47a3-893a-532a219f9041"}]}} Jul 24 01:31:29.258883 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-952652749', 'imageRef': '9fcc346b-5e09-42b6-9557-a6eb28d96f08', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5b0ed4ca-04a4-47a3-893a-532a219f9041'}]}}} Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.260924 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:29.262090 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:29.264497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 24 01:31:29.264497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.264497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a673a7fa-c226-489b-9375-0b6d80c0ac8d tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:29.264497 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a673a7fa-c226-489b-9375-0b6d80c0ac8d tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013578 Jul 24 01:31:29.273188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb848c73-1b4f-4f23-8d2e-350884389088 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:29.273716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb848c73-1b4f-4f23-8d2e-350884389088 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: 7a5cceb1-f320-493d-8a3d-1665b2fb7d59] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:29.276659 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2325/4541] 10.222.0.27 () {60 vars in 1147 bytes} [Sun Jul 24 01:31:29 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 24 01:31:29.293518 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-cb848c73-1b4f-4f23-8d2e-350884389088 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] HTTP exception thrown: Instance 7a5cceb1-f320-493d-8a3d-1665b2fb7d59 could not be found. Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb848c73-1b4f-4f23-8d2e-350884389088 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/7a5cceb1-f320-493d-8a3d-1665b2fb7d59/metadata/test2 HTTP/1.1 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 7a5cceb1-f320-493d-8a3d-1665b2fb7d59 could not be found. Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': '7a5cceb1-f320-493d-8a3d-1665b2fb7d59', 'id': 'test2'} Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5cceb1-f320-493d-8a3d-1665b2fb7d59 could not be found. Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5cceb1-f320-493d-8a3d-1665b2fb7d59 could not be found. Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:29.295761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:29.299587 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:29.299587 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:29.299587 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5cceb1-f320-493d-8a3d-1665b2fb7d59 could not be found. Jul 24 01:31:29.299587 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:29.299587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb848c73-1b4f-4f23-8d2e-350884389088 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 404 to user: Instance 7a5cceb1-f320-493d-8a3d-1665b2fb7d59 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:29.299587 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb848c73-1b4f-4f23-8d2e-350884389088 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/7a5cceb1-f320-493d-8a3d-1665b2fb7d59/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027989 Jul 24 01:31:29.318518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:29.319222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:29.329194 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2217/4542] 10.222.0.27 () {58 vars in 1280 bytes} [Sun Jul 24 01:31:29 2022] GET /compute/v2.1/servers/7a5cceb1-f320-493d-8a3d-1665b2fb7d59/metadata/test2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:29.342274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:29.342819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:29.346224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:29.346688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:29.350871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:29.351333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:29.383143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:29.383605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:29.384410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:29.384857 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:29.519805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:31:29.769112 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ae15e819-a245-44ab-bd09-753eb9c2527c tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 204 len: 0 microversion: 2.1 time: 0.432479 Jul 24 01:31:29.778421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2218/4543] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:31:29 2022] DELETE /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:31:29.794923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:29.801766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:29.822167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:29.822808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:29.823755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:29.829257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:30.666502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:30.679075 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b06aa43-cd4e-44b9-b32b-234ab6e14cef tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1525 microversion: 2.1 time: 0.889438 Jul 24 01:31:30.690478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2219/4544] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:29 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1525 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:30.699540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:30.701191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:30.726573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:30.727335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:30.728492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:30.738502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:30.938800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:30.948205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8e7b524a-7bfa-4bdc-be78-86e94bced123 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 1.664300 Jul 24 01:31:30.960676 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2326/4545] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:29 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:31.498673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:31.512905 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed98c3cf-49dd-4634-be87-89bc53866dbe tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.815536 Jul 24 01:31:31.523219 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2220/4546] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:30 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:31.709603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:31.710295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:31.729859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:31.732761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:31.740428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:31.741174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:31.968889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:31.969620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:31.990703 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:31.991118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:32.003626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:32.004865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:32.576690 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:31:32.577725 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 01:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb (ip 10.222.0.27) !!! Jul 24 01:31:32.644449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:32.654705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-224df875-2bfe-4396-ba7b-d8b7b20d4bff tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1525 microversion: 2.1 time: 0.950332 Jul 24 01:31:32.659115 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2327/4547] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:31 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1525 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:32.674036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:32.687839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:32.713247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:32.713731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:32.726881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:32.728208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:32.794887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:32.811096 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88a14786-beef-4c8e-a747-268fc2fc1560 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.849246 Jul 24 01:31:32.821550 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2221/4548] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:31 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:33.400793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:33.409998 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-630a287c-f2e7-4e36-b5d4-9f92f6cbf90e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.749379 Jul 24 01:31:33.410597 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2328/4549] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:32 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:33.675480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:33.676734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:33.679794 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:33.694959 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:33.695732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:33.698732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:33.699804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:33.754601 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:33.843169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:33.846059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:33.871593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:33.872530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:33.873734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:33.874431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:34.553301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:34.567775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-873969b1-59e3-4977-817b-f0172c7a09c7 tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1525 microversion: 2.1 time: 0.896219 Jul 24 01:31:34.570756 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2222/4550] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:33 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1525 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:34.582190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4eb0c630-4f9a-4377-bc70-6e71c9bb64ea req-de506f2a-9aa1-4361-b428-d220499a9b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0852dbf4-63fa-425c-ac23-ad365e48a816", "name": "network-vif-plugged", "status": "completed", "tag": "47feb688-97a4-4fb0-a7d1-54bc281fd10b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:34.615564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4eb0c630-4f9a-4377-bc70-6e71c9bb64ea req-de506f2a-9aa1-4361-b428-d220499a9b71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:34.619078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4eb0c630-4f9a-4377-bc70-6e71c9bb64ea req-de506f2a-9aa1-4361-b428-d220499a9b71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:34.652050 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4eb0c630-4f9a-4377-bc70-6e71c9bb64ea req-de506f2a-9aa1-4361-b428-d220499a9b71 service nova] Creating event network-vif-plugged:47feb688-97a4-4fb0-a7d1-54bc281fd10b for instance 0852dbf4-63fa-425c-ac23-ad365e48a816 on n-h2-master-1 Jul 24 01:31:34.673016 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4eb0c630-4f9a-4377-bc70-6e71c9bb64ea req-de506f2a-9aa1-4361-b428-d220499a9b71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098876 Jul 24 01:31:34.676403 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2223/4551] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:34.694910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:34.702119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:34.737959 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:34.738860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:34.740911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:34.742292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:34.867831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:34.877552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e859d61-1ee2-4ca6-b796-2498c0f67362 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 1.039420 Jul 24 01:31:34.883229 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2329/4552] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:33 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:35.066720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c43687ae-8de8-41b4-bc92-fb7834283e1a req-42d10075-5824-435f-a8ed-2423735ca8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83ad84e-7f36-42f4-89a5-ad2786f991eb", "name": "network-vif-deleted", "tag": "7aaf550b-d44f-45ee-aae8-618b13212b66"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:35.099298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c43687ae-8de8-41b4-bc92-fb7834283e1a req-42d10075-5824-435f-a8ed-2423735ca8e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:35.102867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c43687ae-8de8-41b4-bc92-fb7834283e1a req-42d10075-5824-435f-a8ed-2423735ca8e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:35.144963 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c43687ae-8de8-41b4-bc92-fb7834283e1a req-42d10075-5824-435f-a8ed-2423735ca8e5 service nova] Creating event network-vif-deleted:7aaf550b-d44f-45ee-aae8-618b13212b66 for instance a83ad84e-7f36-42f4-89a5-ad2786f991eb on n-h1-master-1 Jul 24 01:31:35.159980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c43687ae-8de8-41b4-bc92-fb7834283e1a req-42d10075-5824-435f-a8ed-2423735ca8e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095977 Jul 24 01:31:35.164462 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2330/4553] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:35.588918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:35.589652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:35.605011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:35.605801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:35.608218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:35.618036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:35.800279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:35.803637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:35.807985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lazy-loading 'fault' on Instance uuid a83ad84e-7f36-42f4-89a5-ad2786f991eb {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:31:35.914509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:35.926262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-befd2c73-02fd-4212-9ee1-ef65d313a106 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 1.246192 Jul 24 01:31:35.939486 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2224/4554] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:34 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:35.953048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:35.953905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:35.969701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:35.986143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:35.987314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:35.993531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ffc6952f95b4fbc9281bb3557fb5842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:35.994609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:36.020529 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5dfceeaa-8813-4832-a9bc-bbc1826094de tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 200 len: 1314 microversion: 2.1 time: 0.436636 Jul 24 01:31:36.030581 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2331/4555] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:35 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:36.492841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:36.505471 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8e82c129-ac1e-4fec-8d25-f2dd3d949db2 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.564606 Jul 24 01:31:36.527119 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2225/4556] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:35 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:36.958740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:36.960048 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:36.984754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:36.987003 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:36.989572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:36.992136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:37.037739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:37.039194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] [instance: a83ad84e-7f36-42f4-89a5-ad2786f991eb] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:37.055760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:37.056488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:37.057596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:37.064363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:37.179407 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] HTTP exception thrown: Instance a83ad84e-7f36-42f4-89a5-ad2786f991eb could not be found. Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Request method failure captured: Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb HTTP/1.1 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KDUCPb21aD4950-MChDtYdi5tImLh94Fd7PF8XyiqfMkv8EfRRPoj3t5NaLAjxufkevIgCktAV6jhbfpsfeCKkSy1_U1e1acnpiIqwWnKogX_kjr8hHKsmdxzqhepkm8BF7paJD-sU6IeLbNYPw_EAPbyumPSx4eR69DrOMLa_Pxg0 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a7dd7cdb4d84a9ec2aae5a9601d2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a7dd7cdb4d84a9ec2aae5a9601d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 4136a7dd7cdb4d84a9ec2aae5a9601d2 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-544338610 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 1ffc6952f95b4fbc9281bb3557fb5842 Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-544338610-project Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: exception: Instance a83ad84e-7f36-42f4-89a5-ad2786f991eb could not be found. Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a83ad84e-7f36-42f4-89a5-ad2786f991eb'} Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83ad84e-7f36-42f4-89a5-ad2786f991eb could not be found. Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83ad84e-7f36-42f4-89a5-ad2786f991eb could not be found. Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:37.198958 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83ad84e-7f36-42f4-89a5-ad2786f991eb could not be found. Jul 24 01:31:37.206305 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:37.206986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] Returning 404 to user: Instance a83ad84e-7f36-42f4-89a5-ad2786f991eb could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:37.211404 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d4ba0607-60a6-4591-a3ac-9c5d982546fe tempest-ServerMetadataNegativeTestJSON-544338610 tempest-ServerMetadataNegativeTestJSON-544338610-project] 10.222.0.27 "GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb" status: 404 len: 111 microversion: 2.1 time: 0.174546 Jul 24 01:31:37.212028 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2226/4557] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:37 2022] GET /compute/v2.1/servers/a83ad84e-7f36-42f4-89a5-ad2786f991eb => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:37.474686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:37.489497 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc071ec4-77fc-433a-bc60-d92e069ceea7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1308 microversion: 2.1 time: 0.536394 Jul 24 01:31:37.490791 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2332/4558] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:36 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:37.535152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:37.535813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:37.550589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:37.551651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:37.552990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:37.555399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:37.844061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:37.859967 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94f6ea69-505e-49b3-a35d-45778f211381 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.328993 Jul 24 01:31:37.861311 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2227/4559] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:37 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:38.507326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:38.508916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:38.526229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:38.530027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:38.532988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:38.539758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:38.862902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:38.871271 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1067ddde-5010-4a2a-b06d-fc541fa85fc5 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1488 microversion: 2.1 time: 0.368045 Jul 24 01:31:38.871876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2333/4560] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:38 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1488 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:38.879128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:38.879806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:38.895238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:38.895711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:38.896727 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:38.897234 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:38.900666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a289b38-5bba-4b90-9262-9a75aab9700e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1499643672"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:38.901992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a289b38-5bba-4b90-9262-9a75aab9700e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:38.914523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a289b38-5bba-4b90-9262-9a75aab9700e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:38.914985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a289b38-5bba-4b90-9262-9a75aab9700e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:38.915788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a289b38-5bba-4b90-9262-9a75aab9700e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:38.920916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a289b38-5bba-4b90-9262-9a75aab9700e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:39.230927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:39.254046 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd0e4546-5f74-4c28-ad6d-0d71c6103f60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.377306 Jul 24 01:31:39.255738 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2228/4561] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:38 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:40.272680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:40.273542 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:40.288798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:40.292419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:40.293476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:40.295819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:41.726482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:41.750008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76f75746-d9b4-48b0-846f-2618f333d44d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 1.478929 Jul 24 01:31:41.753008 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2229/4562] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:40 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:42.770694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:42.771364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:42.793479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:42.796528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:42.797785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:42.798578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:43.554210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:43.582538 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43c1357c-49d8-42c3-a50b-c8d2024c6b2b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1527 microversion: 2.1 time: 0.817538 Jul 24 01:31:43.588893 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2230/4563] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:42 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1527 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:44.008765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a289b38-5bba-4b90-9262-9a75aab9700e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "POST /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816/action" status: 202 len: 0 microversion: 2.1 time: 5.116180 Jul 24 01:31:44.017925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2334/4564] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:31:38 2022] POST /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816/action => generated 0 bytes in 5132 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:31:44.039712 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a757ff16-6022-42dd-a494-b3390d64fd46 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea18c940>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:44.185115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a757ff16-6022-42dd-a494-b3390d64fd46 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249" status: 200 len: 1414 microversion: 2.1 time: 0.160734 Jul 24 01:31:44.186206 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2231/4565] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:44 2022] GET /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249 => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:44.199381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dd072a6c-5f52-46d9-8579-a9cd4c1bee73 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9ffa790>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:44.283018 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dd072a6c-5f52-46d9-8579-a9cd4c1bee73 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249" status: 200 len: 1414 microversion: 2.1 time: 0.087445 Jul 24 01:31:44.283018 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2335/4566] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:44 2022] GET /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:44.293561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec2719b4-2334-4d83-b032-afc21e3406d7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1a8af0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:44.574314 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec2719b4-2334-4d83-b032-afc21e3406d7 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249" status: 204 len: 0 microversion: 2.1 time: 0.284352 Jul 24 01:31:44.574738 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2232/4567] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:44 2022] DELETE /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:31:44.584565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6aaccea3-4ffd-4fbb-8904-a78bca9aeab6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1a84c0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:44.635009 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-6aaccea3-4ffd-4fbb-8904-a78bca9aeab6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Image not found. Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6aaccea3-4ffd-4fbb-8904-a78bca9aeab6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249 HTTP/1.1 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6e79db8a-f570-4b3a-b59f-432ae893d249'} Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6e79db8a-f570-4b3a-b59f-432ae893d249 Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 24 01:31:44.646583 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e79db8a-f570-4b3a-b59f-432ae893d249 could not be found. Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6aaccea3-4ffd-4fbb-8904-a78bca9aeab6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:44.654764 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6aaccea3-4ffd-4fbb-8904-a78bca9aeab6 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249" status: 404 len: 62 microversion: 2.1 time: 0.072992 Jul 24 01:31:44.663228 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2233/4568] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:44 2022] GET /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:31:44.670270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:44.674388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:44.684618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ef37104-1b0f-4386-a126-903365b42ae0 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Action: 'create', calling method: .version_select at 0x7f05e9dc7430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1085854323", "metadata": {"Type": "work"}}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:44.689502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:44.690216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:44.691376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:44.691990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ef37104-1b0f-4386-a126-903365b42ae0 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Request method failure captured: Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 122 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KEA3BjFxXxeMPO9yjwNJ6hKlGkDGqYMRbkKZbzPgJJwIt3uxEDUJRY3rkC0C7faJQ2g2S6bnDy1fZd1BkzSXPDxANNFciJ1ZTXysoHdgvg_UbcFXZUk7CHxmP9IZZhn2dQEGI74sL6I16TcGwiPK8Qq9vUfMpCSOwoSEWYK6HFl9XA Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaae260f909c45f3a04e415f5cbaf051", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 15010e45f00444a4a53de55b947b9572 Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1085854323", "metadata": {"Type": "work"}}} Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1085854323', 'metadata': {'Type': 'work'}}}} Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi '#$%' Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:44.698347 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ef37104-1b0f-4386-a126-903365b42ae0 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:44.703510 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ef37104-1b0f-4386-a126-903365b42ae0 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.317621 Jul 24 01:31:44.717600 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2336/4569] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:31:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:31:44.734330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:44.735079 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:44.783299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:44.783777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:44.789145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:44.789869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:44.924049 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:45.000993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:45.009805 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9929bfcf-25bb-4baa-b4c5-d4a090e56a14 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1509 microversion: 2.1 time: 0.350374 Jul 24 01:31:45.013341 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2234/4570] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:44 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:45.024156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b92bd57b-83ad-4920-bbe6-0d371acd2c67 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Action: 'create', calling method: .version_select at 0x7f05ea232670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-173233032", "metadata": {"Type": "work"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b92bd57b-83ad-4920-bbe6-0d371acd2c67 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Request method failure captured: Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 119 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEA3BjFxXxeMPO9yjwNJ6hKlGkDGqYMRbkKZbzPgJJwIt3uxEDUJRY3rkC0C7faJQ2g2S6bnDy1fZd1BkzSXPDxANNFciJ1ZTXysoHdgvg_UbcFXZUk7CHxmP9IZZhn2dQEGI74sL6I16TcGwiPK8Qq9vUfMpCSOwoSEWYK6HFl9XA Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaae260f909c45f3a04e415f5cbaf051", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 15010e45f00444a4a53de55b947b9572 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-173233032", "metadata": {"Type": "work"}}} Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-173233032', 'metadata': {'Type': 'work'}}}} Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi '0' Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:45.033254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 24 01:31:45.037828 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.045079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b92bd57b-83ad-4920-bbe6-0d371acd2c67 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:45.047039 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b92bd57b-83ad-4920-bbe6-0d371acd2c67 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031109 Jul 24 01:31:45.048619 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2235/4571] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:31:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:31:45.059950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1fff867-6562-4204-91b8-2ae43c7b002d tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Action: 'create', calling method: .version_select at 0x7f05ea1a8280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-271174662", "metadata": {"Type": "work"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1fff867-6562-4204-91b8-2ae43c7b002d tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Request method failure captured: Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 118 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEA3BjFxXxeMPO9yjwNJ6hKlGkDGqYMRbkKZbzPgJJwIt3uxEDUJRY3rkC0C7faJQ2g2S6bnDy1fZd1BkzSXPDxANNFciJ1ZTXysoHdgvg_UbcFXZUk7CHxmP9IZZhn2dQEGI74sL6I16TcGwiPK8Qq9vUfMpCSOwoSEWYK6HFl9XA Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaae260f909c45f3a04e415f5cbaf051", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 15010e45f00444a4a53de55b947b9572 Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-271174662", "metadata": {"Type": "work"}}} Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-271174662', 'metadata': {'Type': 'work'}}}} Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi '' Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:31:45.065905 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 24 01:31:45.069858 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.074753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d1fff867-6562-4204-91b8-2ae43c7b002d tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:45.078758 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d1fff867-6562-4204-91b8-2ae43c7b002d tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024472 Jul 24 01:31:45.081797 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2236/4572] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:31:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:31:45.096041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a111b5a8-3409-4845-babc-561294e19ead tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Calling method '.version_select at 0x7f05ea1a8550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:45.149150 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a111b5a8-3409-4845-babc-561294e19ead tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] HTTP exception thrown: Volume tempest-invalid-1753174218 could not be found. Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a111b5a8-3409-4845-babc-561294e19ead tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Request method failure captured: Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1753174218 HTTP/1.1 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEA3BjFxXxeMPO9yjwNJ6hKlGkDGqYMRbkKZbzPgJJwIt3uxEDUJRY3rkC0C7faJQ2g2S6bnDy1fZd1BkzSXPDxANNFciJ1ZTXysoHdgvg_UbcFXZUk7CHxmP9IZZhn2dQEGI74sL6I16TcGwiPK8Qq9vUfMpCSOwoSEWYK6HFl9XA Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaae260f909c45f3a04e415f5cbaf051", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 15010e45f00444a4a53de55b947b9572 Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: exception: Volume tempest-invalid-1753174218 could not be found. Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'tempest-invalid-1753174218'} Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1753174218 could not be found. (HTTP 404) (Request-ID: req-6a1a7882-b20d-46bc-b3fd-c885cd1ec7d0) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:31:45.158868 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1753174218 could not be found. Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1753174218 could not be found. Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1753174218 could not be found. Jul 24 01:31:45.163968 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.170411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a111b5a8-3409-4845-babc-561294e19ead tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Returning 404 to user: Volume tempest-invalid-1753174218 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:45.171706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a111b5a8-3409-4845-babc-561294e19ead tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1753174218" status: 404 len: 99 microversion: 2.1 time: 0.082563 Jul 24 01:31:45.171706 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2237/4573] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:31:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1753174218 => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:31:45.191743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d53b8bdf-885d-4311-9c46-871b42e0d916 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009868 Jul 24 01:31:45.194260 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2238/4574] 10.222.0.27 () {58 vars in 1139 bytes} [Sun Jul 24 01:31:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 24 01:31:45.208073 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9904a0f7-7423-41cb-84c4-a2da1e810309 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008371 Jul 24 01:31:45.210268 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2239/4575] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:31:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 24 01:31:45.223625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09c447c0-b47f-4fb4-8310-1cf9a54c25a9 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Calling method '.version_select at 0x7f05ea1003a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:45.266940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:45.276538 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4eb2614f-beb3-4aff-9d47-4f6d6373cc2d tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1500 microversion: 2.1 time: 0.546540 Jul 24 01:31:45.286592 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2337/4576] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:44 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1500 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:45.294561 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-09c447c0-b47f-4fb4-8310-1cf9a54c25a9 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] HTTP exception thrown: Volume 0a77e752-eae0-4c64-9707-a23f41b742e3 could not be found. Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09c447c0-b47f-4fb4-8310-1cf9a54c25a9 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Request method failure captured: Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/os-volumes/0a77e752-eae0-4c64-9707-a23f41b742e3 HTTP/1.1 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEA3BjFxXxeMPO9yjwNJ6hKlGkDGqYMRbkKZbzPgJJwIt3uxEDUJRY3rkC0C7faJQ2g2S6bnDy1fZd1BkzSXPDxANNFciJ1ZTXysoHdgvg_UbcFXZUk7CHxmP9IZZhn2dQEGI74sL6I16TcGwiPK8Qq9vUfMpCSOwoSEWYK6HFl9XA Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaae260f909c45f3a04e415f5cbaf051", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 15010e45f00444a4a53de55b947b9572 Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: exception: Volume 0a77e752-eae0-4c64-9707-a23f41b742e3 could not be found. Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '0a77e752-eae0-4c64-9707-a23f41b742e3'} Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a77e752-eae0-4c64-9707-a23f41b742e3 could not be found. (HTTP 404) (Request-ID: req-d2c8fe3c-bd2c-48a6-89ec-a57b1454a1eb) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:31:45.297041 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a77e752-eae0-4c64-9707-a23f41b742e3 could not be found. Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a77e752-eae0-4c64-9707-a23f41b742e3 could not be found. Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a77e752-eae0-4c64-9707-a23f41b742e3 could not be found. Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09c447c0-b47f-4fb4-8310-1cf9a54c25a9 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Returning 404 to user: Volume 0a77e752-eae0-4c64-9707-a23f41b742e3 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09c447c0-b47f-4fb4-8310-1cf9a54c25a9 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/0a77e752-eae0-4c64-9707-a23f41b742e3" status: 404 len: 109 microversion: 2.1 time: 0.080289 Jul 24 01:31:45.304919 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2240/4577] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:31:45 2022] DELETE /compute/v2.1/os-volumes/0a77e752-eae0-4c64-9707-a23f41b742e3 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:31:45.312230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6a33dd8-c673-4f6f-8024-57a2756f0e93 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Calling method '.version_select at 0x7f05eae55a60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:45.361401 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c6a33dd8-c673-4f6f-8024-57a2756f0e93 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] HTTP exception thrown: Volume 8828bb6d-6a1b-4cfd-8369-83526736aa10 could not be found. Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6a33dd8-c673-4f6f-8024-57a2756f0e93 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Request method failure captured: Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-volumes/8828bb6d-6a1b-4cfd-8369-83526736aa10 HTTP/1.1 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KEA3BjFxXxeMPO9yjwNJ6hKlGkDGqYMRbkKZbzPgJJwIt3uxEDUJRY3rkC0C7faJQ2g2S6bnDy1fZd1BkzSXPDxANNFciJ1ZTXysoHdgvg_UbcFXZUk7CHxmP9IZZhn2dQEGI74sL6I16TcGwiPK8Qq9vUfMpCSOwoSEWYK6HFl9XA Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaae260f909c45f3a04e415f5cbaf051", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaae260f909c45f3a04e415f5cbaf051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: eaae260f909c45f3a04e415f5cbaf051 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesNegativeTest-873470064 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 15010e45f00444a4a53de55b947b9572 Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesNegativeTest-873470064-project Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: exception: Volume 8828bb6d-6a1b-4cfd-8369-83526736aa10 could not be found. Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8828bb6d-6a1b-4cfd-8369-83526736aa10'} Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8828bb6d-6a1b-4cfd-8369-83526736aa10 could not be found. (HTTP 404) (Request-ID: req-1e624b01-b125-44cb-82a3-3945d8bae506) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:31:45.364222 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8828bb6d-6a1b-4cfd-8369-83526736aa10 could not be found. Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8828bb6d-6a1b-4cfd-8369-83526736aa10 could not be found. Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8828bb6d-6a1b-4cfd-8369-83526736aa10 could not be found. Jul 24 01:31:45.368085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:45.377920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6a33dd8-c673-4f6f-8024-57a2756f0e93 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] Returning 404 to user: Volume 8828bb6d-6a1b-4cfd-8369-83526736aa10 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:45.379129 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6a33dd8-c673-4f6f-8024-57a2756f0e93 tempest-VolumesNegativeTest-873470064 tempest-VolumesNegativeTest-873470064-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8828bb6d-6a1b-4cfd-8369-83526736aa10" status: 404 len: 109 microversion: 2.1 time: 0.074305 Jul 24 01:31:45.380415 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2338/4578] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:31:45 2022] GET /compute/v2.1/os-volumes/8828bb6d-6a1b-4cfd-8369-83526736aa10 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:46.028931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:46.029553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:46.037968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:46.038427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:46.044540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:46.045202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:46.297062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:46.299559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:46.311752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:46.318140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:46.319005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:46.319902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:46.322735 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:46.338231 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e14cdf88-9503-4dea-a50c-aec39cba247e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1509 microversion: 2.1 time: 0.312854 Jul 24 01:31:46.354059 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2241/4579] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:46 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:46.715424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:46.790895 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-623bbcef-36fe-4261-9a30-8ced2c0a487e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1506 microversion: 2.1 time: 0.500177 Jul 24 01:31:46.791507 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2339/4580] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:46 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:47.365615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:47.367563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:47.392560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:47.392728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:47.394758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:47.396839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:47.807008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:47.813083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:47.813738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:47.829038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:47.829496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:47.830327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:47.830747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:47.832957 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-991c5348-0823-43b0-8664-1b3c9649f976 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1509 microversion: 2.1 time: 0.471018 Jul 24 01:31:47.833814 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2242/4581] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:47 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:48.190027 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-105b9ca5-d0f4-46fd-9d89-2bc3cb07e53b req-96229dbd-a1bc-4d83-ae28-9634f2bd4511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1cd906-b406-46dd-bd65-fe0292f7c9de", "name": "network-vif-unplugged", "status": "completed", "tag": "aa20a123-c219-46a0-959b-811824ea97c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:48.207073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-105b9ca5-d0f4-46fd-9d89-2bc3cb07e53b req-96229dbd-a1bc-4d83-ae28-9634f2bd4511 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:48.207844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-105b9ca5-d0f4-46fd-9d89-2bc3cb07e53b req-96229dbd-a1bc-4d83-ae28-9634f2bd4511 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:48.240678 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-105b9ca5-d0f4-46fd-9d89-2bc3cb07e53b req-96229dbd-a1bc-4d83-ae28-9634f2bd4511 service nova] Creating event network-vif-unplugged:aa20a123-c219-46a0-959b-811824ea97c7 for instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de on n-h1-master-1 Jul 24 01:31:48.264590 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-105b9ca5-d0f4-46fd-9d89-2bc3cb07e53b req-96229dbd-a1bc-4d83-ae28-9634f2bd4511 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078898 Jul 24 01:31:48.264913 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2243/4582] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:48.800427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:48.809838 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68ac7c5d-c9b9-43c3-bb4d-260a02a25dca tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1506 microversion: 2.1 time: 1.003408 Jul 24 01:31:48.820901 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2340/4583] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:47 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1506 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:48.854487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:48.855869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:48.874156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:48.878084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:48.882098 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:48.882562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:49.349790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:49.367175 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-617c6b71-1ead-43ac-89de-502978de945f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1452 microversion: 2.1 time: 0.519230 Jul 24 01:31:49.369620 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2244/4584] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:48 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1452 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:49.386383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:49.386988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:49.397627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:49.398391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:49.399338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:49.399928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:49.830486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:49.844944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:49.845573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:49.860916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:49.862104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:49.862723 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8bb8c91f-2be1-472d-9c86-cd7f62618c84 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1452 microversion: 2.1 time: 0.479657 Jul 24 01:31:49.863297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:49.864079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:49.864500 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2341/4585] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:49 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1452 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:50.021347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:50.021930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:50.042745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.043206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.044304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.044751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.146451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lazy-loading 'flavor' on Instance uuid 6a1cd906-b406-46dd-bd65-fe0292f7c9de {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:31:50.171658 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Cannot 'shelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state shelved_offloaded Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action HTTP/1.1 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 14 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: {"shelve": {}} Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: exception: Cannot 'shelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state shelved_offloaded Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'shelve': {}}} Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 24 01:31:50.179111 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state shelved_offloaded Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state shelved_offloaded Jul 24 01:31:50.184569 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:50.190063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 409 to user: Cannot 'shelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state shelved_offloaded {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:50.191842 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-479af757-c201-4708-b5ed-e3b425d9dc9c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 409 len: 155 microversion: 2.1 time: 0.180714 Jul 24 01:31:50.209781 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2342/4586] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:31:50 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 155 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:31:50.221907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2aaf317c-00c9-43d8-947f-ab056b095115 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:50.222872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2aaf317c-00c9-43d8-947f-ab056b095115 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:50.239772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aaf317c-00c9-43d8-947f-ab056b095115 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.240229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aaf317c-00c9-43d8-947f-ab056b095115 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.241280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aaf317c-00c9-43d8-947f-ab056b095115 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.242096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2aaf317c-00c9-43d8-947f-ab056b095115 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.412865 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2aaf317c-00c9-43d8-947f-ab056b095115 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 202 len: 0 microversion: 2.1 time: 0.199231 Jul 24 01:31:50.415841 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2343/4587] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:31:50 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:31:50.438120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:50.439168 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:50.449094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:50.462583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.462807 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eacf360f-ca69-4289-853a-b4191f96531a tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1506 microversion: 2.1 time: 0.621889 Jul 24 01:31:50.465087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2245/4588] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:49 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:50.467123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.469845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.470301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.613946 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:50.614568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:50.626194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.626656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.629427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:50.631998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:50.870688 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:50.882371 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45bc78ac-1b11-43b0-aa4c-104f5bbb60f6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1460 microversion: 2.1 time: 0.460582 Jul 24 01:31:50.896480 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2344/4589] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:50 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1460 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:51.021540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:51.036019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa59bf56-8343-41ce-a456-93c55616fe4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.426400 Jul 24 01:31:51.039978 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2246/4590] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:50 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:51.062438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-dc9e7a8a-97f4-4ac9-9ecc-c06224bfa52e req-3de42734-c651-4307-b173-b2cf8d4b684f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0852dbf4-63fa-425c-ac23-ad365e48a816", "name": "network-vif-plugged", "status": "completed", "tag": "47feb688-97a4-4fb0-a7d1-54bc281fd10b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:51.083784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dc9e7a8a-97f4-4ac9-9ecc-c06224bfa52e req-3de42734-c651-4307-b173-b2cf8d4b684f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:51.084487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dc9e7a8a-97f4-4ac9-9ecc-c06224bfa52e req-3de42734-c651-4307-b173-b2cf8d4b684f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:51.106971 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-dc9e7a8a-97f4-4ac9-9ecc-c06224bfa52e req-3de42734-c651-4307-b173-b2cf8d4b684f service nova] Creating event network-vif-plugged:47feb688-97a4-4fb0-a7d1-54bc281fd10b for instance 0852dbf4-63fa-425c-ac23-ad365e48a816 on n-h2-master-1 Jul 24 01:31:51.112567 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-dc9e7a8a-97f4-4ac9-9ecc-c06224bfa52e req-3de42734-c651-4307-b173-b2cf8d4b684f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060987 Jul 24 01:31:51.113809 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2345/4591] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:51.483594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:51.485295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:51.493522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:51.494923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:51.495814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:51.496356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:51.774488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:51.785128 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aecf3194-1d02-41e2-b76b-919cd79c45d0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1488 microversion: 2.1 time: 0.307873 Jul 24 01:31:51.789710 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2247/4592] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:51 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1488 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:51.803742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:51.804376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:51.819822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:51.820370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:51.821262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:51.821726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:51.894486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:31:51.912572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:51.913205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:51.927179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:51.927641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:51.928443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:51.928885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:52.166674 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-480519a5-3267-4f71-a101-110e57a36cc4 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 204 len: 0 microversion: 2.1 time: 0.368106 Jul 24 01:31:52.171745 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2346/4593] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:31:51 2022] DELETE /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:31:52.193545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:52.194328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:52.220732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:52.222823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:52.232531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:52.233354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:52.538361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:52.548518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-48ac6cd3-4f59-4f7d-9080-b0df9ba4b946 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.374836 Jul 24 01:31:52.562685 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2347/4594] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:52 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:52.567901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-864c1504-ebdd-4c16-97ab-f8c9e7eb9033 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05e9d13670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:52.609374 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-864c1504-ebdd-4c16-97ab-f8c9e7eb9033 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Image not found. Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-864c1504-ebdd-4c16-97ab-f8c9e7eb9033 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249 HTTP/1.1 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: exception: Image not found. Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6e79db8a-f570-4b3a-b59f-432ae893d249'} Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6e79db8a-f570-4b3a-b59f-432ae893d249 to delete Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e79db8a-f570-4b3a-b59f-432ae893d249 could not be found. Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:52.611540 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:31:52.616627 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:52.619534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-864c1504-ebdd-4c16-97ab-f8c9e7eb9033 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Image not found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:52.620605 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-864c1504-ebdd-4c16-97ab-f8c9e7eb9033 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249" status: 404 len: 62 microversion: 2.1 time: 0.056600 Jul 24 01:31:52.622395 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2348/4595] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:52 2022] DELETE /compute/v2.1/images/6e79db8a-f570-4b3a-b59f-432ae893d249 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:31:52.624354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-864c1504-ebdd-4c16-97ab-f8c9e7eb9033 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:52.625571 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-864c1504-ebdd-4c16-97ab-f8c9e7eb9033 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001362 Jul 24 01:31:52.632262 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2349/4596] 10.222.0.27 () {56 vars in 885 bytes} [Sun Jul 24 01:31:52 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 24 01:31:52.641579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd3432b2-716a-4c81-b967-b1b1238d5003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1274443915"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:52.642916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd3432b2-716a-4c81-b967-b1b1238d5003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:52.651242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd3432b2-716a-4c81-b967-b1b1238d5003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:52.652040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd3432b2-716a-4c81-b967-b1b1238d5003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:52.653614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd3432b2-716a-4c81-b967-b1b1238d5003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:52.654235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd3432b2-716a-4c81-b967-b1b1238d5003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:53.091305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:53.105732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf711226-07d0-4e65-b7db-62aed2e2bb29 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1460 microversion: 2.1 time: 1.197088 Jul 24 01:31:53.108425 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2248/4597] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:51 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1460 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:53.114875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:53.115604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:53.123922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:53.124738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:53.126045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:53.126707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:53.132728 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd3432b2-716a-4c81-b967-b1b1238d5003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.500974 Jul 24 01:31:53.132728 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2350/4598] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:31:52 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 24 01:31:53.194404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:31:53.235208 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:53.289015 n-d-master-1 devstack@n-api.service[119562]: INFO nova.compute.api [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Instance is already in deleting state, ignoring this request Jul 24 01:31:53.290650 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e9d69766-1fb3-4beb-a721-00799b751e81 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 204 len: 0 microversion: 2.1 time: 0.180314 Jul 24 01:31:53.291884 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2249/4599] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:31:53 2022] DELETE /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:31:53.302258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:53.303339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:53.322438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:53.326738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:53.330261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:53.330845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:53.583567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:53.597010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5d6a9fc5-de2d-4e26-9b41-c4e9e6ef81cd tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1494 microversion: 2.1 time: 0.300970 Jul 24 01:31:53.598362 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2351/4600] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:53 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1494 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:54.129441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:54.130202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:54.142244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.143338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.144306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.145182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.456129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:54.474234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80d75e44-c385-4b7f-b5b5-8005c7526fdc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.352236 Jul 24 01:31:54.474832 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2250/4601] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:54 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:54.555626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e7f16c1-f686-4807-9282-d14d706d8b2d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:54.557006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e7f16c1-f686-4807-9282-d14d706d8b2d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:54.567895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e7f16c1-f686-4807-9282-d14d706d8b2d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.568671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e7f16c1-f686-4807-9282-d14d706d8b2d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.569461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e7f16c1-f686-4807-9282-d14d706d8b2d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.569924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e7f16c1-f686-4807-9282-d14d706d8b2d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.615673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:54.616323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:54.626966 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e7f16c1-f686-4807-9282-d14d706d8b2d tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076315 Jul 24 01:31:54.628341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.628706 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2352/4602] 10.222.0.27 () {60 vars in 1342 bytes} [Sun Jul 24 01:31:54 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:54.628828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.629724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.630189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.738579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:54.739648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:54.752662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.753115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.756888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:54.757409 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:54.817517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:31:54.824438 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:54.999287 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-953df474-d830-485d-baff-7764d5c660b5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 204 len: 0 microversion: 2.20 time: 0.264578 Jul 24 01:31:55.000222 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2353/4603] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:31:54 2022] DELETE /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:31:55.013479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:55.016613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:55.021405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:55.033370 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de9670d4-7182-44ba-9a96-9c0770ee29a0 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1494 microversion: 2.1 time: 0.418192 Jul 24 01:31:55.035175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2251/4604] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:54 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1494 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:55.048669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:55.049374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:55.050694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:55.051774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:55.098872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c177e563-a183-4755-a40f-6a4ed68dd5fd req-60b994a0-83c8-48d3-b9fa-5b34b2e08778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-unplugged", "status": "completed", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:55.116549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c177e563-a183-4755-a40f-6a4ed68dd5fd req-60b994a0-83c8-48d3-b9fa-5b34b2e08778 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:55.119663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c177e563-a183-4755-a40f-6a4ed68dd5fd req-60b994a0-83c8-48d3-b9fa-5b34b2e08778 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:55.146242 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c177e563-a183-4755-a40f-6a4ed68dd5fd req-60b994a0-83c8-48d3-b9fa-5b34b2e08778 service nova] Creating event network-vif-unplugged:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:31:55.176377 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c177e563-a183-4755-a40f-6a4ed68dd5fd req-60b994a0-83c8-48d3-b9fa-5b34b2e08778 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081628 Jul 24 01:31:55.178920 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2252/4605] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:31:55.494312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:55.495551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:55.515324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:55.521892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:55.524363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:55.526986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:55.527302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:55.547365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:55.560247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:55.582196 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d8ce2962-07d4-436b-b9ac-9509f11903ab tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.574102 Jul 24 01:31:55.584860 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2354/4606] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:55 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:31:55.607139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e2b23e66-8d4f-4428-a440-18cbfe838b11 req-7f5e11eb-33c3-44b0-a815-dcb7b7ae2ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0852dbf4-63fa-425c-ac23-ad365e48a816", "name": "network-vif-deleted", "tag": "47feb688-97a4-4fb0-a7d1-54bc281fd10b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:31:55.659982 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e2b23e66-8d4f-4428-a440-18cbfe838b11 req-7f5e11eb-33c3-44b0-a815-dcb7b7ae2ac5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:55.661039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e2b23e66-8d4f-4428-a440-18cbfe838b11 req-7f5e11eb-33c3-44b0-a815-dcb7b7ae2ac5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:55.686945 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e2b23e66-8d4f-4428-a440-18cbfe838b11 req-7f5e11eb-33c3-44b0-a815-dcb7b7ae2ac5 service nova] Creating event network-vif-deleted:47feb688-97a4-4fb0-a7d1-54bc281fd10b for instance 0852dbf4-63fa-425c-ac23-ad365e48a816 on n-h2-master-1 Jul 24 01:31:55.693997 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e2b23e66-8d4f-4428-a440-18cbfe838b11 req-7f5e11eb-33c3-44b0-a815-dcb7b7ae2ac5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107096 Jul 24 01:31:55.700789 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2355/4607] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:31:55.983204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:56.007133 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ac5332c-6a48-433e-a7af-95134c3d5b6b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.517751 Jul 24 01:31:56.011330 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2253/4608] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:55 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:56.052785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:56.053508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:56.067972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:56.071133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:56.078774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:56.081137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:56.225037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:56.227699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:56.238842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lazy-loading 'fault' on Instance uuid 0852dbf4-63fa-425c-ac23-ad365e48a816 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:31:56.360325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f04ff3b36d4b0686c9a68ff55ee99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39cbca23eba4208a1c160cfb5aef490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:56.378026 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca1720af-a5db-406c-92c1-225632828789 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 200 len: 1298 microversion: 2.1 time: 0.330553 Jul 24 01:31:56.380474 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2356/4609] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:56 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 1298 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:31:56.607116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:56.608472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:56.626930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:56.627997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:56.630344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:56.633350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.017083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:57.033155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.033828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:57.046330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:57.055945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:57.056307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.057947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.062196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a056ae5b-8547-44ed-86e9-6b7451b6c267 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.460722 Jul 24 01:31:57.063100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.064590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.070124 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2254/4610] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:56 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:57.398849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.400385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 0852dbf4-63fa-425c-ac23-ad365e48a816] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:57.437038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.438208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.440650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.441907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.462280 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Instance 0852dbf4-63fa-425c-ac23-ad365e48a816 could not be found. Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 HTTP/1.1 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 0852dbf4-63fa-425c-ac23-ad365e48a816 could not be found. Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '0852dbf4-63fa-425c-ac23-ad365e48a816'} Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0852dbf4-63fa-425c-ac23-ad365e48a816 could not be found. Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0852dbf4-63fa-425c-ac23-ad365e48a816 could not be found. Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.466465 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.470914 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.470914 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.470914 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:57.470914 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:57.470914 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0852dbf4-63fa-425c-ac23-ad365e48a816 could not be found. Jul 24 01:31:57.470914 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.474253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Instance 0852dbf4-63fa-425c-ac23-ad365e48a816 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:57.478982 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-58e5450f-33c4-40fa-9664-75603dbd3705 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816" status: 404 len: 111 microversion: 2.1 time: 0.082995 Jul 24 01:31:57.483898 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2255/4611] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:57 2022] GET /compute/v2.1/servers/0852dbf4-63fa-425c-ac23-ad365e48a816 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:57.511068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d311efc-0632-4c3c-8090-962a4ce16d7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1bc0d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.556804 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-2d311efc-0632-4c3c-8090-962a4ce16d7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Image not found. Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d311efc-0632-4c3c-8090-962a4ce16d7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e HTTP/1.1 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a32b9cad-3d52-4a07-8e31-a1164b16f02e'} Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a32b9cad-3d52-4a07-8e31-a1164b16f02e to delete Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a32b9cad-3d52-4a07-8e31-a1164b16f02e could not be found. Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.560247 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:31:57.565053 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.569099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d311efc-0632-4c3c-8090-962a4ce16d7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:57.570965 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d311efc-0632-4c3c-8090-962a4ce16d7c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e" status: 404 len: 62 microversion: 2.1 time: 0.081524 Jul 24 01:31:57.575837 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2256/4612] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:57 2022] DELETE /compute/v2.1/images/a32b9cad-3d52-4a07-8e31-a1164b16f02e => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:31:57.582343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.583100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:57.594654 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.595360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.596908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.597821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.618244 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c HTTP/1.1 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9d83bd7f-0a9a-4866-967c-0faffbacfc2c'} Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:57.622050 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.626859 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.628842 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:57.630799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c332930-975a-47b3-b3ff-6504b5f68939 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 404 len: 111 microversion: 2.1 time: 0.052708 Jul 24 01:31:57.631800 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2257/4613] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:31:57 2022] DELETE /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:57.644782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.652081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 9d83bd7f-0a9a-4866-967c-0faffbacfc2c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:57.662860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.663572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.665075 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.667157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.692331 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c HTTP/1.1 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9d83bd7f-0a9a-4866-967c-0faffbacfc2c'} Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.697405 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.705155 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.705155 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.705155 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:57.705155 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:57.705155 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. Jul 24 01:31:57.705155 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.709251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Instance 9d83bd7f-0a9a-4866-967c-0faffbacfc2c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:57.710413 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-055af098-f815-4b31-9563-097403d9912e tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c" status: 404 len: 111 microversion: 2.1 time: 0.073780 Jul 24 01:31:57.715276 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2258/4614] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:57 2022] GET /compute/v2.1/servers/9d83bd7f-0a9a-4866-967c-0faffbacfc2c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:57.724837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-476f03db-9481-4747-a988-7b11a1615987 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1d0790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.756875 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-476f03db-9481-4747-a988-7b11a1615987 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Image not found. Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-476f03db-9481-4747-a988-7b11a1615987 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 HTTP/1.1 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f5f2a8cd-545c-4c95-b027-66a7cff2b855'} Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f5f2a8cd-545c-4c95-b027-66a7cff2b855 to delete Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5f2a8cd-545c-4c95-b027-66a7cff2b855 could not be found. Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.759478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:31:57.765120 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.781227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-476f03db-9481-4747-a988-7b11a1615987 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:57.781227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-476f03db-9481-4747-a988-7b11a1615987 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855" status: 404 len: 62 microversion: 2.1 time: 0.059037 Jul 24 01:31:57.781227 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2259/4615] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:57 2022] DELETE /compute/v2.1/images/f5f2a8cd-545c-4c95-b027-66a7cff2b855 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:31:57.788647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:57.794746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.795718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:57.802868 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-178dd45e-ffea-4665-a1e7-5ab993066931 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.775900 Jul 24 01:31:57.803789 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2357/4616] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:57 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:57.807309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.808032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.809605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.810305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.851315 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 HTTP/1.1 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '06b6d77e-7536-4c72-9de6-622af5973970'} Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:57.858439 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.862737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.864500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:57.865549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a18335f7-d64d-4ece-a163-5167aae75538 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 404 len: 111 microversion: 2.1 time: 0.079618 Jul 24 01:31:57.867162 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2260/4617] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:31:57 2022] DELETE /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:57.881058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:57.881058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 06b6d77e-7536-4c72-9de6-622af5973970] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:57.890498 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:57.892442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.893049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.893870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:57.894368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:57.912773 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 HTTP/1.1 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '06b6d77e-7536-4c72-9de6-622af5973970'} Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.914887 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:57.921068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:57.921068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:57.921068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:57.921068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:57.921068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. Jul 24 01:31:57.921068 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:57.923793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Instance 06b6d77e-7536-4c72-9de6-622af5973970 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:57.924120 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63ba6bcc-2660-41ca-8638-36388d063b97 tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970" status: 404 len: 111 microversion: 2.1 time: 0.052632 Jul 24 01:31:57.934491 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2358/4618] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:57 2022] GET /compute/v2.1/servers/06b6d77e-7536-4c72-9de6-622af5973970 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:57.937074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e0d7b2c-31c8-4f3e-8963-63b94a69680f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '.version_select at 0x7f05ea1a6280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:58.003354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4e0d7b2c-31c8-4f3e-8963-63b94a69680f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Image not found. Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e0d7b2c-31c8-4f3e-8963-63b94a69680f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 HTTP/1.1 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: exception: Image not found. Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '87f72428-ca97-4b3e-95ad-d9f226052ca0'} Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 87f72428-ca97-4b3e-95ad-d9f226052ca0 to delete Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 87f72428-ca97-4b3e-95ad-d9f226052ca0 could not be found. Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.009090 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 24 01:31:58.014961 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.025473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e0d7b2c-31c8-4f3e-8963-63b94a69680f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Image not found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:58.034286 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e0d7b2c-31c8-4f3e-8963-63b94a69680f tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0" status: 404 len: 62 microversion: 2.1 time: 0.098342 Jul 24 01:31:58.034919 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2261/4619] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:57 2022] DELETE /compute/v2.1/images/87f72428-ca97-4b3e-95ad-d9f226052ca0 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:31:58.047470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:58.048381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:58.075818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.076528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.078311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.090256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:58.091584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:58.095263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.118933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.126736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.133239 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.135840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.158227 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 HTTP/1.1 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '3e248bf7-9673-4759-8bb7-1a966355e4b5'} Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:58.171163 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.175011 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.180720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:58.182646 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-867b8bcf-44a6-4fe1-8a99-f6c802185a1c tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 404 len: 111 microversion: 2.1 time: 0.141847 Jul 24 01:31:58.186385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2359/4620] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:31:58 2022] DELETE /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:58.206062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:58.207284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] [instance: 3e248bf7-9673-4759-8bb7-1a966355e4b5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:58.225415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.228458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.232541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.233350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.304514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] HTTP exception thrown: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Request method failure captured: Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 HTTP/1.1 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J_yoO1V3ccAUucYZYeHngQS3IHkIXiMFDv4gH9V6MSCD4w7HuUvK7jEbM5SI0cY6D8-9NNvrQ7rvqQVB0ZIJCRXxyam2mRCozcnp8YzDvlgVO8h7xIGz9aN1VlSVsvkGi32AnXZIuSYOFKghajT1dhaEX403BVid9mtcYP5rIPBidg Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e39cbca23eba4208a1c160cfb5aef490", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e39cbca23eba4208a1c160cfb5aef490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e39cbca23eba4208a1c160cfb5aef490 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ImagesTestJSON-1181959975 Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b0f04ff3b36d4b0686c9a68ff55ee99d Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ImagesTestJSON-1181959975-project Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '3e248bf7-9673-4759-8bb7-1a966355e4b5'} Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.307420 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:31:58.313609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:31:58.313609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:31:58.313609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:31:58.313609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:31:58.313609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. Jul 24 01:31:58.313609 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:31:58.319483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] Returning 404 to user: Instance 3e248bf7-9673-4759-8bb7-1a966355e4b5 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:31:58.321160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c3b7acf0-2f95-45a8-bc43-7fc689487dfc tempest-ImagesTestJSON-1181959975 tempest-ImagesTestJSON-1181959975-project] 10.222.0.27 "GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5" status: 404 len: 111 microversion: 2.1 time: 0.130332 Jul 24 01:31:58.325553 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2360/4621] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:58 2022] GET /compute/v2.1/servers/3e248bf7-9673-4759-8bb7-1a966355e4b5 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:31:58.822228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:58.823088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:58.833060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.844936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.846023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:58.846670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:58.862573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:58.886133 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:58.888721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:58.892194 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-059f91fa-eb56-4db4-abb6-5a6be560fdc9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1722 microversion: 2.20 time: 0.808617 Jul 24 01:31:58.910630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2262/4622] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:58 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1722 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:31:59.847087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:31:59.864008 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-39f7f557-c048-40a9-95f7-da8839485347 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 1.047162 Jul 24 01:31:59.876888 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2361/4623] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:31:58 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:31:59.923154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:31:59.924990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:31:59.932776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:59.933473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:31:59.934618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:31:59.935227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:00.185913 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0507f60e-69ce-4a98-b718-23f5da4b4316 tempest-ComputeTenantNetworksTest-236104921 tempest-ComputeTenantNetworksTest-236104921-project] Calling method '.version_select at 0x7f05ea1dbdc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:00.680476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:00.694386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:00.703560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '472ff2bf65fb473ba60274de014b08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8eb99dbda38447a8ff7721744633469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:00.704964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1b2ac889-8509-4bdf-94f9-44b2fbe05227 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 200 len: 1655 microversion: 2.20 time: 0.791404 Jul 24 01:32:00.718581 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2362/4624] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:31:59 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 1655 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:32:00.733656 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7a6702ae-63dd-4898-8349-9025f87c2b99 req-e1f243e3-cdd5-4860-a540-c5a0a5172ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3e0006-7485-440e-9282-2f6f982cc604", "name": "network-vif-deleted", "tag": "4e29293a-0608-4f8c-903a-03bc61e05c91"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:00.776484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7a6702ae-63dd-4898-8349-9025f87c2b99 req-e1f243e3-cdd5-4860-a540-c5a0a5172ebf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:00.777265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7a6702ae-63dd-4898-8349-9025f87c2b99 req-e1f243e3-cdd5-4860-a540-c5a0a5172ebf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:00.856848 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7a6702ae-63dd-4898-8349-9025f87c2b99 req-e1f243e3-cdd5-4860-a540-c5a0a5172ebf service nova] Creating event network-vif-deleted:4e29293a-0608-4f8c-903a-03bc61e05c91 for instance 6e3e0006-7485-440e-9282-2f6f982cc604 on n-h1-master-1 Jul 24 01:32:00.904486 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7a6702ae-63dd-4898-8349-9025f87c2b99 req-e1f243e3-cdd5-4860-a540-c5a0a5172ebf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183371 Jul 24 01:32:00.906128 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2363/4625] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:00.943401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:00.946388 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:00.971517 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:00.974002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:00.977132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:00.978715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:02.959103 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0507f60e-69ce-4a98-b718-23f5da4b4316 tempest-ComputeTenantNetworksTest-236104921 tempest-ComputeTenantNetworksTest-236104921-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 3.583376 Jul 24 01:32:02.960198 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2263/4626] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:31:59 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 3586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:32:02.970720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-45bd9750-efc1-48e6-b472-d2d811d4739d req-28015d30-3046-4e86-bfe7-c64384d1b7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-plugged", "status": "completed", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:03.012483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-45bd9750-efc1-48e6-b472-d2d811d4739d req-28015d30-3046-4e86-bfe7-c64384d1b7ea service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:03.013002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-45bd9750-efc1-48e6-b472-d2d811d4739d req-28015d30-3046-4e86-bfe7-c64384d1b7ea service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:03.080319 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-45bd9750-efc1-48e6-b472-d2d811d4739d req-28015d30-3046-4e86-bfe7-c64384d1b7ea service nova] Creating event network-vif-plugged:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:32:03.083055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:03.094838 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-45bd9750-efc1-48e6-b472-d2d811d4739d req-28015d30-3046-4e86-bfe7-c64384d1b7ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133329 Jul 24 01:32:03.095988 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2264/4627] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:03.098459 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea15776f-d091-4ba4-9d6e-5304003d2f0b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 2.181271 Jul 24 01:32:03.101456 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2364/4628] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:00 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:03.103648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:03.118544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:03.126865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:03.127775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:03.128764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:03.129375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:03.143127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f265c04e-a1d8-4dc7-8072-63c631b60241 tempest-ComputeTenantNetworksTest-236104921 tempest-ComputeTenantNetworksTest-236104921-project] Calling method '.version_select at 0x7f05e9cee160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:03.150943 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] HTTP exception thrown: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Request method failure captured: Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 HTTP/1.1 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wjXIPqI3Vs_zE1UFzaGu_3eOu25uVnXSYJQR4trMUzUShBIUbTVHtpAUHI-V0I_vQ3yGiie44C6ZES7Df8PXLRhaK5lutEZU9PwZ9v42ADphRhuClVG3wBNZ6A8dPcnwMRtievMeqvWZ0xLIKu2J2mZXkM85XOquT8P9wmyBHo_4 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8eb99dbda38447a8ff7721744633469", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 472ff2bf65fb473ba60274de014b08a9 Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6e3e0006-7485-440e-9282-2f6f982cc604'} Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:03.156100 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:03.162611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Returning 404 to user: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:03.164955 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f62b9eb8-8dc4-4a2b-b8ba-1d1f56f603c9 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 404 len: 111 microversion: 2.20 time: 0.067513 Jul 24 01:32:03.175108 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2265/4629] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:32:03 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:32:03.184687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-53867ee1-1cc5-40e5-81d1-71a3f7551000 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '.version_select at 0x7f05ea1dc040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:03.226767 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-53867ee1-1cc5-40e5-81d1-71a3f7551000 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17601749" status: 204 len: 0 microversion: 2.20 time: 0.047131 Jul 24 01:32:03.227769 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2266/4630] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:32:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17601749 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:32:03.524693 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f265c04e-a1d8-4dc7-8072-63c631b60241 tempest-ComputeTenantNetworksTest-236104921 tempest-ComputeTenantNetworksTest-236104921-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/b8196c48-2050-4535-84ad-6f1bc1f5fd7a" status: 200 len: 140 microversion: 2.1 time: 0.422066 Jul 24 01:32:03.525435 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2365/4631] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:32:03 2022] GET /compute/v2.1/os-tenant-networks/b8196c48-2050-4535-84ad-6f1bc1f5fd7a => generated 140 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:04.116662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:04.118053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:04.123205 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:04.161496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:04.163736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:04.164837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:04.169655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:04.873279 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:04.881984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d96ace23-bb34-4e4a-8011-d36565d3cd4b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.769263 Jul 24 01:32:04.886506 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2267/4632] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:04 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:05.904786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:05.905389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:05.967438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:05.967903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:05.968735 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:05.969251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:07.861173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:07.869257 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad3bd2aa-a56f-4571-bdae-5d6633cfbe92 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 1.970597 Jul 24 01:32:07.869881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2366/4633] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:05 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:08.889192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:08.890779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:08.912769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:08.914114 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:08.919752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:08.920700 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:09.313188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:09.321598 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85c889c7-fc74-4626-ade7-5bc03b66328e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.438100 Jul 24 01:32:09.326459 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2268/4634] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:08 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:10.344961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:10.346401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:10.371114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:10.373089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:10.377622 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:10.379055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:10.703696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:10.711816 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4a31a66-445a-4c6c-81cd-eea4bbb719ad tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.372534 Jul 24 01:32:10.718951 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2367/4635] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:10 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:11.733276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:11.733982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:11.768776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:11.769434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:11.770312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:11.777318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:11.997338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:11.998562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:12.015346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:12.017122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:12.020103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:12.021131 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:12.078256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] HTTP exception thrown: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Request method failure captured: Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 HTTP/1.1 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8wjXIPqI3Vs_zE1UFzaGu_3eOu25uVnXSYJQR4trMUzUShBIUbTVHtpAUHI-V0I_vQ3yGiie44C6ZES7Df8PXLRhaK5lutEZU9PwZ9v42ADphRhuClVG3wBNZ6A8dPcnwMRtievMeqvWZ0xLIKu2J2mZXkM85XOquT8P9wmyBHo_4 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8eb99dbda38447a8ff7721744633469", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 472ff2bf65fb473ba60274de014b08a9 Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6e3e0006-7485-440e-9282-2f6f982cc604'} Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:12.085406 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.092867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Returning 404 to user: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:12.094043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-100d45d0-a212-4dee-b7f3-7ad8188a5b9e tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 404 len: 111 microversion: 2.20 time: 0.097820 Jul 24 01:32:12.097313 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2368/4636] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:32:11 2022] DELETE /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:32:12.115110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:12.118998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 6e3e0006-7485-440e-9282-2f6f982cc604] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:12.146039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:12.146638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:12.148718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:12.153750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:12.210171 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] HTTP exception thrown: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Request method failure captured: Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 HTTP/1.1 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8wjXIPqI3Vs_zE1UFzaGu_3eOu25uVnXSYJQR4trMUzUShBIUbTVHtpAUHI-V0I_vQ3yGiie44C6ZES7Df8PXLRhaK5lutEZU9PwZ9v42ADphRhuClVG3wBNZ6A8dPcnwMRtievMeqvWZ0xLIKu2J2mZXkM85XOquT8P9wmyBHo_4 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8eb99dbda38447a8ff7721744633469", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 472ff2bf65fb473ba60274de014b08a9 Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6e3e0006-7485-440e-9282-2f6f982cc604'} Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.211820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Returning 404 to user: Instance 6e3e0006-7485-440e-9282-2f6f982cc604 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:12.219059 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c1b61098-54a3-4f75-bf3e-f043732dafa5 tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604" status: 404 len: 111 microversion: 2.20 time: 0.111563 Jul 24 01:32:12.228937 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2369/4637] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:32:12 2022] GET /compute/v2.1/servers/6e3e0006-7485-440e-9282-2f6f982cc604 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:32:12.547701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:12.563133 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-335fd313-eacd-44bf-a734-1ba85e5b9a6c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.835707 Jul 24 01:32:12.574587 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2269/4638] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:11 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:13.585814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:13.586443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:13.626199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:13.626723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:13.627568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:13.627991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:14.033638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:14.049626 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-83218355-1b5a-4988-bfb0-d25bf7e4f7e6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.464761 Jul 24 01:32:14.054587 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2370/4639] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:13 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:15.071817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:15.073551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:15.097274 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:15.111216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:15.115850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:15.123666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:15.671766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:15.685447 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de910dea-6891-4fe7-907b-21df232ab37e tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.618186 Jul 24 01:32:15.697920 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2270/4640] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:15 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:16.712150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:16.712771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:16.730300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:16.735711 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:16.736775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:16.739854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:18.205187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:18.220547 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-53a6e72b-d009-4928-a298-5210e5f7bcce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 1.513133 Jul 24 01:32:18.223511 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2371/4641] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:16 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:19.239626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:19.240174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:19.296550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:19.297013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:19.297851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:19.298382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:19.712063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:19.721717 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a28b9b41-32cb-4391-bdf7-b4a1408cd0af tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.486106 Jul 24 01:32:19.732548 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2271/4642] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:19 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:20.753412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:20.754075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:20.783766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:20.790644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:20.791750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:20.795565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:21.499287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:21.514563 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4adc369d-4bab-492d-821d-22c1eb5dde4d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.768997 Jul 24 01:32:21.527496 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2372/4643] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:20 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:21.763740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:21.764831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:21.789543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:21.790141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:21.790996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:21.791446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:21.885936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] HTTP exception thrown: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Request method failure captured: Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e HTTP/1.1 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3J8wjXIPqI3Vs_zE1UFzaGu_3eOu25uVnXSYJQR4trMUzUShBIUbTVHtpAUHI-V0I_vQ3yGiie44C6ZES7Df8PXLRhaK5lutEZU9PwZ9v42ADphRhuClVG3wBNZ6A8dPcnwMRtievMeqvWZ0xLIKu2J2mZXkM85XOquT8P9wmyBHo_4 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8eb99dbda38447a8ff7721744633469", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 472ff2bf65fb473ba60274de014b08a9 Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '5a9ecad8-dbf6-42db-bcc4-3b6e613e022e'} Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:21.907454 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:21.912716 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:21.928140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Returning 404 to user: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:21.931986 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-673c3ad1-809e-420e-86f6-1d39f47d70cd tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 404 len: 111 microversion: 2.20 time: 0.173112 Jul 24 01:32:21.941652 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2272/4644] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:32:21 2022] DELETE /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:32:21.950173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:21.950917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] [instance: 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:21.968234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:21.968997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:21.972169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:21.972813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:22.044304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] HTTP exception thrown: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Request method failure captured: Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e HTTP/1.1 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3J8wjXIPqI3Vs_zE1UFzaGu_3eOu25uVnXSYJQR4trMUzUShBIUbTVHtpAUHI-V0I_vQ3yGiie44C6ZES7Df8PXLRhaK5lutEZU9PwZ9v42ADphRhuClVG3wBNZ6A8dPcnwMRtievMeqvWZ0xLIKu2J2mZXkM85XOquT8P9wmyBHo_4 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.20 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8eb99dbda38447a8ff7721744633469", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8eb99dbda38447a8ff7721744633469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b8eb99dbda38447a8ff7721744633469 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409934697 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 472ff2bf65fb473ba60274de014b08a9 Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409934697-project Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '5a9ecad8-dbf6-42db-bcc4-3b6e613e022e'} Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:22.048660 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. Jul 24 01:32:22.053443 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:22.063324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] Returning 404 to user: Instance 5a9ecad8-dbf6-42db-bcc4-3b6e613e022e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:22.068674 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eddde6fb-eb45-46c6-806b-7e9c308bad3a tempest-AttachVolumeShelveTestJSON-1409934697 tempest-AttachVolumeShelveTestJSON-1409934697-project] 10.222.0.27 "GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e" status: 404 len: 111 microversion: 2.20 time: 0.123071 Jul 24 01:32:22.072050 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2373/4645] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:32:21 2022] GET /compute/v2.1/servers/5a9ecad8-dbf6-42db-bcc4-3b6e613e022e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:32:22.534677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:22.535490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:22.556461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:22.567253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:22.571323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:22.575458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:23.786367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cac2d81e-38d0-4b41-bf63-63c6bfa59aee tempest-AZV2TestJSON-844784203 tempest-AZV2TestJSON-844784203-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:23.792119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cac2d81e-38d0-4b41-bf63-63c6bfa59aee tempest-AZV2TestJSON-844784203 tempest-AZV2TestJSON-844784203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:23.797345 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cac2d81e-38d0-4b41-bf63-63c6bfa59aee tempest-AZV2TestJSON-844784203 tempest-AZV2TestJSON-844784203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:23.800335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cac2d81e-38d0-4b41-bf63-63c6bfa59aee tempest-AZV2TestJSON-844784203 tempest-AZV2TestJSON-844784203-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:23.801044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cac2d81e-38d0-4b41-bf63-63c6bfa59aee tempest-AZV2TestJSON-844784203 tempest-AZV2TestJSON-844784203-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:23.904493 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cac2d81e-38d0-4b41-bf63-63c6bfa59aee tempest-AZV2TestJSON-844784203 tempest-AZV2TestJSON-844784203-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.846112 Jul 24 01:32:23.921688 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2374/4646] 10.222.0.27 () {58 vars in 1163 bytes} [Sun Jul 24 01:32:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:32:24.109596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:24.113353 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:24.146877 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-367a6e22-5ca4-473c-8715-65cab32f54b7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 1.616550 Jul 24 01:32:24.159548 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2273/4647] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:22 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:25.168967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:25.170788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:25.220306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:25.220804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:25.224406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:25.225111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:25.333008 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:26.095173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:26.128783 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a2970a7-47f6-4812-9811-3b94a6c140e8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 0.942155 Jul 24 01:32:26.130546 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2375/4648] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:25 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:26.312710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-33e44b21-97ca-4039-917c-8d0064535491 req-374bca5b-b8e7-460c-8c56-8c6e33989d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1cd906-b406-46dd-bd65-fe0292f7c9de", "name": "network-vif-plugged", "status": "completed", "tag": "aa20a123-c219-46a0-959b-811824ea97c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:26.346607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-33e44b21-97ca-4039-917c-8d0064535491 req-374bca5b-b8e7-460c-8c56-8c6e33989d5c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:26.359598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-33e44b21-97ca-4039-917c-8d0064535491 req-374bca5b-b8e7-460c-8c56-8c6e33989d5c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:26.408989 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-33e44b21-97ca-4039-917c-8d0064535491 req-374bca5b-b8e7-460c-8c56-8c6e33989d5c service nova] Creating event network-vif-plugged:aa20a123-c219-46a0-959b-811824ea97c7 for instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de on n-h1-master-1 Jul 24 01:32:26.440675 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-33e44b21-97ca-4039-917c-8d0064535491 req-374bca5b-b8e7-460c-8c56-8c6e33989d5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133275 Jul 24 01:32:26.450137 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2274/4649] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:32:27.156459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:27.157730 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:27.187472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:27.189717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:27.199829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:27.202742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:27.948313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c77ffc80-a516-4ab5-a2c2-159930c43bc2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'create', calling method: .version_select at 0x7f05ea1e2c10>, body: {"keypair": {"name": "tempest-keypair-2109603605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5fsKkPrTh09sTmSu/gmBa+IBn0aEpqbgKgOzjk9Ghf27wUP+aJscM39sup4eax10Ws39ZzM+79bm9pq7huMSTZpPxtoNyP76vFdVOIPJvSdmn9gEoJK/wvdRAmeiAA/w=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:28.016268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c77ffc80-a516-4ab5-a2c2-159930c43bc2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:32:28.032495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c77ffc80-a516-4ab5-a2c2-159930c43bc2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for user 81dad264129d487c88fb39d9356550b1 and project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:32:28.094598 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c77ffc80-a516-4ab5-a2c2-159930c43bc2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.804601 Jul 24 01:32:28.097032 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2275/4650] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:32:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:28.633576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:28.649167 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-53b41ef6-4002-412d-8725-0b34ed20a7e4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 1.506788 Jul 24 01:32:28.660491 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2376/4651] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:27 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:29.596689 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:29.597456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:29.629481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:29.633157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:29.634115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:29.641510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:29.674720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:29.675368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:29.692211 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=38 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:29.696989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:29.703581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:29.712864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:29.713633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:30.279148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:30.294495 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa691e56-e4f0-4360-a6b5-37828f986d35 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.704817 Jul 24 01:32:30.299313 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2276/4652] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:29 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:30.316419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-91147578-796b-4782-8433-71a08c51ffae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-696525784"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:30.317618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-91147578-796b-4782-8433-71a08c51ffae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:30.348050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91147578-796b-4782-8433-71a08c51ffae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:30.349050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91147578-796b-4782-8433-71a08c51ffae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:30.350245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91147578-796b-4782-8433-71a08c51ffae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:30.352414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91147578-796b-4782-8433-71a08c51ffae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:30.827590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:30.845087 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f3a2e08-a269-4021-b7a3-3601370edc60 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1518 microversion: 2.1 time: 1.169656 Jul 24 01:32:30.846088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2377/4653] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:29 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1518 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:31.129455 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-91147578-796b-4782-8433-71a08c51ffae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.818458 Jul 24 01:32:31.158793 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2277/4654] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:30 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 24 01:32:31.170555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:31.171237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:31.188711 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:31.191714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:31.194255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:31.197973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:31.866927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:31.871880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:31.886023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:31.887128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:31.889517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:31.890409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:32.857354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:32.868758 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-984c6d79-17ad-49c4-acd1-71ec8e399c8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 1.704927 Jul 24 01:32:32.872340 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2378/4655] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:31 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:32.944465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:32.955405 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-911b7fca-1219-4755-8ee0-3ad082a6aec8 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.095438 Jul 24 01:32:32.960374 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2278/4656] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:31 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:32.985117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:32.986252 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:32.994874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:32.996025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:32.997527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:32.998426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:33.469337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-77addedd-2db3-404a-a52f-6bf57da994c5 req-9b8ad1d7-4c54-45ea-9953-e9317c629129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-unplugged", "status": "completed", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:33.489053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-77addedd-2db3-404a-a52f-6bf57da994c5 req-9b8ad1d7-4c54-45ea-9953-e9317c629129 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:33.492813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-77addedd-2db3-404a-a52f-6bf57da994c5 req-9b8ad1d7-4c54-45ea-9953-e9317c629129 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:33.547826 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-77addedd-2db3-404a-a52f-6bf57da994c5 req-9b8ad1d7-4c54-45ea-9953-e9317c629129 service nova] Creating event network-vif-unplugged:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:32:33.575641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-77addedd-2db3-404a-a52f-6bf57da994c5 req-9b8ad1d7-4c54-45ea-9953-e9317c629129 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109128 Jul 24 01:32:33.578141 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2279/4657] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:33.628905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:33.639632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a089adb5-bb62-488a-b641-8344bc4211bf tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.659955 Jul 24 01:32:33.640967 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2379/4658] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:32 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:33.669572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:33.670969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:33.680880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:33.681595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:33.682900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:33.684487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:33.891670 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:33.893215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:33.896091 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:33.907821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:33.908603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:33.919011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:33.919729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:34.536662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:34.544899 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8b9ccc3-5f39-4c5a-b142-115c08dbc55c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.657137 Jul 24 01:32:34.563488 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2380/4659] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:33 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:34.697640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:34.711678 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80eed629-54fa-44e2-9393-8cf8ff4c6aa4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.047485 Jul 24 01:32:34.712465 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2280/4660] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:33 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:34.744941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dae458a5-8254-4ffc-99e6-aab48cacc969 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:34.764536 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-dae458a5-8254-4ffc-99e6-aab48cacc969 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 827dcde7-27ea-470f-b17b-a3decaab798f has no mapping to a cell. Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dae458a5-8254-4ffc-99e6-aab48cacc969 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/827dcde7-27ea-470f-b17b-a3decaab798f/action HTTP/1.1 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 15 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: {"os-stop": {}} Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 827dcde7-27ea-470f-b17b-a3decaab798f has no mapping to a cell. Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '827dcde7-27ea-470f-b17b-a3decaab798f', 'body': {'os-stop': {}}} Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 827dcde7-27ea-470f-b17b-a3decaab798f has no mapping to a cell. Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:34.771460 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827dcde7-27ea-470f-b17b-a3decaab798f has no mapping to a cell. Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827dcde7-27ea-470f-b17b-a3decaab798f has no mapping to a cell. Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dae458a5-8254-4ffc-99e6-aab48cacc969 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 827dcde7-27ea-470f-b17b-a3decaab798f has no mapping to a cell. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dae458a5-8254-4ffc-99e6-aab48cacc969 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/827dcde7-27ea-470f-b17b-a3decaab798f/action" status: 404 len: 117 microversion: 2.1 time: 0.038657 Jul 24 01:32:34.791813 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2381/4661] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:34 2022] POST /compute/v2.1/servers/827dcde7-27ea-470f-b17b-a3decaab798f/action => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:34.805641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:34.806710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:34.809047 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:34.832971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:34.833455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:34.834719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:34.837184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:35.233401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:35.258873 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e71a4862-33fa-420e-8fe3-7f6494427fe4 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.461824 Jul 24 01:32:35.263829 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2281/4662] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:34 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:35.283823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:35.287181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:35.329072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:35.330364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:35.332327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:35.336126 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:35.513071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1881729596", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b565b593-c54e-43d5-ad25-f35c2197ac6e"}], "security_groups": [{"name": "tempest-securitygroup--1136695719"}], "key_name": "tempest-keypair-2109603605", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dad03902-735e-422d-ae2e-fc027b422840 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.487555 Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2382/4663] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:35 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:35.902673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:35.943920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] validate_networks() for [('b565b593-c54e-43d5-ad25-f35c2197ac6e', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:32:36.264765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:36.272814 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36de4165-2582-4998-a039-2a9ddfdc1ac5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1685 microversion: 2.1 time: 0.505769 Jul 24 01:32:36.273421 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2383/4664] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:35 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1685 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:36.300263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3aeac557-b7b9-478c-b16c-189ca8f32ab6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:36.306206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3aeac557-b7b9-478c-b16c-189ca8f32ab6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:36.321370 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3aeac557-b7b9-478c-b16c-189ca8f32ab6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba could not be found. Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3aeac557-b7b9-478c-b16c-189ca8f32ab6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba/action HTTP/1.1 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 15 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: {"suspend": {}} Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba could not be found. Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba', 'body': {'suspend': {}}} Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba could not be found. Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba could not be found. Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:36.325126 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:36.329153 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:36.329153 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:36.329153 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba could not be found. Jul 24 01:32:36.329153 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:36.337087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3aeac557-b7b9-478c-b16c-189ca8f32ab6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:36.338359 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3aeac557-b7b9-478c-b16c-189ca8f32ab6 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba/action" status: 404 len: 111 microversion: 2.1 time: 0.048332 Jul 24 01:32:36.342745 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2384/4665] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:36 2022] POST /compute/v2.1/servers/04cc8870-2cc4-45b5-9b2d-eb2dd123c2ba/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:36.358900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:36.360882 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:36.375888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:36.378435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:36.379275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:36.379725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:36.797540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:36.818519 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d71cd4d-f441-43da-a34f-5d7bccf77d5f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.466821 Jul 24 01:32:36.819116 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2385/4666] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:36 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:36.837433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:36.849548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:36.862113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:36.862581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:36.863386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:36.863845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.153147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:37.168794 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f3bdd25-2ed7-40c4-8246-5047b0b9d4ca tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.335183 Jul 24 01:32:37.169814 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2386/4667] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:36 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:37.185897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:37.186733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:37.195512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.201832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.203006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.204189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.260012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lazy-loading 'flavor' on Instance uuid 6a1cd906-b406-46dd-bd65-fe0292f7c9de {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:32:37.362537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:32:37.364373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:32:37.365366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:32:37.366500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:32:37.367977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:32:37.409840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.411976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.414458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.420972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.451310 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-994f5621-7d25-4fcd-b267-2ce0b61583f0 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 202 len: 0 microversion: 2.1 time: 0.269494 Jul 24 01:32:37.457992 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2387/4668] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:37 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:32:37.468269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:37.469142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:37.487061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.487522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.488336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.488784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.561630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:32:37.575439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for user 81dad264129d487c88fb39d9356550b1 and project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:32:37.616517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:32:37.618925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:32:37.771044 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d8865d7f-5f22-4160-b0de-e119f2cf34c2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.262466 Jul 24 01:32:37.778109 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2282/4669] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:32:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:32:37.784762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:37.788311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:37.810562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.811029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.811837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:37.812288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:37.978639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:38.036665 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00a8b95d-c51b-410e-b53b-e638e8fb3fc7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1685 microversion: 2.1 time: 0.575725 Jul 24 01:32:38.044450 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2388/4670] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:37 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1685 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:38.057248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f0f7c49f-cbae-4634-9c06-3215453f5e61 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:38.066899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f0f7c49f-cbae-4634-9c06-3215453f5e61 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:38.367106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f0f7c49f-cbae-4634-9c06-3215453f5e61 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:38.375189 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f0f7c49f-cbae-4634-9c06-3215453f5e61 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1238 microversion: 2.1 time: 0.327506 Jul 24 01:32:38.381991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2389/4671] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:38 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1238 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:38.391866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:38.401549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b9136d1-ada8-4015-9c40-cfd3104cf8be tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1513 microversion: 2.1 time: 0.621404 Jul 24 01:32:38.406450 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2283/4672] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:37 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1513 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:39.039755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-99866223-f3a6-4173-b178-abf74b832cfe tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Action: 'create', calling method: .version_select at 0x7f05e9cefc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1303859298", "metadata": {"Type": "work"}}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:39.061995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:39.062904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:39.089943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:39.090865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:39.093199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:39.094041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:39.532550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:39.542707 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-acb01419-5f9a-4b36-85d4-c8bf38d70ff8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1685 microversion: 2.1 time: 0.485392 Jul 24 01:32:39.550429 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2284/4673] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:39 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1685 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:39.570844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:39.571555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:39.586017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:39.586608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:39.587425 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:39.587873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:39.712914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:39.722685 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-396f2349-8b67-4229-9562-b8302834f940 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1290 microversion: 2.1 time: 0.164994 Jul 24 01:32:39.731694 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2285/4674] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:39 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1290 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:39.747670 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:39.748746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:39.762017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:39.764004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:39.764800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:39.765255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.015316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-99866223-f3a6-4173-b178-abf74b832cfe tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.331836 Jul 24 01:32:40.015950 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2390/4675] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:32:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1334 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 24 01:32:40.030536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aba67709-5fe5-4af4-91e2-7ccfdb4f7573 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05e9d110d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:40.119716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:40.142351 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6a1ed192-f235-4b41-9050-6158d8dd40dc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1496 microversion: 2.1 time: 0.407533 Jul 24 01:32:40.152642 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2286/4676] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:39 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1496 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:40.172591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:40.173147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:40.225210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.225808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.226720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.228013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.250598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aba67709-5fe5-4af4-91e2-7ccfdb4f7573 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 353 microversion: 2.1 time: 0.226032 Jul 24 01:32:40.255423 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2391/4677] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:40 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:40.311498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lazy-loading 'flavor' on Instance uuid 6a1cd906-b406-46dd-bd65-fe0292f7c9de {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:32:40.341391 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Cannot 'suspend' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state suspended Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action HTTP/1.1 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 15 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: {"suspend": {}} Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'suspend' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state suspended Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'suspend': {}}} Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de in vm_state suspended. Cannot suspend while the instance is in this state. Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 24 01:32:40.343359 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state suspended Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state suspended Jul 24 01:32:40.349579 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:40.351566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 409 to user: Cannot 'suspend' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state suspended {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:40.356950 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a49e823b-0522-41dd-a9d0-5d43ddede35c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 409 len: 148 microversion: 2.1 time: 0.196120 Jul 24 01:32:40.366515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-70d69560-6b62-41a9-a3a9-b927315ebc96 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:40.367215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-70d69560-6b62-41a9-a3a9-b927315ebc96 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:40.373026 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2287/4678] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:40 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 148 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:32:40.387097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70d69560-6b62-41a9-a3a9-b927315ebc96 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.392519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70d69560-6b62-41a9-a3a9-b927315ebc96 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.393841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70d69560-6b62-41a9-a3a9-b927315ebc96 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.394460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70d69560-6b62-41a9-a3a9-b927315ebc96 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.556814 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-70d69560-6b62-41a9-a3a9-b927315ebc96 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 202 len: 0 microversion: 2.1 time: 0.194211 Jul 24 01:32:40.561260 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2392/4679] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:40 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:32:40.576259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:40.577080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:40.619407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:40.633322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:40.636693 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.638235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.642347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.645991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.672189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.674273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:40.694338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:40.696291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:41.412312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:41.420678 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:41.430103 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d67caca3-e57c-4dd1-b586-7ac24dc36c22 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1502 microversion: 2.1 time: 0.860333 Jul 24 01:32:41.440336 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b973eef2-78b9-4e2c-b185-b7fad8275307 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.851995 Jul 24 01:32:41.442418 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2393/4680] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:40 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:41.444869 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2288/4681] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:40 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1502 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:41.452373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:41.462924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3de305ea-4af1-44ad-b904-d47435d40acc tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05ea1dc670>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:41.464563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:41.491926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:41.493476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:41.497006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:41.499274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:41.512690 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:41.752430 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3de305ea-4af1-44ad-b904-d47435d40acc tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 353 microversion: 2.1 time: 0.299343 Jul 24 01:32:41.755602 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2289/4682] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:41 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 353 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:41.763263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-15d3d60f-66d0-4b69-b267-41fcc1b3a290 req-d82fb090-5dbf-44fa-a064-7921bef0deab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-plugged", "status": "completed", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:41.825399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-15d3d60f-66d0-4b69-b267-41fcc1b3a290 req-d82fb090-5dbf-44fa-a064-7921bef0deab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:41.826205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-15d3d60f-66d0-4b69-b267-41fcc1b3a290 req-d82fb090-5dbf-44fa-a064-7921bef0deab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:41.851557 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-15d3d60f-66d0-4b69-b267-41fcc1b3a290 req-d82fb090-5dbf-44fa-a064-7921bef0deab service nova] Creating event network-vif-plugged:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:32:41.861866 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-15d3d60f-66d0-4b69-b267-41fcc1b3a290 req-d82fb090-5dbf-44fa-a064-7921bef0deab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104628 Jul 24 01:32:41.862403 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2290/4683] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:41.887860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:41.909176 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6c2de5c-6a5c-46c3-a388-8b87e736b0a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1296 microversion: 2.1 time: 0.465275 Jul 24 01:32:41.912575 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2394/4684] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:41 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1296 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:42.460268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:42.460925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:42.475792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:42.478317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:42.482051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:42.482761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:42.483731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:42.485057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:42.517333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:42.518665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:42.528995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:42.535188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:42.990921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:43.005643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-296fbd0c-c6d2-48dc-830d-08266507b297 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.549168 Jul 24 01:32:43.008765 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2395/4685] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:42 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:43.018641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-82ae5318-6b35-4ce5-bcae-6dc97a4c5959 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05e9cfcc10>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:43.087294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:43.109210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c396a3e-45a9-4813-aaff-c71545e2d649 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1502 microversion: 2.1 time: 0.661332 Jul 24 01:32:43.125137 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2291/4686] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:42 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1502 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:43.138757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:43.144007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:43.156418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:43.158200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:43.162084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:43.162860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:43.241881 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-82ae5318-6b35-4ce5-bcae-6dc97a4c5959 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 354 microversion: 2.1 time: 0.229450 Jul 24 01:32:43.242600 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2396/4687] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:43 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 354 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:43.254319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-284f8433-c8ae-4a62-8818-5aff9906dcd0 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05e9ccf310>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:43.346227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:43.355696 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1e50e78-1da3-4151-9f6d-440a0a5e0c09 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1296 microversion: 2.1 time: 0.229139 Jul 24 01:32:43.360959 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2292/4688] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:43 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1296 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:43.399519 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-284f8433-c8ae-4a62-8818-5aff9906dcd0 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 354 microversion: 2.1 time: 0.147528 Jul 24 01:32:43.401801 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2397/4689] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:43 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:43.417121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-173c3487-c333-411d-9ae8-ab59a345cbbf tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05ea1bc9d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:43.647842 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-173c3487-c333-411d-9ae8-ab59a345cbbf tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 202 len: 0 microversion: 2.1 time: 0.236541 Jul 24 01:32:43.648931 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2293/4690] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:32:43 2022] DELETE /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:32:43.658632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a2198a6-77c2-491f-83ae-b08290f8044b tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05e9ccfdc0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:43.764622 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a2198a6-77c2-491f-83ae-b08290f8044b tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 353 microversion: 2.1 time: 0.110374 Jul 24 01:32:43.769475 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2398/4691] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:43 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:44.028403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:44.030168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:44.084313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:44.085121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:44.091058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:44.092339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:44.133637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:44.134458 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:44.154414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:44.155449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:44.158709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:44.163017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:44.676979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:44.681333 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:44.689463 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d38aa7b-bc8f-4848-b166-ecc2a928b874 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.665040 Jul 24 01:32:44.695862 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2294/4692] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:44 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:44.713559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:44.715958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:44.744130 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:44.749591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:44.752699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:44.755243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:45.179855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:45.238904 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e634fd6-7b74-492d-b612-1c5a4697684b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.109231 Jul 24 01:32:45.241072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2399/4693] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:44 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:45.267821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88297e36-3f45-46cc-8d57-e08ffa8bad43 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05e9ccf4c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:45.382228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:45.402661 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81fa4b2a-4580-4721-b8a3-29b51cdd2131 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 0.702938 Jul 24 01:32:45.404141 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2295/4694] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:44 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:45.417945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:45.419464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:45.429156 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88297e36-3f45-46cc-8d57-e08ffa8bad43 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 353 microversion: 2.1 time: 0.184922 Jul 24 01:32:45.434372 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2400/4695] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:45 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:45.458187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:45.462067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:45.468119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:45.472972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:45.740171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:45.742514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:45.768673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:45.770342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:45.775543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:45.778025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:46.264191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:46.277327 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-48afff32-87d4-441a-b583-a48f17f28bc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.866494 Jul 24 01:32:46.280575 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2296/4696] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:45 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:46.299228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31d88ec4-06d5-4fcc-ac4c-f29cb6f95dce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:46.308099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-31d88ec4-06d5-4fcc-ac4c-f29cb6f95dce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: b4490f05-1b63-4e5a-9e59-8cf3fddfd58d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:46.332090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-31d88ec4-06d5-4fcc-ac4c-f29cb6f95dce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance b4490f05-1b63-4e5a-9e59-8cf3fddfd58d could not be found. Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31d88ec4-06d5-4fcc-ac4c-f29cb6f95dce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/b4490f05-1b63-4e5a-9e59-8cf3fddfd58d/action HTTP/1.1 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 15 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: {"unpause": {}} Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b4490f05-1b63-4e5a-9e59-8cf3fddfd58d could not be found. Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b4490f05-1b63-4e5a-9e59-8cf3fddfd58d', 'body': {'unpause': {}}} Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4490f05-1b63-4e5a-9e59-8cf3fddfd58d could not be found. Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4490f05-1b63-4e5a-9e59-8cf3fddfd58d could not be found. Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:46.340520 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:46.345015 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:46.345015 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:46.345015 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4490f05-1b63-4e5a-9e59-8cf3fddfd58d could not be found. Jul 24 01:32:46.345015 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:46.345015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31d88ec4-06d5-4fcc-ac4c-f29cb6f95dce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance b4490f05-1b63-4e5a-9e59-8cf3fddfd58d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:46.345015 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-31d88ec4-06d5-4fcc-ac4c-f29cb6f95dce tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/b4490f05-1b63-4e5a-9e59-8cf3fddfd58d/action" status: 404 len: 111 microversion: 2.1 time: 0.047196 Jul 24 01:32:46.346164 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2297/4697] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:46 2022] POST /compute/v2.1/servers/b4490f05-1b63-4e5a-9e59-8cf3fddfd58d/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:46.356649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:46.357278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:46.397618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:46.400781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:46.405402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:46.406187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:46.406394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:46.429050 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd890b6c-aeb0-4609-b407-aa8b0a943666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.718727 Jul 24 01:32:46.437315 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2401/4698] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:45 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:46.445595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:46.462401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:46.479397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:46.485013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:46.486042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:46.489035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:47.334700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:47.352827 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c452c75-67ea-45dc-bfdd-bb30ab9eb90b tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.005494 Jul 24 01:32:47.355778 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2298/4699] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:46 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:47.362121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4753b307-6859-4aaf-990c-324ab1d9303f tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05ea21f280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:47.460172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:47.469960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eea43f1f-c421-4440-b13e-550edc53b12c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 1.029416 Jul 24 01:32:47.482126 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2402/4700] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:46 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:47.489057 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4753b307-6859-4aaf-990c-324ab1d9303f tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 353 microversion: 2.1 time: 0.131732 Jul 24 01:32:47.490070 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2299/4701] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:47 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:47.496969 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:47.502225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:47.502856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:47.512667 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:47.513307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:47.569819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:47.570917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:47.571709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:47.575079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:47.578479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:47.579509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:47.584024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:47.585269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:47.667820 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:48.374887 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:48.446220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:48.460246 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4d4d8278-b8ef-4f72-aa92-e6315c835666 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.969457 Jul 24 01:32:48.461651 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2300/4702] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:47 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:48.474860 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1c16b1f1-c644-4863-b2a8-fedfc74d76f9 req-ce2ea40d-c8f6-41b4-9809-c803943b3031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da", "tag": "f96cacfb-b526-4529-b9eb-7efa1961a98c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:48.500035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1c16b1f1-c644-4863-b2a8-fedfc74d76f9 req-ce2ea40d-c8f6-41b4-9809-c803943b3031 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:48.500694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1c16b1f1-c644-4863-b2a8-fedfc74d76f9 req-ce2ea40d-c8f6-41b4-9809-c803943b3031 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:48.536637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:48.564235 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-74f19919-2f57-4b13-a94b-b94756d9c772 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.079501 Jul 24 01:32:48.572112 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2403/4703] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:47 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:48.581890 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1c16b1f1-c644-4863-b2a8-fedfc74d76f9 req-ce2ea40d-c8f6-41b4-9809-c803943b3031 service nova] Creating event network-changed:f96cacfb-b526-4529-b9eb-7efa1961a98c for instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da on n-h1-master-1 Jul 24 01:32:48.597084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:48.599828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:48.602822 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1c16b1f1-c644-4863-b2a8-fedfc74d76f9 req-ce2ea40d-c8f6-41b4-9809-c803943b3031 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139370 Jul 24 01:32:48.609563 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2301/4704] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:48.612170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:48.612631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:48.614519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:48.614966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:48.628666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c4c9fc0-44b5-47c2-bc95-b59cd5f13052 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05ea193d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:48.781265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c4c9fc0-44b5-47c2-bc95-b59cd5f13052 tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 200 len: 353 microversion: 2.1 time: 0.170224 Jul 24 01:32:48.782317 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2302/4705] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:48 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:48.790553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:48.791847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:48.831171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:48.834737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:48.837282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:48.845190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:48.872692 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Cannot 'unpause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action HTTP/1.1 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 15 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: {"unpause": {}} Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'unpause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'unpause': {}}} Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de in vm_state active. Cannot unpause while the instance is in this state. Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:48.874792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:48.879602 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:48.879602 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:48.879602 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:48.879602 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:48.879602 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:48.880801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 409 to user: Cannot 'unpause' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:48.881938 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3e91c0b-3de2-423a-8f13-bf8c7358c0df tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 409 len: 145 microversion: 2.1 time: 0.098593 Jul 24 01:32:48.892259 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2303/4706] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:48 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 145 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 24 01:32:48.898181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:48.899193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:48.907541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:48.908299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:48.910099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:48.911421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:49.894387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:49.904623 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03b2481d-041d-4259-a82b-12a4d668cc68 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.010849 Jul 24 01:32:49.917764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:49.918693 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2304/4707] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:48 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:49.925949 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a088513-2d0a-431e-b8f1-cdb1d0b173a6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 1.353313 Jul 24 01:32:49.928633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2404/4708] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:48 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:49.969029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:49.969661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:49.990238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:49.990666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:49.993152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:49.996416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:50.316195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:50.325196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aec0da56-460e-48d6-a6c3-264077464d67 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.377594 Jul 24 01:32:50.325811 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2305/4709] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:49 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:50.379403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42ed4f72-a632-445a-b0e6-220416e240aa tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Calling method '.version_select at 0x7f05ea1dc430>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:50.473100 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-42ed4f72-a632-445a-b0e6-220416e240aa tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] HTTP exception thrown: Volume a610e1ec-1bc8-45f5-8d55-771abf44d00b could not be found. Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42ed4f72-a632-445a-b0e6-220416e240aa tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Request method failure captured: Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b HTTP/1.1 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KE2nA1FsrrgPwOwAhcaXjk9ialLTmknXQ3mIHZNUxVg8jdzEuyOOxunnu7_SZPTrrJNHukPaSG0SytSnhp0f3X23b5hAgQ83h4qByQQyjsQRqQWe2UOctKvvL9DgbIsQXjcEq5--pdgBPbsfimtKeX8IkU6WYEo1J3GP8N-lVj0pq8 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 36a8a8aec8f94f20930d073277b5c516 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesGetTestJSON-1616978727 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36a8a8aec8f94f20930d073277b5c516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36a8a8aec8f94f20930d073277b5c516"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36a8a8aec8f94f20930d073277b5c516", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36a8a8aec8f94f20930d073277b5c516"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesGetTestJSON-1616978727 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 36a8a8aec8f94f20930d073277b5c516 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesGetTestJSON-1616978727 Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesGetTestJSON-1616978727-project Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a175648d864b49f3bae2d022c1b303dc Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesGetTestJSON-1616978727-project Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: exception: Volume a610e1ec-1bc8-45f5-8d55-771abf44d00b could not be found. Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a610e1ec-1bc8-45f5-8d55-771abf44d00b'} Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a610e1ec-1bc8-45f5-8d55-771abf44d00b could not be found. (HTTP 404) (Request-ID: req-d72a2d24-220f-4ac5-8f29-0216fc385fb0) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:32:50.475522 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a610e1ec-1bc8-45f5-8d55-771abf44d00b could not be found. Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a610e1ec-1bc8-45f5-8d55-771abf44d00b could not be found. Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a610e1ec-1bc8-45f5-8d55-771abf44d00b could not be found. Jul 24 01:32:50.481521 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:50.485601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42ed4f72-a632-445a-b0e6-220416e240aa tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] Returning 404 to user: Volume a610e1ec-1bc8-45f5-8d55-771abf44d00b could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:50.487881 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42ed4f72-a632-445a-b0e6-220416e240aa tempest-VolumesGetTestJSON-1616978727 tempest-VolumesGetTestJSON-1616978727-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b" status: 404 len: 109 microversion: 2.1 time: 0.161007 Jul 24 01:32:50.488820 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2306/4710] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:32:50 2022] GET /compute/v2.1/os-volumes/a610e1ec-1bc8-45f5-8d55-771abf44d00b => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:50.500520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:50.506727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:50.521824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:50.529184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:50.530561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:50.539113 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:50.680405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-729aed08-e8e7-4346-ab70-74f4b08ef2a9 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Action: 'create', calling method: .version_select at 0x7f05e9cf2280>, body: {"keypair": {"name": "tempest-keypair-503615692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfWG9aSMAM+ST3eK3wDtq2/ehMJGQkj3/gJFL1A02r6en9ZKRJC3U7rvxi7EW+ZV5+Hk7l1LW6LtHZumNG+XJG+PMv0031tf+7N/0vTouZYZ8mafCKN564BdwtovIwGZA=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:50.781286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-729aed08-e8e7-4346-ab70-74f4b08ef2a9 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Getting quotas for project 0d638e520c9c4152afb6125e91dcb399. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:32:50.814060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-729aed08-e8e7-4346-ab70-74f4b08ef2a9 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Getting quotas for user e0b873c4cd7b4558ab357acff39f0253 and project 0d638e520c9c4152afb6125e91dcb399. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:32:50.886186 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-729aed08-e8e7-4346-ab70-74f4b08ef2a9 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.952925 Jul 24 01:32:50.894634 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2405/4711] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:32:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:50.950513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:50.951259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:50.977058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:50.977522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:50.984524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:50.986262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:52.058359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:52.076166 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-10bfddf0-3d5f-418a-9e13-a739bc4742da tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 1.586082 Jul 24 01:32:52.077260 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2307/4712] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:50 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:52.103239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:52.104170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:52.145303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:52.145834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:52.146656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:52.147108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:52.200464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:52.218173 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2be6692-9c33-4dc7-b01f-ca1cf03522f1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 1.266019 Jul 24 01:32:52.232604 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2406/4713] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:50 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:52.264853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0de53f2e-30c9-47f5-aa9b-8b1e5b001077 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:52.278583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0de53f2e-30c9-47f5-aa9b-8b1e5b001077 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 3fba33da-ec7f-4d16-98ad-aaff872f1860] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:52.296276 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-0de53f2e-30c9-47f5-aa9b-8b1e5b001077 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 3fba33da-ec7f-4d16-98ad-aaff872f1860 could not be found. Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0de53f2e-30c9-47f5-aa9b-8b1e5b001077 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/3fba33da-ec7f-4d16-98ad-aaff872f1860/action HTTP/1.1 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 18 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: {"unshelve": null} Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 3fba33da-ec7f-4d16-98ad-aaff872f1860 could not be found. Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '3fba33da-ec7f-4d16-98ad-aaff872f1860', 'body': {'unshelve': None}} Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fba33da-ec7f-4d16-98ad-aaff872f1860 could not be found. Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fba33da-ec7f-4d16-98ad-aaff872f1860 could not be found. Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:52.302334 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:52.307514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:52.307514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:52.307514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:52.307514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:52.307514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fba33da-ec7f-4d16-98ad-aaff872f1860 could not be found. Jul 24 01:32:52.307514 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:52.310132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0de53f2e-30c9-47f5-aa9b-8b1e5b001077 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 3fba33da-ec7f-4d16-98ad-aaff872f1860 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:52.313937 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0de53f2e-30c9-47f5-aa9b-8b1e5b001077 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/3fba33da-ec7f-4d16-98ad-aaff872f1860/action" status: 404 len: 111 microversion: 2.1 time: 0.076416 Jul 24 01:32:52.317538 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2407/4714] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:52 2022] POST /compute/v2.1/servers/3fba33da-ec7f-4d16-98ad-aaff872f1860/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:52.336989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:52.343836 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:52.368872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:52.369412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:52.370833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:52.375662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:52.844007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:52.857047 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7031c33a-2bc1-4812-a83d-185a1a07369b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.776142 Jul 24 01:32:52.861844 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2308/4715] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:52 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:53.065944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:53.079186 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-508724bf-ba9b-4e07-ba3b-b296959b5dc7 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.752763 Jul 24 01:32:53.080917 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2408/4716] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:52 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:53.108454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:53.110087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:53.151451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.152326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.153385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.154153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.236114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:53.236739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:53.243305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.244063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.245507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.246140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.658880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:53.685186 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6b63305-08c4-47d3-8bd3-4782d37c9b27 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.579883 Jul 24 01:32:53.688708 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2309/4717] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:53 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:53.713495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:53.715387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:53.738372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:53.743946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.748203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.749083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.749578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.756477 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e919a1c7-ee59-4550-86c7-84b47b32f929 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 0.524769 Jul 24 01:32:53.762180 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2409/4718] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:53 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:53.843325 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Cannot 'unshelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action HTTP/1.1 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 18 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: {"unshelve": null} Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: exception: Cannot 'unshelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'unshelve': None}} Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de in vm_state active. Cannot unshelve while the instance is in this state. Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 24 01:32:53.845391 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active Jul 24 01:32:53.851345 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:53.856145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 409 to user: Cannot 'unshelve' instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de while it is in vm_state active {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:53.858769 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ad722f0b-343e-4a7b-86bf-921d5db4a718 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action" status: 409 len: 146 microversion: 2.1 time: 0.155646 Jul 24 01:32:53.864318 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2310/4719] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:32:53 2022] POST /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de/action => generated 146 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:32:53.870615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:53.871291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:53.888845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:53.889484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:53.906188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.907049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.908181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.909384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.942626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.943515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:53.944674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:53.945438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:54.710122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:54.726080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:54.735857 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d88fb47-131a-4d74-9f8e-e7b2bfa1ff27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.852778 Jul 24 01:32:54.737219 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b839a7ee-18e1-491b-a52e-5192aa5367ae tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.873296 Jul 24 01:32:54.754158 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2410/4720] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:53 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:54.754398 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2311/4721] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:53 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:54.765405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:54.767256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:54.780084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:54.781962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:54.800604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:54.801687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:54.802753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:54.803588 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:54.804031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:54.807890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:54.809047 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:54.809512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:55.575293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:55.605490 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43793809-115b-46bb-82e5-c84dbdfcd866 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.847443 Jul 24 01:32:55.626097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:55.626378 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2411/4722] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:54 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:55.637152 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d22316b1-b527-42e9-b1ad-d847b0e7449e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 0.862067 Jul 24 01:32:55.639282 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2312/4723] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:54 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:55.667328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1adbcc3b-2174-4e74-94c1-a332d3a76c16 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-21151451_updated"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:55.677138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1adbcc3b-2174-4e74-94c1-a332d3a76c16 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: e89e7945-b3f5-4140-8934-0a20d6465e54] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:55.704128 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1adbcc3b-2174-4e74-94c1-a332d3a76c16 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance e89e7945-b3f5-4140-8934-0a20d6465e54 could not be found. Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1adbcc3b-2174-4e74-94c1-a332d3a76c16 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: request: PUT /compute/v2.1/servers/e89e7945-b3f5-4140-8934-0a20d6465e54 HTTP/1.1 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 79 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-21151451_updated"}} Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: exception: Instance e89e7945-b3f5-4140-8934-0a20d6465e54 could not be found. Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e89e7945-b3f5-4140-8934-0a20d6465e54', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-21151451_updated'}}} Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89e7945-b3f5-4140-8934-0a20d6465e54 could not be found. Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 24 01:32:55.716196 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89e7945-b3f5-4140-8934-0a20d6465e54 could not be found. Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89e7945-b3f5-4140-8934-0a20d6465e54 could not be found. Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1adbcc3b-2174-4e74-94c1-a332d3a76c16 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance e89e7945-b3f5-4140-8934-0a20d6465e54 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:55.725478 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1adbcc3b-2174-4e74-94c1-a332d3a76c16 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "PUT /compute/v2.1/servers/e89e7945-b3f5-4140-8934-0a20d6465e54" status: 404 len: 111 microversion: 2.1 time: 0.079984 Jul 24 01:32:55.727565 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2412/4724] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:32:55 2022] PUT /compute/v2.1/servers/e89e7945-b3f5-4140-8934-0a20d6465e54 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:55.739252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:55.740560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:55.752026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:55.761207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:55.762237 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:55.768975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:55.770444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:55.780940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:55.798664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:55.799133 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:55.799953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:55.800410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:56.583517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:56.610300 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf0ee3f7-ab44-4b0e-8d51-46acb7cfc668 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.868655 Jul 24 01:32:56.614925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2313/4725] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:55 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:56.633036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:56.634135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:56.662128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:56.662977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:56.665238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:56.665891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:56.697008 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:56.721107 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-11ca3385-39a6-481c-ad79-7868f1152b29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.960420 Jul 24 01:32:56.733508 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2413/4726] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:55 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:32:56.763019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:56.763671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:56.797304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:56.802210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:56.803431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:56.803904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:57.405135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:57.424818 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-372c9d09-127b-41ee-9eb9-22f9bafbce9f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.798025 Jul 24 01:32:57.439736 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2314/4727] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:56 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:57.449380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2c56050f-88e5-4bf8-818d-ca5d8a34f668 req-dd961411-48a1-43aa-aad9-5395125df9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da", "name": "network-vif-plugged", "status": "completed", "tag": "f96cacfb-b526-4529-b9eb-7efa1961a98c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:57.478318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2c56050f-88e5-4bf8-818d-ca5d8a34f668 req-dd961411-48a1-43aa-aad9-5395125df9a0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:57.479721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2c56050f-88e5-4bf8-818d-ca5d8a34f668 req-dd961411-48a1-43aa-aad9-5395125df9a0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:57.515461 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2c56050f-88e5-4bf8-818d-ca5d8a34f668 req-dd961411-48a1-43aa-aad9-5395125df9a0 service nova] Creating event network-vif-plugged:f96cacfb-b526-4529-b9eb-7efa1961a98c for instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da on n-h1-master-1 Jul 24 01:32:57.526638 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2c56050f-88e5-4bf8-818d-ca5d8a34f668 req-dd961411-48a1-43aa-aad9-5395125df9a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083318 Jul 24 01:32:57.527263 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2315/4728] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:32:57.535342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d86bbce-1cb0-48e1-b00d-c5d478498e11 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d86bbce-1cb0-48e1-b00d-c5d478498e11 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de HTTP/1.1 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 280 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:57.540664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:32:57.545534 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:57.548275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d86bbce-1cb0-48e1-b00d-c5d478498e11 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:57.549338 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d86bbce-1cb0-48e1-b00d-c5d478498e11 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "PUT /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 400 len: 619 microversion: 2.1 time: 0.020981 Jul 24 01:32:57.550578 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2316/4729] 10.222.0.27 () {60 vars in 1256 bytes} [Sun Jul 24 01:32:57 2022] PUT /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:32:57.562494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:57.564198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:57.572459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:57.573629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:57.575018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:57.575683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:57.876779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:57.889113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e7f415c6-d3b3-4c54-b617-bb0cb6b15a23 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 1.154379 Jul 24 01:32:57.889732 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2414/4730] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:56 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:57.910956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:57.913080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:57.935546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:57.936315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:57.937332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:57.940727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:58.139739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:58.148423 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2b266b64-ea1c-45d2-8b1f-40fa57bf3fc9 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.592674 Jul 24 01:32:58.183876 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2317/4731] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:57 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:58.215331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:58.216515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:58.235045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:58.236431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:58.237407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:58.238072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:58.279128 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:58.467072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:58.481626 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-92533ed4-cb98-4653-94e5-b4617876e833 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.588749 Jul 24 01:32:58.484226 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2415/4732] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:57 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:58.492861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "95667b0e-cfd8-4f14-b405-ea77d97e116b"}], "security_groups": [{"name": "tempest-securitygroup--590346814"}], "key_name": "tempest-keypair-503615692", "user_data": "}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:58.858741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] validate_networks() for [('95667b0e-cfd8-4f14-b405-ea77d97e116b', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:32:58.891679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:58.934262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61ba0483-e5fc-472c-b9d0-f5b01d60d0fc tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.732297 Jul 24 01:32:58.945402 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2318/4733] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:58 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:58.948290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:58.955029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:58.965715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:58.965715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:58.965715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:58.969996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:59.770084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:32:59.785371 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8d7f49a6-fccd-44b9-9f8a-c08d79948958 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1364 microversion: 2.1 time: 0.846157 Jul 24 01:32:59.798103 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2319/4734] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:58 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1364 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:32:59.804775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59dd7466-b8b3-49cb-a2e5-ab31cd0f7a7c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59dd7466-b8b3-49cb-a2e5-ab31cd0f7a7c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de HTTP/1.1 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 24 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": ""}} Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de', 'body': {'server': {'name': ''}}} Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise error Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi '' Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 01:32:59.809206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 24 01:32:59.815017 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:32:59.816638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59dd7466-b8b3-49cb-a2e5-ab31cd0f7a7c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:32:59.818086 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59dd7466-b8b3-49cb-a2e5-ab31cd0f7a7c tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "PUT /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 400 len: 108 microversion: 2.1 time: 0.018288 Jul 24 01:32:59.819940 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2320/4735] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:32:59 2022] PUT /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:32:59.833803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:32:59.834469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:32:59.850662 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:59.851121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:32:59.851915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:32:59.852363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:00.843560 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:01.024782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:01.052228 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7bb3a994-0ddb-4081-8930-b98a642070d7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 1.230941 Jul 24 01:33:01.071260 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2321/4736] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:59 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:01.077628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:01.078638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:01.087236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:01.088910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:01.090563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:01.091244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:01.472523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:33:01.473216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:33:01.473913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:33:01.474518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:33:01.475101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:33:01.480146 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:01.496467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:01.497114 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:01.504595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:01.508590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:01.564768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Getting quotas for project 0d638e520c9c4152afb6125e91dcb399. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:33:01.573177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Getting quotas for user e0b873c4cd7b4558ab357acff39f0253 and project 0d638e520c9c4152afb6125e91dcb399. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:33:01.606236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:33:01.609249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:33:01.617285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:01.638989 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da137300-5ebd-4d69-a967-7650fb307d3d tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1505 microversion: 2.1 time: 0.563732 Jul 24 01:33:01.640394 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2322/4737] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:01 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:01.674428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:01.675187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:01.689996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:01.690285 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9970d50-e76f-4961-928a-153b8c2af0dd tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.202008 Jul 24 01:33:01.690452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:01.691255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:01.691512 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2416/4738] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:32:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 3205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:33:01.691697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:01.714958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff072e2b-4977-4e66-974f-c7d7b6b8ec95 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:01.717946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff072e2b-4977-4e66-974f-c7d7b6b8ec95 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:02.075075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff072e2b-4977-4e66-974f-c7d7b6b8ec95 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:02.084780 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff072e2b-4977-4e66-974f-c7d7b6b8ec95 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1225 microversion: 2.1 time: 0.385676 Jul 24 01:33:02.105039 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2417/4739] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:01 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1225 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:02.128627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:02.131785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:02.160911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:02.163124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:02.166698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:02.167334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:02.246893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:02.288260 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9599ec9-06ac-4ed3-aeae-fec1cb43b333 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1550 microversion: 2.1 time: 0.641309 Jul 24 01:33:02.291932 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2323/4740] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:01 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1550 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:02.319888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5dfdb5f7-84f8-4f2d-8bc5-13cea02a36c3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:02.322866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5dfdb5f7-84f8-4f2d-8bc5-13cea02a36c3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:02.348351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfdb5f7-84f8-4f2d-8bc5-13cea02a36c3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:02.355638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfdb5f7-84f8-4f2d-8bc5-13cea02a36c3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:02.364235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfdb5f7-84f8-4f2d-8bc5-13cea02a36c3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:02.365333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dfdb5f7-84f8-4f2d-8bc5-13cea02a36c3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:02.621070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:02.632891 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-54f6ead9-3eeb-4472-ba7e-3a52664b85ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 0.526650 Jul 24 01:33:02.635259 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2418/4741] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:02 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:02.896622 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5dfdb5f7-84f8-4f2d-8bc5-13cea02a36c3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.590711 Jul 24 01:33:02.904669 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2324/4742] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:33:02 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-interface => generated 284 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:03.105037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:03.105742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:03.125885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:03.129510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:03.130932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:03.132498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:03.178081 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:03.428238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:03.459798 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7c2f7a3-48e4-4dd5-b6c6-bc239e9dbeb7 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1229 microversion: 2.1 time: 0.359505 Jul 24 01:33:03.476447 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2419/4743] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:03 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1229 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:03.652942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:03.653882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:03.676947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:03.677475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:03.679491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:03.688170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:04.492801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:04.494819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:04.513800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:04.516087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:04.520870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:04.521759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:04.882943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:04.893637 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9415e5d4-a55b-46fa-847b-577c8070e362 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1295 microversion: 2.1 time: 0.405020 Jul 24 01:33:04.905273 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2420/4744] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:04 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1295 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:05.133080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:05.145008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8cc3a6a1-da30-4ee1-818a-04e145d2811e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 1.496749 Jul 24 01:33:05.160823 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2325/4745] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:03 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:05.923630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:05.924905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:05.959656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:05.960163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:05.961008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:05.961452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:06.162589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:06.163432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:06.166928 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:06.191791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:06.206546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:06.214245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:06.215457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:06.297111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:06.312393 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cd2f058a-0268-4ea7-9987-93cd86ff00f4 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1283 microversion: 2.1 time: 0.393900 Jul 24 01:33:06.318167 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2421/4746] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:05 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1283 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:07.122494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-37c01b5d-8f42-48f7-8a6f-bf2a97c3462a req-16c9e2b6-0f26-4880-bf8f-f352d2d68aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da", "tag": "f96cacfb-b526-4529-b9eb-7efa1961a98c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:07.154723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-37c01b5d-8f42-48f7-8a6f-bf2a97c3462a req-16c9e2b6-0f26-4880-bf8f-f352d2d68aef service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:07.155570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-37c01b5d-8f42-48f7-8a6f-bf2a97c3462a req-16c9e2b6-0f26-4880-bf8f-f352d2d68aef service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:07.226915 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-37c01b5d-8f42-48f7-8a6f-bf2a97c3462a req-16c9e2b6-0f26-4880-bf8f-f352d2d68aef service nova] Creating event network-changed:f96cacfb-b526-4529-b9eb-7efa1961a98c for instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da on n-h1-master-1 Jul 24 01:33:07.264195 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-37c01b5d-8f42-48f7-8a6f-bf2a97c3462a req-16c9e2b6-0f26-4880-bf8f-f352d2d68aef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145630 Jul 24 01:33:07.268872 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2422/4747] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:33:07.278457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:07.304455 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-613c2c15-0c2a-4244-a500-416d42be50c6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 1.146036 Jul 24 01:33:07.305056 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2326/4748] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:06 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:07.332078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:07.333083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:07.358842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:07.362763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:07.365478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:07.372312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:08.323458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:08.324685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:08.344789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:08.348172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:08.349863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:08.356574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:09.592187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:09.608877 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ce371862-c73d-468c-babd-262718297791 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 2.281165 Jul 24 01:33:09.612737 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2423/4749] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:07 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:09.846921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:09.861963 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6043d7a9-3487-4598-9d7f-6ec19e0e6f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1680 microversion: 2.1 time: 1.543015 Jul 24 01:33:09.876441 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2327/4750] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:08 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1680 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:10.628137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:10.628765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:10.640738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:10.641450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:10.644589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:10.646444 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:10.884939 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:10.886657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:10.909705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:10.912434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:10.916636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:10.920452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:11.406101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:11.424721 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3f2b9633-bd2e-4d05-a1a6-a1cee486d323 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 0.800217 Jul 24 01:33:11.430551 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2424/4751] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:10 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:11.444371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-06275215-83f8-4448-ba56-9c380bc6b3af req-e8e5b3dc-98ce-4616-830c-ddfdcb4161ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2141b68a-e9f7-4f81-a504-41eb9507586c", "tag": "e3df1518-b0e5-4c9a-b615-ac64e852117d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:11.528209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-06275215-83f8-4448-ba56-9c380bc6b3af req-e8e5b3dc-98ce-4616-830c-ddfdcb4161ac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:11.528675 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-06275215-83f8-4448-ba56-9c380bc6b3af req-e8e5b3dc-98ce-4616-830c-ddfdcb4161ac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:11.540050 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:11.554387 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-06275215-83f8-4448-ba56-9c380bc6b3af req-e8e5b3dc-98ce-4616-830c-ddfdcb4161ac service nova] Creating event network-changed:e3df1518-b0e5-4c9a-b615-ac64e852117d for instance 2141b68a-e9f7-4f81-a504-41eb9507586c on n-h2-master-1 Jul 24 01:33:11.561892 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-06275215-83f8-4448-ba56-9c380bc6b3af req-e8e5b3dc-98ce-4616-830c-ddfdcb4161ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128930 Jul 24 01:33:11.563146 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2425/4752] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:11.732659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:11.742244 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-db302f08-a39d-4016-b254-b7fbc4649f75 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.861857 Jul 24 01:33:11.748740 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2328/4753] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:10 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:11.896584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:11.897300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:11.911744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:11.914523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:11.917479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:11.918922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:12.086414 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:12.335196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:12.346676 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f1dda79-ad1d-4507-9ded-bb7fd566381c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.453413 Jul 24 01:33:12.361523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2426/4754] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:11 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:12.444828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:12.445465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:12.463659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:12.464610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:12.466271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:12.468228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:12.866947 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:12.876747 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b690431-29be-431b-828c-cd67a3870ee0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 0.436806 Jul 24 01:33:12.878927 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2329/4755] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:12 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:13.528439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-992885ef-36ad-4f0e-bd91-1fbba18e8e68 req-fb30fdcc-802f-4660-aeae-019d1d777a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-unplugged", "status": "completed", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:13.557866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-992885ef-36ad-4f0e-bd91-1fbba18e8e68 req-fb30fdcc-802f-4660-aeae-019d1d777a70 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.559623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-992885ef-36ad-4f0e-bd91-1fbba18e8e68 req-fb30fdcc-802f-4660-aeae-019d1d777a70 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.621197 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-992885ef-36ad-4f0e-bd91-1fbba18e8e68 req-fb30fdcc-802f-4660-aeae-019d1d777a70 service nova] Creating event network-vif-unplugged:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:33:13.637290 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-992885ef-36ad-4f0e-bd91-1fbba18e8e68 req-fb30fdcc-802f-4660-aeae-019d1d777a70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116096 Jul 24 01:33:13.641290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:13.644413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:13.644975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2427/4756] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:13.664351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.664847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.665753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.666215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.705004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 HTTP/1.1 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: exception: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'cf3adf5d-740b-4b11-a7cb-6656c7160ab2'} Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:33:13.706755 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-369d074a-ad3c-426c-9778-84f4d1d5f838 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 404 len: 111 microversion: 2.1 time: 0.073243 Jul 24 01:33:13.713206 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2330/4757] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:33:13 2022] DELETE /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:33:13.720863 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:13.721957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: cf3adf5d-740b-4b11-a7cb-6656c7160ab2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:13.741368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.742819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.744237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.745101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.817055 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 HTTP/1.1 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: exception: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'cf3adf5d-740b-4b11-a7cb-6656c7160ab2'} Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:33:13.823289 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance cf3adf5d-740b-4b11-a7cb-6656c7160ab2 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:33:13.830065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba3c40c8-4384-45d8-80c2-41f75c4d1672 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2" status: 404 len: 111 microversion: 2.1 time: 0.109326 Jul 24 01:33:13.836403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:13.836923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:13.843994 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2428/4758] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:13 2022] GET /compute/v2.1/servers/cf3adf5d-740b-4b11-a7cb-6656c7160ab2 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:33:13.848976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.849448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.850336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.850791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.898228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:13.898893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:13.912883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.913730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:33:13.926813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:13.932279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:13.932740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:14.335715 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-772bf828-66e0-45c1-bb04-a931104b86e1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 204 len: 0 microversion: 2.1 time: 0.503161 Jul 24 01:33:14.336656 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2331/4759] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:33:13 2022] DELETE /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:33:14.352906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:14.353652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:14.388927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:14.389341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:14.390173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:14.390621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:15.089130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:15.098921 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98a9633d-679e-477a-9258-431057c173d6 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 1.205115 Jul 24 01:33:15.099503 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2429/4760] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:13 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:15.135400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:15.136028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:15.154304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:15.157895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:15.158768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:15.159224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:15.191201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:15.200176 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ddcc927-725a-41ca-88f8-fbd540ca8c50 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1511 microversion: 2.1 time: 0.855771 Jul 24 01:33:15.207155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2332/4761] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:14 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1511 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:16.132633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:16.133140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:16.153647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:16.154032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:16.154735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:16.155182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:16.622278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:16.636419 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c640e16d-df3d-464f-b1ae-f4b2c8728877 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 1.505394 Jul 24 01:33:16.636834 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2430/4762] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:15 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:16.658812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:16.659535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:16.705020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:16.705504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:16.706368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:16.708906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:17.072276 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:17.086425 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4e809689-8cda-4dc0-bc5e-f687126994c1 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1511 microversion: 2.1 time: 0.440808 Jul 24 01:33:17.090981 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2431/4763] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:16 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:17.103101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:17.106745 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:17.126578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:17.127256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:17.136865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:17.140458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:17.446274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:17.493980 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7da25f2c-d2c6-4d8b-9943-308ea38504ff tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 1.380731 Jul 24 01:33:17.512348 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2333/4764] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:16 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:17.586809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1915c0e0-ed64-4ff0-b7dd-b99c180a1f82 req-3c1c76b1-33c3-4b9f-9d61-50789546dd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1cd906-b406-46dd-bd65-fe0292f7c9de", "name": "network-vif-deleted", "tag": "aa20a123-c219-46a0-959b-811824ea97c7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:17.614482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:17.640254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1915c0e0-ed64-4ff0-b7dd-b99c180a1f82 req-3c1c76b1-33c3-4b9f-9d61-50789546dd59 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:17.640814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1915c0e0-ed64-4ff0-b7dd-b99c180a1f82 req-3c1c76b1-33c3-4b9f-9d61-50789546dd59 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:17.646891 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-49ed5f37-3dff-442f-a667-a7a3c272ee07 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.554195 Jul 24 01:33:17.647597 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2432/4765] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:17 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:17.668264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:17.670175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:17.683909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:17.687803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:17.690217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:17.690918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:17.693466 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1915c0e0-ed64-4ff0-b7dd-b99c180a1f82 req-3c1c76b1-33c3-4b9f-9d61-50789546dd59 service nova] Creating event network-vif-deleted:aa20a123-c219-46a0-959b-811824ea97c7 for instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de on n-h1-master-1 Jul 24 01:33:17.704228 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1915c0e0-ed64-4ff0-b7dd-b99c180a1f82 req-3c1c76b1-33c3-4b9f-9d61-50789546dd59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125144 Jul 24 01:33:17.707333 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2334/4766] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:18.110269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:18.111144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:18.147991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.152562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.154665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.155162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.237478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:18.250814 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-786c85fb-cc4b-4256-8b86-b0b1cde1672b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.586041 Jul 24 01:33:18.252471 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2433/4767] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:17 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:18.259558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.260211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.260839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lazy-loading 'fault' on Instance uuid 6a1cd906-b406-46dd-bd65-fe0292f7c9de {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:33:18.273424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d5a5698d-a2ff-4c51-933d-d1c07d3ed2a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:18.275366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d5a5698d-a2ff-4c51-933d-d1c07d3ed2a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:18.297001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5a5698d-a2ff-4c51-933d-d1c07d3ed2a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.299749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5a5698d-a2ff-4c51-933d-d1c07d3ed2a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.301965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5a5698d-a2ff-4c51-933d-d1c07d3ed2a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.303643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d5a5698d-a2ff-4c51-933d-d1c07d3ed2a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.425192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014d9b85786b4a22b71463e346159fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da60c4b9da1b4445a038238d0db2927e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:18.442844 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:18.452789 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f2a47ed-7b26-4a2a-b2d3-1be6e1c5662f tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 200 len: 1307 microversion: 2.1 time: 0.347426 Jul 24 01:33:18.458413 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2335/4768] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:18 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 1307 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:18.492375 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d5a5698d-a2ff-4c51-933d-d1c07d3ed2a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.224843 Jul 24 01:33:18.496948 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2434/4769] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:33:18 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:33:18.505997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:18.507034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:18.545141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.546993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.548186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:18.549250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.550350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:18.554286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.588770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.589113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:18.589997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:18.590485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:19.275417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:19.301125 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ca3804d-1a9d-48a2-b20b-70fd2b21ee4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1669 microversion: 2.1 time: 0.784555 Jul 24 01:33:19.304939 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2336/4770] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:18 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1669 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:19.316671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:19.330016 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e55e417e-eb5f-4060-865f-cda5d73e6b51 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 0.801016 Jul 24 01:33:19.332123 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2435/4771] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:18 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:19.485179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:19.488998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] [instance: 6a1cd906-b406-46dd-bd65-fe0292f7c9de] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:19.502838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:19.503290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:19.522318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:19.522831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:19.568668 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] HTTP exception thrown: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de could not be found. Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Request method failure captured: Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de HTTP/1.1 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KA6PkRUUQSEy6yQvVR1Ub4YYH7RgkxE0tonKIwCiYSojJUaPb_-o-WqWJwW64tR7Uiaqo-JLvSP3ARX3-XowPSTos_qweBeqx8R5VUnFC-1eY_MJYN3ytQcncwzHPP8FKOqva_di0ZUfyer4obuC3W8vr4_WwgDM3OyJIC6G5hT9uw Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da60c4b9da1b4445a038238d0db2927e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da60c4b9da1b4445a038238d0db2927e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: da60c4b9da1b4445a038238d0db2927e Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1376879131 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 014d9b85786b4a22b71463e346159fc4 Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1376879131-project Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de could not be found. Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6a1cd906-b406-46dd-bd65-fe0292f7c9de'} Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de could not be found. Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de could not be found. Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:33:19.574999 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de could not be found. Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] Returning 404 to user: Instance 6a1cd906-b406-46dd-bd65-fe0292f7c9de could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:33:19.579061 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f2529554-0a72-4cbe-970c-6f53dd2cff24 tempest-ServersNegativeTestJSON-1376879131 tempest-ServersNegativeTestJSON-1376879131-project] 10.222.0.27 "GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de" status: 404 len: 111 microversion: 2.1 time: 0.105783 Jul 24 01:33:19.585086 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2337/4772] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:19 2022] GET /compute/v2.1/servers/6a1cd906-b406-46dd-bd65-fe0292f7c9de => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:33:19.827296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8475a122-6447-4b85-b236-b69f2c942acb req-249dd144-c09d-4742-86bc-b8059837169d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2141b68a-e9f7-4f81-a504-41eb9507586c", "name": "network-vif-plugged", "status": "completed", "tag": "e3df1518-b0e5-4c9a-b615-ac64e852117d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:19.860307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8475a122-6447-4b85-b236-b69f2c942acb req-249dd144-c09d-4742-86bc-b8059837169d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:19.890763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8475a122-6447-4b85-b236-b69f2c942acb req-249dd144-c09d-4742-86bc-b8059837169d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:19.962444 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8475a122-6447-4b85-b236-b69f2c942acb req-249dd144-c09d-4742-86bc-b8059837169d service nova] Creating event network-vif-plugged:e3df1518-b0e5-4c9a-b615-ac64e852117d for instance 2141b68a-e9f7-4f81-a504-41eb9507586c on n-h2-master-1 Jul 24 01:33:19.990437 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8475a122-6447-4b85-b236-b69f2c942acb req-249dd144-c09d-4742-86bc-b8059837169d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180608 Jul 24 01:33:20.002443 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2436/4773] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:33:20.323178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:20.323822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:20.338825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:20.349110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:20.349739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:20.350622 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:20.350926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:20.351392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:20.362183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:20.367508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:20.370000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:20.371183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:21.255837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:21.267737 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4278ce4e-62df-4c41-a16a-0c4b154a44d1 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 0.922481 Jul 24 01:33:21.278834 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2437/4774] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:20 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:21.333849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:21.350543 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9a1d590-4b54-4350-9919-157b8eb994e2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1669 microversion: 2.1 time: 1.032470 Jul 24 01:33:21.354593 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2338/4775] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:20 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1669 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:22.286186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:22.287441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:22.305009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:22.305531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:22.308663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:22.309254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:22.349839 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:22.372346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:22.373822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:22.409862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:22.411372 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:22.417635 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:22.418367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:22.880723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:22.891998 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-64745a8b-0ce5-4b99-9a0a-a2d96941696b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.522155 Jul 24 01:33:22.906697 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2339/4776] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:22 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:22.921055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-35eda2fa-be6f-4936-aef5-2e16c0240da3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:22.925179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-35eda2fa-be6f-4936-aef5-2e16c0240da3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:22.940039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35eda2fa-be6f-4936-aef5-2e16c0240da3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:22.941793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35eda2fa-be6f-4936-aef5-2e16c0240da3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:22.942858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35eda2fa-be6f-4936-aef5-2e16c0240da3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:22.943462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35eda2fa-be6f-4936-aef5-2e16c0240da3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:23.017410 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-35eda2fa-be6f-4936-aef5-2e16c0240da3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 200 len: 324 microversion: 2.1 time: 0.109074 Jul 24 01:33:23.024982 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2340/4777] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:33:22 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 324 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:23.036230 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:23.038820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:23.063120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:23.092717 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:23.096297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:23.100395 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-400f6c85-df2f-4fb6-9457-976f3a6196e0 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1350 microversion: 2.1 time: 0.817430 Jul 24 01:33:23.101008 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2438/4778] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:22 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1350 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:23.112283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:23.137746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:24.130448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:24.131159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:24.155980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:24.156449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:24.157235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:24.157690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:24.482291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:24.497823 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-861fcae6-2272-4614-aec7-81af560e2b65 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 1.466497 Jul 24 01:33:24.498726 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2341/4779] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:23 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:24.523382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:24.524296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:24.547193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:24.549354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:24.551764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:24.552328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:24.807867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:24.816450 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d418711c-6b1a-4193-a696-8b0bedebef3f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1540 microversion: 2.1 time: 0.695650 Jul 24 01:33:24.817035 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2439/4780] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:24 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1540 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:24.835543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4233757-4173-4613-9098-d5019c632c9a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:24.836315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4233757-4173-4613-9098-d5019c632c9a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:24.854455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4233757-4173-4613-9098-d5019c632c9a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:24.854924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4233757-4173-4613-9098-d5019c632c9a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:24.855920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4233757-4173-4613-9098-d5019c632c9a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:24.856768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4233757-4173-4613-9098-d5019c632c9a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:25.081721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:25.106936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90834035-b8bb-4b14-9747-72ea8cb5539f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.587772 Jul 24 01:33:25.108107 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2342/4781] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:24 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:25.128403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:25.137412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:25.148713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:25.150107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:25.151174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:25.151779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:25.152836 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4233757-4173-4613-9098-d5019c632c9a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.321946 Jul 24 01:33:25.153708 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2440/4782] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:33:24 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:33:25.766344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:25.777998 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d0974ca-f0e5-45ba-b3b4-10b8c5d54452 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.653263 Jul 24 01:33:25.782062 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2343/4783] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:25 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:25.798854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:25.799470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:25.809214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:25.809707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:25.810487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:25.810926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:26.548223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:26.585850 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a1c8a10-0220-48f4-89e3-5bd556521348 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.790560 Jul 24 01:33:26.593031 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2441/4784] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:25 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:26.815328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2072686633", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "27a9c0f0-0057-4e7d-b288-37b58950f9cd"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:26.919848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] validate_networks() for [('27a9c0f0-0057-4e7d-b288-37b58950f9cd', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:33:28.721121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:33:28.721763 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:33:28.722327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:33:28.722690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:33:28.723028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:33:28.759448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:28.759856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:28.760591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:28.761036 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:28.867356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:33:28.891245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for user f6a5e8716f324b53b51e8d34cb704321 and project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:33:28.927113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:33:28.933173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:33:29.034562 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78302744-e722-484b-aa5b-724455e88aa6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223083 Jul 24 01:33:29.035789 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2344/4785] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:33:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:33:29.046643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6cf3b58-98a7-4f92-82f3-d9d930e7ba37 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:29.047432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6cf3b58-98a7-4f92-82f3-d9d930e7ba37 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:29.616975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e6cf3b58-98a7-4f92-82f3-d9d930e7ba37 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:29.646527 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6cf3b58-98a7-4f92-82f3-d9d930e7ba37 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1215 microversion: 2.1 time: 0.600281 Jul 24 01:33:29.652297 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2442/4786] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:29 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1215 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:30.142382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-dac2fbf0-8291-457b-9bd8-f5143a97ef44 req-181e77db-9e74-4f98-ac59-89f6fa6af553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2141b68a-e9f7-4f81-a504-41eb9507586c", "tag": "e3df1518-b0e5-4c9a-b615-ac64e852117d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:30.160124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dac2fbf0-8291-457b-9bd8-f5143a97ef44 req-181e77db-9e74-4f98-ac59-89f6fa6af553 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:30.160596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dac2fbf0-8291-457b-9bd8-f5143a97ef44 req-181e77db-9e74-4f98-ac59-89f6fa6af553 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:30.207643 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-dac2fbf0-8291-457b-9bd8-f5143a97ef44 req-181e77db-9e74-4f98-ac59-89f6fa6af553 service nova] Creating event network-changed:e3df1518-b0e5-4c9a-b615-ac64e852117d for instance 2141b68a-e9f7-4f81-a504-41eb9507586c on n-h2-master-1 Jul 24 01:33:30.221959 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-dac2fbf0-8291-457b-9bd8-f5143a97ef44 req-181e77db-9e74-4f98-ac59-89f6fa6af553 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097934 Jul 24 01:33:30.226075 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2345/4787] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:30.671531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:30.676848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:30.697116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:30.697577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:30.698410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:30.698850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:31.641664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:31.657512 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7fd62b7f-a92d-4df5-97ea-c43c7f252111 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1267 microversion: 2.1 time: 0.993076 Jul 24 01:33:31.674101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2443/4788] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:30 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1267 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:32.678899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:32.680185 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:32.697266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:32.698201 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:32.699215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:32.699755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:32.863564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:32.878555 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9735a4f1-c908-461f-9352-697067bdce10 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1273 microversion: 2.1 time: 0.203751 Jul 24 01:33:32.879175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2346/4789] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:32 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:33.181694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-02eceb2b-51e2-4fad-8ee0-d384ca1a2ac4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:33.182175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-02eceb2b-51e2-4fad-8ee0-d384ca1a2ac4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:33.199737 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:33.201872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02eceb2b-51e2-4fad-8ee0-d384ca1a2ac4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:33.202450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02eceb2b-51e2-4fad-8ee0-d384ca1a2ac4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:33.203149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02eceb2b-51e2-4fad-8ee0-d384ca1a2ac4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:33.203589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02eceb2b-51e2-4fad-8ee0-d384ca1a2ac4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:33.261944 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-02eceb2b-51e2-4fad-8ee0-d384ca1a2ac4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/ips" status: 200 len: 146 microversion: 2.1 time: 0.077441 Jul 24 01:33:33.268295 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2444/4790] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:33:33 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/ips => generated 146 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:33.896943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:33.898409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:33.912660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:33.913418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:33.916121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:33.916752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:34.222603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:34.232133 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-396ebb4b-6e4e-45f5-83bb-ce427967aa4e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 0.339538 Jul 24 01:33:34.239854 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2347/4791] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:33 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:35.248770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:35.249398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:35.264817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:35.265282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:35.266106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:35.266545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:35.639612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:35.650093 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6e47290-a79e-4934-a7a5-6b54156db6ed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 0.402727 Jul 24 01:33:35.650480 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2445/4792] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:35 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:36.668615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:36.670144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:36.678593 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:36.699189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:36.699658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:36.706363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:36.707410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:37.092387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-52e76db6-e266-40ec-9a2b-41c27017e6e7 req-95010bca-7029-411a-985f-df20429737fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c3e7dd-5b93-4737-a3a5-5a68504f0421", "tag": "7acb899b-af7b-4262-8f28-c343f123dff1"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:37.117153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-52e76db6-e266-40ec-9a2b-41c27017e6e7 req-95010bca-7029-411a-985f-df20429737fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:37.117153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-52e76db6-e266-40ec-9a2b-41c27017e6e7 req-95010bca-7029-411a-985f-df20429737fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:37.147874 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-52e76db6-e266-40ec-9a2b-41c27017e6e7 req-95010bca-7029-411a-985f-df20429737fe service nova] Creating event network-changed:7acb899b-af7b-4262-8f28-c343f123dff1 for instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 on n-h1-master-1 Jul 24 01:33:37.165198 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-52e76db6-e266-40ec-9a2b-41c27017e6e7 req-95010bca-7029-411a-985f-df20429737fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082943 Jul 24 01:33:37.166635 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2446/4793] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:37.310140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:37.323135 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03246f2f-2b51-4178-a164-7569b6ef0ebe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 0.659127 Jul 24 01:33:37.324781 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2348/4794] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:36 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:37.858458 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af8fa830-9d67-4c49-8722-c9dade859f0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35f566f7-0a5c-40e1-a9a2-8ce0548788f9"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:37.859910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af8fa830-9d67-4c49-8722-c9dade859f0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:37.876224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8fa830-9d67-4c49-8722-c9dade859f0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:37.877378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8fa830-9d67-4c49-8722-c9dade859f0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:37.882372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8fa830-9d67-4c49-8722-c9dade859f0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:37.882875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af8fa830-9d67-4c49-8722-c9dade859f0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:38.341017 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af8fa830-9d67-4c49-8722-c9dade859f0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485981 Jul 24 01:33:38.341756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:38.342262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:38.348687 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2447/4795] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:33:37 2022] POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:38.365206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:38.366304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:38.369125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:38.373100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:38.809335 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:38.913014 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:39.826714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:39.849528 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1cba6017-13fd-4ff6-ad39-4ebb96431d4c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 1.502504 Jul 24 01:33:39.850944 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2349/4796] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:38 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:40.869448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:40.870781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:40.896839 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:40.899310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:40.900065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:40.901179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:40.901827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:41.521120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:41.542300 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8daa63d0-5117-4028-b9f4-d1335d157c84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 0.669225 Jul 24 01:33:41.544180 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2448/4797] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:40 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:42.573472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:42.574147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:42.607163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:42.607532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:42.627245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:42.635749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:43.636611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:43.650713 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-655ba187-40c3-4784-b567-6d235a2ced6b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 1.089741 Jul 24 01:33:43.652084 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2350/4798] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:42 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:44.671772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:44.673185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:44.695179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:44.710244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:44.711369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:44.711998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:45.139195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-384f6c4e-b723-4311-b7ae-9748f97fd78a req-73bd9384-203e-4ea8-99e0-76db16d4b305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c3e7dd-5b93-4737-a3a5-5a68504f0421", "name": "network-vif-plugged", "status": "completed", "tag": "7acb899b-af7b-4262-8f28-c343f123dff1"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:45.159430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-384f6c4e-b723-4311-b7ae-9748f97fd78a req-73bd9384-203e-4ea8-99e0-76db16d4b305 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:45.159878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-384f6c4e-b723-4311-b7ae-9748f97fd78a req-73bd9384-203e-4ea8-99e0-76db16d4b305 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:45.229646 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-384f6c4e-b723-4311-b7ae-9748f97fd78a req-73bd9384-203e-4ea8-99e0-76db16d4b305 service nova] Creating event network-vif-plugged:7acb899b-af7b-4262-8f28-c343f123dff1 for instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 on n-h1-master-1 Jul 24 01:33:45.242844 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-384f6c4e-b723-4311-b7ae-9748f97fd78a req-73bd9384-203e-4ea8-99e0-76db16d4b305 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106671 Jul 24 01:33:45.247246 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2351/4799] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:45.550839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:45.564386 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a8e711f-5a07-4a85-9eb2-4d69fd770ccc tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 0.898977 Jul 24 01:33:45.565511 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2449/4800] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:44 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:46.582785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:46.583412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:46.603641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:46.604101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:46.610626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:46.613399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:46.990283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:47.001803 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a3d3625-89e2-4f4a-9bd7-f41799d79a29 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1315 microversion: 2.1 time: 0.423753 Jul 24 01:33:47.005394 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2352/4801] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:46 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:48.021310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:48.022130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:48.032057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:48.034143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:48.035525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:48.036235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:48.502440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:48.518532 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-545ab8bd-ffe0-40db-8952-79e445b35113 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1503 microversion: 2.1 time: 0.500757 Jul 24 01:33:48.533467 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2450/4802] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:48 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1503 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:48.549574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f0099eed-af92-406e-8e78-f3eb5f54c9ff tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:48.578557 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0099eed-af92-406e-8e78-f3eb5f54c9ff tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:48.579299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0099eed-af92-406e-8e78-f3eb5f54c9ff tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:48.650606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f0099eed-af92-406e-8e78-f3eb5f54c9ff tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Going to try to stop instance {{(pid=119562) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:33:48.715186 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=90 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:48.780425 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f0099eed-af92-406e-8e78-f3eb5f54c9ff tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421/action" status: 202 len: 0 microversion: 2.1 time: 0.238366 Jul 24 01:33:48.781813 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2353/4803] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:33:48 2022] POST /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:33:48.792435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:48.793609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:48.802458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:48.803365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:48.804731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:48.806330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:49.442932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:49.480783 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b6b9654-c9c4-4261-8a7b-c4a646c1fc3a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.691199 Jul 24 01:33:49.484469 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2451/4804] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:48 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:50.503253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:50.504087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:50.533339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:50.546776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:50.548000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:50.549083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:51.095210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:51.104438 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f2d01035-edcf-42f1-87d0-c8c20ab06cac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.605990 Jul 24 01:33:51.114831 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2354/4805] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:50 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:51.283709 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22cd4477-de71-4ecf-8ea8-77ea8cb95517 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: .version_select at 0x7f05e9e4b8b0>, body: {"keypair": {"name": "tempest-keypair-539451344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAt7eD6faoZ+gO5Fj/M/gSIC6r1U9HFo8cPZTUXkQbtPG3KuvKah1OjoMQ4px7Qee9uflePqy4iPcrWzlx3WjIQd/roIZf940+LGyL2v/bnntlgNfshHeGnh8LXn9t9Pw=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:51.302431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-22cd4477-de71-4ecf-8ea8-77ea8cb95517 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:33:51.310055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-22cd4477-de71-4ecf-8ea8-77ea8cb95517 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:33:51.388269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22cd4477-de71-4ecf-8ea8-77ea8cb95517 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.372880 Jul 24 01:33:51.392052 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2452/4806] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:33:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:33:52.126377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:52.133196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:52.143115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:52.144488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:52.146337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:52.147520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:52.831858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:52.850729 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2084c72e-8176-4de9-ba23-a019c7c523df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.732044 Jul 24 01:33:52.851939 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2355/4807] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:52 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:53.874827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:53.876417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:53.894249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:53.901213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:53.903843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:53.912095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:53.928946 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:54.633857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:54.649403 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a71112d-8aaf-4234-a337-fa42aaa167b9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.784217 Jul 24 01:33:54.669226 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2453/4808] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:53 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:55.232412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-17667343", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d079b7a7-c0b2-4912-ba85-a51dab0beef6"}], "security_groups": [{"name": "tempest-securitygroup--2131259153"}], "key_name": "tempest-keypair-539451344", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:55.522492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] validate_networks() for [('d079b7a7-c0b2-4912-ba85-a51dab0beef6', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:33:55.581152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f4fd0a8-6b5e-4510-b54a-21ce93982ed3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:33:55.593745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f4fd0a8-6b5e-4510-b54a-21ce93982ed3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:55.594818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f4fd0a8-6b5e-4510-b54a-21ce93982ed3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:55.644303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f4fd0a8-6b5e-4510-b54a-21ce93982ed3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Going to try to stop instance {{(pid=119561) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:33:55.771977 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f4fd0a8-6b5e-4510-b54a-21ce93982ed3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action" status: 202 len: 0 microversion: 2.1 time: 0.194518 Jul 24 01:33:55.775755 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2454/4809] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:33:55 2022] POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:33:55.786483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:55.787216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:55.816578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:55.817301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:55.818310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:55.818749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:56.348616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:56.356966 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2b542df8-e015-4e43-af08-1600c7ef8efb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.578833 Jul 24 01:33:56.357966 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2455/4810] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:55 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:56.375667 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:56.376398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:56.383472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:56.384216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:56.385496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:56.386300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:56.603243 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:33:56.603750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:33:56.604157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:33:56.604562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:33:56.604982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:33:56.623809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:56.627000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:56.627902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:56.628335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:56.688898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:33:56.709817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:33:56.729894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:33:56.733080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:33:56.739290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:56.756397 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab9d3ebe-5284-4e25-9ab9-a488dbdef810 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.396210 Jul 24 01:33:56.768261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2456/4811] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:56 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:56.861220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b755e50c-e0d1-4e4a-9848-8635b5063977 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.635556 Jul 24 01:33:56.892765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f503939-9dcb-4d7a-b8b1-e9a435e0b78b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:56.893758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f503939-9dcb-4d7a-b8b1-e9a435e0b78b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:56.899100 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2356/4812] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:33:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:33:57.048295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f503939-9dcb-4d7a-b8b1-e9a435e0b78b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:57.056686 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f503939-9dcb-4d7a-b8b1-e9a435e0b78b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1239 microversion: 2.1 time: 0.173769 Jul 24 01:33:57.057279 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2457/4813] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:56 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1239 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:57.374330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:57.375500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:57.397953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:57.399833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:57.400891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:57.401506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:57.774829 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:57.776816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:57.778250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:57.790052 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-336a8b7d-cede-446b-bdcd-f5decc295d6f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.417309 Jul 24 01:33:57.792229 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2357/4814] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:57 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:57.814667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:57.817911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:57.818788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:57.819247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:58.077010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:58.077897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:58.091592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:58.091592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:58.092191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:58.093195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:58.220673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:58.225906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:58.230517 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9f16757-aa51-482e-a161-4f778310d6a7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1291 microversion: 2.1 time: 0.157394 Jul 24 01:33:58.235009 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bc98007d-41d2-4c92-aeda-84c96064be15 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.463383 Jul 24 01:33:58.240818 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2358/4815] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:58 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1291 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:58.243098 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2458/4816] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:57 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:58.810526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:58.811025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:58.822288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:58.823190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:58.826052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:58.826739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:59.250264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:59.251856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:59.268473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:59.280323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:59.281333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:59.281830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:59.489381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:59.501523 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0a922a72-f9e0-412a-bbd5-47beb4acb5f0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1297 microversion: 2.1 time: 0.256468 Jul 24 01:33:59.502482 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2459/4817] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:59 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1297 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:33:59.508564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:33:59.511490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:33:59.518965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:59.520773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:59.522703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:33:59.524767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:33:59.686760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:59.698286 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1731db44-a9ce-402f-ba2c-4af996893972 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.893633 Jul 24 01:33:59.709364 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2359/4818] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:58 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:33:59.887085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:33:59.896725 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-db50a387-4b91-4e86-a65e-1c53706d8c92 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.392744 Jul 24 01:33:59.897367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2460/4819] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:33:59 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:00.519684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:00.520176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:00.533080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:00.535040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:00.536612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:00.537443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:00.712425 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:00.723775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:00.725848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:00.754011 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b68ff75-f1e7-4e9b-ac28-ffbc8eb67d69 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1297 microversion: 2.1 time: 0.239125 Jul 24 01:34:00.755722 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2360/4820] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:00 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1297 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:00.757075 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:00.757646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:00.758608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:00.759277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:00.917252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:00.918014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:00.927080 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:00.928215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:00.930912 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:00.931701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:01.536508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:01.555874 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e9e9061-f3d6-4c01-b5be-3132441a3a9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.840292 Jul 24 01:34:01.563006 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2461/4821] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:00 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:01.678591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:01.689084 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3191bbdd-4391-4822-8922-34efbc6fb2cb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.777056 Jul 24 01:34:01.694167 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2361/4822] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:00 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:01.771626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:01.772248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:01.785775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:01.786242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:01.787025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:01.787467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:02.580170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:02.580743 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:02.595840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:02.596309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:02.597117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:02.597917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:02.751670 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:02.768888 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68643efa-2e05-45cb-8b94-779cc12b8794 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 1.000602 Jul 24 01:34:02.771862 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2462/4823] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:01 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:02.794800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:02.795439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:02.821135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:02.821795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:02.822566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:02.823172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:03.093888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:03.104659 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8f62e87b-796a-4371-a12d-fe0b25c5fed0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.531207 Jul 24 01:34:03.105268 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2362/4824] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:02 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:03.255397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:03.265098 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c402b353-1aa3-48a0-af34-01f883b56103 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.492019 Jul 24 01:34:03.275394 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2463/4825] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:02 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:03.785521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:03.809075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:03.847302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:03.847709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:03.859024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:03.861718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:04.198081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-512729aa-059f-46ee-a800-eb4316a82bb2 req-24a048fd-13e8-4578-a74b-a40bb597f79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83899dfe-0d1b-4320-afe1-6437e34e77cd", "tag": "f965375d-2afd-485c-a606-17f0391d4767"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:04.214151 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:04.223667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-512729aa-059f-46ee-a800-eb4316a82bb2 req-24a048fd-13e8-4578-a74b-a40bb597f79f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:04.224110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-512729aa-059f-46ee-a800-eb4316a82bb2 req-24a048fd-13e8-4578-a74b-a40bb597f79f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:04.247611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:04.266363 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-512729aa-059f-46ee-a800-eb4316a82bb2 req-24a048fd-13e8-4578-a74b-a40bb597f79f service nova] Creating event network-changed:f965375d-2afd-485c-a606-17f0391d4767 for instance 83899dfe-0d1b-4320-afe1-6437e34e77cd on n-h2-master-1 Jul 24 01:34:04.268641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-512729aa-059f-46ee-a800-eb4316a82bb2 req-24a048fd-13e8-4578-a74b-a40bb597f79f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478513 Jul 24 01:34:04.269881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2464/4826] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:04.273304 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ce4a370-6675-4f17-a800-462f31bde6c8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 0.491448 Jul 24 01:34:04.274593 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2363/4827] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:03 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:04.277737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:04.278087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:04.283048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:04.284159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:04.285010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:04.285491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:04.286630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:04.287743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:04.300815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:04.301557 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:04.303203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:04.303825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:04.757830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:04.765707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:04.776509 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-557023c0-3089-4149-8d0b-1bfcd094be22 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.497170 Jul 24 01:34:04.781064 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3bf856ef-aae2-4cbe-b603-249aab4d184b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.505660 Jul 24 01:34:04.791927 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2364/4828] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:04 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:04.792757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2465/4829] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:04 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:05.295588 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:05.297316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:05.319856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:05.323109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:05.326260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:05.328234 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:05.513500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:05.522303 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5a1f2ca7-eed2-4a70-81f3-af6f3e0f096b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 0.233895 Jul 24 01:34:05.523425 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2365/4830] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:05 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:05.802426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:05.805575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:05.805952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:05.808475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:05.821387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:05.823520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:05.823978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:05.824987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:05.825431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:05.830204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:05.831030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:05.831850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:06.079479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:06.088505 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d323f03-cedc-45e7-90be-f0adff39eed5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.292800 Jul 24 01:34:06.089976 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2366/4831] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:05 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:06.135391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:06.148584 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b82fac74-8889-4a40-865b-33b617a91b76 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.349163 Jul 24 01:34:06.150411 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2466/4832] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:05 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:06.540088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:06.540785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:06.549069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:06.549537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:06.550373 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:06.550823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:06.668621 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:06.720327 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:06.779795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:06.787645 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d53a9153-43ae-40f3-8cc0-3d81d588c2c5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 0.252006 Jul 24 01:34:06.798912 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2367/4833] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:06 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:07.106040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:07.107577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:07.131528 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:07.145510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:07.146282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:07.149613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:07.151600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:07.166861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:07.167495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:07.185563 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:07.214832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:07.215132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:07.216148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:07.216770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:07.577104 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:07.606823 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c1704d6e-dd8c-4af8-8a4a-2093de741674 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.501839 Jul 24 01:34:07.609756 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2467/4834] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:07 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:07.713344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:07.736916 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-861b593a-bbd6-43d1-a0bd-d73d798625c9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.575498 Jul 24 01:34:07.737531 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2368/4835] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:07 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:07.807485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:07.808408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:07.833927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:07.834760 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:07.838031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:07.838762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:08.316748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:08.325515 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eedb5209-f278-43af-92b3-87d6db14082b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 0.522236 Jul 24 01:34:08.326141 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2468/4836] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:07 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:08.624505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:08.625314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:08.636321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:08.637702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:08.639206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:08.640137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:08.754837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:08.755464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:08.782377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:08.783128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:08.784087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:08.786336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:09.770031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:09.787860 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f53742eb-de0a-47e0-a8ff-4dc4d9f06c9a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 1.028145 Jul 24 01:34:09.798894 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2469/4837] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:08 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:09.804716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:09.813240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:09.813996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:09.824675 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0727758-c774-4d81-9c04-776a0af57f26 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 1.204171 Jul 24 01:34:09.826247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2369/4838] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:08 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:09.848863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:09.851503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:09.853275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:09.855084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:09.902000 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:10.231804 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:10.244213 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bb63e8f-a5e4-4183-b815-4565fa48db5f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 0.453916 Jul 24 01:34:10.254725 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2470/4839] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:09 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:10.809377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:10.810157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:10.818458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:10.819009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:10.819977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:10.820491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:10.823437 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:10.847079 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:10.847950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:10.865252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:10.874498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:10.875374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:10.876019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:11.225328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:11.238015 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-399fbd9a-b608-4553-b774-168c0f51fc83 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1725 microversion: 2.1 time: 0.435083 Jul 24 01:34:11.242080 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2370/4840] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:10 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1725 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:11.262401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:11.263333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:11.274189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:11.277191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:11.278582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:11.278726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:11.281034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:11.290716 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-08a28981-5549-4d13-938a-585ccf84ea74 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.450876 Jul 24 01:34:11.291653 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2471/4841] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:10 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:11.673657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:11.688997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c65c6d14-dbfe-4320-be71-8979600061ea tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 0.430786 Jul 24 01:34:11.703208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2371/4842] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:11 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:11.843673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9ab85846-c53e-4767-b97f-49576fc5d495 req-41c15abb-e89a-4e0a-9573-30a8d2326f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83899dfe-0d1b-4320-afe1-6437e34e77cd", "name": "network-vif-plugged", "status": "completed", "tag": "f965375d-2afd-485c-a606-17f0391d4767"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:11.856664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9ab85846-c53e-4767-b97f-49576fc5d495 req-41c15abb-e89a-4e0a-9573-30a8d2326f9a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:11.857329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9ab85846-c53e-4767-b97f-49576fc5d495 req-41c15abb-e89a-4e0a-9573-30a8d2326f9a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:11.880790 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9ab85846-c53e-4767-b97f-49576fc5d495 req-41c15abb-e89a-4e0a-9573-30a8d2326f9a service nova] Creating event network-vif-plugged:f965375d-2afd-485c-a606-17f0391d4767 for instance 83899dfe-0d1b-4320-afe1-6437e34e77cd on n-h2-master-1 Jul 24 01:34:11.889583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9ab85846-c53e-4767-b97f-49576fc5d495 req-41c15abb-e89a-4e0a-9573-30a8d2326f9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050194 Jul 24 01:34:11.890401 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2472/4843] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:12.262549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:12.263127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:12.274806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:12.287974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:12.289211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:12.290434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:12.310504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:12.311606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:12.326663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:12.327364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:12.328743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:12.331122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:12.788049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:12.806490 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75c3aef8-bab0-4019-9ee6-9a7f0d4277b5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1702 microversion: 2.1 time: 0.547876 Jul 24 01:34:12.806490 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2372/4844] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:12 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1702 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:12.813937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:12.817138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:12.835992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:12.838272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:12.838612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:12.839920 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:12.839920 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:12.852669 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d10fb8e-dff2-4d09-8acd-04d9f71b57e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.545858 Jul 24 01:34:12.854649 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2473/4845] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:12 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:12.859942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4ae46500-8a57-4818-a96a-df7fbd20a4d1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:12.885087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ae46500-8a57-4818-a96a-df7fbd20a4d1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:12.885879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ae46500-8a57-4818-a96a-df7fbd20a4d1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:12.919798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4ae46500-8a57-4818-a96a-df7fbd20a4d1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Going to try to start instance {{(pid=119561) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 01:34:12.996780 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4ae46500-8a57-4818-a96a-df7fbd20a4d1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action" status: 202 len: 0 microversion: 2.1 time: 0.140446 Jul 24 01:34:12.997998 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2474/4846] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:12 2022] POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:34:13.030349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:13.041451 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-265597f0-3336-45ef-b69b-8a8851f8b904 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1365 microversion: 2.1 time: 0.234598 Jul 24 01:34:13.042979 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2373/4847] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:12 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:13.047069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:13.049358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:13.079015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:13.083778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:13.085211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:13.086141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:13.471491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:13.484376 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d69252f6-3612-40cb-aa42-3f31e5f25ea4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1711 microversion: 2.1 time: 0.482182 Jul 24 01:34:13.485925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2475/4848] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:13 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1711 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:13.876646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:13.877471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:13.888092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:13.894710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:13.895749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:13.896544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:14.059461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:14.061427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:14.069147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:14.069831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:14.070651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:14.071157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:14.398316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:14.416416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffbc84c5-93aa-4fb6-80b5-ada023970750 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1513 microversion: 2.1 time: 0.544439 Jul 24 01:34:14.417649 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2374/4849] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:13 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1513 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:14.502523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:14.503610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:14.516363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:14.517268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:14.518142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:14.518592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:14.600333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:14.608040 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8aeaa49b-97c3-44b1-9646-c2a17cf29d4c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1555 microversion: 2.1 time: 0.552901 Jul 24 01:34:14.619699 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2476/4850] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:14 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1555 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:14.638698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-73f7fd00-196a-4a42-8685-d3fdbd2cdf3e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:14.640594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-73f7fd00-196a-4a42-8685-d3fdbd2cdf3e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:14.654183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f7fd00-196a-4a42-8685-d3fdbd2cdf3e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:14.662355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f7fd00-196a-4a42-8685-d3fdbd2cdf3e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:14.663669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f7fd00-196a-4a42-8685-d3fdbd2cdf3e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:14.664291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73f7fd00-196a-4a42-8685-d3fdbd2cdf3e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:14.813171 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-73f7fd00-196a-4a42-8685-d3fdbd2cdf3e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178418 Jul 24 01:34:14.815969 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2477/4851] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:34:14 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:14.816958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:14.828109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f8d21bd-5403-4cd4-be33-8aa2ceda9412 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1711 microversion: 2.1 time: 0.329425 Jul 24 01:34:14.831438 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2375/4852] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:14 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1711 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:15.441519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:15.442231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:15.455783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:15.456252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:15.457067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:15.463691 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:15.861638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:15.864251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:15.888396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:15.888878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:15.893599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:15.894201 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:16.491034 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:16.508431 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05c2fcc4-7880-4e59-a7d7-56f29303a9de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1490 microversion: 2.1 time: 1.077951 Jul 24 01:34:16.521832 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2478/4853] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:15 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1490 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:16.527222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30aacf4b-9ae3-4a6c-b0bf-b4bb8ef9fad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:16.528290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30aacf4b-9ae3-4a6c-b0bf-b4bb8ef9fad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:16.545330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30aacf4b-9ae3-4a6c-b0bf-b4bb8ef9fad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:16.545825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30aacf4b-9ae3-4a6c-b0bf-b4bb8ef9fad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:16.546902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30aacf4b-9ae3-4a6c-b0bf-b4bb8ef9fad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:16.547514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30aacf4b-9ae3-4a6c-b0bf-b4bb8ef9fad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:16.608967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:16.617449 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-21f5e131-e22f-446d-ad0f-fd861ee441f9 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1715 microversion: 2.1 time: 0.773246 Jul 24 01:34:16.626138 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2376/4854] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:15 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1715 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:16.631687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30aacf4b-9ae3-4a6c-b0bf-b4bb8ef9fad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 200 len: 155 microversion: 2.1 time: 0.108191 Jul 24 01:34:16.636825 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2479/4855] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:16 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 155 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:16.642074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:16.643026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:16.664599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:16.666195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:16.668512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:16.669223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:16.917490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:16.937600 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15d2b28c-5f74-48da-bd88-8231d7ea9624 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.299508 Jul 24 01:34:16.940990 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2377/4856] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:16 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:16.967133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:16.967858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:16.977833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:16.978549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:16.979712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:16.980334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:17.237767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:17.251405 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8839c76-40ca-4eab-88c8-fbb4ce1ef914 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.289564 Jul 24 01:34:17.252205 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2480/4857] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:16 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:17.270711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:17.273130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:17.288646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:17.289464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:17.290505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:17.291172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:17.482058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d9bea946-f90d-462b-8976-efac354f3205 req-e6ac9ade-7ea9-4486-b253-0eee6db4c680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83899dfe-0d1b-4320-afe1-6437e34e77cd", "tag": "f965375d-2afd-485c-a606-17f0391d4767"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:17.493185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d9bea946-f90d-462b-8976-efac354f3205 req-e6ac9ade-7ea9-4486-b253-0eee6db4c680 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:17.494553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d9bea946-f90d-462b-8976-efac354f3205 req-e6ac9ade-7ea9-4486-b253-0eee6db4c680 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:17.531764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d9bea946-f90d-462b-8976-efac354f3205 req-e6ac9ade-7ea9-4486-b253-0eee6db4c680 service nova] Creating event network-changed:f965375d-2afd-485c-a606-17f0391d4767 for instance 83899dfe-0d1b-4320-afe1-6437e34e77cd on n-h2-master-1 Jul 24 01:34:17.539707 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d9bea946-f90d-462b-8976-efac354f3205 req-e6ac9ade-7ea9-4486-b253-0eee6db4c680 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066793 Jul 24 01:34:17.540814 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2481/4858] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:17.595357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:17.604829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bd8a3842-e4cb-4fea-b1ea-55f096b51c56 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.338629 Jul 24 01:34:17.618979 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2378/4859] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:17 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:17.623965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:17.624722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:17.634464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:17.634928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:17.635708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:17.636149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:18.059603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:18.068846 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79aa7355-3b44-4744-8673-e05faeac4913 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.449585 Jul 24 01:34:18.081979 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2482/4860] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:17 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:18.407191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1350866140", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "27a9c0f0-0057-4e7d-b288-37b58950f9cd"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:18.499774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] validate_networks() for [('27a9c0f0-0057-4e7d-b288-37b58950f9cd', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:34:19.580849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:34:19.581519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:34:19.581773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:34:19.582195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:34:19.582611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:34:19.615083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:19.615846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:19.617419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:19.618100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:19.662989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:34:19.670694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for user f6a5e8716f324b53b51e8d34cb704321 and project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:34:19.688396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:34:19.691004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:34:19.816150 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-205b4830-a69d-4591-9069-b8772efa030b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413197 Jul 24 01:34:19.821509 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2379/4861] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:34:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:34:19.832475 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ecea0e11-86ff-474a-931e-6d333068e8bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:19.833055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ecea0e11-86ff-474a-931e-6d333068e8bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:19.994289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecea0e11-86ff-474a-931e-6d333068e8bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:20.008171 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ecea0e11-86ff-474a-931e-6d333068e8bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1215 microversion: 2.1 time: 0.180789 Jul 24 01:34:20.009475 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2483/4862] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:19 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:21.026333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:21.026953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:21.054140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:21.054886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:21.064174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:21.064728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:21.191188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:21.200857 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-df1a927d-9a9b-44f9-806d-db0467d0643f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1211 microversion: 2.1 time: 0.179446 Jul 24 01:34:21.207086 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2380/4863] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:21 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1211 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:22.224640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:22.225992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:22.245781 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:22.246104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:22.247189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:22.248965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:22.432894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:22.445956 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a09d61d1-e736-4894-a787-461d43d19e70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1273 microversion: 2.1 time: 0.225225 Jul 24 01:34:22.448368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2484/4864] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:22 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:23.469291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:23.470258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:23.490435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:23.492608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:23.494337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:23.495055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:23.677781 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:23.687471 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-06056108-9d55-4165-9069-ab168f0a7f6c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1315 microversion: 2.1 time: 0.226048 Jul 24 01:34:23.688072 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2381/4865] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:23 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:24.104156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7ed03f9d-c4ce-4b3e-99ff-884c99d2470b req-c9853c6a-0c51-4b1a-95b2-d3d7a55fc2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a732903f-a01d-4df5-8011-affbebcd17b3", "tag": "66e8d415-850f-4ba2-b7c1-4092d4bd070c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:24.148737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7ed03f9d-c4ce-4b3e-99ff-884c99d2470b req-c9853c6a-0c51-4b1a-95b2-d3d7a55fc2c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:24.149433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7ed03f9d-c4ce-4b3e-99ff-884c99d2470b req-c9853c6a-0c51-4b1a-95b2-d3d7a55fc2c0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:24.177720 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7ed03f9d-c4ce-4b3e-99ff-884c99d2470b req-c9853c6a-0c51-4b1a-95b2-d3d7a55fc2c0 service nova] Creating event network-changed:66e8d415-850f-4ba2-b7c1-4092d4bd070c for instance a732903f-a01d-4df5-8011-affbebcd17b3 on n-h1-master-1 Jul 24 01:34:24.187500 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7ed03f9d-c4ce-4b3e-99ff-884c99d2470b req-c9853c6a-0c51-4b1a-95b2-d3d7a55fc2c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095749 Jul 24 01:34:24.188580 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2485/4866] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:24.704367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:24.705708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:24.724329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:24.724793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:24.726271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:24.726685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:25.038963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:25.049573 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04c0a034-1a16-4066-8030-3dc6af6c062f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1315 microversion: 2.1 time: 0.348973 Jul 24 01:34:25.050754 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2382/4867] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:24 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:26.073059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:26.073795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:26.088528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:26.091830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:26.092845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:26.095571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:26.488028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:26.504542 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c0d7a6c1-e4e8-4c0b-aed0-f534d1051e27 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1315 microversion: 2.1 time: 0.435584 Jul 24 01:34:26.505154 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2486/4868] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:26 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:27.529381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:27.530844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:27.552563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:27.556450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:27.557467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:27.559608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:27.904734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:27.914614 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd71b2b0-75d8-43e0-9950-f15dc7dd18aa tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1315 microversion: 2.1 time: 0.396215 Jul 24 01:34:27.915499 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2383/4869] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:27 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:28.931157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:28.931772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:28.949865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:28.954077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:28.957248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:28.957986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:29.391484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:29.404919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68f6d423-8bfe-444a-be2a-9a0cb3658093 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1315 microversion: 2.1 time: 0.477583 Jul 24 01:34:29.426642 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2487/4870] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:28 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:30.432552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:30.433458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:30.436768 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:30.438965 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:30.448132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:30.448932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:30.453705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:30.454339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:31.248106 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:31.602834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-813be07e-afc9-422e-83bc-92ba73aca8c3 req-53e7391e-fa23-49e9-96fd-12e303645d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a732903f-a01d-4df5-8011-affbebcd17b3", "name": "network-vif-plugged", "status": "completed", "tag": "66e8d415-850f-4ba2-b7c1-4092d4bd070c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:31.625456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-813be07e-afc9-422e-83bc-92ba73aca8c3 req-53e7391e-fa23-49e9-96fd-12e303645d6c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:31.626300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-813be07e-afc9-422e-83bc-92ba73aca8c3 req-53e7391e-fa23-49e9-96fd-12e303645d6c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:31.642070 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-813be07e-afc9-422e-83bc-92ba73aca8c3 req-53e7391e-fa23-49e9-96fd-12e303645d6c service nova] Creating event network-vif-plugged:66e8d415-850f-4ba2-b7c1-4092d4bd070c for instance a732903f-a01d-4df5-8011-affbebcd17b3 on n-h1-master-1 Jul 24 01:34:31.648778 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-813be07e-afc9-422e-83bc-92ba73aca8c3 req-53e7391e-fa23-49e9-96fd-12e303645d6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.405050 Jul 24 01:34:31.650248 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2488/4871] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:31.761493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:31.769455 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44ad4274-3c40-40a9-972c-bbb796c511f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1315 microversion: 2.1 time: 1.340804 Jul 24 01:34:31.779469 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2384/4872] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:30 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1315 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:32.796748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:32.797631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:32.808305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:32.809275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:32.811046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:32.812130 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:33.412831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:33.425006 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f30b116d-69d3-449c-b31e-b9c3871bd147 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1315 microversion: 2.1 time: 0.631486 Jul 24 01:34:33.425633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2489/4873] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:32 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:33.669227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:33.670455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:33.681711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:33.682641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:33.683764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:33.684374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:33.783062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:34:33.963815 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:34.057256 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af69e50c-0106-48f3-bf5a-2ec743a3fbed tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 204 len: 0 microversion: 2.1 time: 0.392392 Jul 24 01:34:34.066305 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2385/4874] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:34:33 2022] DELETE /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:34:34.073403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:34.074280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:34.091388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:34.092604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:34.095528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:34.096791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:34.152657 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:34.448991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:34.450098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:34.464153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:34.467272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:34.468622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:34.469977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:34.515953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:34.529026 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-618e11d3-cb95-448e-8d56-67f1a4f723ae tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1663 microversion: 2.1 time: 0.460817 Jul 24 01:34:34.529782 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2490/4875] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:34 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1663 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:34.932206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:34.945346 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e6c0338-811d-4822-bb20-9d4921b9ef44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1502 microversion: 2.1 time: 0.500575 Jul 24 01:34:34.964347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a50338fd-fa30-4d9c-9a73-29196aa1d418 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:34.965524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a50338fd-fa30-4d9c-9a73-29196aa1d418 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:34.967466 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=56 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:34.977497 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2386/4876] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:34 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1502 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:34.978792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a50338fd-fa30-4d9c-9a73-29196aa1d418 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:34.979385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a50338fd-fa30-4d9c-9a73-29196aa1d418 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:34.980205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a50338fd-fa30-4d9c-9a73-29196aa1d418 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:34.980693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a50338fd-fa30-4d9c-9a73-29196aa1d418 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:35.052243 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a50338fd-fa30-4d9c-9a73-29196aa1d418 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.092911 Jul 24 01:34:35.056704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2491/4877] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:34 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:34:35.557281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:35.558361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:35.565847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:35.566402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:35.567192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:35.567629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:36.044157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:36.060938 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e449973-aa23-4952-a186-8fe112060e1a tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1663 microversion: 2.1 time: 0.513872 Jul 24 01:34:36.060938 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2387/4878] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:35 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1663 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:36.066179 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c34742f5-9bf3-4505-8c0f-57d188cc3459 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:36.067810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c34742f5-9bf3-4505-8c0f-57d188cc3459 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:36.112598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34742f5-9bf3-4505-8c0f-57d188cc3459 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:36.113079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34742f5-9bf3-4505-8c0f-57d188cc3459 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:36.117072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34742f5-9bf3-4505-8c0f-57d188cc3459 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:36.118489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c34742f5-9bf3-4505-8c0f-57d188cc3459 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:36.240765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c34742f5-9bf3-4505-8c0f-57d188cc3459 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.179557 Jul 24 01:34:36.245086 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2492/4879] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:36 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:37.078836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:37.079899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:37.092288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:37.095035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:37.096226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:37.097153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:37.248395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b873c4cd7b4558ab357acff39f0253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d638e520c9c4152afb6125e91dcb399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:37.254993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b8b2014e-343b-4b30-96b0-e10d0b913af5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:37.256564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b8b2014e-343b-4b30-96b0-e10d0b913af5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:37.264832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac1dce11-4714-4faa-bf51-558f1e9f6c71 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 200 len: 1596 microversion: 2.1 time: 0.188439 Jul 24 01:34:37.265661 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2388/4880] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:37 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 1596 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:37.270963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8b2014e-343b-4b30-96b0-e10d0b913af5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:37.271422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8b2014e-343b-4b30-96b0-e10d0b913af5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:37.273205 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8b2014e-343b-4b30-96b0-e10d0b913af5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:37.273905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8b2014e-343b-4b30-96b0-e10d0b913af5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:37.342064 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b8b2014e-343b-4b30-96b0-e10d0b913af5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.084907 Jul 24 01:34:37.345181 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2493/4881] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:37 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:37.454647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1df99606-6431-45fe-9a46-7f02a5bd34fd req-5dafcaa7-61ee-4280-a48d-29cc0b8741d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2141b68a-e9f7-4f81-a504-41eb9507586c", "name": "network-vif-deleted", "tag": "e3df1518-b0e5-4c9a-b615-ac64e852117d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:37.460426 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:37.464518 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1df99606-6431-45fe-9a46-7f02a5bd34fd req-5dafcaa7-61ee-4280-a48d-29cc0b8741d8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:37.464979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1df99606-6431-45fe-9a46-7f02a5bd34fd req-5dafcaa7-61ee-4280-a48d-29cc0b8741d8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:37.523645 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1df99606-6431-45fe-9a46-7f02a5bd34fd req-5dafcaa7-61ee-4280-a48d-29cc0b8741d8 service nova] Creating event network-vif-deleted:e3df1518-b0e5-4c9a-b615-ac64e852117d for instance 2141b68a-e9f7-4f81-a504-41eb9507586c on n-h2-master-1 Jul 24 01:34:37.541825 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1df99606-6431-45fe-9a46-7f02a5bd34fd req-5dafcaa7-61ee-4280-a48d-29cc0b8741d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090704 Jul 24 01:34:37.542774 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2389/4882] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:34:38.285113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:38.285901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] [instance: 2141b68a-e9f7-4f81-a504-41eb9507586c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:38.322547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:38.326756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:38.328438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:38.333234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:38.355678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ceabbb6a-21f3-461a-a078-4a0230d1af70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:38.360119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ceabbb6a-21f3-461a-a078-4a0230d1af70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:38.378922 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] HTTP exception thrown: Instance 2141b68a-e9f7-4f81-a504-41eb9507586c could not be found. Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Request method failure captured: Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c HTTP/1.1 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KFAUVGj_XbdbYhqpC1QkMwzlozcqo_Jl42NQGtgbFmwFhAKRNzLTfID80CP0WEbFrKibqZwDXVcgNzkOYd4yYNM4zisahxvmIe3DaDgNKHeMxLtb3-dw45noRUaUDFvEkdpkpzYjB8U8AUfWm1533KkKgcWLQT_6xrMMud48Bu9NSM Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 0d638e520c9c4152afb6125e91dcb399 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestFqdnHostnames-1301783924 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d638e520c9c4152afb6125e91dcb399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d638e520c9c4152afb6125e91dcb399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d638e520c9c4152afb6125e91dcb399", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d638e520c9c4152afb6125e91dcb399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestFqdnHostnames-1301783924 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 0d638e520c9c4152afb6125e91dcb399 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1301783924 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestFqdnHostnames-1301783924-project Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: e0b873c4cd7b4558ab357acff39f0253 Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestFqdnHostnames-1301783924-project Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 2141b68a-e9f7-4f81-a504-41eb9507586c could not be found. Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '2141b68a-e9f7-4f81-a504-41eb9507586c'} Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2141b68a-e9f7-4f81-a504-41eb9507586c could not be found. Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2141b68a-e9f7-4f81-a504-41eb9507586c could not be found. Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:34:38.381539 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:38.387197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:34:38.387197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:34:38.387197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:34:38.387197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:34:38.387197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:34:38.387197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2141b68a-e9f7-4f81-a504-41eb9507586c could not be found. Jul 24 01:34:38.387197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:38.387809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceabbb6a-21f3-461a-a078-4a0230d1af70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:38.387809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceabbb6a-21f3-461a-a078-4a0230d1af70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:38.388628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceabbb6a-21f3-461a-a078-4a0230d1af70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:38.393088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Returning 404 to user: Instance 2141b68a-e9f7-4f81-a504-41eb9507586c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:34:38.394330 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23af5931-d866-4b7f-a74d-4b01e4981f1f tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c" status: 404 len: 111 microversion: 2.1 time: 0.115966 Jul 24 01:34:38.395695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ceabbb6a-21f3-461a-a078-4a0230d1af70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:38.398868 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2494/4883] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:38 2022] GET /compute/v2.1/servers/2141b68a-e9f7-4f81-a504-41eb9507586c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:34:38.416227 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22756201-bf4e-458e-9729-83c465aeb2a2 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] Calling method '.version_select at 0x7f05eab23430>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:38.451007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22756201-bf4e-458e-9729-83c465aeb2a2 tempest-ServersTestFqdnHostnames-1301783924 tempest-ServersTestFqdnHostnames-1301783924-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503615692" status: 202 len: 0 microversion: 2.1 time: 0.050805 Jul 24 01:34:38.451647 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2495/4884] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503615692 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:34:38.462190 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ceabbb6a-21f3-461a-a078-4a0230d1af70 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.111954 Jul 24 01:34:38.467083 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2390/4885] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:38 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 24 01:34:39.474915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-056a3369-4326-4672-a6fd-7a61a397a660 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:39.476060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-056a3369-4326-4672-a6fd-7a61a397a660 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:39.488606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-056a3369-4326-4672-a6fd-7a61a397a660 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:39.490599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-056a3369-4326-4672-a6fd-7a61a397a660 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:39.494256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-056a3369-4326-4672-a6fd-7a61a397a660 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:39.494894 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-056a3369-4326-4672-a6fd-7a61a397a660 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:39.549550 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-056a3369-4326-4672-a6fd-7a61a397a660 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.080350 Jul 24 01:34:39.550994 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2496/4886] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:39 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:40.561123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a2e1ceb-994f-4b8d-91b1-418e392efe13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:40.562186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a2e1ceb-994f-4b8d-91b1-418e392efe13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:40.571339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a2e1ceb-994f-4b8d-91b1-418e392efe13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:40.571832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a2e1ceb-994f-4b8d-91b1-418e392efe13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:40.572619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a2e1ceb-994f-4b8d-91b1-418e392efe13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:40.573063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a2e1ceb-994f-4b8d-91b1-418e392efe13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:40.642772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a2e1ceb-994f-4b8d-91b1-418e392efe13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.085834 Jul 24 01:34:40.643433 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2391/4887] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:40 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:41.657958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eba290c5-53f4-4ff5-8d62-d1805cdd0322 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:41.659621 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eba290c5-53f4-4ff5-8d62-d1805cdd0322 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:41.682666 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eba290c5-53f4-4ff5-8d62-d1805cdd0322 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:41.683153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eba290c5-53f4-4ff5-8d62-d1805cdd0322 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:41.683960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eba290c5-53f4-4ff5-8d62-d1805cdd0322 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:41.684589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eba290c5-53f4-4ff5-8d62-d1805cdd0322 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:41.738764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eba290c5-53f4-4ff5-8d62-d1805cdd0322 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.088540 Jul 24 01:34:41.744397 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2497/4888] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:41 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:42.756572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ed4648d-820d-482c-b6b7-b213be7916d6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:42.757621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ed4648d-820d-482c-b6b7-b213be7916d6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:42.774753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed4648d-820d-482c-b6b7-b213be7916d6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:42.775218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed4648d-820d-482c-b6b7-b213be7916d6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:42.776019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed4648d-820d-482c-b6b7-b213be7916d6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:42.776467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ed4648d-820d-482c-b6b7-b213be7916d6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:42.876970 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ed4648d-820d-482c-b6b7-b213be7916d6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.124655 Jul 24 01:34:42.892918 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2392/4889] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:42 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:43.892742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4aa7ed36-50b9-4c23-91a2-b7126dc132ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:43.894186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4aa7ed36-50b9-4c23-91a2-b7126dc132ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:43.912819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4aa7ed36-50b9-4c23-91a2-b7126dc132ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:43.915655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4aa7ed36-50b9-4c23-91a2-b7126dc132ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:43.916639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4aa7ed36-50b9-4c23-91a2-b7126dc132ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:43.917453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4aa7ed36-50b9-4c23-91a2-b7126dc132ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:44.015291 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4aa7ed36-50b9-4c23-91a2-b7126dc132ee tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.128851 Jul 24 01:34:44.019007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2498/4890] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:43 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:45.030597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66af2bcc-34f4-4eca-a013-9a1fecdeae44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:45.032329 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66af2bcc-34f4-4eca-a013-9a1fecdeae44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:45.044251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66af2bcc-34f4-4eca-a013-9a1fecdeae44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:45.051807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66af2bcc-34f4-4eca-a013-9a1fecdeae44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:45.054668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66af2bcc-34f4-4eca-a013-9a1fecdeae44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:45.055379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66af2bcc-34f4-4eca-a013-9a1fecdeae44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:45.150400 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-66af2bcc-34f4-4eca-a013-9a1fecdeae44 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 14 microversion: 2.1 time: 0.126973 Jul 24 01:34:45.153837 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2393/4891] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:45 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:34:46.162334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ec575524-2a08-4f56-9094-e9a2301a545e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:46.164298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ec575524-2a08-4f56-9094-e9a2301a545e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:46.187629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec575524-2a08-4f56-9094-e9a2301a545e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:46.188374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec575524-2a08-4f56-9094-e9a2301a545e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:46.190616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec575524-2a08-4f56-9094-e9a2301a545e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:46.192512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec575524-2a08-4f56-9094-e9a2301a545e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:46.299078 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ec575524-2a08-4f56-9094-e9a2301a545e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action" status: 200 len: 8204 microversion: 2.1 time: 0.141999 Jul 24 01:34:46.300502 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2499/4892] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:46 2022] POST /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3/action => generated 8204 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:46.312590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:46.313620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:46.330485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:46.340837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:46.342006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:46.343195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:46.959830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:46.980618 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-36274e8b-c119-4375-bca2-08cd59ff766a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.673536 Jul 24 01:34:46.981486 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2394/4893] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:46 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:47.005003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:47.007839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:47.019876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:47.022832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:47.024640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:47.027634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:47.446309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:47.459252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-56169d24-fd12-4441-9777-4eaaa839e553 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.458169 Jul 24 01:34:47.464460 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2500/4894] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:46 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:47.485960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:47.486622 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:47.508922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:47.509710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:47.510575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:47.511021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:47.877333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:47.889521 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1318f6c9-4869-4854-b68f-d5033500357f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.405990 Jul 24 01:34:47.890944 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2395/4895] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:47 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:47.914950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:47.915962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:47.934594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:47.937942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:47.938914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:47.939762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:48.253640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:48.266973 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8548770f-0cc8-43b5-b71f-923b1c3ecd6d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.363415 Jul 24 01:34:48.268456 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2501/4896] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:47 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:48.289150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:48.289864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:48.300441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:48.301509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:48.308973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:48.313614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:48.433576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Locking {{(pid=119562) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 24 01:34:48.586283 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fafc3c77-0a12-4577-a3d9-d4ab9b7d659c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.302466 Jul 24 01:34:48.590345 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2396/4897] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:48 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:34:48.595766 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:48.596393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:48.614577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:48.619283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:48.620940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:48.621613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:48.860849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:48.862004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:48.880564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:48.882695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:48.886924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:48.887589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:48.915419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:48.929598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ecb95a9-c9f8-40db-8c49-caaca469d9f3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.336833 Jul 24 01:34:48.935052 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2502/4898] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:48 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:48.948791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2421299c-3558-479c-affb-d24a79350fed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:48.969508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2421299c-3558-479c-affb-d24a79350fed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:48.970006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2421299c-3558-479c-affb-d24a79350fed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:49.038422 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-2421299c-3558-479c-affb-d24a79350fed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] HTTP exception thrown: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 is locked Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2421299c-3558-479c-affb-d24a79350fed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Request method failure captured: Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action HTTP/1.1 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 15 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KB82qt59Jo-oxIvUJAPvsaw5akn_eDWVXslD9r7Jve7msH7AwSbjX431vT3GmYrZX0k0w5oJUn7XXheNTs6zlQjJ9lxDx7oOwlmPBOwVJldXxk0wvoZxvvs9Q0BtBdnLlMhrrh0hUt96yztddkMWYVNE4jdjTVsg9GdU4jB-SXGJAY Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b97b2217fca247759ee6e9f15d150866", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f6a5e8716f324b53b51e8d34cb704321 Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: {"os-stop": {}} Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 is locked Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '88b3e6c8-eefb-480b-badb-78a2ee07ad73', 'body': {'os-stop': {}}} Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 is locked Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 is locked Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 is locked Jul 24 01:34:49.040366 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:34:49.046542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2421299c-3558-479c-affb-d24a79350fed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Returning 409 to user: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 is locked {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:34:49.047589 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2421299c-3558-479c-affb-d24a79350fed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 409 len: 107 microversion: 2.1 time: 0.103662 Jul 24 01:34:49.048350 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2503/4899] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:48 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 107 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 24 01:34:49.060119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:49.060912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:49.067661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:49.068889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:49.069932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:49.070577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:49.088097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lazy-loading 'services' on Instance uuid 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:34:49.143207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Unlocking {{(pid=119561) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 24 01:34:49.201615 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-116e62b5-2af1-4468-9e43-cc99962b42d2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-volume_attachments/35f566f7-0a5c-40e1-a9a2-8ce0548788f9" status: 202 len: 0 microversion: 2.1 time: 0.353747 Jul 24 01:34:49.217045 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2397/4900] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:34:48 2022] DELETE /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-volume_attachments/35f566f7-0a5c-40e1-a9a2-8ce0548788f9 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:34:49.258137 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2fecd98-157a-4142-badf-76fcdad4e563 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.202087 Jul 24 01:34:49.262456 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2504/4901] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:49 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:34:49.269008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bdc52524-4390-4591-be63-602a75723392 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:49.281236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdc52524-4390-4591-be63-602a75723392 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:49.284090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdc52524-4390-4591-be63-602a75723392 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:49.355443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bdc52524-4390-4591-be63-602a75723392 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Going to try to stop instance {{(pid=119562) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:34:49.414599 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bdc52524-4390-4591-be63-602a75723392 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.149642 Jul 24 01:34:49.426415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:49.427042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:49.432478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2398/4902] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:49 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:34:49.441046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:49.441696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:49.445220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:49.445710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:50.284925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:50.300746 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3965845d-239a-4695-9df9-a87ed980fbd3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.878685 Jul 24 01:34:50.313768 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2505/4903] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:49 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:51.340832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:51.341552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:51.352811 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:51.353273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:51.354391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:51.354876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:51.875048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:51.888431 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-82552605-5371-4fdb-afb1-363a6f0fde0e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.549464 Jul 24 01:34:51.891014 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2399/4904] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:51 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:52.911427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:52.914092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:52.928373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:52.929065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:52.930697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:52.931092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:53.277552 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:53.288157 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9849f98e-2426-412e-a4e6-afc2a48be1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.383034 Jul 24 01:34:53.297982 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2506/4905] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:52 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:54.307780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:54.309908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:54.335735 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:54.343238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:54.345976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:54.348981 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:54.363908 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=90,nova_cell1:UPDATE=5 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:54.753136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:54.766284 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f829838-0e3a-492f-b5ae-204d42a7f17e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.464473 Jul 24 01:34:54.780600 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2400/4906] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:54 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:55.784080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:55.784775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:55.819005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:55.821463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:55.825997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:55.826505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:56.621109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:56.633005 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6f0cb9c3-6d25-487a-8001-286d1a5b46c0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.853600 Jul 24 01:34:56.638180 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2507/4907] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:55 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:57.656330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:57.658050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:57.672855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:57.673642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:57.674700 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:57.682106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:58.038607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:58.057991 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a8114fcd-b789-46cf-921a-4508fd3d46df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.405022 Jul 24 01:34:58.061726 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2401/4908] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:57 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:58.304747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0173209f-fd0b-4de3-9da4-256ad66fe1eb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:34:58.329255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0173209f-fd0b-4de3-9da4-256ad66fe1eb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:58.330418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0173209f-fd0b-4de3-9da4-256ad66fe1eb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:58.402922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0173209f-fd0b-4de3-9da4-256ad66fe1eb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Going to try to stop instance {{(pid=119561) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:34:58.408709 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:58.492416 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0173209f-fd0b-4de3-9da4-256ad66fe1eb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action" status: 202 len: 0 microversion: 2.1 time: 0.192387 Jul 24 01:34:58.503795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:58.505031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:58.507539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2508/4909] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:34:58 2022] POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:34:58.519937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:58.520420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:58.521301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:58.522011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:58.783334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:58.794956 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4d3cd950-ce18-4020-9af4-4f6dce8645e0 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1679 microversion: 2.1 time: 0.296493 Jul 24 01:34:58.796306 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2402/4910] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:58 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1679 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:34:59.077020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:59.081843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:59.104659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:59.105322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:59.107087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:59.107693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:59.431128 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:34:59.442727 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0fb16da8-d1bf-43af-bf6a-92d4b171ee0c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.367654 Jul 24 01:34:59.444554 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2509/4911] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:59 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:34:59.821560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:34:59.822644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:34:59.843222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:59.848937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:34:59.852047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:34:59.858603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:00.042342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a97a996d-da98-4d91-86a8-7aa4228e0673 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Action: 'create', calling method: .version_select at 0x7f05eb832a60>, body: {"keypair": {"name": "tempest-keypair-2140036558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwH+ZLvIq3ZwE94ApN/Ve9eM77ZFizRHGwqkCHkZTVS+tEw71/uVyvJeyhMk4NWdVeQSZ9X5qaolGXbat7V6ZVpqIZoHgaHiBl/kTiNyKUNPYA2v2RA6CVVZQjojPlxbA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:00.100580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-a97a996d-da98-4d91-86a8-7aa4228e0673 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Getting quotas for project 3d222453d2a14232b467364e9d39ec72. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:00.112869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-a97a996d-da98-4d91-86a8-7aa4228e0673 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Getting quotas for user 491186789eb04cf5bf6c16d9d9d7d043 and project 3d222453d2a14232b467364e9d39ec72. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:00.162075 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a97a996d-da98-4d91-86a8-7aa4228e0673 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.432813 Jul 24 01:35:00.162954 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2403/4912] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:34:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:00.452016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:00.462259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:00.464492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:00.478393 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7437d2f9-e88c-4962-bc86-cb959e47b65b tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1679 microversion: 2.1 time: 0.667677 Jul 24 01:35:00.491619 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2510/4913] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:34:59 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1679 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:00.492254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:00.492968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:00.494225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:00.494833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:01.084053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:01.093513 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-958c3944-d01b-4097-8ba3-bfb2c4144859 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1654 microversion: 2.1 time: 0.636766 Jul 24 01:35:01.118146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-99b45b8a-bc0d-49eb-9ee9-21fe416b21a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:01.124269 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2404/4914] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:00 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1654 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:01.136839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99b45b8a-bc0d-49eb-9ee9-21fe416b21a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:01.139565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99b45b8a-bc0d-49eb-9ee9-21fe416b21a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:01.263693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-99b45b8a-bc0d-49eb-9ee9-21fe416b21a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Going to try to start instance {{(pid=119561) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 01:35:01.472334 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-99b45b8a-bc0d-49eb-9ee9-21fe416b21a2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.359896 Jul 24 01:35:01.500015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:01.502389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:01.511509 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2511/4915] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:35:01 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:35:01.530329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:01.534176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:01.537475 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:01.547590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:01.548102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:01.548737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:01.589094 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:01.594762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:01.610803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:01.611322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:02.776951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:02.810962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:02.811593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-461e1f2f-45e9-44f5-bdd9-f3a6b59c7aa5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1679 microversion: 2.1 time: 1.308137 Jul 24 01:35:02.812220 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2405/4916] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:01 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1679 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:02.823412 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67452978-1b32-4ffd-bef0-cd6f362158e5 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1663 microversion: 2.1 time: 1.309256 Jul 24 01:35:02.835199 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2512/4917] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:01 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1663 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:03.829912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:03.831424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:03.841387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:03.842594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:03.867160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:03.867944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:03.868417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:03.871847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:03.872727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:03.874173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:03.874830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:03.875820 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:04.733484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:04.751123 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d88ca3c-e80e-4d93-b9e3-ac7d2d7ee9f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1679 microversion: 2.1 time: 0.925354 Jul 24 01:35:04.762150 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2406/4918] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:03 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1679 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:04.880951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:04.890155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fb2aca46-ac6c-415e-aa3a-1b2abbac91ef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1663 microversion: 2.1 time: 1.053245 Jul 24 01:35:04.890757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2513/4919] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:03 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1663 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:05.784626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:05.787819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:05.818728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:05.819201 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:05.820026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:05.822835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:05.844409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-622498161", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e478718e-a5f1-4f76-96c4-9adfeaa8e948"}], "security_groups": [{"name": "tempest-securitygroup--457806472"}], "key_name": "tempest-keypair-2140036558", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:05.886522 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:06.350843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] validate_networks() for [('e478718e-a5f1-4f76-96c4-9adfeaa8e948', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:35:07.183327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:07.197335 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-32f2d1ba-d4c9-42fe-9fa4-9971cead25c8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1679 microversion: 2.1 time: 1.422575 Jul 24 01:35:07.202654 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2407/4920] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:05 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1679 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:07.210889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:07.212792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:07.221212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:07.235697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:07.237800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:07.238566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:08.259668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:08.279521 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8ab5603-5d6a-43e2-9f61-5c70ef7c6654 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 1.074954 Jul 24 01:35:08.293532 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2408/4921] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:07 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:08.305404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:08.306100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:08.330377 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:08.355646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:08.356119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:08.357195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:08.357645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:08.738339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Getting quotas for project 3d222453d2a14232b467364e9d39ec72. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:08.756939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Getting quotas for user 491186789eb04cf5bf6c16d9d9d7d043 and project 3d222453d2a14232b467364e9d39ec72. Resources: dict_keys(['metadata_items']) {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:08.808139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:35:08.812216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:35:08.814467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:35:08.815826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:35:08.818565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:35:08.859192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:08.860127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:08.862832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:08.863553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:08.955197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:08.956791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Getting quotas for project 3d222453d2a14232b467364e9d39ec72. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:08.971303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Getting quotas for user 491186789eb04cf5bf6c16d9d9d7d043 and project 3d222453d2a14232b467364e9d39ec72. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:08.971516 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1f9e624-e981-4d50-adb2-5bf245a6c275 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1679 microversion: 2.1 time: 0.674314 Jul 24 01:35:08.974813 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2409/4922] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:08 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1679 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:08.984544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:08.987440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:09.000796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:35:09.004025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:35:09.005845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:09.006670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:09.007572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:09.009166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:09.087035 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-59400403-9a5c-44d2-a1be-9d39636c983b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.249135 Jul 24 01:35:09.088526 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2514/4923] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:35:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 3251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:35:09.100390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6be5833-cd94-46df-a88a-7ebf9eda8523 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:09.103687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d6be5833-cd94-46df-a88a-7ebf9eda8523 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:09.381525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d6be5833-cd94-46df-a88a-7ebf9eda8523 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:09.398986 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d6be5833-cd94-46df-a88a-7ebf9eda8523 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1269 microversion: 2.1 time: 0.297309 Jul 24 01:35:09.400110 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2515/4924] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:09 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1269 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:09.514127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:09.525418 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e0f7a436-3704-4753-88dd-a34ffbb3e60b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.549096 Jul 24 01:35:09.526052 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2410/4925] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:08 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:09.542700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:09.543238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:09.563838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:09.569872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:09.571865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:09.573493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:09.673410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Unlocking {{(pid=119561) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 24 01:35:09.773132 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23f41fab-28a5-48f4-aef8-4f757829d6f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.234331 Jul 24 01:35:09.778759 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2516/4926] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:35:09 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:35:09.785087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:09.785510 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:09.804775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:09.805227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:09.806251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:09.806780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:09.992093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:09.997503 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:10.015314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:10.015768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:10.016761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:10.017388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:10.133385 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:10.516791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:10.524976 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-821707d3-4db1-44df-a8dd-8f202bd259a1 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1656 microversion: 2.1 time: 0.537379 Jul 24 01:35:10.527696 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2517/4927] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:09 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1656 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:10.544300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f5df338-dde5-49da-b208-e38e6d6ebb89 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:10.549313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f5df338-dde5-49da-b208-e38e6d6ebb89 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:10.596677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:10.623088 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e1a916d-77cf-4686-9507-9ee9cb4717b4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.839085 Jul 24 01:35:10.625330 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2411/4928] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:09 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:10.638637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cde66192-3f75-4c18-b1fb-2f0b54966456 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:10.679443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cde66192-3f75-4c18-b1fb-2f0b54966456 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:10.682083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cde66192-3f75-4c18-b1fb-2f0b54966456 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:10.711041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f5df338-dde5-49da-b208-e38e6d6ebb89 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:10.727466 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f5df338-dde5-49da-b208-e38e6d6ebb89 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1269 microversion: 2.1 time: 0.188610 Jul 24 01:35:10.729115 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2518/4929] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:10 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:10.756270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cde66192-3f75-4c18-b1fb-2f0b54966456 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Going to try to start instance {{(pid=119562) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 01:35:10.759415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:10.764784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:10.794567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:10.795227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:10.809893 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:10.811860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:10.896973 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cde66192-3f75-4c18-b1fb-2f0b54966456 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action" status: 202 len: 0 microversion: 2.1 time: 0.262366 Jul 24 01:35:10.897821 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2412/4930] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:35:10 2022] POST /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:35:10.913755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:10.914928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:10.925447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:10.926828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:10.927992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:10.928773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.277831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:11.287645 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:11.300694 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5356a40-0de2-43e2-889a-4df0bd177f88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.568970 Jul 24 01:35:11.311612 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2519/4931] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:10 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:11.327082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:11.327781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:11.359598 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-296d1a92-05bc-4ed3-83f3-bf13b4ced0b7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1665 microversion: 2.1 time: 0.456989 Jul 24 01:35:11.360390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.362327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.363736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.365824 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.368248 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2413/4932] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:10 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1665 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:11.686003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:11.697639 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc5cbfb5-646b-4ae6-803e-405f78bd3549 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.376058 Jul 24 01:35:11.698255 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2520/4933] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:11 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:11.719065 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d2752175-37b2-4cfb-b8f7-b9605adb1eed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:11.719645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d2752175-37b2-4cfb-b8f7-b9605adb1eed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:11.732526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2752175-37b2-4cfb-b8f7-b9605adb1eed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.733150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2752175-37b2-4cfb-b8f7-b9605adb1eed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.734107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2752175-37b2-4cfb-b8f7-b9605adb1eed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.734812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2752175-37b2-4cfb-b8f7-b9605adb1eed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.746131 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:11.747005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:11.763664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.764447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.765439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.766087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.863547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d2752175-37b2-4cfb-b8f7-b9605adb1eed tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.153277 Jul 24 01:35:11.864949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2414/4934] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:35:11 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:35:11.878436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:11.880204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:11.886536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:11.897905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.898086 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-122fef5b-d25d-4d85-9a56-3c42f30ae6d4 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1321 microversion: 2.1 time: 0.155051 Jul 24 01:35:11.899057 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2521/4935] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:11 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:11.899748 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:11.900835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:11.901540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:12.387246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:12.388926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:12.403156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:12.404046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:12.407489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:12.409539 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:12.487921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:12.492468 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:12.506141 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1149d04c-1570-4544-95ab-f19c554d5e11 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1672 microversion: 2.1 time: 0.635092 Jul 24 01:35:12.517844 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2415/4936] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:11 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1672 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:12.919078 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:12.919758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:12.928994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:12.929465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:12.930298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:12.934472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:13.087707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:13.097637 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6434868f-fb68-4898-a888-97380e732484 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1665 microversion: 2.1 time: 0.715108 Jul 24 01:35:13.108380 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2522/4937] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:12 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1665 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:13.235320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:13.247067 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4fc6862f-ef42-48f8-8e4d-a0eb67df867f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1327 microversion: 2.1 time: 0.332747 Jul 24 01:35:13.248519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2416/4938] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:12 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1327 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:13.525061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:13.525715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:13.546613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:13.547083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:13.547892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:13.548340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.026096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:14.028788 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:14.045385 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b49cd72f-3783-4184-adf8-f8df923e0918 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1652 microversion: 2.1 time: 0.525065 Jul 24 01:35:14.046024 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2523/4939] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:13 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1652 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:14.063917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f0136ac9-6286-4690-af34-a0e5af71f4b0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:14.065280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f0136ac9-6286-4690-af34-a0e5af71f4b0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:14.090497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0136ac9-6286-4690-af34-a0e5af71f4b0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.096480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0136ac9-6286-4690-af34-a0e5af71f4b0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.099208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0136ac9-6286-4690-af34-a0e5af71f4b0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.105555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0136ac9-6286-4690-af34-a0e5af71f4b0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.117439 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:14.118267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:14.132829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.135512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.141405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.142279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.255632 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f0136ac9-6286-4690-af34-a0e5af71f4b0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.196054 Jul 24 01:35:14.262479 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2417/4940] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:35:14 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:35:14.294835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:14.295589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:14.315653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.316319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.317195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.317633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.588084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:14.605783 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-555bfacb-cdea-4961-a3ec-3a340e256f27 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1327 microversion: 2.1 time: 0.326000 Jul 24 01:35:14.606787 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2418/4941] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:14 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1327 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:14.619944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:14.620570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:14.639269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.646808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.652042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:14.658831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:14.780985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:14.794959 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c265f7af-94c5-4085-b8d7-822e6f1cc38e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1669 microversion: 2.1 time: 0.682961 Jul 24 01:35:14.795548 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2524/4942] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:14 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1669 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:15.218850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:15.228748 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a38d8db4-d94a-4116-9cd2-a28c59574aae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1659 microversion: 2.1 time: 0.620876 Jul 24 01:35:15.242815 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2419/4943] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:14 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1659 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:15.624321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:15.625606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:15.642296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:15.642767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:15.643593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:15.646918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:16.250190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:16.250822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:16.267058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:16.268666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:16.275627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:16.276656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:16.959482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:16.975536 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9748c6ab-01a9-4182-97bf-9a2afc803c09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.731249 Jul 24 01:35:16.977761 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2420/4944] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:16 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:16.992099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:16.997227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:17.000839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fdb2edde-9dd2-4ddd-aaea-706e8130d383 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1394 microversion: 2.1 time: 1.381801 Jul 24 01:35:17.001721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:17.012918 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2525/4945] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:15 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1394 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:17.019610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:17.034624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:17.041002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:17.043726 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:17.437568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:17.448549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-91d93cfe-2496-4a4d-b171-98b7cbb65f97 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.458894 Jul 24 01:35:17.451245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2421/4946] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:16 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:17.471058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:17.472016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:17.482932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:17.486421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:17.487983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:17.491354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:17.828016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:17.860244 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f7bcff9-ba71-471c-ab24-5e474bb07d7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.391505 Jul 24 01:35:17.862487 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2526/4947] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:17 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:17.884410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:17.887074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:17.893124 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-47c1df45-704e-47f8-97c6-671dc98cb67c req-d5e10694-4a30-4c30-a32a-89ece18b4003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f7c749c-ea58-447f-9d93-5434dfe66698", "tag": "69e9584d-19a5-4e33-9d2b-ab3773ffb3d2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:17.914575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:17.919149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:17.922342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:17.922843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:17.954085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-47c1df45-704e-47f8-97c6-671dc98cb67c req-d5e10694-4a30-4c30-a32a-89ece18b4003 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:17.954546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-47c1df45-704e-47f8-97c6-671dc98cb67c req-d5e10694-4a30-4c30-a32a-89ece18b4003 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:17.986625 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-47c1df45-704e-47f8-97c6-671dc98cb67c req-d5e10694-4a30-4c30-a32a-89ece18b4003 service nova] Creating event network-changed:69e9584d-19a5-4e33-9d2b-ab3773ffb3d2 for instance 3f7c749c-ea58-447f-9d93-5434dfe66698 on n-h2-master-1 Jul 24 01:35:17.993981 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-47c1df45-704e-47f8-97c6-671dc98cb67c req-d5e10694-4a30-4c30-a32a-89ece18b4003 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104701 Jul 24 01:35:17.995916 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2527/4948] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:35:18.025548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:18.026345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:18.035843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:18.036474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:18.037329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:18.037879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:18.307587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:18.320925 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-31ffded4-785c-4efe-9e9c-2aec41101b60 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.443833 Jul 24 01:35:18.322344 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2422/4949] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:17 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:18.329238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1454881483", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "f7f85318-10c1-466f-8ae4-71502482b803"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:18.338465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:18.351242 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8245d1d1-3074-44ae-8823-b3461907d7aa tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1394 microversion: 2.1 time: 0.331496 Jul 24 01:35:18.352216 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2528/4950] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:18 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1394 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:18.360852 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:18.368886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:18.376262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:18.377872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:18.378776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:18.379487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:18.409500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] validate_networks() for [('f7f85318-10c1-466f-8ae4-71502482b803', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:35:18.763275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:18.773414 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2dfec0ce-776b-4e1f-a7d7-b0c7d64b9fac tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.420070 Jul 24 01:35:18.776616 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2529/4951] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:18 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:18.793882 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:18.794504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:18.801224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:18.802410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:18.803285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:18.803842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:18.918676 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:19.143473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:19.162994 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f5b15aa0-bac6-40a7-9036-b1bccabf5582 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.369889 Jul 24 01:35:19.175860 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2530/4952] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:18 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:19.344449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:35:19.345679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:35:19.346174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:35:19.346591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:35:19.347005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:35:19.360416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:19.361081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:19.362226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:19.362836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:19.368343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:19.368970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:19.384983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:19.385446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:19.386458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:19.386914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:19.391441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Getting quotas for project 81e420896e8b4382b3441e63abf81c15. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:19.402828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Getting quotas for user 280d6677ca794b7eab9fb6f4214f572e and project 81e420896e8b4382b3441e63abf81c15. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:19.427512 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:35:19.430338 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:35:19.518068 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-076259bf-aa7b-4cbb-9918-5a8b7752d62d tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191612 Jul 24 01:35:19.524694 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2423/4953] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:35:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:35:19.533932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d5a0b9d-8962-4a5b-b5b0-f14edfe509b6 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:19.534612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2d5a0b9d-8962-4a5b-b5b0-f14edfe509b6 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:19.692925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d5a0b9d-8962-4a5b-b5b0-f14edfe509b6 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:19.704814 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d5a0b9d-8962-4a5b-b5b0-f14edfe509b6 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1214 microversion: 2.1 time: 0.177775 Jul 24 01:35:19.705829 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2424/4954] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:19 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:19.734305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:19.745655 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5587108b-0cd0-402e-b737-1d04f7c7a081 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1394 microversion: 2.1 time: 0.380957 Jul 24 01:35:19.746948 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2531/4955] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:19 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1394 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:19.921941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1835180515", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "b4a64a56-d854-48e5-9e81-a422b7d4c6e3"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:20.032035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] validate_networks() for [('b4a64a56-d854-48e5-9e81-a422b7d4c6e3', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:35:20.724555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:20.730371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:20.738778 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:20.750157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:20.750742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:20.751824 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:20.752373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:20.947901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:20.959126 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-da5587c5-43be-461b-99a4-a453cf0a5b6c tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1210 microversion: 2.1 time: 0.239772 Jul 24 01:35:20.962143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:35:20.963423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:35:20.964108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:35:20.964553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:35:20.965072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:35:20.966856 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2532/4956] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:20 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1210 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:20.976961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:20.977879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:20.979275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:20.979966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:20.980639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:20.981706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:20.991879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:20.993965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:20.994796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:20.995243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:21.024606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Getting quotas for project 64b9be90c4164b669023b4a6a42df574. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:21.036790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Getting quotas for user 93af4655b28648d08cded0540173d2ac and project 64b9be90c4164b669023b4a6a42df574. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:21.055652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:35:21.058242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:35:21.167762 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-24997396-cb87-40b9-977b-d1e10393a5e9 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455757 Jul 24 01:35:21.170135 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2425/4957] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:35:21.186064 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d316b20-7891-45e0-a6bc-2a566a206caa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:21.187215 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d316b20-7891-45e0-a6bc-2a566a206caa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:21.205859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d316b20-7891-45e0-a6bc-2a566a206caa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:21.208437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d316b20-7891-45e0-a6bc-2a566a206caa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:21.209805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d316b20-7891-45e0-a6bc-2a566a206caa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:21.210601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d316b20-7891-45e0-a6bc-2a566a206caa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:21.245227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d316b20-7891-45e0-a6bc-2a566a206caa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/ips" status: 200 len: 148 microversion: 2.1 time: 0.072078 Jul 24 01:35:21.247364 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2426/4958] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:35:21 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/ips => generated 148 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:21.275965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f9dc11c6-7939-465f-b0b3-38c82c7c0700 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:21.277138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f9dc11c6-7939-465f-b0b3-38c82c7c0700 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:21.565798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f9dc11c6-7939-465f-b0b3-38c82c7c0700 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:21.585284 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f9dc11c6-7939-465f-b0b3-38c82c7c0700 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1214 microversion: 2.1 time: 0.334909 Jul 24 01:35:21.588617 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2427/4959] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:21 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:21.637199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:21.651975 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71efbde7-6bd7-4ca2-9983-6736c89743a8 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1394 microversion: 2.1 time: 0.682806 Jul 24 01:35:21.670109 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2533/4960] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:20 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1394 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:21.984232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:21.984676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:22.015945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:22.018408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:22.021039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:22.025613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:22.220398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:22.235206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bd1bb37c-87fe-4330-a364-481b7cabeebe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1272 microversion: 2.1 time: 0.255275 Jul 24 01:35:22.238129 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2428/4961] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:21 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:22.604585 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:22.605194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:22.617646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:22.618089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:22.620484 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:22.620956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:22.669147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:22.670217 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:22.685870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:22.686660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:22.687669 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:22.688316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:22.787139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:22.803757 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d6495df7-b540-4347-9114-b0a30ce54c06 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1210 microversion: 2.1 time: 0.203142 Jul 24 01:35:22.804368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2534/4962] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:22 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1210 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:23.024909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:23.034279 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be57ec29-84ec-4838-bc73-34ea897ce70d tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1394 microversion: 2.1 time: 0.369280 Jul 24 01:35:23.051782 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2429/4963] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:22 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1394 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:23.257349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:23.258246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:23.270730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:23.271806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:23.290997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:23.292176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:23.588920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:23.599234 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7292a80-93be-4e00-b4e0-904b33ec451a tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1314 microversion: 2.1 time: 0.344808 Jul 24 01:35:23.601286 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2535/4964] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:23 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:23.833592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:23.834972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:23.852012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:23.853955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:23.857439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:23.858208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.057042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:24.068775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:24.069500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:24.075126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1370ef8-76b5-4c2f-a546-b5d9e0ad9f77 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1272 microversion: 2.1 time: 0.249825 Jul 24 01:35:24.085060 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2430/4965] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:23 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:24.087330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.087795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.088589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.089030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.190179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-974ed115-0121-4317-b356-b31b3c0a14c3 req-e5ee6c4b-3081-495f-8f67-586dc749ee95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f7c749c-ea58-447f-9d93-5434dfe66698", "name": "network-vif-plugged", "status": "completed", "tag": "69e9584d-19a5-4e33-9d2b-ab3773ffb3d2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:24.203030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-974ed115-0121-4317-b356-b31b3c0a14c3 req-e5ee6c4b-3081-495f-8f67-586dc749ee95 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.203487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-974ed115-0121-4317-b356-b31b3c0a14c3 req-e5ee6c4b-3081-495f-8f67-586dc749ee95 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.237469 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-974ed115-0121-4317-b356-b31b3c0a14c3 req-e5ee6c4b-3081-495f-8f67-586dc749ee95 service nova] Creating event network-vif-plugged:69e9584d-19a5-4e33-9d2b-ab3773ffb3d2 for instance 3f7c749c-ea58-447f-9d93-5434dfe66698 on n-h2-master-1 Jul 24 01:35:24.247330 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-974ed115-0121-4317-b356-b31b3c0a14c3 req-e5ee6c4b-3081-495f-8f67-586dc749ee95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060892 Jul 24 01:35:24.252811 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2431/4966] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:35:24.262647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f48c1c50-96a6-448d-9d5f-ff39c65c7c61 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98b304c8-cfc8-4926-b4ab-e5ad7af46070"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:24.266241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f48c1c50-96a6-448d-9d5f-ff39c65c7c61 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:24.284001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f48c1c50-96a6-448d-9d5f-ff39c65c7c61 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.290683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f48c1c50-96a6-448d-9d5f-ff39c65c7c61 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.291787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f48c1c50-96a6-448d-9d5f-ff39c65c7c61 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.292481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f48c1c50-96a6-448d-9d5f-ff39c65c7c61 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.483997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:24.506910 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-868cf0b3-81d5-42ca-9c56-e6285fe4dc4b tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1394 microversion: 2.1 time: 0.438163 Jul 24 01:35:24.508768 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2536/4967] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:24 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1394 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:24.768572 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f48c1c50-96a6-448d-9d5f-ff39c65c7c61 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513642 Jul 24 01:35:24.770031 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2432/4968] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:35:24 2022] POST /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:24.793573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:24.795089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:24.804142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.805112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.806521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.807363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.825632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9d6b904c-6900-464a-8c44-c3a1bcf2db60 req-16720676-ee95-4022-a394-ed97d71c5f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120bf4c5-f422-460c-8325-bc01fd99a5c3", "tag": "25dee5ee-3546-48b7-87f9-691200dc11a2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:24.845695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9d6b904c-6900-464a-8c44-c3a1bcf2db60 req-16720676-ee95-4022-a394-ed97d71c5f44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:24.846476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9d6b904c-6900-464a-8c44-c3a1bcf2db60 req-16720676-ee95-4022-a394-ed97d71c5f44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:24.872242 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9d6b904c-6900-464a-8c44-c3a1bcf2db60 req-16720676-ee95-4022-a394-ed97d71c5f44 service nova] Creating event network-changed:25dee5ee-3546-48b7-87f9-691200dc11a2 for instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 on n-h1-master-1 Jul 24 01:35:24.886483 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9d6b904c-6900-464a-8c44-c3a1bcf2db60 req-16720676-ee95-4022-a394-ed97d71c5f44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.375497 Jul 24 01:35:24.887542 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2537/4969] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:25.003945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:25.013326 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a412a1b8-fa9e-462d-9481-f2e80b54ccf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1314 microversion: 2.1 time: 0.241387 Jul 24 01:35:25.014937 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2433/4970] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:24 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:25.102627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:25.103633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:25.111156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:25.111677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:25.112676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:25.113112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:25.340108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:25.366069 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3648dd88-d6e3-4588-bc5b-f5f1d16efcc6 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.268965 Jul 24 01:35:25.369431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2538/4971] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:25 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:25.529973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:25.532988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:25.552706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:25.553166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:25.565587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:25.566137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:25.611897 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:26.008728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:26.020747 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5a0b9bc-f30b-4910-9e76-b10893217864 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1394 microversion: 2.1 time: 0.499501 Jul 24 01:35:26.022034 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2434/4972] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:25 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1394 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:26.035032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:26.035655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:26.043448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:26.043900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:26.044685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:26.045117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:26.387368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:26.387975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:26.411768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:26.412396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:26.414636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:26.415151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:27.013806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:27.039346 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-48dc7045-8bc9-41b7-8108-43a42f4d92cc tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1314 microversion: 2.1 time: 1.011827 Jul 24 01:35:27.040544 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2539/4973] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:26 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:27.047814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:27.048825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:27.059226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:27.059990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:27.061393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:27.062143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:27.092893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:27.108947 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02f9915f-0a64-423b-b9d5-25c77b436831 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.726391 Jul 24 01:35:27.109564 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2435/4974] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:26 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:27.352659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-893293be-7dc0-4912-8fa8-92a8aff4b308 req-2b5d7e22-37e9-489b-bc37-b7d814e15561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5367908-3256-49db-99d0-82d32e47dc6b", "tag": "11c3a5ec-b152-4732-a34e-07716637f3af"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:27.365966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-893293be-7dc0-4912-8fa8-92a8aff4b308 req-2b5d7e22-37e9-489b-bc37-b7d814e15561 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:27.368042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-893293be-7dc0-4912-8fa8-92a8aff4b308 req-2b5d7e22-37e9-489b-bc37-b7d814e15561 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:27.393654 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-893293be-7dc0-4912-8fa8-92a8aff4b308 req-2b5d7e22-37e9-489b-bc37-b7d814e15561 service nova] Creating event network-changed:11c3a5ec-b152-4732-a34e-07716637f3af for instance d5367908-3256-49db-99d0-82d32e47dc6b on n-h2-master-1 Jul 24 01:35:27.406135 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-893293be-7dc0-4912-8fa8-92a8aff4b308 req-2b5d7e22-37e9-489b-bc37-b7d814e15561 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056482 Jul 24 01:35:27.407382 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2436/4975] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:27.599787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:27.629314 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a1c1d85e-fbcb-40c0-bed9-62b3e42d0402 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1574 microversion: 2.1 time: 0.587140 Jul 24 01:35:27.641354 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2540/4976] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:27 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1574 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:27.663439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-374283cb-0e5e-4d14-b582-73131cdf1a44 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:27.665122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-374283cb-0e5e-4d14-b582-73131cdf1a44 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:27.677534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-374283cb-0e5e-4d14-b582-73131cdf1a44 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:27.679381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-374283cb-0e5e-4d14-b582-73131cdf1a44 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:27.680696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-374283cb-0e5e-4d14-b582-73131cdf1a44 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:27.690274 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-374283cb-0e5e-4d14-b582-73131cdf1a44 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:27.830467 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-374283cb-0e5e-4d14-b582-73131cdf1a44 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174762 Jul 24 01:35:27.833150 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2437/4977] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:35:27 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:28.056473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:28.057865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:28.069555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:28.073332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:28.074267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:28.074904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:28.129156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:28.131350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:28.146566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:28.148329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:28.150242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:28.154494 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:29.000762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:29.011684 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:29.015839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1276f830-d64f-41cc-b25d-2a441ce79a56 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1314 microversion: 2.1 time: 0.963351 Jul 24 01:35:29.028266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2541/4978] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:28 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:29.092019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:29.103999 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-baff38d2-1b37-4656-ad98-60ce77a1f93a tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.981413 Jul 24 01:35:29.104623 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2438/4979] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:28 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:29.814938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:29.815545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:29.821749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e75f9e82-984f-48d4-bdc0-c8843e6615c4 req-606dafa0-b967-432e-88ae-004cff01f838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f7c749c-ea58-447f-9d93-5434dfe66698", "tag": "69e9584d-19a5-4e33-9d2b-ab3773ffb3d2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:29.831802 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e75f9e82-984f-48d4-bdc0-c8843e6615c4 req-606dafa0-b967-432e-88ae-004cff01f838 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:29.832746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e75f9e82-984f-48d4-bdc0-c8843e6615c4 req-606dafa0-b967-432e-88ae-004cff01f838 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:29.834801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:29.835258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:29.836158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:29.836698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:29.849539 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e75f9e82-984f-48d4-bdc0-c8843e6615c4 req-606dafa0-b967-432e-88ae-004cff01f838 service nova] Creating event network-changed:69e9584d-19a5-4e33-9d2b-ab3773ffb3d2 for instance 3f7c749c-ea58-447f-9d93-5434dfe66698 on n-h2-master-1 Jul 24 01:35:29.879002 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e75f9e82-984f-48d4-bdc0-c8843e6615c4 req-606dafa0-b967-432e-88ae-004cff01f838 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060889 Jul 24 01:35:29.887179 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2439/4980] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:35:30.035083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:30.035853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:30.055267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:30.055955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:30.057137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:30.057805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:30.124386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:30.137404 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-236f20b9-6b4c-47fc-9450-ac83fd0cb899 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1574 microversion: 2.1 time: 0.326897 Jul 24 01:35:30.148850 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2542/4981] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:29 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1574 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:30.155843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:30.156524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:30.173289 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:30.176896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:30.177778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:30.178230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:30.273801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:30.288281 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85bf48ca-c243-4494-b240-091658072d48 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1314 microversion: 2.1 time: 0.257554 Jul 24 01:35:30.290940 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2440/4982] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:30 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:30.544463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:30.553350 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2f109536-d4b6-4c75-beef-58b45b3e1f70 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.412771 Jul 24 01:35:30.554168 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2543/4983] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:30 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:31.308556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:31.309114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:31.315540 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:31.341236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:31.341715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:31.342536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:31.342980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:31.570891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:31.571507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:31.574546 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=16 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:31.591316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:31.592063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:31.593028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:31.593634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:31.803939 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:31.826296 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-076eae89-4954-4307-9b58-0bbc7f9836cf tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1314 microversion: 2.1 time: 0.521986 Jul 24 01:35:31.848104 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2441/4984] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:31 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:31.961526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:31.974146 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8fbe01d-1401-4419-abd2-6123d17a50b1 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.403143 Jul 24 01:35:31.975622 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2544/4985] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:31 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:32.003116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2d52c72d-9544-48e6-b7d5-34550a81cc1e req-4b7cdf3d-94fb-4e8e-80f7-d634f3ce0a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120bf4c5-f422-460c-8325-bc01fd99a5c3", "name": "network-vif-plugged", "status": "completed", "tag": "25dee5ee-3546-48b7-87f9-691200dc11a2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:32.022270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2d52c72d-9544-48e6-b7d5-34550a81cc1e req-4b7cdf3d-94fb-4e8e-80f7-d634f3ce0a23 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:32.027339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2d52c72d-9544-48e6-b7d5-34550a81cc1e req-4b7cdf3d-94fb-4e8e-80f7-d634f3ce0a23 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:32.064433 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2d52c72d-9544-48e6-b7d5-34550a81cc1e req-4b7cdf3d-94fb-4e8e-80f7-d634f3ce0a23 service nova] Creating event network-vif-plugged:25dee5ee-3546-48b7-87f9-691200dc11a2 for instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 on n-h1-master-1 Jul 24 01:35:32.077161 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2d52c72d-9544-48e6-b7d5-34550a81cc1e req-4b7cdf3d-94fb-4e8e-80f7-d634f3ce0a23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078471 Jul 24 01:35:32.080088 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2442/4986] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:32.855497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:32.857216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:32.873567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:32.874659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:32.875718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:32.876387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:32.994705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:32.996313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:33.003806 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:33.006878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:33.007657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:33.009046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:33.009782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:33.118434 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:33.128743 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c56c441d-75f1-43bb-a36a-4c2c6d31e247 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1314 microversion: 2.1 time: 0.277054 Jul 24 01:35:33.140014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2545/4987] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:32 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:33.212819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:33.221309 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-17570cfe-463e-4b47-84ed-bed79affb6ab tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.232508 Jul 24 01:35:33.232816 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2443/4988] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:32 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:34.146932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:34.147707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:34.155811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:34.156264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:34.157053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:34.157498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:34.240170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:34.241513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:34.248788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:34.249240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:34.250275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:34.250905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:34.842240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:34.852068 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38ac0857-6f9c-4862-b91a-23294804faa1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1498 microversion: 2.1 time: 0.709043 Jul 24 01:35:34.867093 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2546/4989] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:34 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1498 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:34.873204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9006904e-c60f-4734-82cf-7327b762e59a req-bbcf27bd-fcff-48c2-b897-6652c91ecb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5367908-3256-49db-99d0-82d32e47dc6b", "name": "network-vif-plugged", "status": "completed", "tag": "11c3a5ec-b152-4732-a34e-07716637f3af"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:34.889383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:34.901029 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-29c63d82-b113-4c5c-8525-779dc2cb2d62 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.666138 Jul 24 01:35:34.902209 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2444/4990] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:34 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:34.903019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9006904e-c60f-4734-82cf-7327b762e59a req-bbcf27bd-fcff-48c2-b897-6652c91ecb0c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:34.903673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9006904e-c60f-4734-82cf-7327b762e59a req-bbcf27bd-fcff-48c2-b897-6652c91ecb0c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:34.933122 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9006904e-c60f-4734-82cf-7327b762e59a req-bbcf27bd-fcff-48c2-b897-6652c91ecb0c service nova] Creating event network-vif-plugged:11c3a5ec-b152-4732-a34e-07716637f3af for instance d5367908-3256-49db-99d0-82d32e47dc6b on n-h2-master-1 Jul 24 01:35:34.939079 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9006904e-c60f-4734-82cf-7327b762e59a req-bbcf27bd-fcff-48c2-b897-6652c91ecb0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070025 Jul 24 01:35:34.940433 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2547/4991] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:35.357608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:35.358154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:35.367077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:35.367442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:35.368315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:35.368977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:35.410831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:35:35.507336 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eac0a043-2db7-43aa-9fea-6caffa5a8459 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "DELETE /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 204 len: 0 microversion: 2.1 time: 0.154102 Jul 24 01:35:35.511140 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2445/4992] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:35:35 2022] DELETE /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:35:35.518368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:35.519074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:35.527164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:35.527660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:35.528445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:35.529083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:35.859831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:35.870358 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6313924f-4803-461d-8e0c-40760df74da0 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1504 microversion: 2.1 time: 0.357637 Jul 24 01:35:35.871318 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2548/4993] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:35 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:35.919834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:35.920944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:35.928180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:35.928704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:35.929574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:35.930140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:36.198100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:36.206404 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e43fbbd0-9427-498a-ab8f-3350c17f2ebc tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1314 microversion: 2.1 time: 0.290987 Jul 24 01:35:36.207136 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2446/4994] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:35 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:36.895815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:36.895815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:36.902681 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:36.904608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:36.905426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:36.906276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:36.906895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:37.154626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:37.167317 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-99810b19-2f35-4c81-857f-0ce81d6a1786 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1504 microversion: 2.1 time: 0.278379 Jul 24 01:35:37.169016 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2549/4995] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:36 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:37.227809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:37.228399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:37.238934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:37.239671 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:37.240654 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:37.241266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:37.525554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:37.542368 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3bd905dc-57b7-4808-958f-a49d7f985013 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1498 microversion: 2.1 time: 0.317655 Jul 24 01:35:37.555853 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2447/4996] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:37 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1498 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:37.869411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b8fa611d-ae43-49af-9d6a-750271332831 req-5992c0e6-b5e4-4422-aacd-a9f7ee6532ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120bf4c5-f422-460c-8325-bc01fd99a5c3", "name": "network-vif-deleted", "tag": "25dee5ee-3546-48b7-87f9-691200dc11a2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:37.887856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b8fa611d-ae43-49af-9d6a-750271332831 req-5992c0e6-b5e4-4422-aacd-a9f7ee6532ef service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:37.888371 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b8fa611d-ae43-49af-9d6a-750271332831 req-5992c0e6-b5e4-4422-aacd-a9f7ee6532ef service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:37.918318 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b8fa611d-ae43-49af-9d6a-750271332831 req-5992c0e6-b5e4-4422-aacd-a9f7ee6532ef service nova] Creating event network-vif-deleted:25dee5ee-3546-48b7-87f9-691200dc11a2 for instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 on n-h1-master-1 Jul 24 01:35:37.924833 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b8fa611d-ae43-49af-9d6a-750271332831 req-5992c0e6-b5e4-4422-aacd-a9f7ee6532ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058681 Jul 24 01:35:37.925425 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2550/4997] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:38.186199 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:38.188006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:38.197082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:38.198270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:38.199265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:38.199807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:38.241809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:38.242593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:38.242889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lazy-loading 'fault' on Instance uuid 120bf4c5-f422-460c-8325-bc01fd99a5c3 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:35:38.321156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:38.334938 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3ba5b52d-777e-4083-9be2-8e24f98cfcab tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 200 len: 1304 microversion: 2.1 time: 0.154287 Jul 24 01:35:38.336163 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2448/4998] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:38 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:39.357976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:39.359372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 120bf4c5-f422-460c-8325-bc01fd99a5c3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:39.375228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:39.376404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:39.377330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:39.377885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:39.398772 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] HTTP exception thrown: Instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 could not be found. Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Request method failure captured: Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 HTTP/1.1 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KHSJ9p0QnvGSjqEMS-w-heQSgye0WJStSjBvZcVT5EEfc3p8nPZ-OcrvvAtgToUXCGSwR7n5W-vjog1tD9oekIgmzwF8G09755ZKDSVneil19Nt0689XBwl546LtJqbo7OQiRvHwIbXVtr3cbaAJwguSCE0zLXSt6Hod6HwT4rsDFc Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 81e420896e8b4382b3441e63abf81c15 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesActionsTest-1918541038 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81e420896e8b4382b3441e63abf81c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81e420896e8b4382b3441e63abf81c15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81e420896e8b4382b3441e63abf81c15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81e420896e8b4382b3441e63abf81c15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesActionsTest-1918541038 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 81e420896e8b4382b3441e63abf81c15 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesActionsTest-1918541038 Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesActionsTest-1918541038-project Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 280d6677ca794b7eab9fb6f4214f572e Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesActionsTest-1918541038-project Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 could not be found. Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '120bf4c5-f422-460c-8325-bc01fd99a5c3'} Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 could not be found. Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 could not be found. Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:35:39.401077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:39.406019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:39.406019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:35:39.406019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:35:39.406019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:35:39.406019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:35:39.406019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 could not be found. Jul 24 01:35:39.406019 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:39.408382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Returning 404 to user: Instance 120bf4c5-f422-460c-8325-bc01fd99a5c3 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:35:39.409364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cd05bb81-c682-4546-a041-076a21ae289e tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3" status: 404 len: 111 microversion: 2.1 time: 0.058020 Jul 24 01:35:39.420879 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2551/4999] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:39 2022] GET /compute/v2.1/servers/120bf4c5-f422-460c-8325-bc01fd99a5c3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:35:39.523245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-841105297", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "f7f85318-10c1-466f-8ae4-71502482b803"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:39.596475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] validate_networks() for [('f7f85318-10c1-466f-8ae4-71502482b803', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:35:40.427386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93b5e348-f0b9-467a-9e3e-c7b447f7a366 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: .version_select at 0x7f05ead55f70>, body: {"keypair": {"name": "tempest-keypair-1495922635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1GlJI1QUZ6248LFfE2fF7PHz/5XeR/dCH64SbY2yIdg2HqCZBd5rAhbnxIlXLFJCMTMMVTVK/7D2azkYa3nx7R15/2hz0OIW+t7gcG45Yh4kxa7sp3ulVd/ymjrMyF3w=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:40.451808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-93b5e348-f0b9-467a-9e3e-c7b447f7a366 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:40.460257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-93b5e348-f0b9-467a-9e3e-c7b447f7a366 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:40.496131 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93b5e348-f0b9-467a-9e3e-c7b447f7a366 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073098 Jul 24 01:35:40.497806 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2552/5000] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:35:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:35:40.505625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:40.508884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:40.517900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:40.518846 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:40.521376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:40.522048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:40.576335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:35:40.577454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:35:40.578344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:35:40.578985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:35:40.580346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:35:40.594752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:40.595616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:40.596799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:40.597449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:40.597911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:35:40.626252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Getting quotas for project 81e420896e8b4382b3441e63abf81c15. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:40.634925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Getting quotas for user 280d6677ca794b7eab9fb6f4214f572e and project 81e420896e8b4382b3441e63abf81c15. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:40.660014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:35:40.662970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:35:40.735545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c4c277a5-7990-40e3-b515-cdbdacab81a5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216475 Jul 24 01:35:40.737465 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2449/5001] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:35:40.749224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c280bc2f-0766-473b-881d-c783b04dde67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:40.750271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c280bc2f-0766-473b-881d-c783b04dde67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:40.810175 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9d8e1fbb-bb97-4a95-9843-e04631047dce tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 204 len: 0 microversion: 2.1 time: 0.308686 Jul 24 01:35:40.811157 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2553/5002] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:35:40 2022] DELETE /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:35:40.838026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:40.838787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:40.847162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:40.847898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:40.849380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:40.850324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:40.880723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c280bc2f-0766-473b-881d-c783b04dde67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:40.894409 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c280bc2f-0766-473b-881d-c783b04dde67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1213 microversion: 2.1 time: 0.150347 Jul 24 01:35:40.895030 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2450/5003] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:40 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:41.225555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:41.258764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46356234-3300-415d-8756-c50dfb16f0f3 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1504 microversion: 2.1 time: 0.417470 Jul 24 01:35:41.260270 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2554/5004] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:40 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:41.912376 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:41.913620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:41.921975 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:41.922721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:41.923907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:41.924503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:42.008246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:42.018857 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e4dafc71-aca8-4a1f-bb86-80a290c02850 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1265 microversion: 2.1 time: 0.110330 Jul 24 01:35:42.026978 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2451/5005] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:41 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:42.278110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:42.278860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:42.289401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:42.289883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:42.295308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:42.295762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:42.523345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:42.540514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64e961fd-1b52-4e51-9357-a2c43abd7020 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1504 microversion: 2.1 time: 0.266566 Jul 24 01:35:42.550083 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2555/5006] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:42 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:42.668069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1333227494", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d079b7a7-c0b2-4912-ba85-a51dab0beef6"}], "security_groups": [{"name": "tempest-securitygroup--2113272260"}], "key_name": "tempest-keypair-1495922635", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:42.811835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] validate_networks() for [('d079b7a7-c0b2-4912-ba85-a51dab0beef6', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:35:43.038543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:43.039801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:43.047944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:43.048721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:43.049759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:43.050264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:43.200192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:43.212939 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef1b3e2a-ff07-4bec-b077-bbdc3aded5fe tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1271 microversion: 2.1 time: 0.180346 Jul 24 01:35:43.216829 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2556/5007] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:43 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:43.396112 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:35:43.397515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:35:43.398205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:35:43.398804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:35:43.399524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:35:43.415315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:43.416024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:43.417029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:43.418048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:43.442493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:43.449904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:43.468876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:35:43.472636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:35:43.549912 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1f3bb5a-80ee-496b-8bd5-7334c22e6644 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.886329 Jul 24 01:35:43.551677 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2452/5008] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:35:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:35:43.562516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:43.570218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:43.587722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1a60312-5c3d-4c98-a68b-91b6a2cd2d5e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:43.589231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:43.590448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1a60312-5c3d-4c98-a68b-91b6a2cd2d5e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:43.595797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:43.596927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:43.600743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:43.700760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1a60312-5c3d-4c98-a68b-91b6a2cd2d5e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:43.712370 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1a60312-5c3d-4c98-a68b-91b6a2cd2d5e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1242 microversion: 2.1 time: 0.137056 Jul 24 01:35:43.732512 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2453/5009] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:43 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:43.762596 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8c410f56-9cbf-4d1a-bded-11b7e82f3e34 req-fec9ddf3-771b-4d71-90e6-e81a7b85e113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5367908-3256-49db-99d0-82d32e47dc6b", "name": "network-vif-deleted", "tag": "11c3a5ec-b152-4732-a34e-07716637f3af"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:43.808929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8c410f56-9cbf-4d1a-bded-11b7e82f3e34 req-fec9ddf3-771b-4d71-90e6-e81a7b85e113 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:43.813236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8c410f56-9cbf-4d1a-bded-11b7e82f3e34 req-fec9ddf3-771b-4d71-90e6-e81a7b85e113 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:43.836236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8c410f56-9cbf-4d1a-bded-11b7e82f3e34 req-fec9ddf3-771b-4d71-90e6-e81a7b85e113 service nova] Creating event network-vif-deleted:11c3a5ec-b152-4732-a34e-07716637f3af for instance d5367908-3256-49db-99d0-82d32e47dc6b on n-h2-master-1 Jul 24 01:35:43.853819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8c410f56-9cbf-4d1a-bded-11b7e82f3e34 req-fec9ddf3-771b-4d71-90e6-e81a7b85e113 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115739 Jul 24 01:35:43.855192 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2454/5010] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:43.889595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93af4655b28648d08cded0540173d2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b9be90c4164b669023b4a6a42df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:43.901711 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-166e87cc-a8fe-4f49-9069-db35cca1c52b tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 200 len: 1462 microversion: 2.1 time: 0.347136 Jul 24 01:35:43.908985 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2557/5011] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:43 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 1462 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:44.237404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:44.241737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:44.265889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:44.268622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:44.274056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:44.275359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:44.318955 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:44.730382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:44.731109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:44.749427 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:44.751772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:44.752883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:44.754199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:44.796594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:44.806847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44f98428-5c64-4bc4-a8e4-3b8c6ac13bf9 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1313 microversion: 2.1 time: 0.576438 Jul 24 01:35:44.812058 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2455/5012] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:44 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:44.878100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:44.890958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63a25e7b-1fa3-4ca0-a9a3-f396e5838df1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1238 microversion: 2.1 time: 0.164976 Jul 24 01:35:44.892153 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2558/5013] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:44 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1238 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:44.919836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:44.920806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] [instance: d5367908-3256-49db-99d0-82d32e47dc6b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:44.928009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:44.928462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:44.929238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:44.929713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:44.944841 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] HTTP exception thrown: Instance d5367908-3256-49db-99d0-82d32e47dc6b could not be found. Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Request method failure captured: Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b HTTP/1.1 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KHUjSPLoejOiJvUWeP9HjH3BY7px9UCbAiT8rHJWFGjXySdP7aqyhsalMXRv3-BJooNg8gDrTpuFLAxJp4RhWt2zgtJZ-RsWm6N9a7ytSud4UQFDVLb1Qz-JEe6oADTrSvZQGR6asnhB9PBha5Dl0zBeTbVwj5CKrCRin_HYcErDMs Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 64b9be90c4164b669023b4a6a42df574 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesActionsTest-1015677010 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64b9be90c4164b669023b4a6a42df574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64b9be90c4164b669023b4a6a42df574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64b9be90c4164b669023b4a6a42df574", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64b9be90c4164b669023b4a6a42df574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesActionsTest-1015677010 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 64b9be90c4164b669023b4a6a42df574 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesActionsTest-1015677010 Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesActionsTest-1015677010-project Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 93af4655b28648d08cded0540173d2ac Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesActionsTest-1015677010-project Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: exception: Instance d5367908-3256-49db-99d0-82d32e47dc6b could not be found. Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd5367908-3256-49db-99d0-82d32e47dc6b'} Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5367908-3256-49db-99d0-82d32e47dc6b could not be found. Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5367908-3256-49db-99d0-82d32e47dc6b could not be found. Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:35:44.946547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:35:44.952311 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:44.952311 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:35:44.952311 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:35:44.952311 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:35:44.952311 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:35:44.952311 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5367908-3256-49db-99d0-82d32e47dc6b could not be found. Jul 24 01:35:44.952311 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:35:44.953568 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] Returning 404 to user: Instance d5367908-3256-49db-99d0-82d32e47dc6b could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:35:44.954443 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bfaaccc8-687c-49a1-8187-88943f923b51 tempest-VolumesActionsTest-1015677010 tempest-VolumesActionsTest-1015677010-project] 10.222.0.27 "GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b" status: 404 len: 111 microversion: 2.1 time: 0.039086 Jul 24 01:35:44.955011 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2456/5014] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:44 2022] GET /compute/v2.1/servers/d5367908-3256-49db-99d0-82d32e47dc6b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:35:45.828793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:45.830632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:45.849113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:45.851516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:45.852986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:45.853877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:45.906296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0a1dd1b3-89cb-43bc-8bfa-eb871eddb026 req-9a79ac06-d922-433d-bfa7-634d669a7180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a111783-c7c4-48b3-a771-65fcd01d6118", "tag": "8948d33e-f702-48fc-8f1f-db41e06471c1"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:45.944810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0a1dd1b3-89cb-43bc-8bfa-eb871eddb026 req-9a79ac06-d922-433d-bfa7-634d669a7180 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:45.947179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0a1dd1b3-89cb-43bc-8bfa-eb871eddb026 req-9a79ac06-d922-433d-bfa7-634d669a7180 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:45.991226 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0a1dd1b3-89cb-43bc-8bfa-eb871eddb026 req-9a79ac06-d922-433d-bfa7-634d669a7180 service nova] Creating event network-changed:8948d33e-f702-48fc-8f1f-db41e06471c1 for instance 1a111783-c7c4-48b3-a771-65fcd01d6118 on n-h1-master-1 Jul 24 01:35:46.017698 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0a1dd1b3-89cb-43bc-8bfa-eb871eddb026 req-9a79ac06-d922-433d-bfa7-634d669a7180 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119131 Jul 24 01:35:46.019391 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2457/5015] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:35:46.029240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:46.031409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:46.041093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:46.046408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:46.048272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:46.049265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:46.147477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:46.154638 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:46.162062 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4d980445-fa88-46c4-8db7-c1e2d39ba629 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1313 microversion: 2.1 time: 0.342327 Jul 24 01:35:46.163410 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2559/5016] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:45 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:46.180378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:46.194032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85cb32c7-4bd1-4213-b56f-2edbf2dd2f2f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1300 microversion: 2.1 time: 0.171986 Jul 24 01:35:46.195685 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2458/5017] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:46 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1300 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:47.180496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:47.181109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:47.195768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.198443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.199586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.202596 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.213430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:47.214266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:47.229420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.242595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.244076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.244898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.662435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:47.673045 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b696d2c8-af0f-44b0-a35b-8df2d5d9a3e2 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1313 microversion: 2.1 time: 0.496266 Jul 24 01:35:47.682859 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2560/5018] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:47 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:47.683432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d93612ce-f3b7-4444-ae23-47df3be7bea5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:47.684517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d93612ce-f3b7-4444-ae23-47df3be7bea5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:47.696545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93612ce-f3b7-4444-ae23-47df3be7bea5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.697021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93612ce-f3b7-4444-ae23-47df3be7bea5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.699436 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93612ce-f3b7-4444-ae23-47df3be7bea5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.699914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93612ce-f3b7-4444-ae23-47df3be7bea5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.750102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:47.753042 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d93612ce-f3b7-4444-ae23-47df3be7bea5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077581 Jul 24 01:35:47.755388 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2561/5019] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:35:47 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:35:47.760580 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5f55921b-e226-4c88-8112-7bf1a2f0a159 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.550595 Jul 24 01:35:47.771481 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2459/5020] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:47 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:47.830533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:47.831396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:47.844905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.846400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.848156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:47.848819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:47.922641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:35:48.138499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-73cdbbad-1413-4388-902b-13968f0c1f49 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 204 len: 0 microversion: 2.1 time: 0.310827 Jul 24 01:35:48.141870 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2562/5021] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:35:47 2022] DELETE /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:35:48.153072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:48.154045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:48.171763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:48.173214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:48.176275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:48.176969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:48.560508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-983a27be-94c4-4cc6-8f69-bd7fe0a19d45 req-98b353e4-8a07-4f7c-b291-867e7c219cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec18022f-1f61-4587-9301-b11e0168418d", "tag": "73012229-0639-4824-8997-62bf02fd681b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:48.587809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-983a27be-94c4-4cc6-8f69-bd7fe0a19d45 req-98b353e4-8a07-4f7c-b291-867e7c219cf9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:48.588485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-983a27be-94c4-4cc6-8f69-bd7fe0a19d45 req-98b353e4-8a07-4f7c-b291-867e7c219cf9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:48.618361 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-983a27be-94c4-4cc6-8f69-bd7fe0a19d45 req-98b353e4-8a07-4f7c-b291-867e7c219cf9 service nova] Creating event network-changed:73012229-0639-4824-8997-62bf02fd681b for instance ec18022f-1f61-4587-9301-b11e0168418d on n-h2-master-1 Jul 24 01:35:48.630400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:48.635429 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-983a27be-94c4-4cc6-8f69-bd7fe0a19d45 req-98b353e4-8a07-4f7c-b291-867e7c219cf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078879 Jul 24 01:35:48.644266 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2563/5022] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:48.665101 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e54b0833-eb0a-4f20-b4e2-1f5b2816b188 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1675 microversion: 2.1 time: 0.512890 Jul 24 01:35:48.674640 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2460/5023] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:48 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1675 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:48.691109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:48.691976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:48.703150 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:48.706967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:48.717363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:48.717363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:48.778281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:48.779255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:48.798584 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:48.807491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:48.808448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:48.808911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:49.274563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:49.277363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:49.290430 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0700e843-23a4-497d-a571-cf4c4d0cbb67 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1313 microversion: 2.1 time: 0.603452 Jul 24 01:35:49.299842 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2564/5024] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:48 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:49.300157 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f8bf1f4c-95d4-4461-880a-f2033c366231 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.523354 Jul 24 01:35:49.301434 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2461/5025] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:48 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:49.705323 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:49.707897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:49.736906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:49.750641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:49.753620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:49.754535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:50.159170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:50.176444 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f6d6029f-b48e-4f31-9a4e-9bd00825919e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1675 microversion: 2.1 time: 0.489152 Jul 24 01:35:50.180090 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2565/5026] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:49 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1675 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:50.309287 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:50.320578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:50.321627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:50.322864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:50.348767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:50.352962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:50.354219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:50.378127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:50.381434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:50.385124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:50.387353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:50.389749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:50.475022 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:50.754364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:50.764102 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-345b79ed-3d4f-46a1-88e5-bfdae56dc0f1 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1313 microversion: 2.1 time: 0.459491 Jul 24 01:35:50.771975 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2462/5027] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:50 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:50.845192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:50.867474 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67cad91f-5601-4107-b39e-1c9398fa319e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.554786 Jul 24 01:35:50.871589 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2566/5028] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:50 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:51.196891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:51.197545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:51.209954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:51.210589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:51.211478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:51.217571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:51.391108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:51.415275 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2f97cd44-10a6-4e1e-ba8e-24c98e91981d tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1607 microversion: 2.1 time: 0.222395 Jul 24 01:35:51.424086 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2463/5029] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:51 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1607 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:51.832689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:51.832689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:51.832689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:51.832689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:51.832689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:51.832689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:51.910127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:51.910127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:51.910127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:51.910127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:51.911024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:51.920644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:52.516177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:52.526387 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-391345d6-203c-4a02-b3a3-4c1f0a126e94 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1313 microversion: 2.1 time: 0.740520 Jul 24 01:35:52.530245 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2567/5030] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:51 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1313 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:52.543805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d954c240-450a-46b6-9092-b4884e6b64e9 req-ce7cb879-889a-415d-840b-4909e3e7a3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a111783-c7c4-48b3-a771-65fcd01d6118", "name": "network-vif-plugged", "status": "completed", "tag": "8948d33e-f702-48fc-8f1f-db41e06471c1"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:52.566337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d954c240-450a-46b6-9092-b4884e6b64e9 req-ce7cb879-889a-415d-840b-4909e3e7a3fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:52.569159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d954c240-450a-46b6-9092-b4884e6b64e9 req-ce7cb879-889a-415d-840b-4909e3e7a3fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:52.569707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:52.585455 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f4408404-47bf-480b-9b48-a72e854ae182 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.700500 Jul 24 01:35:52.588634 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2464/5031] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:51 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:52.600106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:52.602404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:52.603519 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d954c240-450a-46b6-9092-b4884e6b64e9 req-ce7cb879-889a-415d-840b-4909e3e7a3fc service nova] Creating event network-vif-plugged:8948d33e-f702-48fc-8f1f-db41e06471c1 for instance 1a111783-c7c4-48b3-a771-65fcd01d6118 on n-h1-master-1 Jul 24 01:35:52.611028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:52.611773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:52.612846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:52.613463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:52.614842 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d954c240-450a-46b6-9092-b4884e6b64e9 req-ce7cb879-889a-415d-840b-4909e3e7a3fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083213 Jul 24 01:35:52.615459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2568/5032] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:52.835283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:52.848997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dcd92cfc-a247-40cc-94fb-a7781d0cece7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1607 microversion: 2.1 time: 0.253448 Jul 24 01:35:52.849924 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2465/5033] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:52 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1607 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:52.960183 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-836596f8-4265-405c-8ec6-83af27542f3c req-b596b15d-9eff-44df-bf53-2fb4092f250b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da", "name": "network-vif-deleted", "tag": "f96cacfb-b526-4529-b9eb-7efa1961a98c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:52.981870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-836596f8-4265-405c-8ec6-83af27542f3c req-b596b15d-9eff-44df-bf53-2fb4092f250b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:52.986272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-836596f8-4265-405c-8ec6-83af27542f3c req-b596b15d-9eff-44df-bf53-2fb4092f250b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:53.015690 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-836596f8-4265-405c-8ec6-83af27542f3c req-b596b15d-9eff-44df-bf53-2fb4092f250b service nova] Creating event network-vif-deleted:f96cacfb-b526-4529-b9eb-7efa1961a98c for instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da on n-h1-master-1 Jul 24 01:35:53.033140 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-836596f8-4265-405c-8ec6-83af27542f3c req-b596b15d-9eff-44df-bf53-2fb4092f250b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076020 Jul 24 01:35:53.035242 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2569/5034] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:53.555099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:53.555738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:53.559901 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:53.575045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:53.575657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:53.576290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:53.577641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:53.605003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:53.605737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:53.617485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:53.618694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:53.619628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:53.624138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:53.714212 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=16 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:53.891316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:53.905992 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f08d8615-298f-4798-9bea-0bfc3f5176d5 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1313 microversion: 2.1 time: 0.353083 Jul 24 01:35:53.907232 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2466/5035] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:53 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:53.916225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:53.919208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:53.933058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:53.935580 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:53.936541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:53.938034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:53.998271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:54.010268 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e9541b5-41de-4b26-85ed-410f26e0ccfa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.409709 Jul 24 01:35:54.020715 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2570/5036] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:53 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:54.053533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:54.054030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:54.054493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lazy-loading 'fault' on Instance uuid 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:35:54.154400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:54.164895 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1364a127-9cb4-41f8-8f9a-61c745d623f3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 200 len: 1328 microversion: 2.1 time: 0.255541 Jul 24 01:35:54.177239 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2467/5037] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:53 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 1328 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:54.923448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:54.924683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:54.932424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:54.933226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:54.934351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:54.935013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:55.031859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:55.033844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:55.042563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:55.043444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:55.044476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:55.045152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:55.544147 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:55.559219 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d23e372e-90f6-4b6f-80d9-520734fc7374 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1497 microversion: 2.1 time: 0.639866 Jul 24 01:35:55.571192 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2571/5038] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:54 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1497 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:55.577330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:55.585417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:55.595165 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52f339aa-5c62-45f5-abd8-b40fdd8378d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.567121 Jul 24 01:35:55.596249 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2468/5039] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:55 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:55.602471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:55.614609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:55.615347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:55.617081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:55.619426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:55.640853 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] HTTP exception thrown: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Request method failure captured: Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da HTTP/1.1 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KEriKEHGh_X-wA3lQ_mpoj-0gpC5zaOGqCYNBE4sehVgaDK9tvzukRFEuMj5x-AqHIZY2LOGJOVXz5vx4javylfOVR_nWKVqrdvXPqvAMbTOG6zB26Nd0T30hq61NXQybbcPAnd4AGdjWno_WFE1PVDuMFDjg6tXqwg6mJHXhyHVIA Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f15d0580547d2a83c6b39381873fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 81dad264129d487c88fb39d9356550b1 Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da'} Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:35:55.642945 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:55.645813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:35:55.645813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:35:55.645813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:35:55.645813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:35:55.645813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:35:55.645813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:35:55.645813 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:35:55.647567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Returning 404 to user: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:35:55.648978 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e66537a6-a0d6-4608-ba2d-c09e11697037 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 404 len: 111 microversion: 2.1 time: 0.075189 Jul 24 01:35:55.649789 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2572/5040] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:55 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:35:55.658741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-735b4398-8fbe-4508-a528-42f9b70c010f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '.version_select at 0x7f05eb03b160>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:55.684429 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-735b4398-8fbe-4508-a528-42f9b70c010f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109603605" status: 202 len: 0 microversion: 2.1 time: 0.029647 Jul 24 01:35:55.685054 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2469/5041] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109603605 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:35:56.299937 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:56.300574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:56.309201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:56.309657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:56.310483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:56.310919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:56.376212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:35:56.614655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:56.615365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:56.629552 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:56.633183 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7725992-2ed8-4918-936b-ddeeb0528057 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 204 len: 0 microversion: 2.1 time: 0.337640 Jul 24 01:35:56.634529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:56.635228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:56.637387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:56.638491 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2573/5042] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:35:56 2022] DELETE /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:35:56.639508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:56.666729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:56.668240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:56.691997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:56.692789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:56.694909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:56.697726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:57.054885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:57.073493 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-110a441c-7b3f-4bbe-a7c6-837c70b563ca tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.464594 Jul 24 01:35:57.074147 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2470/5043] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:56 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:35:57.115446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-908568f2-ee8e-44a3-8221-7233c4f356f2 req-cac8194c-91d7-4e66-a9b3-b56553f524f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec18022f-1f61-4587-9301-b11e0168418d", "name": "network-vif-plugged", "status": "completed", "tag": "73012229-0639-4824-8997-62bf02fd681b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:57.136876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-908568f2-ee8e-44a3-8221-7233c4f356f2 req-cac8194c-91d7-4e66-a9b3-b56553f524f7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:57.137336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-908568f2-ee8e-44a3-8221-7233c4f356f2 req-cac8194c-91d7-4e66-a9b3-b56553f524f7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:57.158672 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-908568f2-ee8e-44a3-8221-7233c4f356f2 req-cac8194c-91d7-4e66-a9b3-b56553f524f7 service nova] Creating event network-vif-plugged:73012229-0639-4824-8997-62bf02fd681b for instance ec18022f-1f61-4587-9301-b11e0168418d on n-h2-master-1 Jul 24 01:35:57.167617 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-908568f2-ee8e-44a3-8221-7233c4f356f2 req-cac8194c-91d7-4e66-a9b3-b56553f524f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086229 Jul 24 01:35:57.168238 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2471/5044] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:57.173828 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:57.178850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15e85072-376d-4985-91d4-188caa61a4f7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'create', calling method: .version_select at 0x7f05ead81c10>, body: {"keypair": {"name": "tempest-keypair-1222184023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNwmDRigLM3ekR1CRorDfOY0Rjupf/g41AIdMp1a1D58xdmIGp2eOw1fKHj+OVaHNyRk+xXb9gWITZIi8oG9SMYLeTxAV++ki/vDz8cNBsB71xvubD/TZmMl549JpBPKg=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:57.184158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8b586ae2-ef9b-4d7a-8e66-45f31bff4912 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1503 microversion: 2.1 time: 0.544097 Jul 24 01:35:57.190008 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2574/5045] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:56 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:57.223301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-15e85072-376d-4985-91d4-188caa61a4f7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:35:57.238645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-15e85072-376d-4985-91d4-188caa61a4f7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for user 81dad264129d487c88fb39d9356550b1 and project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:35:57.290230 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15e85072-376d-4985-91d4-188caa61a4f7 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120440 Jul 24 01:35:57.292304 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2472/5046] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:35:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:58.092130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:58.092842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:58.108235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:58.108805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:58.109902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:58.115589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:58.209333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:58.210219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:58.228302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:58.233307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:58.234354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:58.234883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:58.745192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:58.749160 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:58.772428 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-51a81e7d-2dda-4ef5-94c2-c06fc3dae2ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1368 microversion: 2.1 time: 0.684485 Jul 24 01:35:58.772865 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2575/5047] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:58 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1368 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:58.932753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:35:58.947196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-24eaec4d-ab7d-49f4-b558-dee9d920f330 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1503 microversion: 2.1 time: 0.742072 Jul 24 01:35:58.949071 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2473/5048] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:58 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1503 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:35:59.617760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fcb0cb9d-bbac-4457-aade-7e1ebb573a26 req-6f697502-d507-46f2-be30-c8599d7dde69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a111783-c7c4-48b3-a771-65fcd01d6118", "name": "network-vif-deleted", "tag": "8948d33e-f702-48fc-8f1f-db41e06471c1"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:35:59.640892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fcb0cb9d-bbac-4457-aade-7e1ebb573a26 req-6f697502-d507-46f2-be30-c8599d7dde69 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:59.641300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fcb0cb9d-bbac-4457-aade-7e1ebb573a26 req-6f697502-d507-46f2-be30-c8599d7dde69 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:59.689417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fcb0cb9d-bbac-4457-aade-7e1ebb573a26 req-6f697502-d507-46f2-be30-c8599d7dde69 service nova] Creating event network-vif-deleted:8948d33e-f702-48fc-8f1f-db41e06471c1 for instance 1a111783-c7c4-48b3-a771-65fcd01d6118 on n-h1-master-1 Jul 24 01:35:59.709209 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fcb0cb9d-bbac-4457-aade-7e1ebb573a26 req-6f697502-d507-46f2-be30-c8599d7dde69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096367 Jul 24 01:35:59.710869 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2576/5049] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:35:59.792907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:59.794101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:59.821190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:59.826134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:59.827231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:59.832472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:59.967023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:35:59.968061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:35:59.979970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:59.990439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:35:59.991620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:35:59.993408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:00.074309 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:00.076017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:00.076587 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lazy-loading 'fault' on Instance uuid 1a111783-c7c4-48b3-a771-65fcd01d6118 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:36:00.246996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280d6677ca794b7eab9fb6f4214f572e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e420896e8b4382b3441e63abf81c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:00.262417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bfc35372-4763-4842-8894-01b1c13fed59 tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 200 len: 1303 microversion: 2.1 time: 0.299738 Jul 24 01:36:00.264672 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2577/5050] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:59 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 1303 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:36:00.409696 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:00.421354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1ed16171-6118-43cb-9338-e13eca48633d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1559 microversion: 2.1 time: 0.635809 Jul 24 01:36:00.422670 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2474/5051] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:35:59 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1559 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:00.440906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-195f1be3-56ed-4f2d-97c2-e5634b6bd666 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:00.452834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-195f1be3-56ed-4f2d-97c2-e5634b6bd666 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:00.489080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-195f1be3-56ed-4f2d-97c2-e5634b6bd666 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:00.489492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-195f1be3-56ed-4f2d-97c2-e5634b6bd666 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:00.490310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-195f1be3-56ed-4f2d-97c2-e5634b6bd666 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:00.490949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-195f1be3-56ed-4f2d-97c2-e5634b6bd666 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:00.673254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-195f1be3-56ed-4f2d-97c2-e5634b6bd666 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236474 Jul 24 01:36:00.676356 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2578/5052] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:36:00 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:01.287192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:01.287920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] [instance: 1a111783-c7c4-48b3-a771-65fcd01d6118] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:01.300947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:01.306342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:01.307977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:01.308575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:01.335493 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] HTTP exception thrown: Instance 1a111783-c7c4-48b3-a771-65fcd01d6118 could not be found. Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Request method failure captured: Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 HTTP/1.1 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KHSJ9p0QnvGSjqEMS-w-heQSgye0WJStSjBvZcVT5EEfc3p8nPZ-OcrvvAtgToUXCGSwR7n5W-vjog1tD9oekIgmzwF8G09755ZKDSVneil19Nt0689XBwl546LtJqbo7OQiRvHwIbXVtr3cbaAJwguSCE0zLXSt6Hod6HwT4rsDFc Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 81e420896e8b4382b3441e63abf81c15 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesActionsTest-1918541038 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81e420896e8b4382b3441e63abf81c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81e420896e8b4382b3441e63abf81c15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81e420896e8b4382b3441e63abf81c15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81e420896e8b4382b3441e63abf81c15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesActionsTest-1918541038 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 81e420896e8b4382b3441e63abf81c15 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesActionsTest-1918541038 Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesActionsTest-1918541038-project Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 280d6677ca794b7eab9fb6f4214f572e Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesActionsTest-1918541038-project Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 1a111783-c7c4-48b3-a771-65fcd01d6118 could not be found. Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1a111783-c7c4-48b3-a771-65fcd01d6118'} Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a111783-c7c4-48b3-a771-65fcd01d6118 could not be found. Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a111783-c7c4-48b3-a771-65fcd01d6118 could not be found. Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:36:01.343627 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:36:01.347148 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:36:01.347148 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:36:01.347148 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:36:01.347148 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:36:01.347148 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:36:01.347148 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a111783-c7c4-48b3-a771-65fcd01d6118 could not be found. Jul 24 01:36:01.347148 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:36:01.348899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] Returning 404 to user: Instance 1a111783-c7c4-48b3-a771-65fcd01d6118 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:36:01.350015 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-df9ab84e-651e-4683-9067-6ee8d23468ec tempest-VolumesActionsTest-1918541038 tempest-VolumesActionsTest-1918541038-project] 10.222.0.27 "GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118" status: 404 len: 111 microversion: 2.1 time: 0.072039 Jul 24 01:36:01.350807 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2475/5053] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:01 2022] GET /compute/v2.1/servers/1a111783-c7c4-48b3-a771-65fcd01d6118 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:36:02.586580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3fca117f-de38-4d65-a0a5-28db3c6ba83b req-f1e1a66b-e509-4e37-8f4b-47feb124943e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec18022f-1f61-4587-9301-b11e0168418d", "tag": "73012229-0639-4824-8997-62bf02fd681b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:02.587897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-923611", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b565b593-c54e-43d5-ad25-f35c2197ac6e"}], "security_groups": [{"name": "tempest-securitygroup--115002245"}], "key_name": "tempest-keypair-1222184023", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:02.609399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fca117f-de38-4d65-a0a5-28db3c6ba83b req-f1e1a66b-e509-4e37-8f4b-47feb124943e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:02.614177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3fca117f-de38-4d65-a0a5-28db3c6ba83b req-f1e1a66b-e509-4e37-8f4b-47feb124943e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:02.644627 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3fca117f-de38-4d65-a0a5-28db3c6ba83b req-f1e1a66b-e509-4e37-8f4b-47feb124943e service nova] Creating event network-changed:73012229-0639-4824-8997-62bf02fd681b for instance ec18022f-1f61-4587-9301-b11e0168418d on n-h2-master-1 Jul 24 01:36:02.652333 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3fca117f-de38-4d65-a0a5-28db3c6ba83b req-f1e1a66b-e509-4e37-8f4b-47feb124943e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079506 Jul 24 01:36:02.653733 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2579/5054] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:02.915436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] validate_networks() for [('b565b593-c54e-43d5-ad25-f35c2197ac6e', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:36:04.260039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:36:04.260530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:36:04.261123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:36:04.261664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:36:04.262246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:36:04.273972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:04.275341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:04.286306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:04.287476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:04.323115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:36:04.339975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Getting quotas for user 81dad264129d487c88fb39d9356550b1 and project 9c2f15d0580547d2a83c6b39381873fb. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:36:04.379609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:36:04.391385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:36:04.490216 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d089d60-08c1-4a0b-ae37-528716b2859e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.910022 Jul 24 01:36:04.492053 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2476/5055] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:36:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:36:04.502331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-229fd110-a593-4abf-9d21-01d68f2feb6c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:04.503850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-229fd110-a593-4abf-9d21-01d68f2feb6c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:04.616879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e46296d3-67c5-43b3-8493-927f83e509a1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:04.618017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e46296d3-67c5-43b3-8493-927f83e509a1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:04.643051 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e46296d3-67c5-43b3-8493-927f83e509a1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:04.648463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e46296d3-67c5-43b3-8493-927f83e509a1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:04.650559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e46296d3-67c5-43b3-8493-927f83e509a1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:04.651026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e46296d3-67c5-43b3-8493-927f83e509a1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:04.676111 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:04.694284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-229fd110-a593-4abf-9d21-01d68f2feb6c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:04.711043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-229fd110-a593-4abf-9d21-01d68f2feb6c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1234 microversion: 2.1 time: 0.211892 Jul 24 01:36:04.733906 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2580/5056] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:04 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1234 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:04.928589 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e46296d3-67c5-43b3-8493-927f83e509a1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.317340 Jul 24 01:36:04.930371 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2477/5057] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:36:04 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:36:04.941074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:04.942054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:04.965797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:04.966502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:04.986370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:04.989504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:05.315849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:05.324729 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8629520-ecf4-487a-93ec-b47ff641419e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1669 microversion: 2.1 time: 0.390456 Jul 24 01:36:05.325905 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2581/5058] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:04 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:05.748433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:05.750061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:05.768029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:05.770427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:05.772203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:05.774280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:05.964339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:05.978815 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5aa556c-0111-4cbe-ad8a-f4e4b8ed4320 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1238 microversion: 2.1 time: 0.237957 Jul 24 01:36:05.980047 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2478/5059] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:05 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1238 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:06.344577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:06.345358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:06.359684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:06.367369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:06.368572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:06.369172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:06.931374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:06.947720 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9d2821bc-0373-415e-95e2-609620a8c802 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1669 microversion: 2.1 time: 0.604481 Jul 24 01:36:06.948645 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2582/5060] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:06 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1669 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:06.996835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:06.997473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:07.017329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:07.017821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:07.018781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:07.019528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:07.291764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:07.301206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-556b3bce-be1b-4159-8484-c32c7c8d9cb2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1304 microversion: 2.1 time: 0.308123 Jul 24 01:36:07.306427 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2479/5061] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:06 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1304 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:07.967634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:07.969798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:07.990363 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:08.004738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:08.005602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:08.007806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:08.009040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:08.323071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:08.323693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:08.339461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:08.339921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:08.344664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:08.345150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:08.763849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:08.778078 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cd88d48e-930d-421e-97ca-2e3cab818229 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1674 microversion: 2.1 time: 0.814438 Jul 24 01:36:08.784618 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2583/5062] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:07 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1674 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:08.939683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:08.960134 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3d57cbbf-d5e4-4980-a40a-0c717fb82f78 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 0.635298 Jul 24 01:36:08.961729 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2480/5063] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:08 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:09.796486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:09.797751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:09.814888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:09.826786 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:09.828078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:09.829410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:09.986844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:09.988668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:10.007276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:10.022919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:10.043308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:10.052351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:10.634268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:10.642711 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea886970-aadc-4411-b025-dd897fd67eb2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.850071 Jul 24 01:36:10.659190 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2584/5064] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:09 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:10.676580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b6339cc6-c5a3-46dd-b34e-b49a85a729f8 req-fd03a54a-6097-4156-bf52-2cb87b80cb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215b9a1c-c7d0-4007-97a1-7be9e7e29d6e", "tag": "d2494386-8c61-4da7-870e-1324e247a3b4"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:10.706976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b6339cc6-c5a3-46dd-b34e-b49a85a729f8 req-fd03a54a-6097-4156-bf52-2cb87b80cb2e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:10.722333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b6339cc6-c5a3-46dd-b34e-b49a85a729f8 req-fd03a54a-6097-4156-bf52-2cb87b80cb2e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:10.771322 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b6339cc6-c5a3-46dd-b34e-b49a85a729f8 req-fd03a54a-6097-4156-bf52-2cb87b80cb2e service nova] Creating event network-changed:d2494386-8c61-4da7-870e-1324e247a3b4 for instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e on n-h1-master-1 Jul 24 01:36:10.791944 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b6339cc6-c5a3-46dd-b34e-b49a85a729f8 req-fd03a54a-6097-4156-bf52-2cb87b80cb2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131016 Jul 24 01:36:10.792557 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2585/5065] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:11.100194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:11.135606 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50e00162-e30a-41e3-827c-8876c3085cc6 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 1.147014 Jul 24 01:36:11.137211 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2481/5066] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:09 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:36:12.158185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:12.160664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:12.170167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:12.170818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:12.171753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:12.172819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:12.426172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:12.436003 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b18a3973-9284-4d84-b5b3-75639a4f95b8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 0.280649 Jul 24 01:36:12.446866 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2586/5067] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:12 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:13.496591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:13.497387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:13.522052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:13.522562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:13.523721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:13.524504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:14.072189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:14.080193 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ecc69e8a-4e2f-4572-b293-2fe7370d8e74 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 0.621635 Jul 24 01:36:14.088248 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2482/5068] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:13 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:15.107289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:15.108643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:15.112173 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:15.140641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:15.141103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:15.164981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:15.165448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:15.612287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:15.626418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e043adb5-83f9-4a45-807d-ec14b54d12b3 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 0.522161 Jul 24 01:36:15.639732 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2587/5069] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:15 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:16.655762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:16.656383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:16.662149 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:16.664263 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:16.683162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:16.683896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:16.684996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:16.689079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:17.092153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:17.129477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-53aafd83-0a2b-48e2-9479-787ae3493b41 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 0.462003 Jul 24 01:36:17.130630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2483/5070] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:16 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:18.146488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:18.147207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:18.160528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:18.164896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:18.166027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:18.168502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:18.488157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:18.520637 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5829ba34-0118-4442-9d8e-528697f29bdb tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 0.376103 Jul 24 01:36:18.528096 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2588/5071] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:18 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:19.548163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:19.549544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:19.584371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:19.586173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:19.593034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:19.594541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:20.132756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7102b9db-0f56-4845-82f8-cca12ae6837e req-7561e7d6-7748-42b8-9796-bcfdf7e7f2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215b9a1c-c7d0-4007-97a1-7be9e7e29d6e", "name": "network-vif-plugged", "status": "completed", "tag": "d2494386-8c61-4da7-870e-1324e247a3b4"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:20.157055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7102b9db-0f56-4845-82f8-cca12ae6837e req-7561e7d6-7748-42b8-9796-bcfdf7e7f2a1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:20.157423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7102b9db-0f56-4845-82f8-cca12ae6837e req-7561e7d6-7748-42b8-9796-bcfdf7e7f2a1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:20.172979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:20.181591 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6455a15d-70c5-41f5-b640-00c8811d017a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 0.640767 Jul 24 01:36:20.186483 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2484/5072] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:19 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:20.251070 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7102b9db-0f56-4845-82f8-cca12ae6837e req-7561e7d6-7748-42b8-9796-bcfdf7e7f2a1 service nova] Creating event network-vif-plugged:d2494386-8c61-4da7-870e-1324e247a3b4 for instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e on n-h1-master-1 Jul 24 01:36:20.271445 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7102b9db-0f56-4845-82f8-cca12ae6837e req-7561e7d6-7748-42b8-9796-bcfdf7e7f2a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142541 Jul 24 01:36:20.275710 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2589/5073] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:21.203595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:21.204853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:21.219829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:21.220485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:21.222145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:21.222758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:22.312538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:22.321067 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78f58051-3c5a-4b68-873f-9ef7479ffefa tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1359 microversion: 2.1 time: 1.121410 Jul 24 01:36:22.321708 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2485/5074] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:21 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1359 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:23.347749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:23.348568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:23.374681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:23.378336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:23.381858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:23.384655 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:24.065070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:24.074843 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9fd4859-8906-4f45-9fde-a6fe100559cc tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1546 microversion: 2.1 time: 0.740890 Jul 24 01:36:24.097225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2590/5075] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:23 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1546 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:24.103458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2b8ce650-6b75-4128-96fe-a4a8a258fabd tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:24.103964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2b8ce650-6b75-4128-96fe-a4a8a258fabd tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:24.116773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8ce650-6b75-4128-96fe-a4a8a258fabd tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:24.124218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8ce650-6b75-4128-96fe-a4a8a258fabd tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:24.131237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8ce650-6b75-4128-96fe-a4a8a258fabd tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:24.134839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b8ce650-6b75-4128-96fe-a4a8a258fabd tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:24.381824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2b8ce650-6b75-4128-96fe-a4a8a258fabd tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.282860 Jul 24 01:36:24.382451 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2486/5076] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:36:24 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-interface => generated 285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:27.848362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7596012c-ffe9-4858-8977-6136d2dcbcdf req-5fdbf3ea-641e-4160-9ebd-e28c59a10b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215b9a1c-c7d0-4007-97a1-7be9e7e29d6e", "tag": "d2494386-8c61-4da7-870e-1324e247a3b4"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:27.877821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7596012c-ffe9-4858-8977-6136d2dcbcdf req-5fdbf3ea-641e-4160-9ebd-e28c59a10b4e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:27.878642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7596012c-ffe9-4858-8977-6136d2dcbcdf req-5fdbf3ea-641e-4160-9ebd-e28c59a10b4e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:27.902955 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7596012c-ffe9-4858-8977-6136d2dcbcdf req-5fdbf3ea-641e-4160-9ebd-e28c59a10b4e service nova] Creating event network-changed:d2494386-8c61-4da7-870e-1324e247a3b4 for instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e on n-h1-master-1 Jul 24 01:36:27.926398 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7596012c-ffe9-4858-8977-6136d2dcbcdf req-5fdbf3ea-641e-4160-9ebd-e28c59a10b4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082356 Jul 24 01:36:27.927253 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2591/5077] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:37.591011 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:37.592512 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:38.161141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6b426fcc-a7b9-460f-a624-044b3cc464e4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Action: 'create', calling method: .version_select at 0x7f05eacb7d30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-712733307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZCj9aH5OL9qMv+PM5x9zrf72MYiTEupZRFas7tJFhXOrMfZdA8V+GoBD4siWoA16Xand4gG/q/9BO9bAhoxyRRDSR9tySwoycngEcEHxQUb3gpABhcsLBKSKc3fvI7dQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:38.194953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6b426fcc-a7b9-460f-a624-044b3cc464e4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Getting quotas for project f090fd22b51a49819e4efe8e5a6fd184. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:36:38.205273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6b426fcc-a7b9-460f-a624-044b3cc464e4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Getting quotas for user 545a39e3583b41b1b9ba0cf41507754f and project f090fd22b51a49819e4efe8e5a6fd184. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:36:38.261553 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6b426fcc-a7b9-460f-a624-044b3cc464e4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.668490 Jul 24 01:36:38.269462 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2487/5078] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:36:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:44.604006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:44.609641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:44.613821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Searching by: {'deleted': False, 'project_id': '3d222453d2a14232b467364e9d39ec72'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:36:44.640693 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=17 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:44.641479 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=71 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:44.648796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:44.649259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:44.650143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:44.653329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:44.722085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:36:44.816714 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b66d5fe9-1019-427d-93d0-a2de1343198c tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.221704 Jul 24 01:36:44.831647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:44.835976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:44.836234 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2592/5079] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:36:44 2022] GET /compute/v2.1/servers => generated 333 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:44.838267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Searching by: {'deleted': False, 'project_id': '3d222453d2a14232b467364e9d39ec72'} {{(pid=119562) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 01:36:44.859497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:44.862692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:44.863787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:44.867110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:44.922451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.multi_cell_list [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 01:36:45.013513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:45.025027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:45.025812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:45.327518 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-54ebe1d8-c79e-4110-ac77-fb2dade7940e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.501424 Jul 24 01:36:45.330913 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2488/5080] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:36:44 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:36:45.351298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e00bc5b6-2c9a-431a-b884-40cc78d6bd62 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:45.385619 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e00bc5b6-2c9a-431a-b884-40cc78d6bd62 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043175 Jul 24 01:36:45.391140 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2593/5081] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:36:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:45.718152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:45.718653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:45.733309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:45.737058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:45.740110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:45.754980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:45.806039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:36:45.975904 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3aca070-9e10-4346-9f2e-4e7d48418290 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 204 len: 0 microversion: 2.1 time: 0.260879 Jul 24 01:36:45.984462 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2489/5082] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:36:45 2022] DELETE /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:36:45.994215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:45.995097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:46.004578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:46.004970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:46.006132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:46.006571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:46.238937 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:46.249990 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43ec3a88-b7e6-48dc-9591-4e677534798e tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1698 microversion: 2.1 time: 0.260751 Jul 24 01:36:46.251181 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2594/5083] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:45 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1698 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:47.268334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:47.269028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:47.282115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:47.286988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:47.287987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:47.288571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:47.593423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:47.604987 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-978a1663-e58b-4102-ba08-63c444a37518 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1698 microversion: 2.1 time: 0.341509 Jul 24 01:36:47.605506 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2490/5084] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:47 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1698 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:48.623372 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:48.623884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:48.644632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:48.659670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:48.660859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:48.661355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:49.280484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:49.305949 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-39c90edf-f0f2-4c26-9cf6-29d938f06296 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1698 microversion: 2.1 time: 0.681849 Jul 24 01:36:49.320985 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2595/5085] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:48 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1698 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:49.996232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2068863570-access_point-1326760997", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "e4049c12-9261-4fa5-b612-16237bd40192"}], "key_name": "tempest-TestSecurityGroupsBasicOps-712733307", "security_groups": [{"name": "tempest-secgroup_access--722397695"}, {"name": "tempest-secgroup_general--847847820"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:50.323248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:50.323866 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:50.337653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] validate_networks() for [('e4049c12-9261-4fa5-b612-16237bd40192', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:36:50.343813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:50.352270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:50.355428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:50.360844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:50.629704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491186789eb04cf5bf6c16d9d9d7d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d222453d2a14232b467364e9d39ec72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:50.647453 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9561a88a-aa9b-421e-9a76-99cf74b6da17 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 200 len: 1631 microversion: 2.1 time: 0.319035 Jul 24 01:36:50.648155 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2596/5086] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:50 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 1631 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:36:50.694266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-463cda75-5e3d-43cd-986d-bebf0653cd93 req-91adbd7a-ec44-46f5-96b4-935dd7c2e841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f7c749c-ea58-447f-9d93-5434dfe66698", "name": "network-vif-deleted", "tag": "69e9584d-19a5-4e33-9d2b-ab3773ffb3d2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:50.766135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-463cda75-5e3d-43cd-986d-bebf0653cd93 req-91adbd7a-ec44-46f5-96b4-935dd7c2e841 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:50.768797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-463cda75-5e3d-43cd-986d-bebf0653cd93 req-91adbd7a-ec44-46f5-96b4-935dd7c2e841 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:50.832436 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-463cda75-5e3d-43cd-986d-bebf0653cd93 req-91adbd7a-ec44-46f5-96b4-935dd7c2e841 service nova] Creating event network-vif-deleted:69e9584d-19a5-4e33-9d2b-ab3773ffb3d2 for instance 3f7c749c-ea58-447f-9d93-5434dfe66698 on n-h2-master-1 Jul 24 01:36:50.855767 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-463cda75-5e3d-43cd-986d-bebf0653cd93 req-91adbd7a-ec44-46f5-96b4-935dd7c2e841 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167997 Jul 24 01:36:50.856669 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2597/5087] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:36:51.666209 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:51.667744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] [instance: 3f7c749c-ea58-447f-9d93-5434dfe66698] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:51.692439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:51.694841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:51.695941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:51.696080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:36:51.696510 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:36:51.696979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:36:51.697470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:36:51.697990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:36:51.700008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:51.711238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:51.711995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:51.713040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:51.713706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:51.741551 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] HTTP exception thrown: Instance 3f7c749c-ea58-447f-9d93-5434dfe66698 could not be found. Jul 24 01:36:51.744720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Getting quotas for project f090fd22b51a49819e4efe8e5a6fd184. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Request method failure captured: Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 HTTP/1.1 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KHDidyey_u24gJMUVDRsztIXsGCXUw0SAEkYYzyV4GFqWr_ol_OuoM4cqmfF2n5e7ndeFicDpe73xNYQ8vRtKh8OULO7xLTRH-Zwv32pHlbpFb5fjsUnksj1YzkU87gVvzRDdVmyq7OYit8iX2ev6rUEmELxpTe6RWAfcHzB8dmL2c Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 3d222453d2a14232b467364e9d39ec72 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersTestJSON-1030776608 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d222453d2a14232b467364e9d39ec72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d222453d2a14232b467364e9d39ec72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d222453d2a14232b467364e9d39ec72", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d222453d2a14232b467364e9d39ec72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersTestJSON-1030776608 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 3d222453d2a14232b467364e9d39ec72 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersTestJSON-1030776608 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersTestJSON-1030776608-project Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 491186789eb04cf5bf6c16d9d9d7d043 Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersTestJSON-1030776608-project Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 3f7c749c-ea58-447f-9d93-5434dfe66698 could not be found. Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '3f7c749c-ea58-447f-9d93-5434dfe66698'} Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f7c749c-ea58-447f-9d93-5434dfe66698 could not be found. Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f7c749c-ea58-447f-9d93-5434dfe66698 could not be found. Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:36:51.745306 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:36:51.749478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:36:51.749478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:36:51.749478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:36:51.749478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:36:51.749478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f7c749c-ea58-447f-9d93-5434dfe66698 could not be found. Jul 24 01:36:51.749478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:36:51.749910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Returning 404 to user: Instance 3f7c749c-ea58-447f-9d93-5434dfe66698 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:36:51.751464 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-828f2aa7-60a5-4269-a209-4c713299ffc6 tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698" status: 404 len: 111 microversion: 2.1 time: 0.090158 Jul 24 01:36:51.759160 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2598/5088] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:51 2022] GET /compute/v2.1/servers/3f7c749c-ea58-447f-9d93-5434dfe66698 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:36:51.759343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Getting quotas for user 545a39e3583b41b1b9ba0cf41507754f and project f090fd22b51a49819e4efe8e5a6fd184. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:36:51.774176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-85281053-2ef3-4437-a2b6-4bdd6ad5fe5f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] Calling method '.version_select at 0x7f05eae4cee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:51.776586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:36:51.778926 n-d-master-1 devstack@n-api.service[119562]: WARNING nova.utils [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-2068863570-access_point-1326760997 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-2068863570-ac Jul 24 01:36:51.779901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:36:51.823550 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-85281053-2ef3-4437-a2b6-4bdd6ad5fe5f tempest-ServersTestJSON-1030776608 tempest-ServersTestJSON-1030776608-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140036558" status: 202 len: 0 microversion: 2.1 time: 0.062687 Jul 24 01:36:51.825288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2599/5089] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140036558 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:36:51.880180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-51ddc0a4-ea14-44a1-a57a-7f49494c834d tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.888522 Jul 24 01:36:51.883601 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2491/5090] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:36:49 2022] POST /compute/v2.1/servers => generated 456 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:36:51.894386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ab8f673-8d03-48fe-8442-032bb89d6ef8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:51.895360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ab8f673-8d03-48fe-8442-032bb89d6ef8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:52.009083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ab8f673-8d03-48fe-8442-032bb89d6ef8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:52.024903 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ab8f673-8d03-48fe-8442-032bb89d6ef8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1294 microversion: 2.1 time: 0.131958 Jul 24 01:36:52.025622 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2600/5091] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:51 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1294 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:53.043556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:53.044222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:53.081471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:53.092615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:53.093648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:53.094129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:53.282070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:53.294033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee7380a6-3e50-461e-906c-0a33f0963ec4 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1290 microversion: 2.1 time: 0.256892 Jul 24 01:36:53.297819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2492/5092] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:53 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1290 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:54.315566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:54.316185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:54.343778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:54.350511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:54.351699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:54.352454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:54.581187 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:54.590039 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5eb9458c-649a-43fd-b2c5-a9b897a26fa1 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1352 microversion: 2.1 time: 0.279244 Jul 24 01:36:54.591271 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2601/5093] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:54 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1352 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:36:55.608716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:55.610025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:55.632449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:55.636342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:55.637571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:55.639298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:55.863849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:55.887337 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-55c63554-0d28-4ee3-8141-a2f6092f0dd5 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1352 microversion: 2.1 time: 0.283431 Jul 24 01:36:55.888695 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2493/5094] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:55 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1352 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:36:56.909996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:56.911488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:56.915082 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:56.928642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:56.937037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:56.951350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:56.952182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:57.512446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:57.528158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c47f498c-8050-4924-b146-c6edac4bb120 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.624285 Jul 24 01:36:57.530725 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2602/5095] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:56 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:58.548189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:58.549491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:58.568636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:58.569323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:58.570326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:58.572423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:58.859361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:36:58.867867 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e86536d3-2ced-40f8-834f-b003b21d6106 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.323950 Jul 24 01:36:58.881200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2494/5096] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:58 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:36:59.078510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a4122af7-3d5a-4b79-9640-0516d2fcfa55 req-beb78f17-9b9b-47d9-b18a-5c1714ea748b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0101234b-e611-4c5d-8719-b3262c726097", "tag": "c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:36:59.094536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a4122af7-3d5a-4b79-9640-0516d2fcfa55 req-beb78f17-9b9b-47d9-b18a-5c1714ea748b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:59.095336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a4122af7-3d5a-4b79-9640-0516d2fcfa55 req-beb78f17-9b9b-47d9-b18a-5c1714ea748b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:59.154479 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a4122af7-3d5a-4b79-9640-0516d2fcfa55 req-beb78f17-9b9b-47d9-b18a-5c1714ea748b service nova] Creating event network-changed:c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7 for instance 0101234b-e611-4c5d-8719-b3262c726097 on n-h2-master-1 Jul 24 01:36:59.170610 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a4122af7-3d5a-4b79-9640-0516d2fcfa55 req-beb78f17-9b9b-47d9-b18a-5c1714ea748b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095624 Jul 24 01:36:59.171902 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2603/5097] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:36:59.884418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:36:59.885040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:36:59.898409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:59.898861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:36:59.899826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:36:59.900409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:00.296030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:00.314701 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-83b12ba4-b6b7-416d-8ada-5874f558148e tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.433943 Jul 24 01:37:00.316925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2495/5098] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:36:59 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:00.480184 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6c69652-c934-4a85-b3eb-30c7034ca5a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:00.481739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6c69652-c934-4a85-b3eb-30c7034ca5a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:00.510813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6c69652-c934-4a85-b3eb-30c7034ca5a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:00.513967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6c69652-c934-4a85-b3eb-30c7034ca5a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:00.514932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6c69652-c934-4a85-b3eb-30c7034ca5a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:00.515385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6c69652-c934-4a85-b3eb-30c7034ca5a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:00.607368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6c69652-c934-4a85-b3eb-30c7034ca5a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/ips" status: 200 len: 145 microversion: 2.1 time: 0.132826 Jul 24 01:37:00.608580 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2604/5099] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:37:00 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/ips => generated 145 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:01.337720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:01.338278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:01.357410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:01.357940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:01.359105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:01.359624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:01.724965 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:01.743631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:01.754407 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9eb7be0f-28c1-4f47-9d4d-fbb1e12b2a79 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.420918 Jul 24 01:37:01.755220 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2496/5100] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:01 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:01.905795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1240913299", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:01.988424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:37:02.021576 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:02.519220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:37:02.519648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:37:02.520122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:37:02.520532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:37:02.520945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:37:02.548705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:02.549521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:02.550536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:02.551123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:02.639971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Getting quotas for project 067f6fe185724ef0931a4cfb8680cfba. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:37:02.655286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Getting quotas for user 6e881888eab24d93b513f03556871677 and project 067f6fe185724ef0931a4cfb8680cfba. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:37:02.691416 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:37:02.694070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:37:02.773002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:02.773769 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:02.777114 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:02.796274 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:02.796792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:02.799342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:02.799342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:02.816876 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1ceb9f3a-c4cd-4834-8e13-f7e2637cccdb tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914953 Jul 24 01:37:02.825950 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2605/5101] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:37:02.845976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9076731-183d-4506-ade6-813e128cbaec tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:02.846798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9076731-183d-4506-ade6-813e128cbaec tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:03.166404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9076731-183d-4506-ade6-813e128cbaec tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:03.180364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9076731-183d-4506-ade6-813e128cbaec tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1214 microversion: 2.1 time: 0.352273 Jul 24 01:37:03.183870 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2606/5102] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:02 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1214 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:03.346063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:03.358247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e84da30-56ff-4168-a448-7dd1da785dc9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.589185 Jul 24 01:37:03.369846 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2497/5103] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:02 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:03.484846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bcb7d15d-5248-4803-abf9-ff004c207c3e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "277789c2-3457-4101-9db2-c4030d270d81"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:03.486569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bcb7d15d-5248-4803-abf9-ff004c207c3e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:03.503668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcb7d15d-5248-4803-abf9-ff004c207c3e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:03.517772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcb7d15d-5248-4803-abf9-ff004c207c3e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:03.521463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcb7d15d-5248-4803-abf9-ff004c207c3e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:03.523526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcb7d15d-5248-4803-abf9-ff004c207c3e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:04.109562 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bcb7d15d-5248-4803-abf9-ff004c207c3e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629809 Jul 24 01:37:04.115238 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2607/5104] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:37:03 2022] POST /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:04.203074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:04.203868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:04.213008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:04.213720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:04.214675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:04.215320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:04.355144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:04.366786 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-840a7bf1-9c72-40a7-9477-28ad4b2b4882 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1266 microversion: 2.1 time: 0.167967 Jul 24 01:37:04.367393 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2498/5105] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:04 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:04.376502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:04.377317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:04.392128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:04.393709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:04.396120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:04.396664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:04.976641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:04.987256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00d07368-dabf-44d6-842e-86ca7cd8f9cb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.615411 Jul 24 01:37:04.997333 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2608/5106] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:04 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:05.387792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:05.392502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:05.403880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:05.405050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:05.408225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:05.410336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:05.752586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-eeefaa2f-aba5-46bb-a055-3c673d15e4d9 req-ba1eae9d-cc99-486d-b76d-39ff20122733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0101234b-e611-4c5d-8719-b3262c726097", "name": "network-vif-plugged", "status": "completed", "tag": "c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:05.774654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-eeefaa2f-aba5-46bb-a055-3c673d15e4d9 req-ba1eae9d-cc99-486d-b76d-39ff20122733 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:05.776117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-eeefaa2f-aba5-46bb-a055-3c673d15e4d9 req-ba1eae9d-cc99-486d-b76d-39ff20122733 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:05.812878 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-eeefaa2f-aba5-46bb-a055-3c673d15e4d9 req-ba1eae9d-cc99-486d-b76d-39ff20122733 service nova] Creating event network-vif-plugged:c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7 for instance 0101234b-e611-4c5d-8719-b3262c726097 on n-h2-master-1 Jul 24 01:37:05.840991 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-eeefaa2f-aba5-46bb-a055-3c673d15e4d9 req-ba1eae9d-cc99-486d-b76d-39ff20122733 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091055 Jul 24 01:37:05.845478 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2609/5107] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:06.015207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:06.016756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:06.043665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:06.045968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:06.048236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:06.050267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:06.254209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:06.265287 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-974138db-f533-4bd6-96ea-49796d67b371 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1272 microversion: 2.1 time: 0.882341 Jul 24 01:37:06.267017 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2499/5108] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:05 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1272 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:06.508337 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:06.523802 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9e040703-d801-4c69-bb17-ba007565183b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.508642 Jul 24 01:37:06.526245 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2610/5109] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:06 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:07.285250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:07.285967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:07.311381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:07.311843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:07.312708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:07.313194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:07.542657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:07.543990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:07.555036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:07.556066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:07.557045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:07.557719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:07.951911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:07.957142 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:07.972837 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-49102c66-abc4-415f-8ea3-cb938dd36f73 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1314 microversion: 2.1 time: 0.693300 Jul 24 01:37:07.986948 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2500/5110] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:07 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:08.065211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:08.076460 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-77f82772-da48-4ea8-87f2-099b58c66268 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1470 microversion: 2.1 time: 0.537648 Jul 24 01:37:08.079819 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2611/5111] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:07 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1470 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:08.231926 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-cc26ea71-4726-41c0-9a17-651c0788a66c req-82828fda-6614-4f41-bbea-77b2f544d979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9486a9-c2ba-4d76-b940-6368fed3d08a", "tag": "98a86406-0ed6-4a56-afe8-00b0bdb8bea2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:08.251315 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:08.271832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-cc26ea71-4726-41c0-9a17-651c0788a66c req-82828fda-6614-4f41-bbea-77b2f544d979 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:08.282052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-cc26ea71-4726-41c0-9a17-651c0788a66c req-82828fda-6614-4f41-bbea-77b2f544d979 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:08.340787 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-cc26ea71-4726-41c0-9a17-651c0788a66c req-82828fda-6614-4f41-bbea-77b2f544d979 service nova] Creating event network-changed:98a86406-0ed6-4a56-afe8-00b0bdb8bea2 for instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a on n-h1-master-1 Jul 24 01:37:08.361162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-cc26ea71-4726-41c0-9a17-651c0788a66c req-82828fda-6614-4f41-bbea-77b2f544d979 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148168 Jul 24 01:37:08.364413 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2501/5112] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:08.997893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:08.999047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:09.027212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:09.027943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:09.028902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:09.029495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:09.096487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:09.097451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:09.111034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:09.128335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:09.129416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:09.130073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:09.995690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:10.018433 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2f3b283-f01c-4735-b7a0-7efe79a3121e tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1314 microversion: 2.1 time: 1.024113 Jul 24 01:37:10.022037 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2612/5113] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:08 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:10.258039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:10.268203 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-423860e3-3384-4d89-8362-0b161894c255 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1642 microversion: 2.1 time: 1.176796 Jul 24 01:37:10.269831 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2502/5114] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:09 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1642 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:10.285657 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:10.286296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:10.296059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:10.296511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:10.304409 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:10.304881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:10.639249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:10.651217 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b252098d-9030-494b-8108-db100986bad8 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1642 microversion: 2.1 time: 0.370455 Jul 24 01:37:10.651810 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2613/5115] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:10 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1642 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:10.666977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dad62237-25bf-4d07-b2a5-8edfbfc1fc13 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:10.667605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dad62237-25bf-4d07-b2a5-8edfbfc1fc13 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:10.680022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad62237-25bf-4d07-b2a5-8edfbfc1fc13 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:10.680398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad62237-25bf-4d07-b2a5-8edfbfc1fc13 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:10.681208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad62237-25bf-4d07-b2a5-8edfbfc1fc13 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:10.686196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad62237-25bf-4d07-b2a5-8edfbfc1fc13 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:11.044327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:11.044955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:11.143294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:11.146597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:11.152739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:11.154970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:11.222002 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:11.320067 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dad62237-25bf-4d07-b2a5-8edfbfc1fc13 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1793 microversion: 2.1 time: 0.653213 Jul 24 01:37:11.321105 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2503/5116] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:10 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1793 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:11.587977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:11.601573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e548ce8b-3f81-4a59-aaa8-ec5cd5a0c85d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1314 microversion: 2.1 time: 0.565983 Jul 24 01:37:11.604767 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2614/5117] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:11 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:12.625158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:12.626375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:12.650221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:12.650936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:12.654011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:12.654588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:12.977184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:12.998140 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61dc5681-3090-476e-8275-1ed4fd467aaa tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1314 microversion: 2.1 time: 0.378903 Jul 24 01:37:13.011200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2504/5118] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:12 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:13.806273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:13.807783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:13.814884 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:13.815838 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:13.829641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:13.830316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:13.833345 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:13.834019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:14.018119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:14.019321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:14.035164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:14.035813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:14.036941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:14.037558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:14.335291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:14.359997 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ebe498cb-77b3-4d37-9845-7d7f398f20f6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.558369 Jul 24 01:37:14.360942 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2615/5119] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:13 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:14.378447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:14.380235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:14.391338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:14.393766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:14.395154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:14.402225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:14.729481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:14.743623 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4de9e889-32a4-403f-be9d-3d1a736dbd1d tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1314 microversion: 2.1 time: 0.731083 Jul 24 01:37:14.744258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2505/5120] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:14 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:14.775526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-05afd799-9658-4f2e-871c-6b45d1adf754 req-1a771c31-a4ca-4bf1-8647-938c017537d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9486a9-c2ba-4d76-b940-6368fed3d08a", "name": "network-vif-plugged", "status": "completed", "tag": "98a86406-0ed6-4a56-afe8-00b0bdb8bea2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:14.789607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-05afd799-9658-4f2e-871c-6b45d1adf754 req-1a771c31-a4ca-4bf1-8647-938c017537d1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:14.790440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-05afd799-9658-4f2e-871c-6b45d1adf754 req-1a771c31-a4ca-4bf1-8647-938c017537d1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:14.816819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-05afd799-9658-4f2e-871c-6b45d1adf754 req-1a771c31-a4ca-4bf1-8647-938c017537d1 service nova] Creating event network-vif-plugged:98a86406-0ed6-4a56-afe8-00b0bdb8bea2 for instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a on n-h1-master-1 Jul 24 01:37:14.824082 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-05afd799-9658-4f2e-871c-6b45d1adf754 req-1a771c31-a4ca-4bf1-8647-938c017537d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078456 Jul 24 01:37:14.824721 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2506/5121] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:14.866126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:14.878821 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-28c3b746-4375-43fd-adf7-9619ea973544 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.504228 Jul 24 01:37:14.884704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2616/5122] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:14 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:14.899173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:14.899888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:14.916806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:14.917591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:14.918654 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:14.919283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:15.520798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:15.544744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d5d9594-5d8d-4221-87a9-dcc80cc453fe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.649689 Jul 24 01:37:15.549195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2507/5123] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:14 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:15.566730 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:15.568246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:15.575093 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:15.579066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:15.580204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:15.581230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:15.582051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:15.734253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6741bd2f-d075-4fab-a3d7-3a69eacc8045 req-bc0cdeec-f80d-4798-b8f7-b07dca49dd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0101234b-e611-4c5d-8719-b3262c726097", "tag": "c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:15.753211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6741bd2f-d075-4fab-a3d7-3a69eacc8045 req-bc0cdeec-f80d-4798-b8f7-b07dca49dd03 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:15.753694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6741bd2f-d075-4fab-a3d7-3a69eacc8045 req-bc0cdeec-f80d-4798-b8f7-b07dca49dd03 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:15.776091 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6741bd2f-d075-4fab-a3d7-3a69eacc8045 req-bc0cdeec-f80d-4798-b8f7-b07dca49dd03 service nova] Creating event network-changed:c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7 for instance 0101234b-e611-4c5d-8719-b3262c726097 on n-h2-master-1 Jul 24 01:37:15.791331 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6741bd2f-d075-4fab-a3d7-3a69eacc8045 req-bc0cdeec-f80d-4798-b8f7-b07dca49dd03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063505 Jul 24 01:37:15.793194 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2508/5124] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:37:15.803324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:15.805105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:15.815175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:15.816411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:15.818341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:15.819154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:15.957603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:15.968027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1622396-6b8f-47bb-a98e-bd65b6a068d2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.407200 Jul 24 01:37:15.969975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2617/5125] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:15 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:16.113014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-805257637", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "27a9c0f0-0057-4e7d-b288-37b58950f9cd"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:16.202244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] validate_networks() for [('27a9c0f0-0057-4e7d-b288-37b58950f9cd', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:37:16.507832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:16.516468 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5512c971-a83c-4362-a393-882d896baaee tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1314 microversion: 2.1 time: 0.721179 Jul 24 01:37:16.526059 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2509/5126] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:15 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:16.533130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-909e5211-0905-4177-9c0f-f0b2c25210ae tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:16.536417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-909e5211-0905-4177-9c0f-f0b2c25210ae tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:16.551604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-909e5211-0905-4177-9c0f-f0b2c25210ae tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:16.554297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-909e5211-0905-4177-9c0f-f0b2c25210ae tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:16.555348 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-909e5211-0905-4177-9c0f-f0b2c25210ae tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:16.556474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-909e5211-0905-4177-9c0f-f0b2c25210ae tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:16.595802 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-909e5211-0905-4177-9c0f-f0b2c25210ae tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d/ips" status: 200 len: 150 microversion: 2.1 time: 0.067687 Jul 24 01:37:16.597080 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2510/5127] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:37:16 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:16.619875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98b304c8-cfc8-4926-b4ab-e5ad7af46070"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:16.623291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:16.641448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:16.643466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:16.644553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:16.648141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:16.822666 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Invalid volume: volume 98b304c8-cfc8-4926-b4ab-e5ad7af46070 is already attached to instances: 83899dfe-0d1b-4320-afe1-6437e34e77cd Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d/os-volume_attachments HTTP/1.1 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 74 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: {"volumeAttachment": {"volumeId": "98b304c8-cfc8-4926-b4ab-e5ad7af46070"}} Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: exception: Invalid volume: volume 98b304c8-cfc8-4926-b4ab-e5ad7af46070 is already attached to instances: 83899dfe-0d1b-4320-afe1-6437e34e77cd Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': 'ec18022f-1f61-4587-9301-b11e0168418d', 'body': {'volumeAttachment': {'volumeId': '98b304c8-cfc8-4926-b4ab-e5ad7af46070'}}} Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 98b304c8-cfc8-4926-b4ab-e5ad7af46070 is already attached to instances: 83899dfe-0d1b-4320-afe1-6437e34e77cd Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:37:16.826383 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 98b304c8-cfc8-4926-b4ab-e5ad7af46070 is already attached to instances: 83899dfe-0d1b-4320-afe1-6437e34e77cd Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 98b304c8-cfc8-4926-b4ab-e5ad7af46070 is already attached to instances: 83899dfe-0d1b-4320-afe1-6437e34e77cd Jul 24 01:37:16.829719 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:16.837589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 400 to user: Invalid volume: volume 98b304c8-cfc8-4926-b4ab-e5ad7af46070 is already attached to instances: 83899dfe-0d1b-4320-afe1-6437e34e77cd {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:37:16.838841 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ee58d08-c532-441f-8e04-ed9bf00cc295 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.229271 Jul 24 01:37:16.839952 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2511/5128] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:37:16 2022] POST /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d/os-volume_attachments => generated 174 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:37:16.849268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:16.849810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:16.879038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:16.880690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:16.884934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:16.886087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:17.045720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:37:17.290824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9808752c-2e86-4409-9ace-459dcf0a7dce tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 204 len: 0 microversion: 2.1 time: 0.444606 Jul 24 01:37:17.297922 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2512/5129] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:37:16 2022] DELETE /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:37:17.309879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:17.310790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:17.336312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:17.337519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:17.347255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:17.347255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:17.978657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:18.029938 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f6f25e6-9864-4350-94f3-dcf2c725ec9f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1683 microversion: 2.1 time: 0.719254 Jul 24 01:37:18.030680 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2513/5130] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:17 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1683 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:18.055173 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:18.056048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:18.067904 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:18.068602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:18.069539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:18.070295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:18.353457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:37:18.354781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:37:18.355415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:37:18.356339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:37:18.357001 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:37:18.414169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:18.415691 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:18.418836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:18.422198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:18.517504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:18.527385 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b2b9725-1c36-45bf-a0c1-32a8374bb3ef tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1464 microversion: 2.1 time: 0.494282 Jul 24 01:37:18.538658 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2514/5131] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:18 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1464 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:18.550594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:37:18.568159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for user f6a5e8716f324b53b51e8d34cb704321 and project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:37:18.620371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:37:18.628023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:37:18.826149 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-030c2871-e135-4739-8331-047b64bfb1d3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.705038 Jul 24 01:37:18.827679 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2618/5132] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:37:18.835631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac2bd1b6-5af8-4c13-8318-dd9fadb02872 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13508c3d-59c6-44c7-9fdb-da17e4e4cca0", "device": "/dev/sdb"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:18.837025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac2bd1b6-5af8-4c13-8318-dd9fadb02872 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:18.847136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1b6-5af8-4c13-8318-dd9fadb02872 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:18.847819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1b6-5af8-4c13-8318-dd9fadb02872 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:18.849053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1b6-5af8-4c13-8318-dd9fadb02872 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:18.849648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1b6-5af8-4c13-8318-dd9fadb02872 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:18.883263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1892829883", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "45499b4f-fb60-48b6-8b9d-735707ff9037"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:19.003816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] validate_networks() for [('45499b4f-fb60-48b6-8b9d-735707ff9037', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:37:19.442417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac2bd1b6-5af8-4c13-8318-dd9fadb02872 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "POST /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.612026 Jul 24 01:37:19.446143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2619/5133] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:37:18 2022] POST /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a/os-volume_attachments => generated 194 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:19.460772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff89b04c-6596-4bfc-90c4-ff0572fb64e3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:19.462798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff89b04c-6596-4bfc-90c4-ff0572fb64e3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:19.727561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff89b04c-6596-4bfc-90c4-ff0572fb64e3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:19.741057 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff89b04c-6596-4bfc-90c4-ff0572fb64e3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1214 microversion: 2.1 time: 0.293411 Jul 24 01:37:19.754758 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2620/5134] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:19 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:19.832193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:19.846060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:19.923468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:19.929049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:19.949272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:19.954017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:20.890962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:37:20.892125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:37:20.892717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:37:20.893234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:37:20.893777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:37:20.912622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:20.916446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:20.919185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:20.923072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:20.931040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:20.951569 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d10f96ca-c43d-4e5a-928b-3cc8b5bb080e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1683 microversion: 2.1 time: 1.166086 Jul 24 01:37:20.955779 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2621/5135] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:19 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1683 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:21.010925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da2f53dd-4a9e-44f3-a031-3db3a7c3a023 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:21.013983 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Getting quotas for project 5d455f20d2734d0b8942981197e3a782. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:37:21.027125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-da2f53dd-4a9e-44f3-a031-3db3a7c3a023 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:21.033066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Getting quotas for user 0f93ef61264a4d1292ed7700b89c22fd and project 5d455f20d2734d0b8942981197e3a782. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:37:21.059516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da2f53dd-4a9e-44f3-a031-3db3a7c3a023 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:21.063607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da2f53dd-4a9e-44f3-a031-3db3a7c3a023 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:21.064917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da2f53dd-4a9e-44f3-a031-3db3a7c3a023 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:21.065585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da2f53dd-4a9e-44f3-a031-3db3a7c3a023 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:21.073623 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:37:21.087321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:37:21.148794 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-da2f53dd-4a9e-44f3-a031-3db3a7c3a023 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185716 Jul 24 01:37:21.160261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2622/5136] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:20 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:21.165355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:21.187303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:21.216857 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-645c90a9-2370-4db0-b030-c3a46b05ad8e tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.676735 Jul 24 01:37:21.221434 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2515/5137] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:37:21.232693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2dfd0a43-0344-4e26-a6a4-22b5e1d7fb46 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:21.241687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:21.252715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2dfd0a43-0344-4e26-a6a4-22b5e1d7fb46 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:21.253574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:21.257763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:21.259917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:21.267615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dfd0a43-0344-4e26-a6a4-22b5e1d7fb46 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:21.268066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dfd0a43-0344-4e26-a6a4-22b5e1d7fb46 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:21.268854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dfd0a43-0344-4e26-a6a4-22b5e1d7fb46 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:21.269290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dfd0a43-0344-4e26-a6a4-22b5e1d7fb46 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:21.347791 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2dfd0a43-0344-4e26-a6a4-22b5e1d7fb46 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/277789c2-3457-4101-9db2-c4030d270d81" status: 200 len: 194 microversion: 2.1 time: 0.124701 Jul 24 01:37:21.348612 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2516/5138] 10.222.0.27 () {58 vars in 1412 bytes} [Sun Jul 24 01:37:21 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/277789c2-3457-4101-9db2-c4030d270d81 => generated 194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:21.353309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4615a0ad-fa27-4b77-b239-8c7531b94f48 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:21.354311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4615a0ad-fa27-4b77-b239-8c7531b94f48 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:21.553176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:21.579615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4615a0ad-fa27-4b77-b239-8c7531b94f48 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:21.582395 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f4708b3-e831-48b5-a4dc-797bf2cd72c2 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1274 microversion: 2.1 time: 0.420830 Jul 24 01:37:21.582994 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2623/5139] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:21 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1274 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:21.635844 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4615a0ad-fa27-4b77-b239-8c7531b94f48 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1216 microversion: 2.1 time: 0.285975 Jul 24 01:37:21.646983 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2517/5140] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:21 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1216 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:21.976250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:21.978149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:22.006644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:22.007163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:22.018425 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:22.019986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:22.528367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:22.544859 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3ddafa2-a5ec-4981-99ac-8763593afcdd tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1615 microversion: 2.1 time: 0.575884 Jul 24 01:37:22.552296 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2624/5141] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:21 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1615 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:22.602082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:22.603290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:22.617276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:22.635637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:22.636512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:22.636957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:22.657783 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:22.658412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:22.700914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:22.701387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:22.702229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:22.703214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:22.951514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:22.962190 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-932754a9-efaf-4728-acc6-7358c7d8e24e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1272 microversion: 2.1 time: 0.365508 Jul 24 01:37:22.979472 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2518/5142] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:22 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:23.049775 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:23.090751 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b2a12ea-490e-410f-a06a-85ab5253cfbc tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1220 microversion: 2.1 time: 0.437958 Jul 24 01:37:23.094371 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2625/5143] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:22 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1220 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:23.568684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:23.571760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:23.593987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:23.610528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:23.611370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:23.620732 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:23.653908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c58bec8c-5a9e-4cc4-98cb-6feeb78b6005 req-dc2c3114-45e9-40a6-9bae-1afa5cd7a3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec18022f-1f61-4587-9301-b11e0168418d", "name": "network-vif-deleted", "tag": "73012229-0639-4824-8997-62bf02fd681b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:23.679502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c58bec8c-5a9e-4cc4-98cb-6feeb78b6005 req-dc2c3114-45e9-40a6-9bae-1afa5cd7a3d0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:23.693650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c58bec8c-5a9e-4cc4-98cb-6feeb78b6005 req-dc2c3114-45e9-40a6-9bae-1afa5cd7a3d0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:23.729566 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c58bec8c-5a9e-4cc4-98cb-6feeb78b6005 req-dc2c3114-45e9-40a6-9bae-1afa5cd7a3d0 service nova] Creating event network-vif-deleted:73012229-0639-4824-8997-62bf02fd681b for instance ec18022f-1f61-4587-9301-b11e0168418d on n-h2-master-1 Jul 24 01:37:23.749402 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c58bec8c-5a9e-4cc4-98cb-6feeb78b6005 req-dc2c3114-45e9-40a6-9bae-1afa5cd7a3d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099660 Jul 24 01:37:23.758395 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2626/5144] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:37:23.828970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:23.835867 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:23.842392 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d75464ba-333f-4083-825f-9af45258acee tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 200 len: 1615 microversion: 2.1 time: 0.277540 Jul 24 01:37:23.845162 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2519/5145] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:23 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 1615 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:23.985831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:23.986978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:24.013511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:24.017509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:24.022319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:24.034517 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:24.112022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:24.112564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:24.141101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:24.146283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:24.154245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:24.154980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:25.001403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:25.019655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7212c82-7d10-4137-93a8-13f5373bfc26 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1276 microversion: 2.1 time: 0.909621 Jul 24 01:37:25.025868 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2520/5146] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:24 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1276 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:25.059424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:25.064137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:25.096116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:25.105384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:25.108714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:25.113188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:25.207517 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d HTTP/1.1 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ec18022f-1f61-4587-9301-b11e0168418d'} Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:25.213494 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:25.217024 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:25.217024 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:25.217024 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:25.217024 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:37:25.217024 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:37:25.217024 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:37:25.217024 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:25.226456 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:37:25.227646 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f292c426-8f75-41dc-951a-a657cadf4071 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 404 len: 111 microversion: 2.1 time: 0.196516 Jul 24 01:37:25.233308 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2521/5147] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:25 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:37:25.244896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a188610a-f95b-45ba-889f-c28d11e2b9a1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '.version_select at 0x7f05eaf4aee0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:25.298756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a188610a-f95b-45ba-889f-c28d11e2b9a1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495922635" status: 202 len: 0 microversion: 2.1 time: 0.061305 Jul 24 01:37:25.301013 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2522/5148] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:37:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495922635 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:37:25.323109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:25.342248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-031a2dc6-68f0-47ea-ba13-77a1d3297d8a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 1.351799 Jul 24 01:37:25.348911 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2627/5149] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:23 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:25.810474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61469320-46ac-4f3d-b40a-8d3085d2a344 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00a7c2d7-39ab-4b99-83cd-f481c288381d"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:25.812760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61469320-46ac-4f3d-b40a-8d3085d2a344 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:25.839050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61469320-46ac-4f3d-b40a-8d3085d2a344 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:25.839653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61469320-46ac-4f3d-b40a-8d3085d2a344 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:25.841083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61469320-46ac-4f3d-b40a-8d3085d2a344 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:25.843833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61469320-46ac-4f3d-b40a-8d3085d2a344 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:26.037238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:26.038246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:26.054857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:26.055341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:26.058667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:26.061419 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:26.247669 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:26.263514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-19d94eed-23f6-4747-8420-1dd306e1f04c tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1274 microversion: 2.1 time: 0.230171 Jul 24 01:37:26.264123 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2628/5150] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:26 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1274 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:26.361181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:26.362002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:26.380817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:26.384736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:26.385783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:26.387360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:26.449868 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61469320-46ac-4f3d-b40a-8d3085d2a344 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "POST /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642192 Jul 24 01:37:26.450883 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2523/5151] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:37:25 2022] POST /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments => generated 194 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:27.049345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:27.069541 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f15f7365-9584-4b64-8aee-eb7b21bd6ff6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.706129 Jul 24 01:37:27.071710 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2629/5152] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:26 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:27.283410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:27.284132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:27.306545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:27.307040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:27.307851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:27.310406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:27.870689 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:27.884222 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d418bd53-eb00-4341-a7d9-cedb0c7ed810 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.603837 Jul 24 01:37:27.887710 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2524/5153] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:27 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:28.068153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1c944183-e7d9-4a9c-bc1d-3d42f202c4a1 req-f0978c71-23b6-486e-abb4-0b85ea756683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6926042-95f5-4952-ba41-35dc384e36d9", "tag": "68c8297f-c01a-4793-a125-4c2d18ffbe31"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:28.087757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1c944183-e7d9-4a9c-bc1d-3d42f202c4a1 req-f0978c71-23b6-486e-abb4-0b85ea756683 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:28.088505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1c944183-e7d9-4a9c-bc1d-3d42f202c4a1 req-f0978c71-23b6-486e-abb4-0b85ea756683 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:28.089428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:28.090200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:28.101553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:28.102054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:28.102888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:28.107733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:28.115418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1c944183-e7d9-4a9c-bc1d-3d42f202c4a1 req-f0978c71-23b6-486e-abb4-0b85ea756683 service nova] Creating event network-changed:68c8297f-c01a-4793-a125-4c2d18ffbe31 for instance e6926042-95f5-4952-ba41-35dc384e36d9 on n-h2-master-1 Jul 24 01:37:28.137300 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1c944183-e7d9-4a9c-bc1d-3d42f202c4a1 req-f0978c71-23b6-486e-abb4-0b85ea756683 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072660 Jul 24 01:37:28.143303 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2630/5154] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:28.867756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:28.882033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-89a34fae-5e54-4f32-8ac1-351fa657eb5d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.797473 Jul 24 01:37:28.883522 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2525/5155] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:28 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:28.907094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:28.908280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:28.914321 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:28.921743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:28.922847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:28.924083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:28.924984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:29.248696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:29.258035 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5bfd35f7-8822-43ff-98f1-9821c8b87591 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.356812 Jul 24 01:37:29.258827 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2631/5156] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:28 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:29.563226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-66758024-9c5a-4ad8-badc-86fdfb705ce9 req-036778f4-a1bb-464a-9168-0f23f48371be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc863f5-81ee-42ff-941f-4f5b6c1c4024", "tag": "85388af5-88e4-4e15-bbe6-29bfd62ab2b7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:29.581015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-66758024-9c5a-4ad8-badc-86fdfb705ce9 req-036778f4-a1bb-464a-9168-0f23f48371be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:29.581393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-66758024-9c5a-4ad8-badc-86fdfb705ce9 req-036778f4-a1bb-464a-9168-0f23f48371be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:29.613978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-66758024-9c5a-4ad8-badc-86fdfb705ce9 req-036778f4-a1bb-464a-9168-0f23f48371be service nova] Creating event network-changed:85388af5-88e4-4e15-bbe6-29bfd62ab2b7 for instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 on n-h1-master-1 Jul 24 01:37:29.620022 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-66758024-9c5a-4ad8-badc-86fdfb705ce9 req-036778f4-a1bb-464a-9168-0f23f48371be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061548 Jul 24 01:37:29.622444 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2526/5157] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:29.900950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:29.902090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:29.909114 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:29.911332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:29.912138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:29.913135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:29.913761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:30.194900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:30.202033 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:30.206569 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df1369fc-598b-4dfc-89ef-dd0b156411a8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.309854 Jul 24 01:37:30.210133 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2632/5158] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:29 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:30.276121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:30.276937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:30.284633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:30.285225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:30.286168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:30.286708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:30.438307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:30.446484 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af129d76-6f6f-424f-b635-6d7ed93b7778 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.175541 Jul 24 01:37:30.447296 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2527/5159] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:30 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:31.224523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:31.225862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:31.234272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:31.235100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:31.236107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:31.236752 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:31.466743 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:31.468131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:31.473161 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:31.482486 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:31.483021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:31.484142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:31.484719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:31.515713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:31.526943 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-371f9e6e-327d-46ee-8c65-33fe96cfc26d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.306407 Jul 24 01:37:31.527904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2633/5160] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:31 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:31.635973 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:31.763110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:31.773634 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbfe6737-e3fb-4ef1-870a-6422343da67d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.312750 Jul 24 01:37:31.784976 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2528/5161] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:31 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:32.544975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:32.546365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:32.555181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:32.555181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:32.573802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:32.574587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:32.786782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:32.791608 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:32.793635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:32.799595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4abdb114-6492-44e6-9962-b0f9a9b6ef4a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.259023 Jul 24 01:37:32.800203 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2634/5162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:32 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:32.803052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:32.803540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:32.804736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:32.805184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:32.962360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:32.970905 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-64c27167-fcea-4ef8-ab4c-a72220e5e315 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.183958 Jul 24 01:37:32.980042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2529/5163] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:32 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:33.816712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:33.817946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:33.834123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:33.834809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:33.835778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:33.836229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:33.966679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:33.967183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:33.991558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:33.992218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:33.994769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:33.995733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:34.180773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lazy-loading 'services' on Instance uuid 83899dfe-0d1b-4320-afe1-6437e34e77cd {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:37:34.260935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:34.271172 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ff70397-7611-486f-8277-76bf093b0feb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.458489 Jul 24 01:37:34.271862 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2635/5164] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:33 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:34.281189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:34.281189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:34.285254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:34.285650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:34.286679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:34.287129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:34.649117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:34.660250 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3a8146f-3f55-4bbd-b68f-fdff7231e71a tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.386854 Jul 24 01:37:34.664000 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2636/5165] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:34 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:34.684627 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e7c04d3-db68-460a-8ff3-cc5b396c39b1 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments/98b304c8-cfc8-4926-b4ab-e5ad7af46070" status: 202 len: 0 microversion: 2.1 time: 0.722143 Jul 24 01:37:34.686323 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2530/5166] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:37:33 2022] DELETE /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments/98b304c8-cfc8-4926-b4ab-e5ad7af46070 => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:37:34.695659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3734bb71-9c98-4883-b0b0-c0ad89fa5b74 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:34.696967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3734bb71-9c98-4883-b0b0-c0ad89fa5b74 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:34.705984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3734bb71-9c98-4883-b0b0-c0ad89fa5b74 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:34.706934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3734bb71-9c98-4883-b0b0-c0ad89fa5b74 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:34.709793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3734bb71-9c98-4883-b0b0-c0ad89fa5b74 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:34.711079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3734bb71-9c98-4883-b0b0-c0ad89fa5b74 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:34.758978 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3734bb71-9c98-4883-b0b0-c0ad89fa5b74 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067384 Jul 24 01:37:34.760104 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2637/5167] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:34 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:35.291024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:35.292302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:35.305254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:35.305747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:35.306559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:35.307260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:35.505965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:35.513744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ca0c686-2e24-4a42-9051-60c14bc4e4fd tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.227606 Jul 24 01:37:35.515257 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2531/5168] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:35 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:35.680454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:35.680997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:35.690860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:35.691321 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:35.692115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:35.695040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:35.772234 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49f93fa8-89a4-454b-aeae-7bf2525a4ad7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:35.773839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-49f93fa8-89a4-454b-aeae-7bf2525a4ad7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:35.784954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49f93fa8-89a4-454b-aeae-7bf2525a4ad7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:35.786324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49f93fa8-89a4-454b-aeae-7bf2525a4ad7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:35.790247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49f93fa8-89a4-454b-aeae-7bf2525a4ad7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:35.791117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49f93fa8-89a4-454b-aeae-7bf2525a4ad7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:35.871619 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-49f93fa8-89a4-454b-aeae-7bf2525a4ad7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104091 Jul 24 01:37:35.877757 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2532/5169] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:35 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:37:35.978238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:35.991261 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e656be4-ca4c-4a93-866b-1cc67f9654f7 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.314867 Jul 24 01:37:35.993084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2638/5170] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:35 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:36.012373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-03080a63-dedd-4ad9-8d4d-ef7d8739671f req-7aa6411a-d09b-4229-98a8-a3be28116eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6926042-95f5-4952-ba41-35dc384e36d9", "name": "network-vif-plugged", "status": "completed", "tag": "68c8297f-c01a-4793-a125-4c2d18ffbe31"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:36.029223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-03080a63-dedd-4ad9-8d4d-ef7d8739671f req-7aa6411a-d09b-4229-98a8-a3be28116eae service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:36.029788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-03080a63-dedd-4ad9-8d4d-ef7d8739671f req-7aa6411a-d09b-4229-98a8-a3be28116eae service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:36.065746 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-03080a63-dedd-4ad9-8d4d-ef7d8739671f req-7aa6411a-d09b-4229-98a8-a3be28116eae service nova] Creating event network-vif-plugged:68c8297f-c01a-4793-a125-4c2d18ffbe31 for instance e6926042-95f5-4952-ba41-35dc384e36d9 on n-h2-master-1 Jul 24 01:37:36.072287 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-03080a63-dedd-4ad9-8d4d-ef7d8739671f req-7aa6411a-d09b-4229-98a8-a3be28116eae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063521 Jul 24 01:37:36.073432 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2533/5171] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:36.531734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:36.532495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:36.540780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:36.541348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:36.542357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:36.542964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:36.691501 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:36.700282 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ebd92c0f-66e6-4541-9d22-7b37d6aeff45 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.172417 Jul 24 01:37:36.700998 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2639/5172] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:36 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:36.893963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3611df35-0074-4318-becf-9e350f3c0a18 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:36.893963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3611df35-0074-4318-becf-9e350f3c0a18 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:36.907962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3611df35-0074-4318-becf-9e350f3c0a18 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:36.911057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3611df35-0074-4318-becf-9e350f3c0a18 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:36.914480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3611df35-0074-4318-becf-9e350f3c0a18 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:36.915386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3611df35-0074-4318-becf-9e350f3c0a18 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:36.976276 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3611df35-0074-4318-becf-9e350f3c0a18 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095510 Jul 24 01:37:36.977328 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2534/5173] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:36 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:37:37.008919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:37.009523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:37.016463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:37.016965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:37.017815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:37.018263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:37.213029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:37.222921 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88244086-abc3-4259-b956-551db5638628 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.217689 Jul 24 01:37:37.223950 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2640/5174] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:37 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:37.716885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:37.717525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:37.728467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:37.730845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:37.733633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:37.734866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:37.991138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-55780832-0d67-4f4b-b68b-6a1d491fa6a6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:37.995735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-55780832-0d67-4f4b-b68b-6a1d491fa6a6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:38.009707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55780832-0d67-4f4b-b68b-6a1d491fa6a6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:38.010927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55780832-0d67-4f4b-b68b-6a1d491fa6a6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:38.012845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55780832-0d67-4f4b-b68b-6a1d491fa6a6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:38.014785 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-55780832-0d67-4f4b-b68b-6a1d491fa6a6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:38.060937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:38.079047 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-55780832-0d67-4f4b-b68b-6a1d491fa6a6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093699 Jul 24 01:37:38.080557 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2641/5175] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:37 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:37:38.081249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-322822ee-97da-420b-a919-3d8d1848d510 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1314 microversion: 2.1 time: 0.368119 Jul 24 01:37:38.082236 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2535/5176] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:37 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:38.135752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5f7390ed-4b04-4221-bb24-c91280a8c7d3 req-1c3c11d1-c4eb-47d4-af4f-b3a44216a219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc863f5-81ee-42ff-941f-4f5b6c1c4024", "name": "network-vif-plugged", "status": "completed", "tag": "85388af5-88e4-4e15-bbe6-29bfd62ab2b7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:38.148509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5f7390ed-4b04-4221-bb24-c91280a8c7d3 req-1c3c11d1-c4eb-47d4-af4f-b3a44216a219 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:38.149257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5f7390ed-4b04-4221-bb24-c91280a8c7d3 req-1c3c11d1-c4eb-47d4-af4f-b3a44216a219 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:38.163294 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5f7390ed-4b04-4221-bb24-c91280a8c7d3 req-1c3c11d1-c4eb-47d4-af4f-b3a44216a219 service nova] Creating event network-vif-plugged:85388af5-88e4-4e15-bbe6-29bfd62ab2b7 for instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 on n-h1-master-1 Jul 24 01:37:38.170578 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5f7390ed-4b04-4221-bb24-c91280a8c7d3 req-1c3c11d1-c4eb-47d4-af4f-b3a44216a219 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038370 Jul 24 01:37:38.173775 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2642/5177] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:38.241525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:38.242249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:38.249819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:38.251287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:38.252417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:38.253395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:38.509835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:38.541220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ab6a858f-cbdd-4a6d-80f5-653d4cd35bba tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.300838 Jul 24 01:37:38.559922 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2536/5178] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:38 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:39.101150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:39.101818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:39.104694 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:39.111371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81e6565f-7fe9-4366-95f3-77c961c2d4a0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:39.112445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-81e6565f-7fe9-4366-95f3-77c961c2d4a0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:39.136815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81e6565f-7fe9-4366-95f3-77c961c2d4a0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.137268 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81e6565f-7fe9-4366-95f3-77c961c2d4a0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:39.141830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.142519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:39.143471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.144125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81e6565f-7fe9-4366-95f3-77c961c2d4a0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.144729 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:39.145328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81e6565f-7fe9-4366-95f3-77c961c2d4a0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:39.196154 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:39.206063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-81e6565f-7fe9-4366-95f3-77c961c2d4a0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117778 Jul 24 01:37:39.206890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2643/5179] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:39 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:39.529454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:39.538432 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9511745f-588d-4dfe-b324-1b3e41429e88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1502 microversion: 2.1 time: 0.442497 Jul 24 01:37:39.544224 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2537/5180] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:39 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1502 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:39.563443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:39.563993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:39.569894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:39.570531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:39.595676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.614162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:39.615560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.616023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:39.620666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.621177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:39.622271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:39.624516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:40.126923 n-d-master-1 devstack@n-api.service[119561]: INFO nova.network.security_group_api [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Removing security group 8258ee29-533c-42bd-a753-58249ff82780 from port 68c8297f-c01a-4793-a125-4c2d18ffbe31 Jul 24 01:37:40.247520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:40.267865 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-40be4fca-ce2c-4b61-95b3-1dc2a4651835 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1316 microversion: 2.1 time: 0.710214 Jul 24 01:37:40.269246 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2538/5181] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:39 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:40.275651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a64514a5-0751-4f6b-bac8-3b5c6ee52d49 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:40.277452 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a64514a5-0751-4f6b-bac8-3b5c6ee52d49 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:40.285387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a64514a5-0751-4f6b-bac8-3b5c6ee52d49 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:40.286169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a64514a5-0751-4f6b-bac8-3b5c6ee52d49 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:40.289171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a64514a5-0751-4f6b-bac8-3b5c6ee52d49 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:40.290256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a64514a5-0751-4f6b-bac8-3b5c6ee52d49 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:40.334678 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a64514a5-0751-4f6b-bac8-3b5c6ee52d49 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060471 Jul 24 01:37:40.336597 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2539/5182] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:40 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:40.799339 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3704d9c9-bb41-4f55-b724-977d949dd8ec tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9/action" status: 202 len: 0 microversion: 2.1 time: 1.245669 Jul 24 01:37:40.803271 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2644/5183] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:37:39 2022] POST /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9/action => generated 0 bytes in 1250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:37:40.826101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:40.827213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:40.875355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:40.883970 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:40.887279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:40.902061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:40.903275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5502707f-e65b-4c4c-a861-aa97b7cf6374 req-bce0a24e-2813-4bf4-a974-29b9ce6799fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6926042-95f5-4952-ba41-35dc384e36d9", "tag": "68c8297f-c01a-4793-a125-4c2d18ffbe31"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:40.940644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5502707f-e65b-4c4c-a861-aa97b7cf6374 req-bce0a24e-2813-4bf4-a974-29b9ce6799fd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:40.956549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5502707f-e65b-4c4c-a861-aa97b7cf6374 req-bce0a24e-2813-4bf4-a974-29b9ce6799fd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.032497 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5502707f-e65b-4c4c-a861-aa97b7cf6374 req-bce0a24e-2813-4bf4-a974-29b9ce6799fd service nova] Creating event network-changed:68c8297f-c01a-4793-a125-4c2d18ffbe31 for instance e6926042-95f5-4952-ba41-35dc384e36d9 on n-h2-master-1 Jul 24 01:37:41.063419 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5502707f-e65b-4c4c-a861-aa97b7cf6374 req-bce0a24e-2813-4bf4-a974-29b9ce6799fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166627 Jul 24 01:37:41.063904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2645/5184] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:37:41.272415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:41.284285 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63a31382-a20b-49ac-8469-8000aed48978 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1460 microversion: 2.1 time: 0.476385 Jul 24 01:37:41.287751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:41.288471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:41.288828 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2540/5185] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:40 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1460 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:41.304925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:41.305120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.305525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.306643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.307274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.308499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:41.337480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.338166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.339436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.341190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.719397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:41.750661 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4bf26de4-8cb6-4991-bd38-a67920c5fa17 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1504 microversion: 2.1 time: 0.466990 Jul 24 01:37:41.752256 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2646/5186] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:41 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:37:41.760513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dca38e57-8cfe-4e92-9fdb-eefa4ae5e8db tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:41.785424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dca38e57-8cfe-4e92-9fdb-eefa4ae5e8db tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:41.826340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca38e57-8cfe-4e92-9fdb-eefa4ae5e8db tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.832383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca38e57-8cfe-4e92-9fdb-eefa4ae5e8db tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.834925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca38e57-8cfe-4e92-9fdb-eefa4ae5e8db tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.837997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca38e57-8cfe-4e92-9fdb-eefa4ae5e8db tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.852717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:41.861907 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c61b297-f483-4119-a8d7-15bdecdcad59 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.560792 Jul 24 01:37:41.869570 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2541/5187] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:41 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:41.887639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-585b668a-04aa-4c4e-9c37-6202caa4217f tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:41.888415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-585b668a-04aa-4c4e-9c37-6202caa4217f tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:41.900808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-585b668a-04aa-4c4e-9c37-6202caa4217f tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.903221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-585b668a-04aa-4c4e-9c37-6202caa4217f tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.904294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-585b668a-04aa-4c4e-9c37-6202caa4217f tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:41.908208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-585b668a-04aa-4c4e-9c37-6202caa4217f tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:41.957632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dca38e57-8cfe-4e92-9fdb-eefa4ae5e8db tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203628 Jul 24 01:37:41.958274 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2647/5188] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:41 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:41.973410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:41.974096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:42.011285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.011744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.012543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.012997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.070291 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-585b668a-04aa-4c4e-9c37-6202caa4217f tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.197230 Jul 24 01:37:42.071348 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2542/5189] 10.222.0.27 () {58 vars in 1295 bytes} [Sun Jul 24 01:37:41 2022] DELETE /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024/os-server-password => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:37:42.084977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d9f66d68-319d-4264-bc2d-f814d099bc4f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:42.088119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d9f66d68-319d-4264-bc2d-f814d099bc4f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:42.107298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9f66d68-319d-4264-bc2d-f814d099bc4f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.108852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9f66d68-319d-4264-bc2d-f814d099bc4f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.110150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9f66d68-319d-4264-bc2d-f814d099bc4f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.110842 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9f66d68-319d-4264-bc2d-f814d099bc4f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.262784 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d9f66d68-319d-4264-bc2d-f814d099bc4f tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.189862 Jul 24 01:37:42.263403 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2543/5190] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:42 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:42.284587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0ac5b49-6e38-4228-a7d7-8a628fc870b3 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:42.285164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0ac5b49-6e38-4228-a7d7-8a628fc870b3 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:42.305730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0ac5b49-6e38-4228-a7d7-8a628fc870b3 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.306645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0ac5b49-6e38-4228-a7d7-8a628fc870b3 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.306977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0ac5b49-6e38-4228-a7d7-8a628fc870b3 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.307422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0ac5b49-6e38-4228-a7d7-8a628fc870b3 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.370167 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0ac5b49-6e38-4228-a7d7-8a628fc870b3 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.100333 Jul 24 01:37:42.379059 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2544/5191] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:37:42 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024/os-server-password => generated 16 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:37:42.391740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:42.392511 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:42.404396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.406776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.415514 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.416285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.493179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:37:42.668331 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d085c3a5-3f35-4689-8c75-aa2dd4803195 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 204 len: 0 microversion: 2.1 time: 0.281572 Jul 24 01:37:42.669246 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2545/5192] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:37:42 2022] DELETE /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:37:42.680484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2b5bd41b-a814-4f90-8a38-34cb41311a25 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:42.680813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2b5bd41b-a814-4f90-8a38-34cb41311a25 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:42.690149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:42.691449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b5bd41b-a814-4f90-8a38-34cb41311a25 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.691911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b5bd41b-a814-4f90-8a38-34cb41311a25 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.692788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b5bd41b-a814-4f90-8a38-34cb41311a25 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.693397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2b5bd41b-a814-4f90-8a38-34cb41311a25 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.712487 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4070b3a5-ab46-4391-b4fb-dd5cf6794f9a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.753065 Jul 24 01:37:42.713110 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2648/5193] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:41 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:42.727250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:42.732076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:42.755078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.756923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.763200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.763939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.771403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2b5bd41b-a814-4f90-8a38-34cb41311a25 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/277789c2-3457-4101-9db2-c4030d270d81" status: 200 len: 194 microversion: 2.1 time: 0.099151 Jul 24 01:37:42.774041 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2546/5194] 10.222.0.27 () {58 vars in 1412 bytes} [Sun Jul 24 01:37:42 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/277789c2-3457-4101-9db2-c4030d270d81 => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:42.783586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:42.784226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:42.798901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.799369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:42.800193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:42.800646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:43.558072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:43.566691 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-735013b8-9e5d-43f0-917f-a4258bf57adf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.790411 Jul 24 01:37:43.567287 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2547/5195] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:42 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:43.576163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:43.583820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:43.584325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:43.591248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58d9a963-ba2b-4299-a530-a72d8db0b262 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1510 microversion: 2.1 time: 0.874243 Jul 24 01:37:43.591819 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2649/5196] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:42 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1510 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:43.597178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a97c039a-6036-4cc7-97bb-fbba3b647798 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:43.598840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a97c039a-6036-4cc7-97bb-fbba3b647798 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:43.607070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:43.607539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:43.608872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:43.609548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:43.617796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a97c039a-6036-4cc7-97bb-fbba3b647798 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:43.618514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a97c039a-6036-4cc7-97bb-fbba3b647798 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:43.619541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a97c039a-6036-4cc7-97bb-fbba3b647798 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:43.620174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a97c039a-6036-4cc7-97bb-fbba3b647798 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:43.665268 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a97c039a-6036-4cc7-97bb-fbba3b647798 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072282 Jul 24 01:37:43.666859 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2650/5197] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:37:43 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:37:43.689012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:43.690229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:43.708075 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:43.710222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:43.713868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:43.714550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:43.764002 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:43.807561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lazy-loading 'services' on Instance uuid 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:37:43.978585 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-182f0fb3-3d64-4675-ad3a-c132ebe819ae tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/277789c2-3457-4101-9db2-c4030d270d81" status: 202 len: 0 microversion: 2.1 time: 0.409811 Jul 24 01:37:43.984526 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2548/5198] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:37:43 2022] DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/277789c2-3457-4101-9db2-c4030d270d81 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:37:44.010163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:44.021016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:44.038412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:44.039753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:44.042378 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:44.044497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:44.046028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:44.050245 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ae4568e7-cc52-496b-9bd0-887222917cef tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.382058 Jul 24 01:37:44.058460 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2651/5199] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:43 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:44.088363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:37:44.164426 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:44.293211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ef66011-dbd0-4757-85dc-7a0fc2553e7c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 204 len: 0 microversion: 2.1 time: 0.286880 Jul 24 01:37:44.294167 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2549/5200] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:37:44 2022] DELETE /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:37:44.302760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:44.303579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:44.317572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:44.320947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:44.321825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:44.322278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:44.331785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1181602207", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "27a9c0f0-0057-4e7d-b288-37b58950f9cd"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:44.446314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] validate_networks() for [('27a9c0f0-0057-4e7d-b288-37b58950f9cd', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:37:44.951220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:44.962718 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c343d59f-d9fc-4ed2-b2a1-2576270c556d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1678 microversion: 2.1 time: 0.663725 Jul 24 01:37:44.972018 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2652/5201] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:44 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1678 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:44.977520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:44.986641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:45.000750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:45.005470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:45.006671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:45.012918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:45.575874 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:45.594504 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-41d209ca-be6a-4ce5-98fd-a904071f6181 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1510 microversion: 2.1 time: 0.620965 Jul 24 01:37:45.595220 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2653/5202] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:44 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1510 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:45.712028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:37:45.713695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:37:45.714465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:37:45.715090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:37:45.715730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:37:45.740459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:45.741140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:45.742191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:45.742869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:45.770368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:37:45.793817 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Getting quotas for user f6a5e8716f324b53b51e8d34cb704321 and project b97b2217fca247759ee6e9f15d150866. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:37:45.826722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:37:45.834055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:37:45.938562 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3bce36d3-c193-42dd-99fd-283f43dcc559 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611286 Jul 24 01:37:45.943054 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2550/5203] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:37:45.957148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-10eb683f-4453-423e-adef-1fde79de1f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:45.958951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-10eb683f-4453-423e-adef-1fde79de1f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:45.971937 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:45.990317 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:45.991981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:46.035948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:46.042340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:46.043588 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:46.044029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:46.328408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-10eb683f-4453-423e-adef-1fde79de1f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:46.340033 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-10eb683f-4453-423e-adef-1fde79de1f09 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1215 microversion: 2.1 time: 0.390129 Jul 24 01:37:46.341279 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2654/5204] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:45 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:46.612692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:46.613564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:46.624939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:46.627421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:46.628919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:46.630582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:46.869945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:46.894002 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b46b95e7-f4d2-4efd-bf84-6382670e1606 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1468 microversion: 2.1 time: 0.283997 Jul 24 01:37:46.900763 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2655/5205] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:46 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:47.065956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:47.074799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eca7cc3b-0cb6-4c12-b8d2-14ea4b5c6afa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1678 microversion: 2.1 time: 1.089056 Jul 24 01:37:47.082574 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2551/5206] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:45 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1678 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:47.190967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-25bdc7e3-b3d5-4e3c-9d59-707dfbc52be2 req-1c9e51c7-c055-4df8-9d45-922eeff8fbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc863f5-81ee-42ff-941f-4f5b6c1c4024", "name": "network-vif-deleted", "tag": "85388af5-88e4-4e15-bbe6-29bfd62ab2b7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:47.220327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-25bdc7e3-b3d5-4e3c-9d59-707dfbc52be2 req-1c9e51c7-c055-4df8-9d45-922eeff8fbe5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:47.223027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-25bdc7e3-b3d5-4e3c-9d59-707dfbc52be2 req-1c9e51c7-c055-4df8-9d45-922eeff8fbe5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:47.267119 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-25bdc7e3-b3d5-4e3c-9d59-707dfbc52be2 req-1c9e51c7-c055-4df8-9d45-922eeff8fbe5 service nova] Creating event network-vif-deleted:85388af5-88e4-4e15-bbe6-29bfd62ab2b7 for instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 on n-h1-master-1 Jul 24 01:37:47.295345 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-25bdc7e3-b3d5-4e3c-9d59-707dfbc52be2 req-1c9e51c7-c055-4df8-9d45-922eeff8fbe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109443 Jul 24 01:37:47.302246 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2656/5207] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:47.388666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:47.389500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:47.400045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:47.403428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:47.404471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:47.405191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:47.603242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:47.612230 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81d694f4-458e-403d-9ede-9f8841703afe tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1211 microversion: 2.1 time: 0.227575 Jul 24 01:37:47.627763 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2552/5208] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:47 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:47.917242 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:47.918242 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:47.934437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:47.935344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:47.936455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:47.939945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:48.057993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:48.062533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:48.064599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lazy-loading 'fault' on Instance uuid ebc863f5-81ee-42ff-941f-4f5b6c1c4024 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:37:48.103259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:48.103882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:48.126629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:48.128647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:48.132332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:48.133246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:48.162164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f93ef61264a4d1292ed7700b89c22fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d455f20d2734d0b8942981197e3a782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:48.175674 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b34ec627-a082-432c-8fe3-87ec3db29e1d tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 200 len: 1306 microversion: 2.1 time: 0.262712 Jul 24 01:37:48.186936 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2657/5209] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:47 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 1306 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:48.424301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:48.433265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-065b39bb-c304-4dc3-9940-0f760f2c33e2 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1610 microversion: 2.1 time: 0.336893 Jul 24 01:37:48.450666 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2553/5210] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:48 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1610 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:48.658669 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:48.665063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:48.691271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:48.691979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:48.692953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:48.693618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:49.021090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-40db1c30-9d66-482a-9a29-c7e54821f03b req-5b94ead9-21e3-4fd8-b85c-5f68b6708665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83899dfe-0d1b-4320-afe1-6437e34e77cd", "name": "network-vif-deleted", "tag": "f965375d-2afd-485c-a606-17f0391d4767"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:49.049412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-40db1c30-9d66-482a-9a29-c7e54821f03b req-5b94ead9-21e3-4fd8-b85c-5f68b6708665 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:49.054414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-40db1c30-9d66-482a-9a29-c7e54821f03b req-5b94ead9-21e3-4fd8-b85c-5f68b6708665 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:49.083602 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-40db1c30-9d66-482a-9a29-c7e54821f03b req-5b94ead9-21e3-4fd8-b85c-5f68b6708665 service nova] Creating event network-vif-deleted:f965375d-2afd-485c-a606-17f0391d4767 for instance 83899dfe-0d1b-4320-afe1-6437e34e77cd on n-h2-master-1 Jul 24 01:37:49.095213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:49.108423 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-40db1c30-9d66-482a-9a29-c7e54821f03b req-5b94ead9-21e3-4fd8-b85c-5f68b6708665 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089619 Jul 24 01:37:49.114575 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-711667e8-820a-47d4-bd7b-341bd94cc80c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1273 microversion: 2.1 time: 0.470597 Jul 24 01:37:49.117042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2554/5211] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:49.117737 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2658/5212] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:48 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1273 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:49.196979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:49.198007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] [instance: ebc863f5-81ee-42ff-941f-4f5b6c1c4024] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:49.226681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:49.227137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:49.228037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:49.228389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:49.277722 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] HTTP exception thrown: Instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 could not be found. Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Request method failure captured: Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 HTTP/1.1 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KJON9500JD2L8XXZONzeNIVePC-NyoKIe5g9Ff37oBBXYHT6DcjnX6P9K37Cv8PBkFDF4y20_bZ0fqQb5vDZsR7v4xTKZHK5p4W6C8DF9dPAfic6NchR-OCtVoHeE5DCZ6KMwajlAWJcO_FpjtA7ZTVExZw6l6M5rZGoSPW4VETLQs Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 5d455f20d2734d0b8942981197e3a782 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerPasswordTestJSON-374251991 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d455f20d2734d0b8942981197e3a782"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d455f20d2734d0b8942981197e3a782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d455f20d2734d0b8942981197e3a782", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d455f20d2734d0b8942981197e3a782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerPasswordTestJSON-374251991 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 5d455f20d2734d0b8942981197e3a782 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerPasswordTestJSON-374251991 Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerPasswordTestJSON-374251991-project Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 0f93ef61264a4d1292ed7700b89c22fd Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerPasswordTestJSON-374251991-project Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 could not be found. Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ebc863f5-81ee-42ff-941f-4f5b6c1c4024'} Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 could not be found. Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 could not be found. Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:49.282222 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 could not be found. Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:37:49.293625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] Returning 404 to user: Instance ebc863f5-81ee-42ff-941f-4f5b6c1c4024 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:37:49.294203 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a32fc385-5af3-4478-8bf5-bd6fbe67a0f0 tempest-ServerPasswordTestJSON-374251991 tempest-ServerPasswordTestJSON-374251991-project] 10.222.0.27 "GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024" status: 404 len: 111 microversion: 2.1 time: 0.104365 Jul 24 01:37:49.296171 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2555/5213] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:49 2022] GET /compute/v2.1/servers/ebc863f5-81ee-42ff-941f-4f5b6c1c4024 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:37:49.462772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:49.463777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:49.490415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:49.496814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:49.501243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:49.503016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:49.706502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:49.708201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:49.709271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lazy-loading 'fault' on Instance uuid 83899dfe-0d1b-4320-afe1-6437e34e77cd {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:37:50.121052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:50.133893 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1923946e-3353-4cc4-8b87-2b3748f2ebc4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 200 len: 1329 microversion: 2.1 time: 0.678684 Jul 24 01:37:50.137421 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2659/5214] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:49 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 1329 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:50.167303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:50.170873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:50.192716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:50.209451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:50.210794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:50.211395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:50.880050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:50.898459 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ab3c5ef-5a80-443c-8a5a-756252179a2c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1273 microversion: 2.1 time: 0.761201 Jul 24 01:37:50.913214 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2556/5215] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:50 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1273 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:51.180825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:51.182214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:51.201994 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:51.210536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:51.211511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:51.212802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:51.296309 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd HTTP/1.1 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '83899dfe-0d1b-4320-afe1-6437e34e77cd'} Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:37:51.303349 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:37:51.306963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:37:51.306963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:37:51.306963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:37:51.306963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:37:51.306963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:37:51.306963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:37:51.306963 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:37:51.312752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:37:51.314493 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60ac19a6-fe2a-447a-98ff-9a752c39adcf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 404 len: 111 microversion: 2.1 time: 0.140957 Jul 24 01:37:51.321720 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2660/5216] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:51 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:37:51.369045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3ee7126f-109c-40bb-b147-3bb37b7156b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '.version_select at 0x7f05eb69c3a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:51.471941 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3ee7126f-109c-40bb-b147-3bb37b7156b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539451344" status: 202 len: 0 microversion: 2.1 time: 0.132059 Jul 24 01:37:51.478319 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2557/5217] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:37:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539451344 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:37:51.918876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:51.919632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:51.951468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:51.955067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:51.956882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:51.957801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:52.814937 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:52.828331 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-54a2bf89-be7f-4337-be0b-4b459560c381 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.914239 Jul 24 01:37:52.840006 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2661/5218] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:51 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:53.844696 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:53.846296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:53.877018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:53.886799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:53.889072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:53.892707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:54.518350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:54.554144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-492a01f3-66c1-4314-b7e4-d561faf69b2f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.711890 Jul 24 01:37:54.554475 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2558/5219] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:53 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:55.048905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-630d1839-dedf-49fb-99ee-5daf9ef32bf5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: .version_select at 0x7f05eac39c10>, body: {"keypair": {"name": "tempest-keypair-78054407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/1IxHm6EPxgl4KBY9ZgdMHJ4J2VZ7Tf1JjajZGkSh0QDQLc/mo+YF4kPzxwJasAxRq84Q0/IZgB9IM21DOStPXPP2ft7Rd7l0HYfOMxAEAxnJUp2qY3Lws8J/iA+gFIg=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:55.105004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-630d1839-dedf-49fb-99ee-5daf9ef32bf5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:37:55.128257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-630d1839-dedf-49fb-99ee-5daf9ef32bf5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:37:55.188886 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-630d1839-dedf-49fb-99ee-5daf9ef32bf5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.145508 Jul 24 01:37:55.193747 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2662/5220] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:37:55 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:55.365959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f8b69cbf-4263-4ab7-9578-0ef4728f4074 req-b76f24de-d5a7-42bb-b35f-f341f78c996a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d038a1a9-07df-442f-849e-24f7bccd6138", "tag": "4173c6cb-2b16-4304-a3db-053aa758b61b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:37:55.406194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f8b69cbf-4263-4ab7-9578-0ef4728f4074 req-b76f24de-d5a7-42bb-b35f-f341f78c996a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:55.422892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f8b69cbf-4263-4ab7-9578-0ef4728f4074 req-b76f24de-d5a7-42bb-b35f-f341f78c996a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:55.470222 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f8b69cbf-4263-4ab7-9578-0ef4728f4074 req-b76f24de-d5a7-42bb-b35f-f341f78c996a service nova] Creating event network-changed:4173c6cb-2b16-4304-a3db-053aa758b61b for instance d038a1a9-07df-442f-849e-24f7bccd6138 on n-h2-master-1 Jul 24 01:37:55.500702 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f8b69cbf-4263-4ab7-9578-0ef4728f4074 req-b76f24de-d5a7-42bb-b35f-f341f78c996a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140084 Jul 24 01:37:55.508284 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2559/5221] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:55.573894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:55.574726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:55.626598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:55.627084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:55.632732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:55.633276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:56.152109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:56.165788 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29e7a582-7278-4bb8-8164-df5032b56b24 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.593579 Jul 24 01:37:56.168182 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2663/5222] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:55 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:56.610778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3579bff-8d1a-4551-9a96-8088a57d4776 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:56.611368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3579bff-8d1a-4551-9a96-8088a57d4776 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:56.617486 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:56.620270 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:56.630091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3579bff-8d1a-4551-9a96-8088a57d4776 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:56.631115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3579bff-8d1a-4551-9a96-8088a57d4776 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:56.632184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3579bff-8d1a-4551-9a96-8088a57d4776 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:56.632803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3579bff-8d1a-4551-9a96-8088a57d4776 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:56.688983 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3579bff-8d1a-4551-9a96-8088a57d4776 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/00a7c2d7-39ab-4b99-83cd-f481c288381d" status: 200 len: 194 microversion: 2.1 time: 0.084339 Jul 24 01:37:56.690627 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2560/5223] 10.222.0.27 () {58 vars in 1412 bytes} [Sun Jul 24 01:37:56 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/00a7c2d7-39ab-4b99-83cd-f481c288381d => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:37:56.699441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:56.700590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:56.714635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:56.715089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:56.718427 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:56.719478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:56.852027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lazy-loading 'services' on Instance uuid 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:37:56.961381 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-73aa223d-7b02-47ac-9f85-65a187b17928 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/00a7c2d7-39ab-4b99-83cd-f481c288381d" status: 202 len: 0 microversion: 2.1 time: 0.265731 Jul 24 01:37:56.963420 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2664/5224] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:37:56 2022] DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments/00a7c2d7-39ab-4b99-83cd-f481c288381d => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:37:57.186466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:57.187872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:57.195077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:57.195964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:57.197988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:57.199359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:57.729179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:57.750807 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9936a350-5a19-47c1-87e6-7d6edb6ac4c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.563882 Jul 24 01:37:57.752851 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2561/5225] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:57 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:58.774293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:37:58.775223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:37:58.823317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:58.834364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:58.835585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:37:58.840225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:37:59.730223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:37:59.741206 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-682b37b8-f3a4-4cfc-96e5-f6c2122ea748 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.974891 Jul 24 01:37:59.753723 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2665/5226] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:37:58 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:37:59.935897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1271390748", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d079b7a7-c0b2-4912-ba85-a51dab0beef6"}], "security_groups": [{"name": "tempest-securitygroup--1003491286"}], "key_name": "tempest-keypair-78054407", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:00.239300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] validate_networks() for [('d079b7a7-c0b2-4912-ba85-a51dab0beef6', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:38:00.762432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:00.763980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:00.782911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:00.806458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:00.812667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:00.814614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:01.163611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:01.178226 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33f068b9-06e5-40d5-84c4-f293110bce94 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.421513 Jul 24 01:38:01.179248 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2666/5227] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:00 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:01.340332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:38:01.340943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:38:01.342760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:38:01.343336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:38:01.343964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:38:01.364064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:01.371492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:01.372846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:01.374558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:01.399669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:38:01.407153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:38:01.421919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:38:01.424415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:38:01.522289 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f545760d-44f0-4c1a-a458-e496658b417f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.590414 Jul 24 01:38:01.523628 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2562/5228] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:37:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:38:01.533916 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1e2c3ba-d116-4997-b9a9-ea412bd2f919 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:01.534546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f1e2c3ba-d116-4997-b9a9-ea412bd2f919 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:01.645728 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f1e2c3ba-d116-4997-b9a9-ea412bd2f919 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:01.660852 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1e2c3ba-d116-4997-b9a9-ea412bd2f919 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1240 microversion: 2.1 time: 0.131115 Jul 24 01:38:01.662035 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2667/5229] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:01 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1240 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:02.197494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:02.198383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:02.206593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5562dcab-52d7-46fb-8c4f-f28d1b13a901 req-e3f67750-69aa-4b81-a73d-3fac0d3f95e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d038a1a9-07df-442f-849e-24f7bccd6138", "name": "network-vif-plugged", "status": "completed", "tag": "4173c6cb-2b16-4304-a3db-053aa758b61b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:02.228472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:02.243499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5562dcab-52d7-46fb-8c4f-f28d1b13a901 req-e3f67750-69aa-4b81-a73d-3fac0d3f95e9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:02.244901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:02.246226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:02.247004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:02.248496 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5562dcab-52d7-46fb-8c4f-f28d1b13a901 req-e3f67750-69aa-4b81-a73d-3fac0d3f95e9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:02.293989 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5562dcab-52d7-46fb-8c4f-f28d1b13a901 req-e3f67750-69aa-4b81-a73d-3fac0d3f95e9 service nova] Creating event network-vif-plugged:4173c6cb-2b16-4304-a3db-053aa758b61b for instance d038a1a9-07df-442f-849e-24f7bccd6138 on n-h2-master-1 Jul 24 01:38:02.305056 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5562dcab-52d7-46fb-8c4f-f28d1b13a901 req-e3f67750-69aa-4b81-a73d-3fac0d3f95e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101321 Jul 24 01:38:02.307312 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2668/5230] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:38:02.611917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1477420052", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": "none"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:02.648828 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:02.658449 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2cd8d796-abb3-4cb3-a99c-d54855c40fdb tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.467110 Jul 24 01:38:02.661603 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2563/5231] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:02 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:02.693032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:02.695091 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:02.716039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:02.722294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:02.723784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:02.724724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:02.734133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:38:02.734866 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:38:02.743170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:38:02.743170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:38:02.743170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:38:02.753748 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:02.754218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:02.755080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:02.755617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:02.775752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Getting quotas for project 9dbf1905e76a4b4cafcf952a1ad55dc6. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:38:02.782770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Getting quotas for user b00542fdb9aa4093bd57591b171f50ca and project 9dbf1905e76a4b4cafcf952a1ad55dc6. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:38:02.796489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:38:02.798920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:38:02.851096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:02.865035 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f023291e-f5aa-4edd-a461-316798f14575 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.459151 Jul 24 01:38:02.868819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da0fb06d-2aa7-4e68-a9a5-b47d920ca6b6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1292 microversion: 2.1 time: 0.188277 Jul 24 01:38:02.875928 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2669/5232] 10.222.0.27 () {62 vars in 1187 bytes} [Sun Jul 24 01:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 24 01:38:02.882991 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-876fa2d0-92ef-44d8-95ba-f5ab481a4737 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:02.883187 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2564/5233] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:02 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1292 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:02.886981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-876fa2d0-92ef-44d8-95ba-f5ab481a4737 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:02.999302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-876fa2d0-92ef-44d8-95ba-f5ab481a4737 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:03.010265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-876fa2d0-92ef-44d8-95ba-f5ab481a4737 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:03.012217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-876fa2d0-92ef-44d8-95ba-f5ab481a4737 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:03.014309 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-876fa2d0-92ef-44d8-95ba-f5ab481a4737 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1278 microversion: 2.54 time: 0.136438 Jul 24 01:38:03.015559 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2670/5234] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:02 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:03.680444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:03.681704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:03.692155 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:03.704155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:03.710620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:03.711495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:03.712122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:03.898307 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:03.899710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:03.913120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:03.916160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:03.921859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:03.923474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:04.042423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:04.054144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c0b53d27-a13e-4c26-8217-bcba6efdad7a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1315 microversion: 2.1 time: 0.378061 Jul 24 01:38:04.056408 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2565/5235] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:03 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:04.065163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:04.071756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:04.074639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:04.075226 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f85dc146-da00-42c2-aa7f-0520ff9161b7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1298 microversion: 2.1 time: 0.181565 Jul 24 01:38:04.075831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2671/5236] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:03 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:04.106741 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:04.107198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:04.111738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:04.115786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:04.318832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:04.359193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:04.363842 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:04.369757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-332f072f-5449-4da2-ade2-b2e9cd071c5d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1274 microversion: 2.54 time: 0.311132 Jul 24 01:38:04.372512 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2566/5237] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:04 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:05.073500 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:05.074839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:05.092495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:05.094097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:05.102592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.103059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.103856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.104298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.109037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.109500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.110441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.110883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.511771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:05.521205 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eb2fb79d-fb53-42f6-b3b0-9621500bdc95 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.432599 Jul 24 01:38:05.526726 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2567/5238] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:05 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:05.540348 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:05.541373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:05.553137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.555606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.557315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.558432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.614704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:05.624277 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25fce935-0a6f-47dd-9fd0-c0a4a401d9e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1503 microversion: 2.1 time: 0.554666 Jul 24 01:38:05.624926 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2672/5239] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:05 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1503 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:05.641408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bdb7f756-02fb-4935-8806-fa9c5bfc907a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:05.641982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bdb7f756-02fb-4935-8806-fa9c5bfc907a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:05.648178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb7f756-02fb-4935-8806-fa9c5bfc907a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.648872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb7f756-02fb-4935-8806-fa9c5bfc907a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.649849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb7f756-02fb-4935-8806-fa9c5bfc907a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.650606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bdb7f756-02fb-4935-8806-fa9c5bfc907a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.657004 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:05.661096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:05.675349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:05.678109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:05.682343 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dbf11a0d-7129-4bed-9e92-8e9124d7578f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1336 microversion: 2.54 time: 0.154254 Jul 24 01:38:05.683821 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2568/5240] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:05 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1336 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:05.831997 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bdb7f756-02fb-4935-8806-fa9c5bfc907a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138/action" status: 202 len: 0 microversion: 2.1 time: 0.192243 Jul 24 01:38:05.834356 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2673/5241] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:38:05 2022] POST /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:38:05.844420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:05.845260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:05.861596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.862181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:05.865170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:05.865723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.226343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dfbdcbba-3b31-4950-b634-33fd421a96a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:06.228119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dfbdcbba-3b31-4950-b634-33fd421a96a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:06.254204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfbdcbba-3b31-4950-b634-33fd421a96a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.255887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfbdcbba-3b31-4950-b634-33fd421a96a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.258149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfbdcbba-3b31-4950-b634-33fd421a96a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.259944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dfbdcbba-3b31-4950-b634-33fd421a96a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.319049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dfbdcbba-3b31-4950-b634-33fd421a96a2 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097797 Jul 24 01:38:06.324530 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2674/5242] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:38:06 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:38:06.380253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:06.394057 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3671801b-1020-4019-bcff-1f62d072ce7d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1508 microversion: 2.1 time: 0.555570 Jul 24 01:38:06.403293 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2569/5243] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:05 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1508 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:06.542411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cbea6736-7221-40ec-ade0-3e881ee09dac req-86eb3b8f-96f8-49e5-bb60-56c886048d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf7619c-e2c4-4571-be7a-60afc55c8d1e", "tag": "ed1924f9-c86e-4fa7-8619-411c87419dc5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:06.544154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:06.545552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:06.557174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cbea6736-7221-40ec-ade0-3e881ee09dac req-86eb3b8f-96f8-49e5-bb60-56c886048d90 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.558364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cbea6736-7221-40ec-ade0-3e881ee09dac req-86eb3b8f-96f8-49e5-bb60-56c886048d90 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.560077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.560709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.561917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.562487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.576666 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:06.586886 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cbea6736-7221-40ec-ade0-3e881ee09dac req-86eb3b8f-96f8-49e5-bb60-56c886048d90 service nova] Creating event network-changed:ed1924f9-c86e-4fa7-8619-411c87419dc5 for instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e on n-h1-master-1 Jul 24 01:38:06.599911 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cbea6736-7221-40ec-ade0-3e881ee09dac req-86eb3b8f-96f8-49e5-bb60-56c886048d90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069358 Jul 24 01:38:06.607240 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2675/5244] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:06.617136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8fbb461b-25f1-4285-b01e-7f6620b752df tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:06.618214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8fbb461b-25f1-4285-b01e-7f6620b752df tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:06.634921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fbb461b-25f1-4285-b01e-7f6620b752df tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.638552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fbb461b-25f1-4285-b01e-7f6620b752df tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.639768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fbb461b-25f1-4285-b01e-7f6620b752df tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.640300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fbb461b-25f1-4285-b01e-7f6620b752df tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.731705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8fbb461b-25f1-4285-b01e-7f6620b752df tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122304 Jul 24 01:38:06.734512 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2676/5245] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:38:06 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:38:06.751210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:06.754734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:06.772525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.772980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:06.773823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:06.774273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.019116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:07.032069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:07.034753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:07.050365 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3ff98be-f483-452c-a82e-9f8e7c758a44 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1336 microversion: 2.54 time: 0.292865 Jul 24 01:38:07.066672 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2677/5246] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:06 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1336 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:07.075841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:07.077313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:07.087324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.088354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.089949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.092827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.155733 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:38:07.240210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:07.253703 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52cdaacf-fc9d-4d9d-b15c-3efce0c9ea7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.714263 Jul 24 01:38:07.254632 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2570/5247] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:06 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:07.306408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be8b611c-bbec-4a43-8158-e642152fa8f5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 204 len: 0 microversion: 2.1 time: 0.238691 Jul 24 01:38:07.308142 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2678/5248] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:38:07 2022] DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:38:07.316912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:07.318390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:07.330006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.330781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.333057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.333608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.412684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:07.413710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:07.427140 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.427960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.428970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.429822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.804320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:07.816592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-66232886-42fd-4fd5-ab4a-e949b416cbd4 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1669 microversion: 2.1 time: 0.503731 Jul 24 01:38:07.831592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:07.838296 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2571/5249] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:07 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1669 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:07.841041 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5b159280-1427-46c3-badf-4350f8f75003 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1488 microversion: 2.1 time: 0.432724 Jul 24 01:38:07.843659 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2679/5250] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:07 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1488 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:07.860654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:07.861518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:07.868889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.869692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.870713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:07.871363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:07.913997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lazy-loading 'flavor' on Instance uuid d038a1a9-07df-442f-849e-24f7bccd6138 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:38:08.074911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:08.075793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:08.090893 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.091463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.095647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.096225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.286099 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e62c4836-63dd-44fc-99d3-aded1a6e730f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138/action" status: 202 len: 0 microversion: 2.1 time: 0.430129 Jul 24 01:38:08.289973 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2572/5251] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:38:07 2022] POST /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:38:08.298289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:08.298842 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:08.299580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:08.319884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.320411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.321228 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.321756 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.328174 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:08.331895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:08.336019 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-628c7615-3e70-4d1b-8e56-6df3985aa8a6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1357 microversion: 2.54 time: 0.265530 Jul 24 01:38:08.339059 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2680/5252] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:08 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:38:08.350961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:08.351945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:08.371542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.376671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.378240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.379452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.541945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:08.551620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7b39b3f7-b644-441f-bcf5-870e6fc62d3f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.263477 Jul 24 01:38:08.569553 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2573/5253] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:08 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:08.576675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fdd4be7-4c72-4f69-97b6-5569fafc6df7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Action: 'create', calling method: .version_select at 0x7f05eb69c4c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1012174230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKupN7AcObeuFj2GLlJ+eH8NUtyMDlXbzXIFf2cHdIXBcjKmldCCkrSa1WkZ2CXcgdwBip01Bf77bpAw8hAOytkBbkjetCNw2l7dWrAAYSX+vZPu0ryp2FnO/FqUD6EPFw=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:08.610342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3fdd4be7-4c72-4f69-97b6-5569fafc6df7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Getting quotas for project 9dbf1905e76a4b4cafcf952a1ad55dc6. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:38:08.630513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3fdd4be7-4c72-4f69-97b6-5569fafc6df7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Getting quotas for user b00542fdb9aa4093bd57591b171f50ca and project 9dbf1905e76a4b4cafcf952a1ad55dc6. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:38:08.679639 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fdd4be7-4c72-4f69-97b6-5569fafc6df7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.108551 Jul 24 01:38:08.680231 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2574/5254] 10.222.0.27 () {62 vars in 1199 bytes} [Sun Jul 24 01:38:08 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 24 01:38:08.701618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1012174230", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:08.703192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:08.730011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.730476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.731513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.731951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.746538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:08.759059 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ce9c62e-8744-42c9-8fe8-e7f422ac782c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1494 microversion: 2.1 time: 0.418638 Jul 24 01:38:08.769734 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2681/5255] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:08 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1494 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:08.848803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:38:08.849280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:38:08.849727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:38:08.852296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:08.852920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:08.862039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.862495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.863289 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:08.863732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:08.879177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:38:08.879862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:38:09.041901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:09.059281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.062202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.063056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.063708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.106414 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5cfc7f7b-8b58-4d85-bba1-99a60f207b6f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "POST /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78/action" status: 202 len: 1140 microversion: 2.54 time: 0.417253 Jul 24 01:38:09.108006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2575/5256] 10.222.0.27 () {62 vars in 1319 bytes} [Sun Jul 24 01:38:08 2022] POST /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78/action => generated 1140 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 24 01:38:09.131319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:09.134300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:09.162615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.164764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.168285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.169423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.301697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:09.311513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:09.313354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:09.314874 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e430c612-8ab9-4b2e-ba93-e7f753315c0f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.193198 Jul 24 01:38:09.316211 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2576/5257] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:09 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:38:09.382959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:09.402329 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e76d2018-391f-4943-b089-8ec47262ba0c tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1669 microversion: 2.1 time: 0.545166 Jul 24 01:38:09.412006 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2682/5258] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:08 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1669 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:09.577761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:09.578785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:09.588438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.589372 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.590513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.591174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.777538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:09.778275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:09.791735 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.792210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.797356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:09.805008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:09.977734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:10.003318 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-551b78f7-0371-4e83-a2fc-f13151594770 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.430329 Jul 24 01:38:10.004155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2577/5259] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:09 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:10.143275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:10.153060 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b8c1bf76-c3f6-4028-8e6a-3acac6fa2977 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1515 microversion: 2.1 time: 0.380574 Jul 24 01:38:10.153647 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2683/5260] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:09 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:10.348045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:10.349074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:10.365640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:10.366809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:10.367997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:10.368739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:10.424895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:10.425525 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:10.436032 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:10.463813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:10.470228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:10.471064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:10.471510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:10.565557 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:10.578115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:10.582067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:10.583674 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9393cbaa-af19-45b6-a546-95c4da4ca60f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.250524 Jul 24 01:38:10.597102 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2578/5261] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:10 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:10.615239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ab5f659f-8dc9-4d0d-b1d2-c14fb8b041b4 req-d28f8be0-42d7-4f42-9a1c-9ab33922f0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215b9a1c-c7d0-4007-97a1-7be9e7e29d6e", "name": "network-vif-deleted", "tag": "d2494386-8c61-4da7-870e-1324e247a3b4"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:10.644223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ab5f659f-8dc9-4d0d-b1d2-c14fb8b041b4 req-d28f8be0-42d7-4f42-9a1c-9ab33922f0cb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:10.645524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ab5f659f-8dc9-4d0d-b1d2-c14fb8b041b4 req-d28f8be0-42d7-4f42-9a1c-9ab33922f0cb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:10.666553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81dad264129d487c88fb39d9356550b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f15d0580547d2a83c6b39381873fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:10.683271 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38a3ca43-1769-451e-9cc5-d48a4e30934e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 200 len: 1602 microversion: 2.1 time: 0.267666 Jul 24 01:38:10.684205 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2684/5262] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:10 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 1602 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:10.687464 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ab5f659f-8dc9-4d0d-b1d2-c14fb8b041b4 req-d28f8be0-42d7-4f42-9a1c-9ab33922f0cb service nova] Creating event network-vif-deleted:d2494386-8c61-4da7-870e-1324e247a3b4 for instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e on n-h1-master-1 Jul 24 01:38:10.698156 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ab5f659f-8dc9-4d0d-b1d2-c14fb8b041b4 req-d28f8be0-42d7-4f42-9a1c-9ab33922f0cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096437 Jul 24 01:38:10.704887 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2579/5263] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:11.024514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:11.025469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:11.050714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.051845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.052968 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.054450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.172955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:11.173683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:11.207592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.208065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.212248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.212736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.389284 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:11.495351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:11.505007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-134882a6-bf6d-4d96-878e-3521eccdc968 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.487589 Jul 24 01:38:11.510223 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2685/5264] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:11 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:11.563354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:11.573023 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c8d4e87-1ece-42d5-9d00-06f8cafe44e4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1515 microversion: 2.1 time: 0.405780 Jul 24 01:38:11.574182 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2580/5265] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:11 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1515 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:11.603705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:11.604813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:11.620104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.620592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.621414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.624537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.700233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:11.701358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:11.712521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.718423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.721784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:11.723244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:11.764284 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] HTTP exception thrown: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Request method failure captured: Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e HTTP/1.1 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEriKEHGh_X-wA3lQ_mpoj-0gpC5zaOGqCYNBE4sehVgaDK9tvzukRFEuMj5x-AqHIZY2LOGJOVXz5vx4javylfOVR_nWKVqrdvXPqvAMbTOG6zB26Nd0T30hq61NXQybbcPAnd4AGdjWno_WFE1PVDuMFDjg6tXqwg6mJHXhyHVIA Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f15d0580547d2a83c6b39381873fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 81dad264129d487c88fb39d9356550b1 Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '215b9a1c-c7d0-4007-97a1-7be9e7e29d6e'} Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:11.766285 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:11.770817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:11.770817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:11.770817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:11.770817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:38:11.770817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:38:11.770817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:11.770817 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:11.781560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Returning 404 to user: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:38:11.783360 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-36ed0fb8-847b-406c-971d-c69e4d8bb2a8 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 404 len: 111 microversion: 2.1 time: 0.086925 Jul 24 01:38:11.784302 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2581/5266] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:11 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:38:11.796305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-05a6e4b2-897d-4b79-84e7-94756f926661 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '.version_select at 0x7f05ea49ac10>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:11.820978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:11.842830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:11.853249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:11.864189 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c3d5093-563d-4082-b8e6-ca47ba7a21e7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.255166 Jul 24 01:38:11.866529 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2686/5267] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:11 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:11.885611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-05a6e4b2-897d-4b79-84e7-94756f926661 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222184023" status: 202 len: 0 microversion: 2.1 time: 0.095412 Jul 24 01:38:11.887051 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2582/5268] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222184023 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:38:12.530311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:12.531646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:12.548157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:12.551396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:12.551396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:12.553751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:12.592064 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:12.593025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:12.618219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:12.619071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:12.621283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:12.622103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:12.766867 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:13.004620 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=16 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:13.459713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:13.468784 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-de189902-2026-4d0b-a1a1-f74d28686e13 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1515 microversion: 2.1 time: 0.881907 Jul 24 01:38:13.474763 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2583/5269] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:12 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1515 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:13.482859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:13.483593 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:13.493459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:13.498569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:13.499258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:13.500199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:13.500784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:13.500998 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:13.510797 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-debb6df9-d152-4df8-9fbe-0d2cffcf97e7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.983931 Jul 24 01:38:13.520772 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2687/5270] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:12 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:13.603420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:13.619519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:13.621212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:13.622671 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-256907f9-9964-41c0-99a9-073dd74e2c67 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.146813 Jul 24 01:38:13.624329 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2584/5271] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:13 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:14.338196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e0f28c67-02aa-453d-8389-e280e8422599 req-5d0d474d-afbb-4bd5-801d-139e45129b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d038a1a9-07df-442f-849e-24f7bccd6138", "name": "network-vif-plugged", "status": "completed", "tag": "4173c6cb-2b16-4304-a3db-053aa758b61b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:14.369594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e0f28c67-02aa-453d-8389-e280e8422599 req-5d0d474d-afbb-4bd5-801d-139e45129b7d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:14.371139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e0f28c67-02aa-453d-8389-e280e8422599 req-5d0d474d-afbb-4bd5-801d-139e45129b7d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:14.415006 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e0f28c67-02aa-453d-8389-e280e8422599 req-5d0d474d-afbb-4bd5-801d-139e45129b7d service nova] Creating event network-vif-plugged:4173c6cb-2b16-4304-a3db-053aa758b61b for instance d038a1a9-07df-442f-849e-24f7bccd6138 on n-h2-master-1 Jul 24 01:38:14.439562 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e0f28c67-02aa-453d-8389-e280e8422599 req-5d0d474d-afbb-4bd5-801d-139e45129b7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105006 Jul 24 01:38:14.442158 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2688/5272] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:14.489003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:14.489872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:14.512276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:14.513292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:14.521961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:14.529102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:14.529920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:14.533578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:14.546220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:14.554266 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:14.557340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:14.559676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:15.000074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:15.002502 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:15.020766 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e42aa73c-7cab-4e70-8177-7de555d732bf tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1515 microversion: 2.1 time: 0.535667 Jul 24 01:38:15.024685 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2585/5273] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:14 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:15.038350 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:15.039151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:15.043931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:15.055228 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ecc9d75a-4a53-44b8-a48e-11cd9172fee0 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.530943 Jul 24 01:38:15.055817 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2689/5274] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:14 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:15.093703 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:15.094170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:15.095032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:15.095401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:15.279570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:15.288438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:15.299439 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:15.302666 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff9ff66b-29a0-4f58-849c-316ac6fd77fe tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.275113 Jul 24 01:38:15.304717 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2586/5275] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:15 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:16.041025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:16.041653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:16.054995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:16.058121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:16.060261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:16.061586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:16.093361 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:16.106807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:16.134564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:16.135303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:16.136331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:16.137055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:16.349352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:16.362486 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a2ef0c8-e7c8-4daa-b1bd-aa3f97475e01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1515 microversion: 2.1 time: 0.325896 Jul 24 01:38:16.372863 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2690/5276] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:16 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:16.373611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:16.374456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:16.392004 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:16.392473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:16.393271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:16.394086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:16.530128 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:16.539007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:16.546130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:16.554257 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0cf33207-bc70-467b-a81a-fe3fb05978d9 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.188635 Jul 24 01:38:16.555072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2691/5277] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:16 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:17.006201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-96dcd465-b79f-4d41-9f9e-0955aaf7fe52 req-60b524f4-92cd-43f3-8c14-39c5faaf7f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf7619c-e2c4-4571-be7a-60afc55c8d1e", "name": "network-vif-plugged", "status": "completed", "tag": "ed1924f9-c86e-4fa7-8619-411c87419dc5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:17.021757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-96dcd465-b79f-4d41-9f9e-0955aaf7fe52 req-60b524f4-92cd-43f3-8c14-39c5faaf7f0b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:17.022217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-96dcd465-b79f-4d41-9f9e-0955aaf7fe52 req-60b524f4-92cd-43f3-8c14-39c5faaf7f0b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:17.062728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:17.078875 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-96dcd465-b79f-4d41-9f9e-0955aaf7fe52 req-60b524f4-92cd-43f3-8c14-39c5faaf7f0b service nova] Creating event network-vif-plugged:ed1924f9-c86e-4fa7-8619-411c87419dc5 for instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e on n-h1-master-1 Jul 24 01:38:17.081022 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0c145014-d39e-4b0d-b205-dc252b1a62c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 1.011977 Jul 24 01:38:17.081843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2587/5278] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:16 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:17.101878 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-96dcd465-b79f-4d41-9f9e-0955aaf7fe52 req-60b524f4-92cd-43f3-8c14-39c5faaf7f0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101987 Jul 24 01:38:17.102513 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2692/5279] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 24 01:38:17.385311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:17.386609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:17.399261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:17.400308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:17.403031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:17.403815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:17.573250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:17.574283 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:17.598645 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:17.602083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:17.603305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:17.608273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:17.750168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:17.761962 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-833e7871-39ae-49be-8ea2-c8d67dc3fec4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.384042 Jul 24 01:38:17.765229 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2588/5280] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:17 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:17.835820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:17.863432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:17.869351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:17.881976 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93c0e205-b7cf-4a77-80ce-7b0f7859451a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.310923 Jul 24 01:38:17.883756 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2693/5281] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:17 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:18.101417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:18.102086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:18.129332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:18.137126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:18.142260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:18.145430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:18.429044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:18.453385 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-69dcb690-a5d0-4f48-84d3-527e65c3e1c4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1366 microversion: 2.1 time: 0.355786 Jul 24 01:38:18.456639 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2589/5282] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:18 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:18.784502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:18.785133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:18.816488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:18.816962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:18.822227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:18.822684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:18.909702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:18.910406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:18.929852 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:18.939964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:18.940440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:18.945007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:18.948787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:19.215441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:19.232216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:19.233954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:19.239022 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-54c79f02-b705-487a-b1d9-054116563460 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.335379 Jul 24 01:38:19.251463 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2590/5283] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:18 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:19.474514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:19.476880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:19.494004 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:19.494854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:19.499597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:19.500327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:19.730244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:19.743319 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9899887-e1db-47d1-9302-fe102bb49ca1 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.963527 Jul 24 01:38:19.760496 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2694/5284] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:18 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:19.922938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:19.938574 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-574498df-5242-4b4a-91e7-2bc08417da57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1556 microversion: 2.1 time: 0.469288 Jul 24 01:38:19.940040 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2591/5285] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:19 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1556 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:19.960572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fc1da927-1b6f-40ee-841e-6c1cbfad9279 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:19.961096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fc1da927-1b6f-40ee-841e-6c1cbfad9279 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:19.976971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc1da927-1b6f-40ee-841e-6c1cbfad9279 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:19.977435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc1da927-1b6f-40ee-841e-6c1cbfad9279 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:19.978275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc1da927-1b6f-40ee-841e-6c1cbfad9279 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:19.978717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fc1da927-1b6f-40ee-841e-6c1cbfad9279 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:20.277181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:20.281279 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:20.324148 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fc1da927-1b6f-40ee-841e-6c1cbfad9279 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.362072 Jul 24 01:38:20.325461 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2695/5286] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:38:19 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-interface => generated 284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:20.343645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:20.344115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:20.344925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:20.345378 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:20.760567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:20.761199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:20.776382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:20.776851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:20.777708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:20.791954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:21.276695 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:21.286090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:21.293220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:21.305917 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c70252bb-701f-42cd-8156-ff7e0d59e9dc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 1.039758 Jul 24 01:38:21.306795 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2592/5287] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:20 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:22.333876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:22.336443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:22.361850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:22.362914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:22.365708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:22.366431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:22.589100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:22.605827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:22.614113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:22.617593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e977863-238b-477c-8412-c31ccde834ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.297031 Jul 24 01:38:22.636432 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2593/5288] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:22 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:38:22.856457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:22.881880 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78500e1e-f4e5-4182-8d5a-805faa240e5f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 2.113446 Jul 24 01:38:22.893219 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2696/5289] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:20 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:23.637567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:23.646179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:23.666713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:23.670302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:23.679154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:23.682432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:23.911087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:23.911716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:23.928234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:23.928474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:23.929290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:23.929768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:24.693519 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:24.716349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:24.718115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:24.719359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f73199a6-61eb-4bde-ab9b-aa408b117528 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 1.086619 Jul 24 01:38:24.719932 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2594/5290] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:23 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:24.940298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:24.951227 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ee868df-3ef5-4630-bc9b-9adecc4adb43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 1.044205 Jul 24 01:38:24.955329 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2697/5291] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:23 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:25.200270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5895ebab-c0cf-4b61-87d3-11317eae202a req-f60feaad-b71f-4880-beab-4234e5dac769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf7619c-e2c4-4571-be7a-60afc55c8d1e", "tag": "ed1924f9-c86e-4fa7-8619-411c87419dc5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:25.214752 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5895ebab-c0cf-4b61-87d3-11317eae202a req-f60feaad-b71f-4880-beab-4234e5dac769 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:25.215536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5895ebab-c0cf-4b61-87d3-11317eae202a req-f60feaad-b71f-4880-beab-4234e5dac769 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:25.261375 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5895ebab-c0cf-4b61-87d3-11317eae202a req-f60feaad-b71f-4880-beab-4234e5dac769 service nova] Creating event network-changed:ed1924f9-c86e-4fa7-8619-411c87419dc5 for instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e on n-h1-master-1 Jul 24 01:38:25.281716 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5895ebab-c0cf-4b61-87d3-11317eae202a req-f60feaad-b71f-4880-beab-4234e5dac769 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084526 Jul 24 01:38:25.289838 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2595/5292] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:38:25.739631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:25.740271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:25.752554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:25.753020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:25.753862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:25.754308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:25.921572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:25.930065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:25.931551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:25.932752 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3ea02939-c0eb-4eff-bee3-5825c9332431 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.198134 Jul 24 01:38:25.933322 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2698/5293] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:25 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:25.975501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:25.976363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:25.996910 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:26.020538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:26.021712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:26.022338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:26.426772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:26.436471 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8fdfe684-a6c5-4ed2-ad79-9ae601779e03 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.467187 Jul 24 01:38:26.446392 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2596/5294] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:25 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:26.952805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:26.953431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:26.979774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:26.980185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:26.981255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:26.982594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:27.148870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:27.166355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:27.168421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:27.170222 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3b6955d1-1384-4cbe-9b4a-7a9c1a334d81 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.222181 Jul 24 01:38:27.171441 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2699/5295] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:26 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:27.450040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:27.451283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:27.454676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:27.455306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:27.464526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:27.464985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:27.465756 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:27.465986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:27.466240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:27.466394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:27.474791 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:27.475480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:27.503217 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] HTTP exception thrown: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Request method failure captured: Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e HTTP/1.1 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEriKEHGh_X-wA3lQ_mpoj-0gpC5zaOGqCYNBE4sehVgaDK9tvzukRFEuMj5x-AqHIZY2LOGJOVXz5vx4javylfOVR_nWKVqrdvXPqvAMbTOG6zB26Nd0T30hq61NXQybbcPAnd4AGdjWno_WFE1PVDuMFDjg6tXqwg6mJHXhyHVIA Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f15d0580547d2a83c6b39381873fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 81dad264129d487c88fb39d9356550b1 Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '215b9a1c-c7d0-4007-97a1-7be9e7e29d6e'} Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:38:27.513482 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.517892 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.519340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Returning 404 to user: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:38:27.520372 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1b60341-e9ac-4dc8-ac3b-6af02f07058e tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 404 len: 111 microversion: 2.1 time: 0.075912 Jul 24 01:38:27.521105 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2597/5296] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:38:27 2022] DELETE /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:38:27.529655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:27.533420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:27.553184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:27.553994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:27.555474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:27.556432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:27.585792 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] HTTP exception thrown: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Request method failure captured: Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e HTTP/1.1 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEriKEHGh_X-wA3lQ_mpoj-0gpC5zaOGqCYNBE4sehVgaDK9tvzukRFEuMj5x-AqHIZY2LOGJOVXz5vx4javylfOVR_nWKVqrdvXPqvAMbTOG6zB26Nd0T30hq61NXQybbcPAnd4AGdjWno_WFE1PVDuMFDjg6tXqwg6mJHXhyHVIA Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f15d0580547d2a83c6b39381873fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 81dad264129d487c88fb39d9356550b1 Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '215b9a1c-c7d0-4007-97a1-7be9e7e29d6e'} Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:27.590437 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.594218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:27.594218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:27.594218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:27.594218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:38:27.594218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:38:27.594218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. Jul 24 01:38:27.594218 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:27.595893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Returning 404 to user: Instance 215b9a1c-c7d0-4007-97a1-7be9e7e29d6e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:38:27.598639 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cad2463c-b7c3-4732-9c20-9984b244fe0a tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e" status: 404 len: 111 microversion: 2.1 time: 0.073545 Jul 24 01:38:27.603469 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2598/5297] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:27 2022] GET /compute/v2.1/servers/215b9a1c-c7d0-4007-97a1-7be9e7e29d6e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:38:27.876484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:27.895602 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6168c1ca-ed0d-4b21-97cb-f2fbb0806314 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.441713 Jul 24 01:38:27.895602 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2700/5298] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:27 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:28.189074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:28.189753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:28.206106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:28.207638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:28.209165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:28.209888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:28.365475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:28.376896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:28.385260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:28.389651 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd09dbe9-5ce2-44b3-bf08-f5f11288c82d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.205142 Jul 24 01:38:28.390272 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2599/5299] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:28 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:28.909246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:28.910083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:28.925449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:28.926115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:28.927059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:28.928113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:29.357028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:29.365648 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-27098ebf-48e8-48d8-8627-181ea6b7e0b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.460411 Jul 24 01:38:29.366304 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2701/5300] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:28 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:29.411740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:29.412501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:29.424156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:29.424612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:29.425724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:29.425859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:29.599262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:29.613046 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:29.619711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:29.621347 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d9fe3ae8-6562-440c-a4ec-2912efd341ec tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.214803 Jul 24 01:38:29.634066 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2600/5301] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:29 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:30.384258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:30.384870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:30.404549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:30.414740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:30.422867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:30.438557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:30.642903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:30.643792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:30.670412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:30.676841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:30.683637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:30.684816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:30.764685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:30.772787 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cb20c54b-4aae-436e-a6d7-a49a95a1c14e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.392789 Jul 24 01:38:30.781462 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2702/5302] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:30 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:30.924758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:30.939575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:30.947636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:30.957985 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6969274e-72da-4e8d-bc15-d4f83adbe3d3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.315354 Jul 24 01:38:30.970721 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2601/5303] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:30 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:31.800070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:31.800689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:31.818117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:31.832364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:31.836988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:31.842274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:31.985282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:31.986392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:31.998254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:32.000857 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:32.002053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:32.003205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:32.234926 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:32.249656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:32.251951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:32.253925 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-84383d75-08b5-41ed-8083-d52cafc057d6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.273268 Jul 24 01:38:32.255233 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2602/5304] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:31 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 24 01:38:33.123019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:33.133293 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea2db432-b34f-4915-9a81-bbe311a15b7b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 1.338740 Jul 24 01:38:33.153883 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2703/5305] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:31 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:33.274304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:33.274980 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:33.285580 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:33.300923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:33.302174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:33.305926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:33.507524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:33.523772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:33.536874 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:33.568231 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72d3b4df-256c-4f8f-87a2-8876f8218f2d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.276744 Jul 24 01:38:33.571518 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2603/5306] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:33 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:34.156155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:34.158122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:34.174846 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:34.175307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:34.176093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:34.176532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:34.600801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:34.601342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:34.615593 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:34.619759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:34.621294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:34.624846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:34.625812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:34.720435 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:34.733581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:34.753601 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-18ca163b-8636-431c-a953-5b02d4f36c9b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.594918 Jul 24 01:38:34.754314 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2704/5307] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:34 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:35.234099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:35.248795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:35.260020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:35.261252 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b656e57-85a0-4e88-aed0-010922fa720f tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.671370 Jul 24 01:38:35.261843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2604/5308] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:34 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:35.771779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:35.783573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:35.817535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:35.820562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:35.837747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:35.838766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:36.015213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:36.015919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:36.028915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:36.029482 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:36.037751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:36.039286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:36.109905 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] HTTP exception thrown: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Request method failure captured: Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da HTTP/1.1 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEriKEHGh_X-wA3lQ_mpoj-0gpC5zaOGqCYNBE4sehVgaDK9tvzukRFEuMj5x-AqHIZY2LOGJOVXz5vx4javylfOVR_nWKVqrdvXPqvAMbTOG6zB26Nd0T30hq61NXQybbcPAnd4AGdjWno_WFE1PVDuMFDjg6tXqwg6mJHXhyHVIA Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f15d0580547d2a83c6b39381873fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 81dad264129d487c88fb39d9356550b1 Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da'} Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:38:36.111889 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.115199 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.119567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Returning 404 to user: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:38:36.123620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23909946-6136-4dcc-9159-90edad9d0b08 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 404 len: 111 microversion: 2.1 time: 0.114162 Jul 24 01:38:36.124782 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2605/5309] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:38:36 2022] DELETE /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:38:36.142888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:36.145760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] [instance: 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:36.157527 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:36.159223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:36.160955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:36.161828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:36.236869 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] HTTP exception thrown: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Request method failure captured: Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da HTTP/1.1 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KEriKEHGh_X-wA3lQ_mpoj-0gpC5zaOGqCYNBE4sehVgaDK9tvzukRFEuMj5x-AqHIZY2LOGJOVXz5vx4javylfOVR_nWKVqrdvXPqvAMbTOG6zB26Nd0T30hq61NXQybbcPAnd4AGdjWno_WFE1PVDuMFDjg6tXqwg6mJHXhyHVIA Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f15d0580547d2a83c6b39381873fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f15d0580547d2a83c6b39381873fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9c2f15d0580547d2a83c6b39381873fb Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1879708107 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 81dad264129d487c88fb39d9356550b1 Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeTestJSON-1879708107-project Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da'} Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:36.240911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.245718 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:36.245718 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:36.245718 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:36.245718 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:38:36.245718 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:38:36.245718 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. Jul 24 01:38:36.245718 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:38:36.252005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] Returning 404 to user: Instance 1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:38:36.253101 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8cc99d5d-6caa-452e-9ac9-4d882ef13fe5 tempest-AttachVolumeTestJSON-1879708107 tempest-AttachVolumeTestJSON-1879708107-project] 10.222.0.27 "GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da" status: 404 len: 111 microversion: 2.1 time: 0.123992 Jul 24 01:38:36.287260 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2606/5310] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:36 2022] GET /compute/v2.1/servers/1dc1c8e5-2a87-42a7-bb9f-8aa0340f94da => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:38:36.297095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:36.298144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:36.314552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:36.315636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:36.316696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:36.317359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:36.865926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:36.888981 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8640000e-3f9d-438c-95f2-a3b9a5ef04b8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 1.118137 Jul 24 01:38:36.895146 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2705/5311] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:35 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:37.073841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:37.083960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:37.093832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:37.095461 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0105e93d-7b9d-49f9-852a-5db575566ea5 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.806541 Jul 24 01:38:37.102116 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2607/5312] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:36 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:37.911514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:37.913206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:37.942206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:37.950587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:37.961379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:37.964964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:38.108323 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:38.127936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:38.130431 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:38.163622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:38.166298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:38.170926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:38.172249 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:38.909966 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:38.925087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:38.927315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:38.962935 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac074bc8-95f1-4576-a8f2-c07f9cd7a78a tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.842553 Jul 24 01:38:38.970515 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2608/5313] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:38 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:39.319519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:39.332439 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b99688f9-5708-4762-88cb-e477b7b985c4 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 1.425169 Jul 24 01:38:39.334508 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2706/5314] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:37 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:39.993139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:39.993850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:40.018730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:40.023873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:40.024807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:40.025265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:40.350452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:40.352142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:40.367620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:40.368560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:40.369597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:40.379747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:40.436189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:40.463645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:40.484942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:40.493940 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e90f9aa-9327-48ac-ab74-d97fad0b0254 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1409 microversion: 2.54 time: 0.504708 Jul 24 01:38:40.501342 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2609/5315] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:39 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1409 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:41.148479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:41.157299 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6ef8965-0dfa-43f4-b358-f8d2c912477f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.810995 Jul 24 01:38:41.163437 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2707/5316] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:40 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:41.520968 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:41.521969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:41.543948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:41.545872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:41.546961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:41.552175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:41.764571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:41.774965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:41.776487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:41.777693 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aebbb7c8-88c8-47e1-aec4-21fdb3cf4e7b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1415 microversion: 2.54 time: 0.262588 Jul 24 01:38:41.784049 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2610/5317] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:41 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1415 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:42.175310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:42.176018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:42.186991 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=48 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:42.209564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:42.218179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:42.219657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:42.223214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:42.547585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1287102371", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "6d334ac4-c6e5-48cd-86a7-c56bd091e482"}], "key_name": "tempest-TestSecurityGroupsBasicOps-712733307", "security_groups": []}, "os:scheduler_hints": {"different_host": ["0101234b-e611-4c5d-8719-b3262c726097"]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:42.667140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] validate_networks() for [('6d334ac4-c6e5-48cd-86a7-c56bd091e482', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:38:42.800971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:42.814043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ef102ac-e3cb-426e-b12b-c900255ab344 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.641738 Jul 24 01:38:42.820805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2708/5318] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:42 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:42.839519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:42.846549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:42.862783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:42.863251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:42.864042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:42.864483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:43.157479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:43.166564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:43.176097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:43.180337 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4562b40-e38d-47a2-80c1-afc013f3f4ed tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1415 microversion: 2.54 time: 0.352039 Jul 24 01:38:43.182031 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2709/5319] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:42 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1415 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:43.829207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:43.829869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:43.854930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:43.855394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:43.863712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:43.864578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:45.477748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:45.493467 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fb89c0f3-2313-46ec-86a7-93b26b338c9d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 1.661405 Jul 24 01:38:45.499868 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2710/5320] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:43 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:45.506700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:45.510892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:45.531892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:45.532737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:45.533911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:45.534605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:45.837740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:45.856331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:45.862031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:45.881054 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8fa733f0-63bf-47a6-9268-f2bcf3ad01bc tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1400 microversion: 2.54 time: 0.369993 Jul 24 01:38:45.894325 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2711/5321] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:45 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1400 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:45.904475 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dabded38-07ff-4820-8141-26f9a5b75cc3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '.version_select at 0x7f05eaa394c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:45.972392 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dabded38-07ff-4820-8141-26f9a5b75cc3 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1012174230" status: 204 len: 0 microversion: 2.54 time: 0.072534 Jul 24 01:38:45.977797 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2712/5322] 10.222.0.27 () {60 vars in 1318 bytes} [Sun Jul 24 01:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1012174230 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 24 01:38:46.011884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:46.012449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:46.042769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.050532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.051647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.054543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.162540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:38:46.318897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:38:46.319434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:38:46.319872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:38:46.321388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:38:46.322063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:38:46.383083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.386550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.394690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.395203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.426574 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9159667-6c7f-42fc-aeb1-72f9a83d616b tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 204 len: 0 microversion: 2.54 time: 0.434813 Jul 24 01:38:46.430566 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2713/5323] 10.222.0.27 () {60 vars in 1279 bytes} [Sun Jul 24 01:38:45 2022] DELETE /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 24 01:38:46.460217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:46.461487 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:46.469440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.476687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.486299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.487900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Getting quotas for project f090fd22b51a49819e4efe8e5a6fd184. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:38:46.488763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.506513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Getting quotas for user 545a39e3583b41b1b9ba0cf41507754f and project f090fd22b51a49819e4efe8e5a6fd184. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:38:46.540005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:38:46.545651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:38:46.673030 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f674e94-907e-4b77-ac7d-0a0010665c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 4.133002 Jul 24 01:38:46.678140 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2611/5324] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:38:42 2022] POST /compute/v2.1/servers => generated 361 bytes in 4139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:38:46.692701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:46.695051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:46.714686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.715845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.718005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:46.720060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:46.784781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:46.799827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:46.807576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:46.809938 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-344a6bbf-ade2-44cf-817c-1bb008b9a258 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1406 microversion: 2.54 time: 0.369013 Jul 24 01:38:46.814208 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2714/5325] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:46 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:46.830559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef691ecb-6fe1-4234-a54c-48a7bddd9168 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:46.831726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ef691ecb-6fe1-4234-a54c-48a7bddd9168 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:47.135926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ef691ecb-6fe1-4234-a54c-48a7bddd9168 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:47.146695 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef691ecb-6fe1-4234-a54c-48a7bddd9168 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1241 microversion: 2.1 time: 0.330938 Jul 24 01:38:47.167562 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2715/5326] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:46 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1241 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:47.832901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:47.834378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:47.854011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:47.861843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:47.866994 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:47.871782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:47.984107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:48.011223 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-168e22fa-9253-48b9-b22a-ad8107535d4b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 1.331058 Jul 24 01:38:48.030856 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2612/5327] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:46 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:48.168886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:48.169837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:48.215637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:48.226424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:48.227436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:48.227898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:48.241942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:48.255754 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:48.257327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:48.284090 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0ff31062-fd6a-44e4-9c49-98a0c163ceb7 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1406 microversion: 2.54 time: 0.455268 Jul 24 01:38:48.292696 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2716/5328] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:47 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:48.557747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:48.572589 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f823f3ff-a830-44ce-9098-ed5da0902b7a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1237 microversion: 2.1 time: 0.411813 Jul 24 01:38:48.573453 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2613/5329] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:48 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1237 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:49.031430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:49.034569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:49.053509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:49.060804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:49.062103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:49.067183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:49.305096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:49.306412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:49.326489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:49.329969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:49.343084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:49.343851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:49.822489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:49.843600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:49.850753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:49.852315 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-123939dd-084c-423c-a144-e5392ce272e6 tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1406 microversion: 2.54 time: 0.552591 Jul 24 01:38:49.856390 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2614/5330] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:49 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1406 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:49.867437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:49.878357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:49.912927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:49.915191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:49.928670 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:49.932058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:50.424983 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:50.437028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:50.472333 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dc372276-3a06-4363-9aac-cb01045df76c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 1.435750 Jul 24 01:38:50.475107 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b4d82e5c-e928-45b9-a088-32c8acd1e22f tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1301 microversion: 2.1 time: 0.614092 Jul 24 01:38:50.480270 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2717/5332] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:49 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:50.481915 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2615/5332] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:49 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1301 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:50.880867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:50.881493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:50.916770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:50.926609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:50.927624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:50.936518 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:51.109883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:51.111500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:51.111982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lazy-loading 'fault' on Instance uuid b363e8c9-a61e-488e-8c92-7d96cdca7f78 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:38:51.263677 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:51.276427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:51.278914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b00542fdb9aa4093bd57591b171f50ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:51.280155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38fe52b5-96c4-458f-a962-fe42cedd8bdd tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 200 len: 1411 microversion: 2.54 time: 0.405365 Jul 24 01:38:51.292910 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2718/5333] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:50 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 1411 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 24 01:38:51.491536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:51.492168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:51.498019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:51.499331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:51.511376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:51.520951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:51.529423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:51.532199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:51.532660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:51.534072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:51.546379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:51.549574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:52.098654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:52.108035 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67728229-9ddb-4e72-82b8-7fd4516a348b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.614552 Jul 24 01:38:52.124183 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2719/5334] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:51 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:52.233004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:52.244425 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-48e8cad2-a7fe-4826-868f-34256062ef47 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.757037 Jul 24 01:38:52.248330 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2616/5335] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:51 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:52.300926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:52.301785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] [instance: b363e8c9-a61e-488e-8c92-7d96cdca7f78] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:52.313851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:52.315983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:52.317034 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:52.319526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:52.351834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] HTTP exception thrown: Instance b363e8c9-a61e-488e-8c92-7d96cdca7f78 could not be found. Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Request method failure captured: Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 HTTP/1.1 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KJ6vqLGUXFuCKxM_5US7hJkTSdUNMv2EUNj6lFAgs-u_GCwNwq6QBFsD_TGX73uthn-StLJTxzALDa2hFjhwgHPHp4GDXJXe6kWIB0dUWn1bGXqm6FKFdHHHLyQt8VXcm7mRIVfRODELyTkmUtTQ9CbeUzg7WxKJQ1fX-G2ZMgTU64 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Openstack-Nova-Api-Version: 2.54 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9dbf1905e76a4b4cafcf952a1ad55dc6 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerShowV254Test-12528391 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9dbf1905e76a4b4cafcf952a1ad55dc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9dbf1905e76a4b4cafcf952a1ad55dc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9dbf1905e76a4b4cafcf952a1ad55dc6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9dbf1905e76a4b4cafcf952a1ad55dc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerShowV254Test-12528391 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9dbf1905e76a4b4cafcf952a1ad55dc6 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerShowV254Test-12528391 Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerShowV254Test-12528391-project Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b00542fdb9aa4093bd57591b171f50ca Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerShowV254Test-12528391-project Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: exception: Instance b363e8c9-a61e-488e-8c92-7d96cdca7f78 could not be found. Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'b363e8c9-a61e-488e-8c92-7d96cdca7f78'} Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b363e8c9-a61e-488e-8c92-7d96cdca7f78 could not be found. Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b363e8c9-a61e-488e-8c92-7d96cdca7f78 could not be found. Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:38:52.355611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:38:52.362616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:38:52.362616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:38:52.362616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:38:52.362616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:38:52.362616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:38:52.362616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b363e8c9-a61e-488e-8c92-7d96cdca7f78 could not be found. Jul 24 01:38:52.362616 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:38:52.364626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] Returning 404 to user: Instance b363e8c9-a61e-488e-8c92-7d96cdca7f78 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:38:52.366488 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a6f628d-3f23-4da8-9543-d87b5cd4910d tempest-ServerShowV254Test-12528391 tempest-ServerShowV254Test-12528391-project] 10.222.0.27 "GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78" status: 404 len: 111 microversion: 2.54 time: 0.070628 Jul 24 01:38:52.376438 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2720/5336] 10.222.0.27 () {60 vars in 1276 bytes} [Sun Jul 24 01:38:52 2022] GET /compute/v2.1/servers/b363e8c9-a61e-488e-8c92-7d96cdca7f78 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 24 01:38:53.130157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:53.131997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:53.152146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:53.153630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:53.155223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:53.156119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:53.266232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:53.267040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:53.319231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:53.323216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:53.324032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:53.325088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:53.479028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:53.491620 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-caa590c4-c12a-458d-b639-951fd8b4059c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.364370 Jul 24 01:38:53.493548 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2617/5337] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:53 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:54.166866 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:54.194889 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78495ea3-9436-4d1c-a9ec-0ab14b0ac1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1510 microversion: 2.1 time: 0.933751 Jul 24 01:38:54.195852 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2721/5338] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:53 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1510 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:38:54.517369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:54.518039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:54.541911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:54.542694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:54.550131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:54.551590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:54.798082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:54.821254 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4a69388f-c071-4130-b10a-990d46c835b3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.314764 Jul 24 01:38:54.834806 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2618/5339] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:54 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:55.213104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:55.214396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:55.225310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:55.228504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:55.231532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:55.234879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:55.618115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d6064ad-cb64-44a6-b7e5-d5321892b828 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:55.619676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d6064ad-cb64-44a6-b7e5-d5321892b828 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:55.634651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d6064ad-cb64-44a6-b7e5-d5321892b828 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:55.635212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d6064ad-cb64-44a6-b7e5-d5321892b828 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:55.636045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d6064ad-cb64-44a6-b7e5-d5321892b828 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:55.636494 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d6064ad-cb64-44a6-b7e5-d5321892b828 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:55.688710 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d6064ad-cb64-44a6-b7e5-d5321892b828 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/ips" status: 200 len: 150 microversion: 2.1 time: 0.703980 Jul 24 01:38:55.697059 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2722/5340] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:38:54 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/ips => generated 150 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:55.844845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:55.845915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:55.868593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:55.874060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:55.876485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:55.880327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:56.271015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:56.275663 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:56.332420 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16eb5e1f-7592-43a5-a099-fd52975081ff tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.493140 Jul 24 01:38:56.339284 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2723/5341] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:55 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:56.458337 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:56.527423 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:56.551344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:56.568087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47742186-91b5-4d65-be38-00b74ecbd760 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1507 microversion: 2.1 time: 1.359432 Jul 24 01:38:56.568688 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2619/5342] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:55 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1507 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:56.710578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f9f281f1-4d18-4d90-9cc9-e5d5d65f3c51 req-ec9471bd-528e-4f24-8ed6-919a3287143b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d038a1a9-07df-442f-849e-24f7bccd6138", "name": "network-vif-unplugged", "status": "completed", "tag": "4173c6cb-2b16-4304-a3db-053aa758b61b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:56.733187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f9f281f1-4d18-4d90-9cc9-e5d5d65f3c51 req-ec9471bd-528e-4f24-8ed6-919a3287143b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:56.733647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f9f281f1-4d18-4d90-9cc9-e5d5d65f3c51 req-ec9471bd-528e-4f24-8ed6-919a3287143b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:56.787418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f9f281f1-4d18-4d90-9cc9-e5d5d65f3c51 req-ec9471bd-528e-4f24-8ed6-919a3287143b service nova] Creating event network-vif-unplugged:4173c6cb-2b16-4304-a3db-053aa758b61b for instance d038a1a9-07df-442f-849e-24f7bccd6138 on n-h2-master-1 Jul 24 01:38:56.823466 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f9f281f1-4d18-4d90-9cc9-e5d5d65f3c51 req-ec9471bd-528e-4f24-8ed6-919a3287143b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113407 Jul 24 01:38:56.825041 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2724/5343] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:57.349308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:57.350507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:57.373589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:57.374326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:57.382509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:57.382988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:57.588801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:57.589889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:57.604224 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:57.607918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:57.610236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:57.611227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:57.613142 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:57.954140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:57.968487 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-07ce40a6-ff37-46e1-a85d-b2be40f8f3de tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.619857 Jul 24 01:38:57.969810 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2620/5344] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:57 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:58.189545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:58.205045 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2af04dca-2b6a-4248-96fa-4eda513a044c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1507 microversion: 2.1 time: 0.619007 Jul 24 01:38:58.207159 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2725/5345] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:57 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1507 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:58.323900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-afe6b990-7d47-4817-969e-4a966cb6d800 req-400aeaa8-d959-44cb-bbe7-9e9741b0107b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d35458-5da3-43c2-b862-bdacab28e15e", "tag": "bb34731d-3008-469e-8e34-926adcd67d72"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:58.368452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-afe6b990-7d47-4817-969e-4a966cb6d800 req-400aeaa8-d959-44cb-bbe7-9e9741b0107b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:58.379203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-afe6b990-7d47-4817-969e-4a966cb6d800 req-400aeaa8-d959-44cb-bbe7-9e9741b0107b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:58.460380 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-afe6b990-7d47-4817-969e-4a966cb6d800 req-400aeaa8-d959-44cb-bbe7-9e9741b0107b service nova] Creating event network-changed:bb34731d-3008-469e-8e34-926adcd67d72 for instance 58d35458-5da3-43c2-b862-bdacab28e15e on n-h1-master-1 Jul 24 01:38:58.498456 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-afe6b990-7d47-4817-969e-4a966cb6d800 req-400aeaa8-d959-44cb-bbe7-9e9741b0107b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173950 Jul 24 01:38:58.514986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2621/5346] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:58.801550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67ef338e-0aaa-4cc7-80df-3b8316f0e799 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Action: 'create', calling method: .version_select at 0x7f05ea968c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1863768073"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:59.005009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-46477ece-7576-477d-934d-438502056137 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-41140021", "availability_zone": "foo_zone"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:59.006740 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:38:59.006740 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:38:59.007838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.aggregate [None req-46477ece-7576-477d-934d-438502056137 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Generated uuid adaa28e4-ffe3-46e7-b995-e87dc61da30c for aggregate {{(pid=119562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 24 01:38:59.082946 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-46477ece-7576-477d-934d-438502056137 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.237210 Jul 24 01:38:59.085302 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2622/5347] 10.222.0.27 () {60 vars in 1163 bytes} [Sun Jul 24 01:38:58 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:38:59.106138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:59.115045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:59.152153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.163201 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.164596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.165104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.418150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:59.427309 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-62344de0-286c-418a-98d5-1cefbece4c31 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.329051 Jul 24 01:38:59.428399 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2623/5348] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:59 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:59.433256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50ce1e28-c41f-4cfd-b208-dde12b612640 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:59.434798 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:38:59.434798 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:38:59.481253 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50ce1e28-c41f-4cfd-b208-dde12b612640 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.050839 Jul 24 01:38:59.488096 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2624/5349] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:38:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:59.502302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:59.503067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:59.515625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.516202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.517864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.518427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.624786 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67ef338e-0aaa-4cc7-80df-3b8316f0e799 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.266013 Jul 24 01:38:59.625799 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2726/5350] 10.222.0.27 () {60 vars in 1154 bytes} [Sun Jul 24 01:38:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1269 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 24 01:38:59.630809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-058debdd-7301-496b-b807-9af67363eed3 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:59.632786 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:38:59.632786 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:38:59.636120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058debdd-7301-496b-b807-9af67363eed3 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.638297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058debdd-7301-496b-b807-9af67363eed3 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.639400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058debdd-7301-496b-b807-9af67363eed3 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.640008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-058debdd-7301-496b-b807-9af67363eed3 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.675875 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-058debdd-7301-496b-b807-9af67363eed3 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048677 Jul 24 01:38:59.677570 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2727/5351] 10.222.0.27 () {58 vars in 1175 bytes} [Sun Jul 24 01:38:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:59.684884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24bdd630-e1b3-4770-bdf1-3d928e9e1244 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eaa39280>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:59.848021 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24bdd630-e1b3-4770-bdf1-3d928e9e1244 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 345 microversion: 2.1 time: 0.169129 Jul 24 01:38:59.849309 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2728/5352] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:38:59 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:59.855831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca047775-9bf1-4d16-9da3-8595fc09bf44 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:38:59.859366 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:38:59.859366 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:38:59.888491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:38:59.890778 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca047775-9bf1-4d16-9da3-8595fc09bf44 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.039855 Jul 24 01:38:59.890900 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:59.895679 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2729/5353] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:38:59 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:38:59.904111 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fd3f45f3-96bc-42e0-a663-2ed6be076c1c tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 200 len: 1450 microversion: 2.1 time: 0.414515 Jul 24 01:38:59.911183 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58e70910-37d5-48c2-804f-bdb1f0a7c8ab tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90fb090f-6f06-43a9-a602-e02822e9f399"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:59.912344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-58e70910-37d5-48c2-804f-bdb1f0a7c8ab tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:38:59.914054 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2625/5354] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:38:59 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 1450 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:38:59.920862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6db8beac-24e0-4ed3-8512-824c6e58c325 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:38:59.934972 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:38:59.934972 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:38:59.939322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58e70910-37d5-48c2-804f-bdb1f0a7c8ab tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.939793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58e70910-37d5-48c2-804f-bdb1f0a7c8ab tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.940598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58e70910-37d5-48c2-804f-bdb1f0a7c8ab tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.941043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58e70910-37d5-48c2-804f-bdb1f0a7c8ab tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:38:59.957268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6db8beac-24e0-4ed3-8512-824c6e58c325 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:38:59.957767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6db8beac-24e0-4ed3-8512-824c6e58c325 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:00.561241 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58e70910-37d5-48c2-804f-bdb1f0a7c8ab tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661677 Jul 24 01:39:00.562047 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2730/5355] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:38:59 2022] POST /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:00.607894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:00.611899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:00.633249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:00.634589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:00.645130 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:00.645961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:00.748789 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6db8beac-24e0-4ed3-8512-824c6e58c325 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 308 microversion: 2.1 time: 0.833570 Jul 24 01:39:00.754218 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2626/5356] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:38:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 308 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:00.755075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:00.755709 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:00.764937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:00.765594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:00.766585 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:00.767722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:00.997956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:01.007268 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-339c938b-721d-4a74-adc0-1559e5f94938 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1303 microversion: 2.1 time: 0.256205 Jul 24 01:39:01.011268 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2627/5357] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:00 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1303 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:01.019553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76947354-2357-416e-a06d-3e2b7349d77b tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:01.023102 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:01.023102 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:39:01.041695 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76947354-2357-416e-a06d-3e2b7349d77b tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 308 microversion: 2.1 time: 0.027996 Jul 24 01:39:01.043532 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2628/5358] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:39:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 308 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:01.049163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b510a7f5-b003-4f0f-bcb3-3ef822948c34 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea3ce1f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:01.173162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:01.187500 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-91b5d89d-036d-4dc9-ba1b-c689c909a10d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.600408 Jul 24 01:39:01.188118 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2731/5359] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:00 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:01.209446 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b510a7f5-b003-4f0f-bcb3-3ef822948c34 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 345 microversion: 2.1 time: 0.164473 Jul 24 01:39:01.210481 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2629/5360] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:01 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:01.218969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:01.219188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ef051d84-3935-4afe-9be6-06e0ca04bb6b tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-636523034", "availability_zone": "foo_zone"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:01.220540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:01.220958 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:01.220958 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:39:01.252187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:01.252969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:01.255209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:01.256151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:01.296701 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ef051d84-3935-4afe-9be6-06e0ca04bb6b tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.103440 Jul 24 01:39:01.298039 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2732/5361] 10.222.0.27 () {60 vars in 1172 bytes} [Sun Jul 24 01:39:01 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:01.331785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71f9bac2-aa65-4525-9fc4-24f120457415 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:01.334757 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:01.334757 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:39:01.382980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71f9bac2-aa65-4525-9fc4-24f120457415 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.076292 Jul 24 01:39:01.391087 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2733/5362] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:39:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:01.397359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-28ab4f73-92a7-4a1b-900a-610c61d5a6e9 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:01.398461 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:01.398461 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:39:01.419982 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-28ab4f73-92a7-4a1b-900a-610c61d5a6e9 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.026121 Jul 24 01:39:01.422285 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2734/5363] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:39:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:01.433047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b741da18-0cac-4576-9b2b-ec6c38ef1c7f tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:01.437385 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:01.437385 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:39:01.463508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b741da18-0cac-4576-9b2b-ec6c38ef1c7f tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:01.464280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b741da18-0cac-4576-9b2b-ec6c38ef1c7f tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:01.773823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:01.800205 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-65f8ae43-c889-4f6e-833b-eb434881076e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.583934 Jul 24 01:39:01.801963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2630/5364] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:01 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:01.821594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:01.826526 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b741da18-0cac-4576-9b2b-ec6c38ef1c7f tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.397865 Jul 24 01:39:01.832075 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2735/5365] 10.222.0.27 () {60 vars in 1193 bytes} [Sun Jul 24 01:39:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:01.834704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:01.837782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-01a3762d-b2d8-475b-9af6-18b8d423c695 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:01.838564 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:01.838564 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 01:39:01.849659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:01.850136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:01.852273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:01.852718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:01.922837 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-01a3762d-b2d8-475b-9af6-18b8d423c695 tempest-TestAggregatesBasicOps-2013732211 tempest-TestAggregatesBasicOps-2013732211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.089284 Jul 24 01:39:01.923767 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2736/5366] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:39:01 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 24 01:39:02.027098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:02.028082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:02.035657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:02.041437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:02.047938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:02.050410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:02.356920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:02.369610 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c463289f-31c7-43ae-9555-975f8016e114 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.551593 Jul 24 01:39:02.373986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2631/5367] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:01 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:02.387027 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-061cc8ce-5f16-4aa9-9089-c696e40adf79 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea4255e0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:02.472734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:02.485719 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc1b4c74-8656-43d6-97dc-d4d27d0a2f29 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.461330 Jul 24 01:39:02.496793 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2737/5368] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:02 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:02.512928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:02.514043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:02.527908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:02.530731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:02.533876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:02.534649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:02.574841 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-061cc8ce-5f16-4aa9-9089-c696e40adf79 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 346 microversion: 2.1 time: 0.198524 Jul 24 01:39:02.575724 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2632/5369] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:02 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:02.588118 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef4e0610-3962-4f44-8965-71c033c63f35 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Action: 'create', calling method: .version_select at 0x7f05ea32a700>, body: {"snapshot": {"volume_id": "a55e5762-6d71-4018-ae72-271bc7ea7c70", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-331470439"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:02.908507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:02.919193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87c14674-486c-4492-b17c-f852a439db78 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.420095 Jul 24 01:39:02.920364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2738/5370] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:02 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:02.940145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-504c676b-dd8c-4800-8130-2dd231dbe614 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:02.962930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-504c676b-dd8c-4800-8130-2dd231dbe614 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:02.968710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-504c676b-dd8c-4800-8130-2dd231dbe614 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:03.042844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-504c676b-dd8c-4800-8130-2dd231dbe614 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Going to try to stop instance {{(pid=119561) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 01:39:03.077552 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef4e0610-3962-4f44-8965-71c033c63f35 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.494188 Jul 24 01:39:03.079050 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2633/5371] 10.222.0.27 () {60 vars in 1161 bytes} [Sun Jul 24 01:39:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:03.090263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d89372d8-e03a-4b75-a53a-1b310f258690 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ead80790>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:03.205043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-504c676b-dd8c-4800-8130-2dd231dbe614 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.269117 Jul 24 01:39:03.232109 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2739/5372] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:39:02 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:03.256070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:03.262868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:03.278932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:03.290971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:03.295518 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:03.298999 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:03.333603 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d89372d8-e03a-4b75-a53a-1b310f258690 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 200 len: 286 microversion: 2.1 time: 0.248670 Jul 24 01:39:03.339497 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2634/5373] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:03 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 286 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:03.345852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c614bb8-e6ec-4673-b19c-be57cd8b6b40 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eb46e040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:03.666209 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c614bb8-e6ec-4673-b19c-be57cd8b6b40 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.324593 Jul 24 01:39:03.666803 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2635/5374] 10.222.0.27 () {58 vars in 1139 bytes} [Sun Jul 24 01:39:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:03.679612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:03.680479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:03.712082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:03.712554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:03.713362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:03.718590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:04.248262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:04.262009 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f588cd7c-739e-4422-9214-31166c16b01d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 1.026475 Jul 24 01:39:04.264900 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2740/5375] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:03 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:04.287541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03857455-e594-4c37-96c1-7599c6752e7e tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea95a040>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:04.352260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:04.362507 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b5a1530-6d9f-459a-9525-c22a962ebd26 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.687121 Jul 24 01:39:04.363109 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2636/5376] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:03 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:04.530829 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03857455-e594-4c37-96c1-7599c6752e7e tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 200 len: 286 microversion: 2.1 time: 0.254734 Jul 24 01:39:04.531600 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2741/5377] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:04 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 286 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:05.283277 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:05.283913 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:05.286967 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:05.308181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:05.308778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:05.322176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:05.342774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:05.382040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:05.385627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:05.403940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:05.415956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:05.418045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:05.427079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:06.077469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:06.090084 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed5b6501-f26d-455b-91aa-8d53d76d3a2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.709216 Jul 24 01:39:06.091185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2742/5378] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:05 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:06.104297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-92e67272-1726-4c1e-b659-8d0089e125af tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eaaf55e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:06.121875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:06.158101 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c6d2abeb-8439-4e9a-be14-6967cdc5b43f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.878797 Jul 24 01:39:06.170455 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2637/5379] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:05 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:06.197002 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-92e67272-1726-4c1e-b659-8d0089e125af tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 200 len: 286 microversion: 2.1 time: 0.104594 Jul 24 01:39:06.197910 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2743/5380] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:06 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:07.109343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:07.110103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:07.179128 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:07.181005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:07.187912 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:07.224963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:07.225616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:07.234830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:07.236175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:07.251418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:07.261648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:07.269728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:07.277942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:07.998830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:08.007227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b78e68bd-d34b-4c0b-89ff-c1ed242f9a04 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.903497 Jul 24 01:39:08.015353 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2638/5381] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:07 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:08.020603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c87163c-89a9-429c-8c0a-2cfc04388b8e tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea243dc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:08.032931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:08.050017 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-59c2b84d-9518-4609-9032-50751b28e5de tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.875330 Jul 24 01:39:08.050639 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2744/5382] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:07 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:08.085413 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c87163c-89a9-429c-8c0a-2cfc04388b8e tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 200 len: 287 microversion: 2.1 time: 0.068798 Jul 24 01:39:08.086100 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2639/5383] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:08 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:08.097432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cab6454c-3102-4600-8d2b-437eddd35e5c tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eaa399d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:08.233162 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cab6454c-3102-4600-8d2b-437eddd35e5c tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 202 len: 0 microversion: 2.1 time: 0.139578 Jul 24 01:39:08.243719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d3a601e1-45a2-4f48-8b70-cdf2d8d751f0 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea3ce1f0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:08.246887 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2745/5384] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:39:08 2022] DELETE /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:08.384421 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d3a601e1-45a2-4f48-8b70-cdf2d8d751f0 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 200 len: 286 microversion: 2.1 time: 0.144940 Jul 24 01:39:08.391167 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2640/5385] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:08 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:08.512685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6b346ab6-b036-48f3-ae0f-bc2ea4a4cbf2 req-1646e2d1-f32b-44f4-887f-11f6ed352bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d35458-5da3-43c2-b862-bdacab28e15e", "name": "network-vif-plugged", "status": "completed", "tag": "bb34731d-3008-469e-8e34-926adcd67d72"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:08.529682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6b346ab6-b036-48f3-ae0f-bc2ea4a4cbf2 req-1646e2d1-f32b-44f4-887f-11f6ed352bb0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:08.531723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6b346ab6-b036-48f3-ae0f-bc2ea4a4cbf2 req-1646e2d1-f32b-44f4-887f-11f6ed352bb0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:08.565064 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6b346ab6-b036-48f3-ae0f-bc2ea4a4cbf2 req-1646e2d1-f32b-44f4-887f-11f6ed352bb0 service nova] Creating event network-vif-plugged:bb34731d-3008-469e-8e34-926adcd67d72 for instance 58d35458-5da3-43c2-b862-bdacab28e15e on n-h1-master-1 Jul 24 01:39:08.576417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6b346ab6-b036-48f3-ae0f-bc2ea4a4cbf2 req-1646e2d1-f32b-44f4-887f-11f6ed352bb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066340 Jul 24 01:39:08.578743 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2746/5386] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:09.032961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:09.033569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:09.055534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:09.057253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:09.064577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:09.068880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:09.069654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:09.074547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:09.095724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:09.096246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:09.097088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:09.097538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:09.601906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:09.630819 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-77004238-04ce-4ee6-ab1a-233231d19f0a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.601745 Jul 24 01:39:09.650471 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:09.655590 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2641/5387] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:09 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:09.671288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-008b435c-a182-4f2a-8202-c31e8f5cfd24 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ead80280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:09.759922 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-008b435c-a182-4f2a-8202-c31e8f5cfd24 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 200 len: 286 microversion: 2.1 time: 0.102806 Jul 24 01:39:09.761356 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2642/5388] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:09 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:09.912163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:09.931752 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-445188c1-cdb7-436a-a4c2-f7e871826160 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.858566 Jul 24 01:39:09.932721 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2747/5389] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:09 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:10.654295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:10.655000 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:10.679402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:10.679778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:10.680589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:10.681032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:10.777463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3af94636-feaa-45c5-8b16-5eaf0cb54a1f tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eaa18700>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:10.853539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3af94636-feaa-45c5-8b16-5eaf0cb54a1f tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 200 len: 286 microversion: 2.1 time: 0.080795 Jul 24 01:39:10.854780 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2748/5390] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:10 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:10.950282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:10.951027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:10.976267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:10.988648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:10.990223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:11.010872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:11.094504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:11.102684 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-016ae3f2-5518-4cbe-b7f1-387c960fec28 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1299 microversion: 2.1 time: 0.455731 Jul 24 01:39:11.138108 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2643/5391] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:10 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1299 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:11.681946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:11.696682 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-85244efc-315e-4bb2-b3a6-5b4f8a400e2b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.751461 Jul 24 01:39:11.701812 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2749/5392] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:10 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:11.866036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5cf44731-f671-40bc-a4fa-994a3c9b4088 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea3ce0d0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:11.914628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-5cf44731-f671-40bc-a4fa-994a3c9b4088 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] HTTP exception thrown: Snapshot 7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 could not be found. Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5cf44731-f671-40bc-a4fa-994a3c9b4088 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Request method failure captured: Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 HTTP/1.1 Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KKyQd6-8SjmZ_xmBReCab8uNDDlVrFu3_Rysbwace1iOq6I3NHGixjoQLn7dVAx41CaV151hZElcR_5-9MAeaty3xz-E0Z4GWVNUWymI_pvSfahyyOf97k_zS-RSRAlWAVokqkvLiLeNpFYnYU_PPylsBMgR8vFAaq4BLScNKCtoYk Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20694f1b7f424331b1ee37960c73be1d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 345afddf00964ab392563c44803f3f8a Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: method: Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: exception: Snapshot 7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 could not be found. Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '7d22dee2-316f-4c74-a3c7-bbdbace1f0c4'} Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 could not be found. (HTTP 404) (Request-ID: req-8ee162e8-bea8-4507-b729-166bce9b96ff) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:39:11.923904 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 could not be found. Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 could not be found. Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 could not be found. Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5cf44731-f671-40bc-a4fa-994a3c9b4088 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Returning 404 to user: Snapshot 7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5cf44731-f671-40bc-a4fa-994a3c9b4088 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4" status: 404 len: 111 microversion: 2.1 time: 0.063936 Jul 24 01:39:11.930265 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2644/5393] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:39:11 2022] GET /compute/v2.1/os-snapshots/7d22dee2-316f-4c74-a3c7-bbdbace1f0c4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:11.943303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6d6f0d9-0df9-4eb3-88fe-24c2b596e45d tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05f9a634c0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:12.047834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6d6f0d9-0df9-4eb3-88fe-24c2b596e45d tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 202 len: 0 microversion: 2.1 time: 0.109483 Jul 24 01:39:12.048954 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2750/5394] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:39:11 2022] DELETE /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:12.059764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28a3d15d-1a20-4b07-8fe2-32f51b2eae54 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eb84d4c0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:12.119026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:12.120144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:12.134777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:12.135480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:12.137062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:12.140684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:12.172486 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28a3d15d-1a20-4b07-8fe2-32f51b2eae54 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 345 microversion: 2.1 time: 0.119364 Jul 24 01:39:12.173265 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2645/5395] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:12 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:12.721130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:12.721950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:12.732146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:12.736368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:12.737442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:12.738127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:12.822945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:12.836715 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e35c5b5-b2ef-475d-9511-27fdc49d996a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1472 microversion: 2.1 time: 0.721367 Jul 24 01:39:12.838458 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2751/5396] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:12 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1472 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:12.866317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:12.872827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:12.895044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:12.895515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:12.896325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:12.896773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:12.936988 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:13.235873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:13.246092 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b478377b-27f6-44ee-bdbf-94524ff5e9b9 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1472 microversion: 2.1 time: 0.394138 Jul 24 01:39:13.250919 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2752/5397] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:12 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:13.266377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-246d6ac1-24cd-48cb-b2de-612772f27f68 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eaba60d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:13.442343 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-246d6ac1-24cd-48cb-b2de-612772f27f68 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 345 microversion: 2.1 time: 0.179696 Jul 24 01:39:13.443425 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2753/5398] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:13 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:13.448247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-084f0c54-57bc-4ebc-a7a8-03dbe9528d61 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:13.449275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-084f0c54-57bc-4ebc-a7a8-03dbe9528d61 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:13.475544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-084f0c54-57bc-4ebc-a7a8-03dbe9528d61 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:13.481903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-084f0c54-57bc-4ebc-a7a8-03dbe9528d61 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:13.488283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-084f0c54-57bc-4ebc-a7a8-03dbe9528d61 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:13.488956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-084f0c54-57bc-4ebc-a7a8-03dbe9528d61 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:13.625060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:13.651318 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc28b683-20b0-4d2c-b0e4-e220796b6005 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.935706 Jul 24 01:39:13.659227 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2646/5399] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:12 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:13.764889 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-084f0c54-57bc-4ebc-a7a8-03dbe9528d61 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1623 microversion: 2.1 time: 0.318917 Jul 24 01:39:13.779241 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2754/5400] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:13 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1623 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:13.784060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b4332b67-9cd8-4ec9-b48a-11840325b129 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:13.784916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b4332b67-9cd8-4ec9-b48a-11840325b129 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:13.795438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4332b67-9cd8-4ec9-b48a-11840325b129 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:13.796235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4332b67-9cd8-4ec9-b48a-11840325b129 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:13.797278 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4332b67-9cd8-4ec9-b48a-11840325b129 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:13.804294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4332b67-9cd8-4ec9-b48a-11840325b129 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:14.137725 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b4332b67-9cd8-4ec9-b48a-11840325b129 tempest-TestSecurityGroupsBasicOps-242849006 tempest-TestSecurityGroupsBasicOps-242849006-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1912 microversion: 2.1 time: 0.355079 Jul 24 01:39:14.138923 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2647/5401] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:13 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1912 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:14.314805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:14.315836 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:14.342576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:14.345455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:14.346658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:14.347264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:14.453319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:14.458061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cfb10c9e-6942-4fbe-9ffe-9fbd4af7c911 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea2143a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:14.634374 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cfb10c9e-6942-4fbe-9ffe-9fbd4af7c911 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 345 microversion: 2.1 time: 0.181815 Jul 24 01:39:14.640170 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2648/5402] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:14 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 345 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:14.678737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:14.679539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:14.694562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:14.702840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:14.707828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:14.708428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:14.817255 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-218b19e4-8354-4d31-97f2-0ac9beeb735c tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 204 len: 0 microversion: 2.1 time: 0.500242 Jul 24 01:39:14.820431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2755/5403] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:14 2022] DELETE /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:14.842262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:14.843007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:14.880221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:14.880680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:14.886314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:14.889298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:15.263445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:15.292834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ebe2a434-e8ac-4e0f-b751-7e5177f6ea96 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1478 microversion: 2.1 time: 0.465601 Jul 24 01:39:15.304715 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2756/5404] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:14 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1478 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:15.347677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:15.363759 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f67803ec-7230-4d65-9b9c-8263a657dce8 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.691261 Jul 24 01:39:15.375709 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2649/5405] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:14 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:15.653570 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dc3e2c07-52f1-4259-a7f2-9df31977446a tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eac57b80>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:15.862954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dc3e2c07-52f1-4259-a7f2-9df31977446a tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 345 microversion: 2.1 time: 0.218674 Jul 24 01:39:15.868976 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2757/5406] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:15 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:16.332919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:16.334459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:16.344078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:16.344951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:16.346209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:16.346906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:16.382461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:16.383322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:16.402772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:16.403382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:16.404239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:16.415778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:16.741630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:16.756145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cc076eb0-23ce-4dea-81d6-a9599caff469 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1478 microversion: 2.1 time: 0.439825 Jul 24 01:39:16.762682 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2650/5407] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:16 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1478 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:16.878886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ebd727cb-453f-46b2-9e88-554201bf9635 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05ea42de50>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:17.003734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:17.017278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d8cf33fb-3c8f-44f2-b72c-9342214e66c3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.639067 Jul 24 01:39:17.019732 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2758/5408] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:16 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:17.082768 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ebd727cb-453f-46b2-9e88-554201bf9635 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 200 len: 345 microversion: 2.1 time: 0.208601 Jul 24 01:39:17.083536 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2651/5409] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:16 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:17.781854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:17.782643 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:17.800627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:17.822195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:17.823078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:17.823600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:17.982169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-061fdc48-165c-4974-95f2-d37c5f83158c req-e986720a-835c-4d19-97e7-92b152043895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d35458-5da3-43c2-b862-bdacab28e15e", "name": "network-vif-deleted", "tag": "bb34731d-3008-469e-8e34-926adcd67d72"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:18.021281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-061fdc48-165c-4974-95f2-d37c5f83158c req-e986720a-835c-4d19-97e7-92b152043895 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:18.032678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-061fdc48-165c-4974-95f2-d37c5f83158c req-e986720a-835c-4d19-97e7-92b152043895 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:18.086832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-061fdc48-165c-4974-95f2-d37c5f83158c req-e986720a-835c-4d19-97e7-92b152043895 service nova] Creating event network-vif-deleted:bb34731d-3008-469e-8e34-926adcd67d72 for instance 58d35458-5da3-43c2-b862-bdacab28e15e on n-h1-master-1 Jul 24 01:39:18.116578 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-061fdc48-165c-4974-95f2-d37c5f83158c req-e986720a-835c-4d19-97e7-92b152043895 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139481 Jul 24 01:39:18.124443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:18.126032 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2652/5410] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:18.133964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89098b5c-c4a8-4e2d-b562-8a0f7a7cca59 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 200 len: 1478 microversion: 2.1 time: 0.357663 Jul 24 01:39:18.139186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:18.143089 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2759/5411] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:17 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 1478 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:18.152518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:18.159727 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:18.160552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:18.162348 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:18.163737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:18.164627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7140a691-ec3e-495c-a432-03bd29aaf317 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eae099d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:18.262434 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7140a691-ec3e-495c-a432-03bd29aaf317 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] HTTP exception thrown: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7140a691-ec3e-495c-a432-03bd29aaf317 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Request method failure captured: Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 HTTP/1.1 Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KKyQd6-8SjmZ_xmBReCab8uNDDlVrFu3_Rysbwace1iOq6I3NHGixjoQLn7dVAx41CaV151hZElcR_5-9MAeaty3xz-E0Z4GWVNUWymI_pvSfahyyOf97k_zS-RSRAlWAVokqkvLiLeNpFYnYU_PPylsBMgR8vFAaq4BLScNKCtoYk Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20694f1b7f424331b1ee37960c73be1d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 345afddf00964ab392563c44803f3f8a Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: exception: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a55e5762-6d71-4018-ae72-271bc7ea7c70'} Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. (HTTP 404) (Request-ID: req-5a4af692-7478-443a-a5f2-470db6b1ffa6) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:39:18.266543 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.270923 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.275592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7140a691-ec3e-495c-a432-03bd29aaf317 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Returning 404 to user: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:18.277280 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7140a691-ec3e-495c-a432-03bd29aaf317 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 404 len: 109 microversion: 2.1 time: 0.129566 Jul 24 01:39:18.279197 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2760/5412] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:18 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:18.293894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1098930a-8a8f-449d-b3f7-7980ec311539 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eab7dee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:18.360160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1098930a-8a8f-449d-b3f7-7980ec311539 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] HTTP exception thrown: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1098930a-8a8f-449d-b3f7-7980ec311539 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Request method failure captured: Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 HTTP/1.1 Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KKyQd6-8SjmZ_xmBReCab8uNDDlVrFu3_Rysbwace1iOq6I3NHGixjoQLn7dVAx41CaV151hZElcR_5-9MAeaty3xz-E0Z4GWVNUWymI_pvSfahyyOf97k_zS-RSRAlWAVokqkvLiLeNpFYnYU_PPylsBMgR8vFAaq4BLScNKCtoYk Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20694f1b7f424331b1ee37960c73be1d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 345afddf00964ab392563c44803f3f8a Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: exception: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a55e5762-6d71-4018-ae72-271bc7ea7c70'} Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. (HTTP 404) (Request-ID: req-597247a1-ce65-48df-a8d1-c2e874d9bd85) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:39:18.362556 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.366947 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.371507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1098930a-8a8f-449d-b3f7-7980ec311539 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Returning 404 to user: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:18.373135 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1098930a-8a8f-449d-b3f7-7980ec311539 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 404 len: 109 microversion: 2.1 time: 0.087452 Jul 24 01:39:18.374238 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2761/5413] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:39:18 2022] DELETE /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:18.383579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de499e69-5d91-45e5-b4e2-11cb2dfcfe68 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Calling method '.version_select at 0x7f05eae099d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:18.451898 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-de499e69-5d91-45e5-b4e2-11cb2dfcfe68 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] HTTP exception thrown: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de499e69-5d91-45e5-b4e2-11cb2dfcfe68 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Request method failure captured: Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 HTTP/1.1 Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KKyQd6-8SjmZ_xmBReCab8uNDDlVrFu3_Rysbwace1iOq6I3NHGixjoQLn7dVAx41CaV151hZElcR_5-9MAeaty3xz-E0Z4GWVNUWymI_pvSfahyyOf97k_zS-RSRAlWAVokqkvLiLeNpFYnYU_PPylsBMgR8vFAaq4BLScNKCtoYk Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20694f1b7f424331b1ee37960c73be1d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20694f1b7f424331b1ee37960c73be1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 20694f1b7f424331b1ee37960c73be1d Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-71597098 Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 345afddf00964ab392563c44803f3f8a Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesSnapshotsTestJSON-71597098-project Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: method: Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: exception: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a55e5762-6d71-4018-ae72-271bc7ea7c70'} Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. (HTTP 404) (Request-ID: req-4a14978c-7720-4a6e-8dcf-8dc12b97f541) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 24 01:39:18.460117 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. Jul 24 01:39:18.464574 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:18.469740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de499e69-5d91-45e5-b4e2-11cb2dfcfe68 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] Returning 404 to user: Volume a55e5762-6d71-4018-ae72-271bc7ea7c70 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:18.474859 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de499e69-5d91-45e5-b4e2-11cb2dfcfe68 tempest-VolumesSnapshotsTestJSON-71597098 tempest-VolumesSnapshotsTestJSON-71597098-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70" status: 404 len: 109 microversion: 2.1 time: 0.095501 Jul 24 01:39:18.477438 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2762/5414] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:39:18 2022] GET /compute/v2.1/os-volumes/a55e5762-6d71-4018-ae72-271bc7ea7c70 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:39:18.560819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:18.572506 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d8a8723-b192-486b-b534-ffedf6f8096a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1677 microversion: 2.1 time: 0.445085 Jul 24 01:39:18.575764 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2653/5415] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:18 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1677 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:19.190134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:19.191400 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 58d35458-5da3-43c2-b862-bdacab28e15e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:19.209531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:19.214817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:19.216398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:19.219316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:19.249297 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] HTTP exception thrown: Instance 58d35458-5da3-43c2-b862-bdacab28e15e could not be found. Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Request method failure captured: Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e HTTP/1.1 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KIjcwbDJEtyT0eYMkvs_MIRURtXH7osBQyLEFISjYWaPR4bG9M-SmsqjBZeJEguH-Aiodx-9FshZyZk_8ZCV8YWp4UUZTgKKMvwo6o2A66Vb-aYkk6667wf0rFaRkTXpWABH7DppMR0Y929gbaKeultKRBPbUBKaf6cpimU4oGUNNE Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: f090fd22b51a49819e4efe8e5a6fd184 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2068863570 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f090fd22b51a49819e4efe8e5a6fd184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f090fd22b51a49819e4efe8e5a6fd184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f090fd22b51a49819e4efe8e5a6fd184", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f090fd22b51a49819e4efe8e5a6fd184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2068863570 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: f090fd22b51a49819e4efe8e5a6fd184 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2068863570 Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestSecurityGroupsBasicOps-2068863570-project Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 545a39e3583b41b1b9ba0cf41507754f Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2068863570-project Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 58d35458-5da3-43c2-b862-bdacab28e15e could not be found. Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '58d35458-5da3-43c2-b862-bdacab28e15e'} Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d35458-5da3-43c2-b862-bdacab28e15e could not be found. Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d35458-5da3-43c2-b862-bdacab28e15e could not be found. Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:19.256005 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d35458-5da3-43c2-b862-bdacab28e15e could not be found. Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:19.260325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Returning 404 to user: Instance 58d35458-5da3-43c2-b862-bdacab28e15e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:19.263088 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf3aa872-46ab-4280-87d5-740b27a2e7f3 tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e" status: 404 len: 111 microversion: 2.1 time: 0.096969 Jul 24 01:39:19.263697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2763/5416] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:19 2022] GET /compute/v2.1/servers/58d35458-5da3-43c2-b862-bdacab28e15e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:19.592861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:19.594794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:19.603005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:19.603796 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:19.605514 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:19.606456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:20.699160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:20.711824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e44b186c-a8e5-4f21-babf-6768521c3a54 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1654 microversion: 2.1 time: 1.123821 Jul 24 01:39:20.725986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2654/5417] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:19 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1654 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:20.730801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c895a418-2ab9-46c2-b859-87700db2cbf3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:20.753506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c895a418-2ab9-46c2-b859-87700db2cbf3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:20.754041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c895a418-2ab9-46c2-b859-87700db2cbf3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:20.806361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c895a418-2ab9-46c2-b859-87700db2cbf3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Going to try to start instance {{(pid=119561) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 01:39:20.925126 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c895a418-2ab9-46c2-b859-87700db2cbf3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.199038 Jul 24 01:39:20.928240 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2764/5418] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:39:20 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:20.936113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:20.936778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:20.957247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:20.958208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:20.962301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:20.964542 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:22.013100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90fb090f-6f06-43a9-a602-e02822e9f399"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:22.014906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:22.041240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:22.044252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:22.046025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:22.051571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:22.397080 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Invalid volume: volume 90fb090f-6f06-43a9-a602-e02822e9f399 is already attached to instances: ebf7619c-e2c4-4571-be7a-60afc55c8d1e Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments HTTP/1.1 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 74 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: {"volumeAttachment": {"volumeId": "90fb090f-6f06-43a9-a602-e02822e9f399"}} Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid volume: volume 90fb090f-6f06-43a9-a602-e02822e9f399 is already attached to instances: ebf7619c-e2c4-4571-be7a-60afc55c8d1e Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': 'ebf7619c-e2c4-4571-be7a-60afc55c8d1e', 'body': {'volumeAttachment': {'volumeId': '90fb090f-6f06-43a9-a602-e02822e9f399'}}} Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 90fb090f-6f06-43a9-a602-e02822e9f399 is already attached to instances: ebf7619c-e2c4-4571-be7a-60afc55c8d1e Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:39:22.399875 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 90fb090f-6f06-43a9-a602-e02822e9f399 is already attached to instances: ebf7619c-e2c4-4571-be7a-60afc55c8d1e Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 90fb090f-6f06-43a9-a602-e02822e9f399 is already attached to instances: ebf7619c-e2c4-4571-be7a-60afc55c8d1e Jul 24 01:39:22.405895 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:22.409049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 400 to user: Invalid volume: volume 90fb090f-6f06-43a9-a602-e02822e9f399 is already attached to instances: ebf7619c-e2c4-4571-be7a-60afc55c8d1e {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:22.411125 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fe3c9079-72be-4c14-aa09-b93fe0adcb56 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.404494 Jul 24 01:39:22.412818 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2765/5419] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:39:22 2022] POST /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 174 bytes in 408 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 01:39:22.501722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:22.503586 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:22.522843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:22.525121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:22.527492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:22.529554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:22.562819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:22.588236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-541ec2fc-708e-4f3c-9ee7-9fbdbc8c2b92 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1663 microversion: 2.1 time: 1.654368 Jul 24 01:39:22.588947 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2655/5420] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:20 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1663 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:22.825030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lazy-loading 'services' on Instance uuid ebf7619c-e2c4-4571-be7a-60afc55c8d1e {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:39:23.017113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d0f64c5-e7fe-47b3-8f39-693e35d05b9a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments/90fb090f-6f06-43a9-a602-e02822e9f399" status: 202 len: 0 microversion: 2.1 time: 0.520202 Jul 24 01:39:23.019015 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2766/5421] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:39:22 2022] DELETE /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments/90fb090f-6f06-43a9-a602-e02822e9f399 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:23.028149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aea6c45f-a2dd-4213-8338-ec332a80b134 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:23.029441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aea6c45f-a2dd-4213-8338-ec332a80b134 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:23.046026 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aea6c45f-a2dd-4213-8338-ec332a80b134 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:23.048375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aea6c45f-a2dd-4213-8338-ec332a80b134 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:23.049443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aea6c45f-a2dd-4213-8338-ec332a80b134 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:23.052295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aea6c45f-a2dd-4213-8338-ec332a80b134 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:23.178814 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=100 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:23.216637 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aea6c45f-a2dd-4213-8338-ec332a80b134 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193398 Jul 24 01:39:23.221244 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2656/5422] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:23 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:23.607706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:23.608922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:23.643426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:23.646134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:23.647139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:23.651245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:24.232821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e624e11-0a4e-4315-8a60-c5f010a84105 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:24.233784 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e624e11-0a4e-4315-8a60-c5f010a84105 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:24.248415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e624e11-0a4e-4315-8a60-c5f010a84105 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:24.248873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e624e11-0a4e-4315-8a60-c5f010a84105 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:24.249661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e624e11-0a4e-4315-8a60-c5f010a84105 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:24.262552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e624e11-0a4e-4315-8a60-c5f010a84105 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:24.340626 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e624e11-0a4e-4315-8a60-c5f010a84105 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112571 Jul 24 01:39:24.341230 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2657/5423] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:24 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:24.419951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:24.435177 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f89d684-bb68-466d-937c-e074bd903c88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1663 microversion: 2.1 time: 0.828705 Jul 24 01:39:24.444184 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2767/5424] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:23 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1663 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:25.358440 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb9884a4-d76f-4156-993e-4d5b56350663 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:25.359721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb9884a4-d76f-4156-993e-4d5b56350663 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:25.386856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9884a4-d76f-4156-993e-4d5b56350663 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:25.390515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9884a4-d76f-4156-993e-4d5b56350663 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:25.398835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9884a4-d76f-4156-993e-4d5b56350663 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:25.405481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb9884a4-d76f-4156-993e-4d5b56350663 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:25.474621 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:25.475470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:25.489365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:25.499853 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb9884a4-d76f-4156-993e-4d5b56350663 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152380 Jul 24 01:39:25.504728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:25.505119 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2658/5425] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:25 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:25.507320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:25.508427 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:26.312164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:26.320476 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-061646be-3293-4291-8c5d-d313f606eb88 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.854387 Jul 24 01:39:26.336560 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2768/5426] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:25 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:26.343240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:26.344023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:26.357380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:26.358050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:26.358988 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:26.361631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:26.517202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86e9656c-db23-4034-81a3-16feb72c6044 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:26.519090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-86e9656c-db23-4034-81a3-16feb72c6044 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:26.545965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e9656c-db23-4034-81a3-16feb72c6044 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:26.547086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e9656c-db23-4034-81a3-16feb72c6044 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:26.550679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e9656c-db23-4034-81a3-16feb72c6044 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:26.551302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e9656c-db23-4034-81a3-16feb72c6044 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:26.630822 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86e9656c-db23-4034-81a3-16feb72c6044 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117946 Jul 24 01:39:26.634973 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2769/5427] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:26 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:26.861204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:26.880232 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-637abf5e-83c0-474c-b7cd-8b4bcf82372a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.540524 Jul 24 01:39:26.881726 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2659/5428] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:26 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:26.906694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:26.907875 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:26.930788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:26.938976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:26.941381 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:26.941897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:27.285872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:27.297206 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c146cd5-4ae9-4420-9040-4cbf4262ed01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.397489 Jul 24 01:39:27.297831 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2770/5429] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:26 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:27.320247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:27.321414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:27.337846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:27.339645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:27.343033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:27.343919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:27.647862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c72e085-206f-4b48-bcc0-d8a625c803bc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:27.649623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4c72e085-206f-4b48-bcc0-d8a625c803bc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:27.672052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c72e085-206f-4b48-bcc0-d8a625c803bc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:27.672659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c72e085-206f-4b48-bcc0-d8a625c803bc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:27.680325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c72e085-206f-4b48-bcc0-d8a625c803bc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:27.687355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c72e085-206f-4b48-bcc0-d8a625c803bc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:27.774054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:27.782687 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:27.789965 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3276262-3a06-4c81-b0f7-374b08dca1df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.474164 Jul 24 01:39:27.797605 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2660/5430] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:27 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:27.817246 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c72e085-206f-4b48-bcc0-d8a625c803bc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170580 Jul 24 01:39:27.818447 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2771/5431] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:27 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:27.824733 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:27.830489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:27.847966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:27.848414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:27.849199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:27.849648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:28.272606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:28.284724 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-273693bb-761a-45a7-9f49-1dccfca888ae tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.475647 Jul 24 01:39:28.286524 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2661/5432] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:27 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:28.302357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:28.302911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:28.311276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:28.311739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:28.312537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:28.312986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:28.368180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lazy-loading 'flavor' on Instance uuid 88b3e6c8-eefb-480b-badb-78a2ee07ad73 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:39:28.528745 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03a69390-2d2d-4bee-ad49-981919e64545 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.230129 Jul 24 01:39:28.536021 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2772/5433] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:39:28 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:28.539225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:28.539845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:28.563164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:28.566083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:28.569396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:28.571270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:28.833002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eec8b190-c71e-49cb-96c2-c9a3bb44f369 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:28.834980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eec8b190-c71e-49cb-96c2-c9a3bb44f369 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:28.844272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:28.845838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec8b190-c71e-49cb-96c2-c9a3bb44f369 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:28.846668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec8b190-c71e-49cb-96c2-c9a3bb44f369 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:28.847852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec8b190-c71e-49cb-96c2-c9a3bb44f369 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:28.848522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eec8b190-c71e-49cb-96c2-c9a3bb44f369 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:28.862572 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8320247a-286b-4385-9daf-53ec4ad3445f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1675 microversion: 2.1 time: 0.327016 Jul 24 01:39:28.863615 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2662/5434] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:28 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:28.910654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eec8b190-c71e-49cb-96c2-c9a3bb44f369 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085243 Jul 24 01:39:28.912381 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2773/5435] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:28 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:29.887165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:29.889895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:29.910578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:29.911061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:29.918956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:29.919833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:29.924093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-10c5d7a4-6dd9-41e0-9064-5faff599f9fe tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:29.925155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-10c5d7a4-6dd9-41e0-9064-5faff599f9fe tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:29.942770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10c5d7a4-6dd9-41e0-9064-5faff599f9fe tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:29.943232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10c5d7a4-6dd9-41e0-9064-5faff599f9fe tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:29.944039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10c5d7a4-6dd9-41e0-9064-5faff599f9fe tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:29.944488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-10c5d7a4-6dd9-41e0-9064-5faff599f9fe tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:30.083096 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-10c5d7a4-6dd9-41e0-9064-5faff599f9fe tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163682 Jul 24 01:39:30.102526 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2774/5436] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:29 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:30.258836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:30.270180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5f75423a-7135-48b1-a927-81c00667b1ad tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1658 microversion: 2.1 time: 0.393154 Jul 24 01:39:30.276200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2663/5437] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:29 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1658 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:30.291970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4854341a-89c3-4d36-9742-f0130306e7a0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:30.292457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4854341a-89c3-4d36-9742-f0130306e7a0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:30.323189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4854341a-89c3-4d36-9742-f0130306e7a0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:30.325074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4854341a-89c3-4d36-9742-f0130306e7a0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:30.326596 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4854341a-89c3-4d36-9742-f0130306e7a0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:30.328660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4854341a-89c3-4d36-9742-f0130306e7a0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:30.513801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4854341a-89c3-4d36-9742-f0130306e7a0 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action" status: 202 len: 0 microversion: 2.1 time: 0.221044 Jul 24 01:39:30.516542 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2775/5438] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:39:30 2022] POST /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:30.527395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:30.528396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:30.545156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:30.546022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:30.547149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:30.549571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:31.114626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38646fb2-80bd-4f7c-9e88-f299b4d993f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:31.115975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-38646fb2-80bd-4f7c-9e88-f299b4d993f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:31.133724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38646fb2-80bd-4f7c-9e88-f299b4d993f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:31.134657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38646fb2-80bd-4f7c-9e88-f299b4d993f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:31.141790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38646fb2-80bd-4f7c-9e88-f299b4d993f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:31.145769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38646fb2-80bd-4f7c-9e88-f299b4d993f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:31.217691 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38646fb2-80bd-4f7c-9e88-f299b4d993f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108357 Jul 24 01:39:31.221198 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2776/5439] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:31 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:31.673024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:31.683087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e98f29e-8460-444f-8fe9-ab0587f9d2df tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1664 microversion: 2.1 time: 1.159598 Jul 24 01:39:31.683801 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2664/5440] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:30 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1664 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:32.233149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f8f7c87-d773-4e97-9cbd-7ccee14fff82 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:32.234135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f8f7c87-d773-4e97-9cbd-7ccee14fff82 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:32.244373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f8f7c87-d773-4e97-9cbd-7ccee14fff82 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:32.245876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f8f7c87-d773-4e97-9cbd-7ccee14fff82 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:32.246937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f8f7c87-d773-4e97-9cbd-7ccee14fff82 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:32.247579 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f8f7c87-d773-4e97-9cbd-7ccee14fff82 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:32.312611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f8f7c87-d773-4e97-9cbd-7ccee14fff82 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084072 Jul 24 01:39:32.316646 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2777/5441] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:32 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:32.761522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-358930410", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "cc86c1e4-b7e4-4933-9238-baf1830a4d31"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:32.902563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] validate_networks() for [('cc86c1e4-b7e4-4933-9238-baf1830a4d31', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:39:33.312503 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:33.314135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:33.327767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:33.328606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:33.332211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:33.334270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:34.284668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:39:34.285237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:39:34.285570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:39:34.286060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:39:34.287835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:39:34.304502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:34.304972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:34.305822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:34.306272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:34.326029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:34.335161 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30a037ef-8c21-4768-8562-8275e6c64e79 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1664 microversion: 2.1 time: 1.638535 Jul 24 01:39:34.341791 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2778/5442] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:32 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1664 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:34.354932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Getting quotas for project a0193195c3004cca93fa3f343b4b4f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:39:34.357725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f3d320df-0f46-486e-81a2-fb9ea192e420 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:34.358765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f3d320df-0f46-486e-81a2-fb9ea192e420 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:34.371649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3d320df-0f46-486e-81a2-fb9ea192e420 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:34.372122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3d320df-0f46-486e-81a2-fb9ea192e420 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:34.372916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3d320df-0f46-486e-81a2-fb9ea192e420 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:34.375665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Getting quotas for user a6cea44a68f04b52972b770230b5130a and project a0193195c3004cca93fa3f343b4b4f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:39:34.382070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3d320df-0f46-486e-81a2-fb9ea192e420 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:34.417168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:39:34.427367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:39:34.488313 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f3d320df-0f46-486e-81a2-fb9ea192e420 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145129 Jul 24 01:39:34.488911 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2779/5443] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:34 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:34.564266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-60878edb-c215-407a-93e3-61961c0d4167 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202428 Jul 24 01:39:34.570290 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2665/5444] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:39:34.575992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7b9b8bbb-d116-4587-8b58-8ed8f257b65f tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:34.576827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7b9b8bbb-d116-4587-8b58-8ed8f257b65f tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:34.914045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7b9b8bbb-d116-4587-8b58-8ed8f257b65f tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:34.924694 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7b9b8bbb-d116-4587-8b58-8ed8f257b65f tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1227 microversion: 2.1 time: 0.350906 Jul 24 01:39:34.926667 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2780/5445] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:34 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1227 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:34.971393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:34.972633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:34.984911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:34.990517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:34.995878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:34.998507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:35.084836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:35.290695 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd0294da-6d25-4061-9113-9821bd2c610b tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 204 len: 0 microversion: 2.1 time: 0.322624 Jul 24 01:39:35.296052 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2666/5446] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:34 2022] DELETE /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:35.313084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:35.316713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:35.336338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:35.337528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:35.356655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:35.357215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:35.390589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-11acc417-5e30-4fc4-be41-d983a141f7df req-b12c762b-4d2b-4294-8cdf-44fcfd01dae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0101234b-e611-4c5d-8719-b3262c726097", "tag": "c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:35.412446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-11acc417-5e30-4fc4-be41-d983a141f7df req-b12c762b-4d2b-4294-8cdf-44fcfd01dae3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:35.414490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-11acc417-5e30-4fc4-be41-d983a141f7df req-b12c762b-4d2b-4294-8cdf-44fcfd01dae3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:35.461171 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-11acc417-5e30-4fc4-be41-d983a141f7df req-b12c762b-4d2b-4294-8cdf-44fcfd01dae3 service nova] Creating event network-changed:c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7 for instance 0101234b-e611-4c5d-8719-b3262c726097 on n-h2-master-1 Jul 24 01:39:35.485573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-11acc417-5e30-4fc4-be41-d983a141f7df req-b12c762b-4d2b-4294-8cdf-44fcfd01dae3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.477705 Jul 24 01:39:35.492866 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2781/5447] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:35.543658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:35.545966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:35.568586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:35.569335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:35.570553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:35.571158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:35.982694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:35.996385 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f8b3c5fc-be2c-4581-98a9-af36542727eb tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1767 microversion: 2.1 time: 0.694754 Jul 24 01:39:35.998470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2667/5448] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:35 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1767 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:36.009929 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2fad0dbf-0b2b-4c6d-80c4-aff1280cf478 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:36.016795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2fad0dbf-0b2b-4c6d-80c4-aff1280cf478 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:36.029838 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:36.035148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fad0dbf-0b2b-4c6d-80c4-aff1280cf478 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.035924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fad0dbf-0b2b-4c6d-80c4-aff1280cf478 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.036952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fad0dbf-0b2b-4c6d-80c4-aff1280cf478 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.047862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2fad0dbf-0b2b-4c6d-80c4-aff1280cf478 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.094611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2fad0dbf-0b2b-4c6d-80c4-aff1280cf478 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094620 Jul 24 01:39:36.100881 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2668/5449] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:39:35 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:39:36.114825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:36.114825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:36.131347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.131809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.132615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.133061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.585852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:36.594791 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-246b61a1-7862-4f9c-94c1-641f32ffe6c0 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1231 microversion: 2.1 time: 0.492417 Jul 24 01:39:36.595374 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2669/5450] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:36 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1231 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:36.613972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:36.615353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:36.630205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.632277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.634809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.635523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.721974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:36.814201 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:36.888970 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-21f90bb7-4f52-47f5-b621-296fd37916ef tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 204 len: 0 microversion: 2.1 time: 0.287055 Jul 24 01:39:36.889985 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2670/5451] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:36 2022] DELETE /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:36.908044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:36.908943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:36.916298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.916663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.918453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:36.918953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:36.953318 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:36.965714 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87d500b0-fee9-4389-ad87-b0abfe03ae87 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 1.464942 Jul 24 01:39:36.968683 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2782/5452] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:35 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:36.989042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:36.996276 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:37.016721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:37.021852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:37.022783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:37.024225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:37.891398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:37.905917 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-07451636-bc97-4711-8ddd-d7e632b61ad3 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1667 microversion: 2.1 time: 0.923173 Jul 24 01:39:37.911873 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2783/5453] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:36 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1667 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:37.930522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:37.935567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:37.940204 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:37.968858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:37.971674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:37.972761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:37.975067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:38.273115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:38.285299 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2506b168-2372-473a-931e-2675755e0af5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1681 microversion: 2.1 time: 1.389338 Jul 24 01:39:38.288729 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2671/5454] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:36 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1681 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:38.289902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545a39e3583b41b1b9ba0cf41507754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090fd22b51a49819e4efe8e5a6fd184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:38.301328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:38.302275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:38.318691 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a556f356-4e95-436d-8b7a-cb15fe10eb2a tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 200 len: 1649 microversion: 2.1 time: 0.405637 Jul 24 01:39:38.321139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:38.327547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:38.333449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:38.334299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:38.345446 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2784/5455] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:37 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 1649 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:38.363723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:38.364255 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:38.403145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:38.403616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:38.404431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:38.404885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:38.486269 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:38.496918 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.api [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Working on deleting snapshot 1ba105f3-aefb-4c1c-aae3-158d29bf8cf0 from shelved instance... Jul 24 01:39:38.641704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:38.650963 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fc9ac614-861e-4674-a811-28264d77ad81 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1285 microversion: 2.1 time: 0.360745 Jul 24 01:39:38.654742 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2672/5456] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:38 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:38.665242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-18af4613-04e4-4c84-bd44-299853c12c7e req-bd519906-6449-41e3-8527-fc69cbb3a9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0101234b-e611-4c5d-8719-b3262c726097", "name": "network-vif-deleted", "tag": "c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:38.680787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-18af4613-04e4-4c84-bd44-299853c12c7e req-bd519906-6449-41e3-8527-fc69cbb3a9bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:38.690558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-18af4613-04e4-4c84-bd44-299853c12c7e req-bd519906-6449-41e3-8527-fc69cbb3a9bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:38.706757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-18af4613-04e4-4c84-bd44-299853c12c7e req-bd519906-6449-41e3-8527-fc69cbb3a9bc service nova] Creating event network-vif-deleted:c2b90efe-beb4-4aa8-9bdc-82d7cb664ac7 for instance 0101234b-e611-4c5d-8719-b3262c726097 on n-h2-master-1 Jul 24 01:39:38.719735 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-18af4613-04e4-4c84-bd44-299853c12c7e req-bd519906-6449-41e3-8527-fc69cbb3a9bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063242 Jul 24 01:39:38.738258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2673/5457] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:39.305710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:39.307556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:39.326248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:39.326710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:39.331963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:39.332706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:39.799146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:39.816443 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6fcd97f3-223e-406d-aa1c-2a31cba1427e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 200 len: 1613 microversion: 2.1 time: 0.515580 Jul 24 01:39:39.817821 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2674/5458] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:39 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 1613 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:39.830915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:39.831909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] [instance: 0101234b-e611-4c5d-8719-b3262c726097] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:39.833073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Doing local delete in cell 0cd8cbf6-89a9-4578-8b79-4f13f771e70c(cell1) {{(pid=119561) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 24 01:39:39.833945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:39.834401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:39.837837 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.api [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 24 01:39:39.843521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:39.844046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:39.844942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:39.845067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] deallocate_for_instance() {{(pid=119561) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 24 01:39:39.845563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:39.862160 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] HTTP exception thrown: Instance 0101234b-e611-4c5d-8719-b3262c726097 could not be found. Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Request method failure captured: Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 HTTP/1.1 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KIjcwbDJEtyT0eYMkvs_MIRURtXH7osBQyLEFISjYWaPR4bG9M-SmsqjBZeJEguH-Aiodx-9FshZyZk_8ZCV8YWp4UUZTgKKMvwo6o2A66Vb-aYkk6667wf0rFaRkTXpWABH7DppMR0Y929gbaKeultKRBPbUBKaf6cpimU4oGUNNE Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: f090fd22b51a49819e4efe8e5a6fd184 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2068863570 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f090fd22b51a49819e4efe8e5a6fd184"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f090fd22b51a49819e4efe8e5a6fd184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f090fd22b51a49819e4efe8e5a6fd184", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f090fd22b51a49819e4efe8e5a6fd184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2068863570 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: f090fd22b51a49819e4efe8e5a6fd184 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2068863570 Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestSecurityGroupsBasicOps-2068863570-project Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 545a39e3583b41b1b9ba0cf41507754f Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2068863570-project Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 0101234b-e611-4c5d-8719-b3262c726097 could not be found. Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '0101234b-e611-4c5d-8719-b3262c726097'} Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0101234b-e611-4c5d-8719-b3262c726097 could not be found. Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0101234b-e611-4c5d-8719-b3262c726097 could not be found. Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:39.864474 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0101234b-e611-4c5d-8719-b3262c726097 could not be found. Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:39.870374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Returning 404 to user: Instance 0101234b-e611-4c5d-8719-b3262c726097 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:39.872416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-979f8eba-1ebb-415d-9eef-888ebaf3eaaf tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097" status: 404 len: 111 microversion: 2.1 time: 0.050439 Jul 24 01:39:39.873547 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2675/5459] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:39 2022] GET /compute/v2.1/servers/0101234b-e611-4c5d-8719-b3262c726097 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:40.324237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-94536384", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "f55bcd36-212a-420a-8ac7-c43433221069"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:40.424112 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] validate_networks() for [('f55bcd36-212a-420a-8ac7-c43433221069', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:39:41.723206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:39:41.724399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:39:41.725076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:39:41.725728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:39:41.726499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:39:41.751543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:41.753192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:41.760192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:41.761221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:41.810895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Getting quotas for project a373807910a0427bb9ae0955d13bf1fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:39:41.821839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Getting quotas for user a4242cf259f9480b87435fdd16e04610 and project a373807910a0427bb9ae0955d13bf1fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:39:41.861895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:39:41.864911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:39:41.983735 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9b852f1-a519-4455-9cf0-352b4365f612 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.108818 Jul 24 01:39:41.991443 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2676/5460] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:39:42.007109 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:42.008606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:42.042673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:42.044030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:42.068285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:42.074974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:42.477231 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:42.483840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Updating instance_info_cache with network_info: [] {{(pid=119561) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:39:43.010250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:43.021414 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79468298-7ea1-485b-8a00-e75e4b78ef11 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 1.028374 Jul 24 01:39:43.036258 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2677/5461] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:41 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:43.049647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-095c10e2-27bf-4525-93bc-270a1a312901 req-7b4e7267-bce0-4ae5-9537-de900228b0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf7619c-e2c4-4571-be7a-60afc55c8d1e", "name": "network-vif-deleted", "tag": "ed1924f9-c86e-4fa7-8619-411c87419dc5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:43.067688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-095c10e2-27bf-4525-93bc-270a1a312901 req-7b4e7267-bce0-4ae5-9537-de900228b0ca service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.070467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-095c10e2-27bf-4525-93bc-270a1a312901 req-7b4e7267-bce0-4ae5-9537-de900228b0ca service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.124668 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-095c10e2-27bf-4525-93bc-270a1a312901 req-7b4e7267-bce0-4ae5-9537-de900228b0ca service nova] Creating event network-vif-deleted:ed1924f9-c86e-4fa7-8619-411c87419dc5 for instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e on n-h1-master-1 Jul 24 01:39:43.131581 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-095c10e2-27bf-4525-93bc-270a1a312901 req-7b4e7267-bce0-4ae5-9537-de900228b0ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087005 Jul 24 01:39:43.132435 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2678/5462] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:43.142052 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:43.143110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:43.153501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.154071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.154876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.156140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.178121 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e HTTP/1.1 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ebf7619c-e2c4-4571-be7a-60afc55c8d1e'} Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:43.180609 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.186690 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:43.186690 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:43.186690 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:43.186690 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:43.186690 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:43.186690 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:39:43.186690 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.188541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:43.189618 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f29cd49d-3bcc-4404-8934-4ceaa9654772 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 404 len: 111 microversion: 2.1 time: 0.055860 Jul 24 01:39:43.190903 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2679/5463] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:43 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:43.195836 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:43.196734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:43.204688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.205626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.207301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.208187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.369958 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-50a776f8-e476-4657-abb3-a3e740995899 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 204 len: 0 microversion: 2.1 time: 5.022358 Jul 24 01:39:43.371562 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2785/5464] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:38 2022] DELETE /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 0 bytes in 5025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:43.376996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d9fd2c4f-1a7f-473a-a7b9-833d437146ce req-3d8b499d-785f-41a0-ae83-e0f350c59aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d038a1a9-07df-442f-849e-24f7bccd6138", "name": "network-vif-deleted", "tag": "4173c6cb-2b16-4304-a3db-053aa758b61b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:43.386187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d9fd2c4f-1a7f-473a-a7b9-833d437146ce req-3d8b499d-785f-41a0-ae83-e0f350c59aed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.386931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d9fd2c4f-1a7f-473a-a7b9-833d437146ce req-3d8b499d-785f-41a0-ae83-e0f350c59aed service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.399532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.server_external_events [req-d9fd2c4f-1a7f-473a-a7b9-833d437146ce req-3d8b499d-785f-41a0-ae83-e0f350c59aed service nova] Unable to find a host for instance d038a1a9-07df-442f-849e-24f7bccd6138. Dropping event network-vif-deleted {{(pid=119561) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 24 01:39:43.401376 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d9fd2c4f-1a7f-473a-a7b9-833d437146ce req-3d8b499d-785f-41a0-ae83-e0f350c59aed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027454 Jul 24 01:39:43.402036 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2786/5465] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 24 01:39:43.405056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:43.418440 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-542b561b-648e-4a01-8236-855611e8850a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1209 microversion: 2.1 time: 0.225932 Jul 24 01:39:43.419252 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2680/5466] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:43 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1209 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:43.424485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6de9bdab-40e6-4fe4-a723-1e83c03b867c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '.version_select at 0x7f05eaa4faf0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:43.440041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:43.443496 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: d038a1a9-07df-442f-849e-24f7bccd6138] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:43.451014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.451779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.452979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.454132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.460106 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6de9bdab-40e6-4fe4-a723-1e83c03b867c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78054407" status: 202 len: 0 microversion: 2.1 time: 0.056735 Jul 24 01:39:43.464017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2787/5467] 10.222.0.27 () {58 vars in 1214 bytes} [Sun Jul 24 01:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78054407 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:43.473983 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] HTTP exception thrown: Instance d038a1a9-07df-442f-849e-24f7bccd6138 could not be found. Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Request method failure captured: Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 HTTP/1.1 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KB82qt59Jo-oxIvUJAPvsaw5akn_eDWVXslD9r7Jve7msH7AwSbjX431vT3GmYrZX0k0w5oJUn7XXheNTs6zlQjJ9lxDx7oOwlmPBOwVJldXxk0wvoZxvvs9Q0BtBdnLlMhrrh0hUt96yztddkMWYVNE4jdjTVsg9GdU4jB-SXGJAY Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b97b2217fca247759ee6e9f15d150866", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: f6a5e8716f324b53b51e8d34cb704321 Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: exception: Instance d038a1a9-07df-442f-849e-24f7bccd6138 could not be found. Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd038a1a9-07df-442f-849e-24f7bccd6138'} Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d038a1a9-07df-442f-849e-24f7bccd6138 could not be found. Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d038a1a9-07df-442f-849e-24f7bccd6138 could not be found. Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:43.476197 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.481491 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:43.481491 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:43.481491 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:43.481491 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:43.481491 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:43.481491 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d038a1a9-07df-442f-849e-24f7bccd6138 could not be found. Jul 24 01:39:43.481491 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:39:43.482271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Returning 404 to user: Instance d038a1a9-07df-442f-849e-24f7bccd6138 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:43.483232 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2e224dc9-51a9-421f-bd5d-84bb0b86a3c9 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138" status: 404 len: 111 microversion: 2.1 time: 0.053918 Jul 24 01:39:43.483910 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2681/5468] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:43 2022] GET /compute/v2.1/servers/d038a1a9-07df-442f-849e-24f7bccd6138 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:43.492007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:43.492571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:43.517962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.518428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.519350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.519808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.590310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:43.747752 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-661a3a10-7514-4cdd-8fd6-8c4b81156887 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 204 len: 0 microversion: 2.1 time: 0.259473 Jul 24 01:39:43.750026 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2788/5469] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:43 2022] DELETE /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:43.759298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:43.760549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:43.773706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.773942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.774940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:43.776507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:43.970381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:43.984145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ac29c1c-8d1d-42bf-9e66-78da3719554f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1466 microversion: 2.1 time: 0.229222 Jul 24 01:39:43.984716 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2682/5470] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:43 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1466 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:44.049569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:44.058563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:44.073590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:44.074696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:44.077923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:44.078562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:44.436077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:44.436740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:44.446684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:44.451576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:44.452841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:44.453460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:44.922884 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:44.964494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:44.982618 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af842d98-56a1-4df0-a83a-e570f5b73a53 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1271 microversion: 2.1 time: 0.550787 Jul 24 01:39:44.992035 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2683/5471] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:44 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1271 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:44.998875 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:45.001071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:45.001928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:45.011587 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9c555776-e44d-4a13-a18c-d1f2a3933483 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 0.969579 Jul 24 01:39:45.013339 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2789/5472] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:44 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:45.014012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:45.014711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:45.015704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:45.016308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:45.328458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:45.338746 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-67abf3fc-0baa-43db-b2dc-66deb52c540a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1466 microversion: 2.1 time: 0.340877 Jul 24 01:39:45.339352 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2684/5473] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:44 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1466 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:45.753060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6c58fa4d-a0c6-45af-8342-2983675d6d38 req-bf062033-2ac6-4ee3-bea9-b6528b12a6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05", "tag": "bf57cefa-67b9-44ce-a0d3-1efc9c97e743"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:45.767634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6c58fa4d-a0c6-45af-8342-2983675d6d38 req-bf062033-2ac6-4ee3-bea9-b6528b12a6f9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:45.768326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6c58fa4d-a0c6-45af-8342-2983675d6d38 req-bf062033-2ac6-4ee3-bea9-b6528b12a6f9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:45.816613 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6c58fa4d-a0c6-45af-8342-2983675d6d38 req-bf062033-2ac6-4ee3-bea9-b6528b12a6f9 service nova] Creating event network-changed:bf57cefa-67b9-44ce-a0d3-1efc9c97e743 for instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 on n-h2-master-1 Jul 24 01:39:45.826430 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6c58fa4d-a0c6-45af-8342-2983675d6d38 req-bf062033-2ac6-4ee3-bea9-b6528b12a6f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082305 Jul 24 01:39:45.827744 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2790/5474] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:46.006906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:46.007481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:46.015942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:46.016485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:46.017365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:46.018038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:46.031532 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:46.032420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:46.047849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:46.054237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:46.055313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:46.058282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:46.999438 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:47.011378 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-faa37c70-ec9d-4936-b33a-7a3b9368a91e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 0.984035 Jul 24 01:39:47.013117 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2791/5475] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:46 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:47.029841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:47.030324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:47.092391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:47.095464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:47.102661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:47.104123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:47.282767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:47.291105 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28b43c20-419f-4e53-8542-0f11cc517ec3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1313 microversion: 2.1 time: 1.289021 Jul 24 01:39:47.294716 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2685/5476] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:46 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1313 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:47.299498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e5efff8-5a50-40de-9ddb-139ca3d7fa25 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: .version_select at 0x7f05ea2ad3a0>, body: {"keypair": {"name": "tempest-keypair-420280884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq7JDXdFKh3/hLnCM8eTGrEyPUeaL+LSCKbEboNzlpsxFR79CRgVJ2xQIldDKAupT4dGJnbZibk4RFUNWuOniqR4+Bd1CwLwBNHNE+XzZVlCSiIdVtikYEORyqWLbK78w=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:47.338278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6e5efff8-5a50-40de-9ddb-139ca3d7fa25 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:39:47.355587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-6e5efff8-5a50-40de-9ddb-139ca3d7fa25 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:39:47.398210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:47.420562 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e5efff8-5a50-40de-9ddb-139ca3d7fa25 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124695 Jul 24 01:39:47.421191 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2686/5477] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:39:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:47.430826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5eb111ac-ae4e-400f-a1a1-0c02557e4d3e req-75c31190-472a-4067-8f1e-1e9e7abedacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6926042-95f5-4952-ba41-35dc384e36d9", "name": "network-vif-deleted", "tag": "68c8297f-c01a-4793-a125-4c2d18ffbe31"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:47.432485 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e19ebfe-b8b5-463b-9f37-094e4002e34f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 200 len: 1299 microversion: 2.1 time: 0.416121 Jul 24 01:39:47.452256 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2792/5478] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:47 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 1299 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:47.454695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5eb111ac-ae4e-400f-a1a1-0c02557e4d3e req-75c31190-472a-4067-8f1e-1e9e7abedacc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:47.455160 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5eb111ac-ae4e-400f-a1a1-0c02557e4d3e req-75c31190-472a-4067-8f1e-1e9e7abedacc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:47.467855 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5eb111ac-ae4e-400f-a1a1-0c02557e4d3e req-75c31190-472a-4067-8f1e-1e9e7abedacc service nova] Creating event network-vif-deleted:68c8297f-c01a-4793-a125-4c2d18ffbe31 for instance e6926042-95f5-4952-ba41-35dc384e36d9 on n-h2-master-1 Jul 24 01:39:47.491544 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5eb111ac-ae4e-400f-a1a1-0c02557e4d3e req-75c31190-472a-4067-8f1e-1e9e7abedacc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068431 Jul 24 01:39:47.492171 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2687/5479] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:48.031107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:48.032007 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:48.102021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.104663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.107019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.112464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.312138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:48.312950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:48.329612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.330502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.331057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.331908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.552038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:48.564400 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c72be671-23e2-47b0-a262-89d15946b39c tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 0.538985 Jul 24 01:39:48.568803 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2793/5480] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:48 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:48.579993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:48.583556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: e6926042-95f5-4952-ba41-35dc384e36d9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:48.604380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.607123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.611292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.614574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.667561 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] HTTP exception thrown: Instance e6926042-95f5-4952-ba41-35dc384e36d9 could not be found. Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Request method failure captured: Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 HTTP/1.1 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KB82qt59Jo-oxIvUJAPvsaw5akn_eDWVXslD9r7Jve7msH7AwSbjX431vT3GmYrZX0k0w5oJUn7XXheNTs6zlQjJ9lxDx7oOwlmPBOwVJldXxk0wvoZxvvs9Q0BtBdnLlMhrrh0hUt96yztddkMWYVNE4jdjTVsg9GdU4jB-SXGJAY Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b97b2217fca247759ee6e9f15d150866", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f6a5e8716f324b53b51e8d34cb704321 Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: exception: Instance e6926042-95f5-4952-ba41-35dc384e36d9 could not be found. Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e6926042-95f5-4952-ba41-35dc384e36d9'} Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6926042-95f5-4952-ba41-35dc384e36d9 could not be found. Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6926042-95f5-4952-ba41-35dc384e36d9 could not be found. Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:48.672911 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6926042-95f5-4952-ba41-35dc384e36d9 could not be found. Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Returning 404 to user: Instance e6926042-95f5-4952-ba41-35dc384e36d9 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:48.678368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4367f4a5-6ca1-4b92-8f17-8771a4d0ea96 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9" status: 404 len: 111 microversion: 2.1 time: 0.107054 Jul 24 01:39:48.680088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2794/5481] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:48 2022] GET /compute/v2.1/servers/e6926042-95f5-4952-ba41-35dc384e36d9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:48.698336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:48.701890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:48.727598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.730457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.734713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:48.735302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:48.811458 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:48.827003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:48.834863 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0a28923-ddbc-4901-8f37-25400fa6ac2c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1313 microversion: 2.1 time: 0.528671 Jul 24 01:39:48.838265 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2688/5482] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:48 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:49.068147 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bcd0b451-b22e-4b98-8a0c-6dab823bbf41 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 204 len: 0 microversion: 2.1 time: 0.383709 Jul 24 01:39:49.072135 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2795/5483] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:48 2022] DELETE /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:49.077447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:49.078132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:49.095250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:49.100877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:49.100877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:49.100877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:49.593789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:49.595301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:49.606072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:49.606882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:49.607830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:49.608422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:49.641254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:49.661090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c8ab1c5-af09-40ce-a1b9-7997476f43f7 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1508 microversion: 2.1 time: 0.587753 Jul 24 01:39:49.677256 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2689/5484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:49 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1508 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:49.687920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0cb47e0e-bf58-4e16-b7aa-c60ec89ec6a1 req-ffa18a66-417c-494b-9959-89215ddbc36d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0686a7-1377-4d35-a57a-b3064e6de961", "tag": "7cf0ba47-187d-4298-b47b-41da2380b05d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:49.701251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0cb47e0e-bf58-4e16-b7aa-c60ec89ec6a1 req-ffa18a66-417c-494b-9959-89215ddbc36d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:49.705782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0cb47e0e-bf58-4e16-b7aa-c60ec89ec6a1 req-ffa18a66-417c-494b-9959-89215ddbc36d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:49.740100 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0cb47e0e-bf58-4e16-b7aa-c60ec89ec6a1 req-ffa18a66-417c-494b-9959-89215ddbc36d service nova] Creating event network-changed:7cf0ba47-187d-4298-b47b-41da2380b05d for instance 4f0686a7-1377-4d35-a57a-b3064e6de961 on n-h1-master-1 Jul 24 01:39:49.748295 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0cb47e0e-bf58-4e16-b7aa-c60ec89ec6a1 req-ffa18a66-417c-494b-9959-89215ddbc36d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067853 Jul 24 01:39:49.752304 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2690/5485] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:49.867859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:49.868631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:49.884403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:49.887757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:49.888812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:49.892250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:50.661098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:50.678153 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1147634b-54a9-45e8-8171-a06c9131ee77 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 1.095304 Jul 24 01:39:50.714302 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2796/5486] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:49 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:50.731264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:50.737572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:50.761282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:50.777068 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:50.801859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:50.810983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:50.820743 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=78,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=16,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:51.240739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:51.262226 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2a275377-bb38-4fdb-a827-731aa04fe6c2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1313 microversion: 2.1 time: 1.411965 Jul 24 01:39:51.262607 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2691/5487] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:49 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1313 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:51.297278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:51.300505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:51.326582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:51.327673 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:51.330587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:51.331772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:51.534500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lazy-loading 'services' on Instance uuid 2d9486a9-c2ba-4d76-b940-6368fed3d08a {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:39:51.718265 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:51.745556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1438db32-409a-4533-843a-ac921d09890f tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a/os-volume_attachments/13508c3d-59c6-44c7-9fdb-da17e4e4cca0" status: 202 len: 0 microversion: 2.1 time: 0.475796 Jul 24 01:39:51.750106 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2692/5488] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:39:51 2022] DELETE /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a/os-volume_attachments/13508c3d-59c6-44c7-9fdb-da17e4e4cca0 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:51.793565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:51.794809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:51.804999 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:51.826530 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:51.835894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:51.839633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:51.840552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:52.974152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:52.984396 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9fed1f83-df67-4fc9-9342-6089e710e44e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 200 len: 1508 microversion: 2.1 time: 2.266150 Jul 24 01:39:52.984991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2797/5489] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:50 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 1508 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:52.997136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9cc26a62-41a9-4287-b1af-cba1a4739a4e req-fd08d53b-30b1-4148-8c95-64589af89a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a732903f-a01d-4df5-8011-affbebcd17b3", "name": "network-vif-deleted", "tag": "66e8d415-850f-4ba2-b7c1-4092d4bd070c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:53.069510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9cc26a62-41a9-4287-b1af-cba1a4739a4e req-fd08d53b-30b1-4148-8c95-64589af89a19 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:53.070013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9cc26a62-41a9-4287-b1af-cba1a4739a4e req-fd08d53b-30b1-4148-8c95-64589af89a19 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:53.109234 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9cc26a62-41a9-4287-b1af-cba1a4739a4e req-fd08d53b-30b1-4148-8c95-64589af89a19 service nova] Creating event network-vif-deleted:66e8d415-850f-4ba2-b7c1-4092d4bd070c for instance a732903f-a01d-4df5-8011-affbebcd17b3 on n-h1-master-1 Jul 24 01:39:53.123379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9cc26a62-41a9-4287-b1af-cba1a4739a4e req-fd08d53b-30b1-4148-8c95-64589af89a19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129953 Jul 24 01:39:53.126956 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2798/5490] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:53.141484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:53.151174 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:53.179606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:53.183104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:53.185665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:53.186238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:53.528499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:53.546474 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7bf54f70-a250-4054-ae2f-5fd1d1d2eef1 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 1.792017 Jul 24 01:39:53.547679 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2693/5491] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:51 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:53.559233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-27a2a3d9-021e-4f56-b93f-57c7506758af tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] Calling method '.version_select at 0x7f05eaf80280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:53.616035 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-27a2a3d9-021e-4f56-b93f-57c7506758af tempest-TestSecurityGroupsBasicOps-2068863570 tempest-TestSecurityGroupsBasicOps-2068863570-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-712733307" status: 202 len: 0 microversion: 2.1 time: 0.066757 Jul 24 01:39:53.618358 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2694/5492] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:39:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-712733307 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:53.719650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:53.740262 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-236aae2b-fa9c-4f47-b387-5b5e172a47fb tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1313 microversion: 2.1 time: 0.608641 Jul 24 01:39:53.741292 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2799/5493] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:53 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:54.004556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:54.005329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: a732903f-a01d-4df5-8011-affbebcd17b3] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:54.032166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.036190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.040306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.047311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.133241 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] HTTP exception thrown: Instance a732903f-a01d-4df5-8011-affbebcd17b3 could not be found. Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Request method failure captured: Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 HTTP/1.1 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KB82qt59Jo-oxIvUJAPvsaw5akn_eDWVXslD9r7Jve7msH7AwSbjX431vT3GmYrZX0k0w5oJUn7XXheNTs6zlQjJ9lxDx7oOwlmPBOwVJldXxk0wvoZxvvs9Q0BtBdnLlMhrrh0hUt96yztddkMWYVNE4jdjTVsg9GdU4jB-SXGJAY Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b97b2217fca247759ee6e9f15d150866", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f6a5e8716f324b53b51e8d34cb704321 Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: exception: Instance a732903f-a01d-4df5-8011-affbebcd17b3 could not be found. Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a732903f-a01d-4df5-8011-affbebcd17b3'} Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a732903f-a01d-4df5-8011-affbebcd17b3 could not be found. Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a732903f-a01d-4df5-8011-affbebcd17b3 could not be found. Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:54.144203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:54.148077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:54.148077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:54.148077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:54.148077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:54.148077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:54.148077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a732903f-a01d-4df5-8011-affbebcd17b3 could not be found. Jul 24 01:39:54.148077 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:54.154112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Returning 404 to user: Instance a732903f-a01d-4df5-8011-affbebcd17b3 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:54.159120 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6be3ec8-fdf5-4e47-84dc-f0498b70a50b tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3" status: 404 len: 111 microversion: 2.1 time: 0.157536 Jul 24 01:39:54.160084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2800/5494] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:53 2022] GET /compute/v2.1/servers/a732903f-a01d-4df5-8011-affbebcd17b3 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:39:54.179492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:54.180862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:54.199329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.200818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.202042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.204052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.300029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:54.342508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1bd4d3c6-42d3-44bd-bf6d-92610abe91a6 req-de6c85a9-eecf-4b3a-bb28-81f50c8972b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0686a7-1377-4d35-a57a-b3064e6de961", "name": "network-vif-plugged", "status": "completed", "tag": "7cf0ba47-187d-4298-b47b-41da2380b05d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:54.391540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1bd4d3c6-42d3-44bd-bf6d-92610abe91a6 req-de6c85a9-eecf-4b3a-bb28-81f50c8972b0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.393661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1bd4d3c6-42d3-44bd-bf6d-92610abe91a6 req-de6c85a9-eecf-4b3a-bb28-81f50c8972b0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.427068 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1bd4d3c6-42d3-44bd-bf6d-92610abe91a6 req-de6c85a9-eecf-4b3a-bb28-81f50c8972b0 service nova] Creating event network-vif-plugged:7cf0ba47-187d-4298-b47b-41da2380b05d for instance 4f0686a7-1377-4d35-a57a-b3064e6de961 on n-h1-master-1 Jul 24 01:39:54.443247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1bd4d3c6-42d3-44bd-bf6d-92610abe91a6 req-de6c85a9-eecf-4b3a-bb28-81f50c8972b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.767220 Jul 24 01:39:54.451185 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2695/5495] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:39:54.519803 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0fffc3ce-2a5c-433e-83bd-9a02bb095c9f tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 204 len: 0 microversion: 2.1 time: 0.355236 Jul 24 01:39:54.527555 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2801/5496] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:54 2022] DELETE /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:54.536398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:54.537110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:54.545481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.553405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.555370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.556692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.565024 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:54.565760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:54.584685 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.585135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:54.602212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:54.602790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:55.126193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:55.134034 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9cd6a328-0b4b-4c42-8732-8c059d205a01 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1496 microversion: 2.1 time: 0.602355 Jul 24 01:39:55.135250 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2696/5497] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:54 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1496 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:55.149524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:55.150571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:55.164612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:55.166152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:55.168029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:55.169333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:55.348489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:55.375201 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed642d95-77aa-4f78-accc-a2a35c5b5334 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 0.814315 Jul 24 01:39:55.383948 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2802/5498] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:54 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:55.694889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:55.710847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-06598b50-53fa-4240-a919-00dddbfdb39f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1313 microversion: 2.1 time: 0.567081 Jul 24 01:39:55.713596 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2697/5499] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:55 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:56.037904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-22af7a1b-e0e4-4f49-bfb7-90f29f793b60 req-ebe10236-35ca-4a8a-bfed-f9fb682ed831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c3e7dd-5b93-4737-a3a5-5a68504f0421", "name": "network-vif-deleted", "tag": "7acb899b-af7b-4262-8f28-c343f123dff1"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:56.062192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-22af7a1b-e0e4-4f49-bfb7-90f29f793b60 req-ebe10236-35ca-4a8a-bfed-f9fb682ed831 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.065783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-22af7a1b-e0e4-4f49-bfb7-90f29f793b60 req-ebe10236-35ca-4a8a-bfed-f9fb682ed831 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.133999 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-22af7a1b-e0e4-4f49-bfb7-90f29f793b60 req-ebe10236-35ca-4a8a-bfed-f9fb682ed831 service nova] Creating event network-vif-deleted:7acb899b-af7b-4262-8f28-c343f123dff1 for instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 on n-h1-master-1 Jul 24 01:39:56.156347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:56.157253 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:56.158311 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-22af7a1b-e0e4-4f49-bfb7-90f29f793b60 req-ebe10236-35ca-4a8a-bfed-f9fb682ed831 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128855 Jul 24 01:39:56.166703 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2803/5500] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:56.186758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.187156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.187954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.188401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.297549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:56.307269 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-62441351-9d62-4f6b-8d10-05d8856190e6 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 200 len: 1287 microversion: 2.1 time: 0.156690 Jul 24 01:39:56.317613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2698/5501] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:56 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 1287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:39:56.395975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:56.396913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:56.425407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.431738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.433952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.434997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.469420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-09b92e67-0616-40d9-8277-bf148f05e104 req-a0a54ed4-2796-4f25-bbf0-2470f8dd327a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05", "name": "network-vif-plugged", "status": "completed", "tag": "bf57cefa-67b9-44ce-a0d3-1efc9c97e743"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:56.496092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-09b92e67-0616-40d9-8277-bf148f05e104 req-a0a54ed4-2796-4f25-bbf0-2470f8dd327a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.497313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-09b92e67-0616-40d9-8277-bf148f05e104 req-a0a54ed4-2796-4f25-bbf0-2470f8dd327a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.539070 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-09b92e67-0616-40d9-8277-bf148f05e104 req-a0a54ed4-2796-4f25-bbf0-2470f8dd327a service nova] Creating event network-vif-plugged:bf57cefa-67b9-44ce-a0d3-1efc9c97e743 for instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 on n-h2-master-1 Jul 24 01:39:56.573403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-09b92e67-0616-40d9-8277-bf148f05e104 req-a0a54ed4-2796-4f25-bbf0-2470f8dd327a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101947 Jul 24 01:39:56.578746 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2699/5502] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:39:56.584959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1781516602", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d079b7a7-c0b2-4912-ba85-a51dab0beef6"}], "security_groups": [{"name": "tempest-securitygroup--1530640437"}], "key_name": "tempest-keypair-420280884", "user_data": "}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:56.842353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:56.854461 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f56e9d38-85e8-442b-9f98-9e51ad662955 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 0.464778 Jul 24 01:39:56.860595 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2804/5503] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:56 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:56.873109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:56.875769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:56.891342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.893087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.893943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:56.894394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:56.915184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] validate_networks() for [('d079b7a7-c0b2-4912-ba85-a51dab0beef6', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:39:57.350067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:57.365748 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6808dad2-b3fd-456b-b7a6-2d0eb1a39a30 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1501 microversion: 2.1 time: 0.503687 Jul 24 01:39:57.367398 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2805/5504] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:56 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:57.377570 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=16 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:57.380837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:57.382427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 48c3e7dd-5b93-4737-a3a5-5a68504f0421] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:57.396334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:57.397421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:57.398281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:57.405616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:57.442811 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] HTTP exception thrown: Instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 could not be found. Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Request method failure captured: Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 HTTP/1.1 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KB82qt59Jo-oxIvUJAPvsaw5akn_eDWVXslD9r7Jve7msH7AwSbjX431vT3GmYrZX0k0w5oJUn7XXheNTs6zlQjJ9lxDx7oOwlmPBOwVJldXxk0wvoZxvvs9Q0BtBdnLlMhrrh0hUt96yztddkMWYVNE4jdjTVsg9GdU4jB-SXGJAY Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b97b2217fca247759ee6e9f15d150866", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f6a5e8716f324b53b51e8d34cb704321 Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 could not be found. Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '48c3e7dd-5b93-4737-a3a5-5a68504f0421'} Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 could not be found. Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 could not be found. Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:39:57.448864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:57.452620 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:39:57.452620 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:39:57.452620 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:39:57.452620 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:39:57.452620 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:39:57.452620 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 could not be found. Jul 24 01:39:57.452620 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:39:57.455707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Returning 404 to user: Instance 48c3e7dd-5b93-4737-a3a5-5a68504f0421 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:39:57.457869 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3b3d6842-9740-40e3-9f97-11a20d172b84 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421" status: 404 len: 111 microversion: 2.1 time: 0.088220 Jul 24 01:39:57.460380 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2806/5505] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:57 2022] GET /compute/v2.1/servers/48c3e7dd-5b93-4737-a3a5-5a68504f0421 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:57.473061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:57.474264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:57.508720 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:57.509360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:57.517964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:57.518429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:57.917462 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:57.937255 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9fddfbb0-3a44-4fbe-8550-8db0acda23fc tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1501 microversion: 2.1 time: 0.463873 Jul 24 01:39:57.937980 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2807/5506] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:57 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1501 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:57.942794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:57.943497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:57.951990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:57.968975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:57.970098 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:57.970574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.071366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:39:58.136787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:39:58.137318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:39:58.137953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:39:58.138467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:39:58.138993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:39:58.144587 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:58.152839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.156838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.158361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.159092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.188577 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:39:58.207086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Getting quotas for user 4611d01617d645579ae3529c8f8f9de2 and project 109467986076453b893b8720a2b1144a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:39:58.240146 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ef90f4d-b4be-439e-ad12-3b85895b1d43 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 204 len: 0 microversion: 2.1 time: 0.300805 Jul 24 01:39:58.241207 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2808/5507] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:39:57 2022] DELETE /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:39:58.246628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:39:58.248788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:58.249665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:58.253072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:39:58.259018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.259731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.260736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.261354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.368424 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d01cb91e-8d30-4eac-bed7-1f759b37245b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.788166 Jul 24 01:39:58.375079 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2700/5508] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:39:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:39:58.386551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:39:58.387392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:58.403659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.404299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.405523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.406215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.452270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lazy-loading 'flavor' on Instance uuid 4f0686a7-1377-4d35-a57a-b3064e6de961 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:39:58.600551 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1854b1c0-f6c8-4420-b90a-61f5472f9d1b tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action" status: 202 len: 0 microversion: 2.1 time: 0.221702 Jul 24 01:39:58.606750 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2701/5509] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:39:58 2022] POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:39:58.613657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:58.614578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:58.624090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.624740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.625757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.626401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.698651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:58.713533 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-94ea50c9-18db-4907-94b2-1d8459712b75 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1327 microversion: 2.1 time: 0.469422 Jul 24 01:39:58.715621 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2809/5510] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:58 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1327 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:58.722218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f94d0ec-d202-4f14-a3dc-a4722eb039da tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:58.723263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f94d0ec-d202-4f14-a3dc-a4722eb039da tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:58.922553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f94d0ec-d202-4f14-a3dc-a4722eb039da tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:58.930148 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f94d0ec-d202-4f14-a3dc-a4722eb039da tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1241 microversion: 2.1 time: 0.213341 Jul 24 01:39:58.940946 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2810/5511] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:58 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:58.951226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:58.952227 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:58.960204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.960882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.961914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:58.963602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:58.980545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:58.990527 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-86d6db5b-d228-4af5-8447-800e8013de83 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1673 microversion: 2.1 time: 0.382112 Jul 24 01:39:59.002304 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2702/5512] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:58 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1673 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:59.284691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:59.314322 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8e6f272d-ae7f-45b5-985d-4c59b14b434f tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1509 microversion: 2.1 time: 0.380442 Jul 24 01:39:59.337575 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2811/5513] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:58 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:39:59.743205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:59.744429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:59.763226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:59.763932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:59.764896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:59.765488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:59.951080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:39:59.951812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:39:59.965825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:59.966882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:59.967714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:39:59.968352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:39:59.973061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:39:59.981595 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6d537fa5-0c5d-4b60-97ea-11c1bb054ba4 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1527 microversion: 2.1 time: 0.254065 Jul 24 01:39:59.992982 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2703/5514] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:59 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1527 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:00.011752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:00.013551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:00.025814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:00.026804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:00.028332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:00.030383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:00.148535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:00.170857 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25f96e87-1926-4276-9021-d70065f68cdb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1237 microversion: 2.1 time: 0.226355 Jul 24 01:40:00.172113 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2812/5515] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:39:59 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1237 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:00.178037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:00.191559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:00.198930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:00.199725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:00.200822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:00.201490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:00.259840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:00.274335 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c3ca4f93-c474-4f57-9a0a-806931f5db69 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1673 microversion: 2.1 time: 0.267707 Jul 24 01:40:00.275646 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2704/5516] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:00 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:00.338659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:00.339520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:00.350467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:00.351110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:00.355082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:00.356176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:00.625965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:00.700287 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22bf3794-ef79-4832-96a4-fb042e11108e tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1527 microversion: 2.1 time: 0.524676 Jul 24 01:40:00.712904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2813/5517] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:00 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1527 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:01.045522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:01.062019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-29e4d36a-26ea-4017-93fa-658bccf34de2 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1492 microversion: 2.1 time: 0.727574 Jul 24 01:40:01.079917 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2705/5518] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:00 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1492 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:01.088733 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:01.089427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.097855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.098697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.100102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.101089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.158559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:40:01.273817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:01.276074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.306730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.308041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.309198 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.310411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.315183 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:01.325416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb3e2a69-2c90-424d-af6b-26ff0a63b07b tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 204 len: 0 microversion: 2.1 time: 0.243873 Jul 24 01:40:01.327698 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2706/5519] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:40:01 2022] DELETE /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:40:01.341366 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-827937ef-cec7-4c1f-a259-a258e34340a3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:01.342444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-827937ef-cec7-4c1f-a259-a258e34340a3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.347543 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] HTTP exception thrown: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Request method failure captured: Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 HTTP/1.1 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KLTmcA_fMBLDsO5hZL0fMEDWn7GV7q0qEGLZYRjIaJ2s0BIhU_sn2WvWVkYS_emqBhpIHmFCWIzpxG1_i64gEz6UBNOv5fRe6zEKJrKuhDaXePjC117CLDlpMlLfVTROEci55rubNQqlRKmte-S29dAtmhz330oQIZhbAhxYGNhMP4 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 99fa4a8655d946dcbbbafdda043b2a57 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-413893664 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/99fa4a8655d946dcbbbafdda043b2a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99fa4a8655d946dcbbbafdda043b2a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_99fa4a8655d946dcbbbafdda043b2a57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99fa4a8655d946dcbbbafdda043b2a57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-413893664 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 99fa4a8655d946dcbbbafdda043b2a57 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-413893664 Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestMultiTenantJSON-413893664-project Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 9943ea411696482b8d288153ac2e8bbb Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-413893664-project Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: exception: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05'} Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:40:01.349499 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:01.354043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:01.355233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827937ef-cec7-4c1f-a259-a258e34340a3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.355233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827937ef-cec7-4c1f-a259-a258e34340a3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.355233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827937ef-cec7-4c1f-a259-a258e34340a3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.355233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-827937ef-cec7-4c1f-a259-a258e34340a3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.367679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Returning 404 to user: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:40:01.369061 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0df2d250-d349-45cb-ac28-3175d8a5e7dc tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 404 len: 111 microversion: 2.1 time: 0.654746 Jul 24 01:40:01.370169 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2814/5520] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:40:00 2022] DELETE /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 111 bytes in 656 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:40:01.378638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:01.388025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.399154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.400391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.402201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.408036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.474765 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-827937ef-cec7-4c1f-a259-a258e34340a3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action" status: 202 len: 0 microversion: 2.1 time: 0.144381 Jul 24 01:40:01.481043 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2707/5521] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:40:01 2022] POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:40:01.492687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:01.493208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.507846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.508308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.509689 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.515056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.526867 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:01.633719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:01.651838 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6d6cf76-3ddd-43bd-9055-dd1cec486ce5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1299 microversion: 2.1 time: 0.280282 Jul 24 01:40:01.653269 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2815/5522] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:01 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:01.659913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:01.660266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.666834 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:01.668537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.669100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.670206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.670778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.732397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:01.743403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b4cbf96-148c-4de6-8d70-7017ead97d38 tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1606 microversion: 2.1 time: 0.260861 Jul 24 01:40:01.744594 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2708/5523] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:01 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1606 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:01.753451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:01.753451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.761178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.762141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.763521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.764063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.927347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:01.958402 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba962b65-8b4a-4436-835e-e735e6f303a8 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1470 microversion: 2.1 time: 0.302483 Jul 24 01:40:01.960836 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2816/5524] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:01 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:01.973498 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:01.976232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:01.994539 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:01.996169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:01.997776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.001346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.062438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:02.074939 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ebae6a9f-8177-4378-845b-e5a8c608d179 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1527 microversion: 2.1 time: 0.327872 Jul 24 01:40:02.085760 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2709/5525] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:01 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1527 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:02.095262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Action: 'update', calling method: >, body: {"server": {"name": "a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05_new"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:02.096526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:02.121291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.121800 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.124834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.125406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.152879 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] HTTP exception thrown: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Request method failure captured: Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: request: PUT /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 HTTP/1.1 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 64 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KLTmcA_fMBLDsO5hZL0fMEDWn7GV7q0qEGLZYRjIaJ2s0BIhU_sn2WvWVkYS_emqBhpIHmFCWIzpxG1_i64gEz6UBNOv5fRe6zEKJrKuhDaXePjC117CLDlpMlLfVTROEci55rubNQqlRKmte-S29dAtmhz330oQIZhbAhxYGNhMP4 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 99fa4a8655d946dcbbbafdda043b2a57 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-413893664 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/99fa4a8655d946dcbbbafdda043b2a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99fa4a8655d946dcbbbafdda043b2a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_99fa4a8655d946dcbbbafdda043b2a57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99fa4a8655d946dcbbbafdda043b2a57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-413893664 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 99fa4a8655d946dcbbbafdda043b2a57 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-413893664 Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestMultiTenantJSON-413893664-project Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 9943ea411696482b8d288153ac2e8bbb Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-413893664-project Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: {"server": {"name": "a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05_new"}} Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: exception: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05', 'body': {'server': {'name': 'a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05_new'}}} Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 24 01:40:02.154705 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] Returning 404 to user: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:40:02.159239 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c96fa2e2-f7d3-45f9-a180-ae3440ac2a0c tempest-ServersNegativeTestMultiTenantJSON-413893664 tempest-ServersNegativeTestMultiTenantJSON-413893664-project] 10.222.0.27 "PUT /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 404 len: 111 microversion: 2.1 time: 0.069384 Jul 24 01:40:02.164453 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2710/5526] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:40:02 2022] PUT /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:40:02.173638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:02.174172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:02.191204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.191662 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.192452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.192895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.265028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:40:02.393122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:02.407677 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a15af10-730d-4e5b-835c-bfee7c2e11b3 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1498 microversion: 2.1 time: 0.439871 Jul 24 01:40:02.410214 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2817/5527] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:01 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1498 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:02.444508 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f03fe89-0348-4641-a0a3-a78490c98f65 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 204 len: 0 microversion: 2.1 time: 0.274350 Jul 24 01:40:02.446006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2711/5528] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:40:02 2022] DELETE /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:40:02.446980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-387ac973-6b6c-4edc-9af0-5db642511677 req-1b49711b-d1de-40ea-a900-db3c8e409183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3e6c8-eefb-480b-badb-78a2ee07ad73", "name": "network-vif-deleted", "tag": "2ed4f95f-c322-4ffb-89ef-412f2df8414c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:02.456059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:02.458082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-387ac973-6b6c-4edc-9af0-5db642511677 req-1b49711b-d1de-40ea-a900-db3c8e409183 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.458712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-387ac973-6b6c-4edc-9af0-5db642511677 req-1b49711b-d1de-40ea-a900-db3c8e409183 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.462048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:02.475488 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-387ac973-6b6c-4edc-9af0-5db642511677 req-1b49711b-d1de-40ea-a900-db3c8e409183 service nova] Creating event network-vif-deleted:2ed4f95f-c322-4ffb-89ef-412f2df8414c for instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 on n-h2-master-1 Jul 24 01:40:02.482414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.484027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.484760 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-387ac973-6b6c-4edc-9af0-5db642511677 req-1b49711b-d1de-40ea-a900-db3c8e409183 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043815 Jul 24 01:40:02.485773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.489354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.490109 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2818/5529] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:40:02.677151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:02.678024 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:02.693757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.698211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.699213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.699858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.720374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:02.734402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-86e41c0e-d1d0-4ec8-b3ec-2980dac9c4f9 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1533 microversion: 2.1 time: 0.282306 Jul 24 01:40:02.736126 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2712/5530] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:02 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1533 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:02.762522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:02.763154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:02.777717 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.778182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:02.779078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:02.780659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:03.022601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a5e8716f324b53b51e8d34cb704321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b2217fca247759ee6e9f15d150866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:03.034063 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed8e064c-8079-4491-9bfe-88839898734d tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 200 len: 1606 microversion: 2.1 time: 0.276859 Jul 24 01:40:03.037539 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2713/5531] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:02 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 1606 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:03.055028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:03.058043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:03.076704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:03.079074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:03.083311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:03.084047 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:03.541522 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:03.549605 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f09c0a6-9d04-4487-8776-78ec75ce45cb tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1367 microversion: 2.1 time: 0.882710 Jul 24 01:40:03.550415 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2819/5532] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:02 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1367 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:03.564913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:03.565641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:03.570514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:03.579553 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee3d96fd-458d-4e34-b769-87b2ffb0ca99 tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1470 microversion: 2.1 time: 0.538841 Jul 24 01:40:03.585663 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2714/5533] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:03 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1470 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:03.602747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:03.604653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:03.605630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:03.609398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:03.763496 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:03.764949 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:03.783485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:03.784092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:03.785155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:03.786662 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:04.813664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:04.822648 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14287e15-a46c-4463-8ff9-f76f479aaebf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1498 microversion: 2.1 time: 1.271163 Jul 24 01:40:04.828732 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2820/5534] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:03 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1498 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:04.833904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:04.839544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] [instance: 88b3e6c8-eefb-480b-badb-78a2ee07ad73] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:04.848875 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:04.851539 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:04.851989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:04.853226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:04.859427 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a00bff0-ea38-4f45-8001-7143d28a3b05 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1533 microversion: 2.1 time: 1.110766 Jul 24 01:40:04.862006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:04.871774 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2715/5535] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:03 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1533 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:04.883659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-703c8ae4-d7fc-422d-a2f2-70a1df8cd554 req-23d311a8-140c-45a0-aee1-da6356f0fbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea392706-2c21-4d1b-9745-ae358a86e2f6", "tag": "5aa7e2e7-b966-4365-9881-676e3ebc4d5a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:04.886550 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] HTTP exception thrown: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 could not be found. Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Request method failure captured: Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 HTTP/1.1 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KB82qt59Jo-oxIvUJAPvsaw5akn_eDWVXslD9r7Jve7msH7AwSbjX431vT3GmYrZX0k0w5oJUn7XXheNTs6zlQjJ9lxDx7oOwlmPBOwVJldXxk0wvoZxvvs9Q0BtBdnLlMhrrh0hUt96yztddkMWYVNE4jdjTVsg9GdU4jB-SXGJAY Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b97b2217fca247759ee6e9f15d150866", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b97b2217fca247759ee6e9f15d150866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: b97b2217fca247759ee6e9f15d150866 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1581516256 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: f6a5e8716f324b53b51e8d34cb704321 Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1581516256-project Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 could not be found. Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '88b3e6c8-eefb-480b-badb-78a2ee07ad73'} Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 could not be found. Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 could not be found. Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:04.888232 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 could not be found. Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Returning 404 to user: Instance 88b3e6c8-eefb-480b-badb-78a2ee07ad73 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b502f9b5-fd94-4a58-8555-c24a8ded6e1a tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73" status: 404 len: 111 microversion: 2.1 time: 0.061692 Jul 24 01:40:04.892758 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2821/5536] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:04 2022] GET /compute/v2.1/servers/88b3e6c8-eefb-480b-badb-78a2ee07ad73 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:40:04.903900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-703c8ae4-d7fc-422d-a2f2-70a1df8cd554 req-23d311a8-140c-45a0-aee1-da6356f0fbb0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:04.904431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-703c8ae4-d7fc-422d-a2f2-70a1df8cd554 req-23d311a8-140c-45a0-aee1-da6356f0fbb0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:04.906914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:04.909752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:04.917634 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-703c8ae4-d7fc-422d-a2f2-70a1df8cd554 req-23d311a8-140c-45a0-aee1-da6356f0fbb0 service nova] Creating event network-changed:5aa7e2e7-b966-4365-9881-676e3ebc4d5a for instance ea392706-2c21-4d1b-9745-ae358a86e2f6 on n-h2-master-1 Jul 24 01:40:04.924462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:04.925184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:04.925313 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-703c8ae4-d7fc-422d-a2f2-70a1df8cd554 req-23d311a8-140c-45a0-aee1-da6356f0fbb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051711 Jul 24 01:40:04.926635 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2716/5537] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:04.926997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:04.927475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:04.935279 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:04.936432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:04.945123 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:04.945967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:04.948214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:04.949907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:05.363497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e881888eab24d93b513f03556871677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067f6fe185724ef0931a4cfb8680cfba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:05.376877 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2e5382aa-5e83-4dad-97b4-30eee7038b0c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 200 len: 1470 microversion: 2.1 time: 0.448029 Jul 24 01:40:05.389274 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2717/5538] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:04 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:05.394416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b21c7146-c27f-4e16-a1e6-483ef762f12e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] Calling method '.version_select at 0x7f05ea041430>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:05.422093 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b21c7146-c27f-4e16-a1e6-483ef762f12e tempest-ServerActionsTestJSON-1581516256 tempest-ServerActionsTestJSON-1581516256-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931508585" status: 202 len: 0 microversion: 2.1 time: 0.031417 Jul 24 01:40:05.424306 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2718/5539] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:40:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931508585 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:40:05.485325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:05.486956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-32363bc4-5b33-41aa-9840-4e622e0379b0 req-da0dc3af-99c7-4db9-836c-8802f2f2f9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9486a9-c2ba-4d76-b940-6368fed3d08a", "name": "network-vif-deleted", "tag": "98a86406-0ed6-4a56-afe8-00b0bdb8bea2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:05.498155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03f72f18-0188-4af9-b8a1-b0084118ac4b tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1367 microversion: 2.1 time: 0.601504 Jul 24 01:40:05.498973 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2822/5540] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:04 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:05.526780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-32363bc4-5b33-41aa-9840-4e622e0379b0 req-da0dc3af-99c7-4db9-836c-8802f2f2f9ce service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:05.527243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-32363bc4-5b33-41aa-9840-4e622e0379b0 req-da0dc3af-99c7-4db9-836c-8802f2f2f9ce service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:05.555254 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-32363bc4-5b33-41aa-9840-4e622e0379b0 req-da0dc3af-99c7-4db9-836c-8802f2f2f9ce service nova] Creating event network-vif-deleted:98a86406-0ed6-4a56-afe8-00b0bdb8bea2 for instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a on n-h1-master-1 Jul 24 01:40:05.569415 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-32363bc4-5b33-41aa-9840-4e622e0379b0 req-da0dc3af-99c7-4db9-836c-8802f2f2f9ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082538 Jul 24 01:40:05.570474 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2719/5541] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:05.846533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:05.847216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:05.872440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:05.872645 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:05.873470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:05.874412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:05.885074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:05.885830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:05.921523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:05.924384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:05.925636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:05.927711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.205633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:06.217106 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b870cba1-0f85-40e8-83a2-dffc59870a13 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1491 microversion: 2.1 time: 0.343076 Jul 24 01:40:06.226385 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2720/5542] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:05 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1491 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:06.255749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:06.266385 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a0f9bac3-53a9-4cd8-9eb5-804309bd0211 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1501 microversion: 2.1 time: 0.423986 Jul 24 01:40:06.284714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:06.285377 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2823/5543] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:05 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1501 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:06.286323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:06.294799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.295502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.296870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.297510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.329894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lazy-loading 'flavor' on Instance uuid 4f0686a7-1377-4d35-a57a-b3064e6de961 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:40:06.395284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:06.396020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] [instance: 2d9486a9-c2ba-4d76-b940-6368fed3d08a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:06.403243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.404785 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.405777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.406642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.430170 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] HTTP exception thrown: Instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a could not be found. Jul 24 01:40:06.431505 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b7c69582-265b-4ea2-8c82-28878038eadd tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action" status: 202 len: 0 microversion: 2.1 time: 0.150607 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Request method failure captured: Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a HTTP/1.1 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KI6TEklokqGw3ySjU1AX8LC6h5HSnYv9B9d2Nd7L3LL9SdKxJtjbU4-hVT9GQ1WSxA4W3FofZFg5eMrXAuz_L9yqpMuHsS6-azdOGwsHx6sptEHl2VIJv1GWg7WDXRNPfs5ukiIiO91_FVa2TjQ6xz5LJFn-Haxk1oVafjbjSV4NuQ Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 067f6fe185724ef0931a4cfb8680cfba Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesBackupsTest-1068997336 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/067f6fe185724ef0931a4cfb8680cfba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/067f6fe185724ef0931a4cfb8680cfba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_067f6fe185724ef0931a4cfb8680cfba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/067f6fe185724ef0931a4cfb8680cfba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesBackupsTest-1068997336 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 067f6fe185724ef0931a4cfb8680cfba Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesBackupsTest-1068997336 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesBackupsTest-1068997336-project Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 6e881888eab24d93b513f03556871677 Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesBackupsTest-1068997336-project Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a could not be found. Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '2d9486a9-c2ba-4d76-b940-6368fed3d08a'} Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a could not be found. Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a could not be found. Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:06.431880 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:06.435964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:06.435964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:06.435964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:06.435964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:40:06.435964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:40:06.435964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a could not be found. Jul 24 01:40:06.435964 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:06.437217 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2721/5544] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:40:06 2022] POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:40:06.437311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] Returning 404 to user: Instance 2d9486a9-c2ba-4d76-b940-6368fed3d08a could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:40:06.437311 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9a9f2430-bc62-4a91-9fa6-c56ae2fbbb8c tempest-VolumesBackupsTest-1068997336 tempest-VolumesBackupsTest-1068997336-project] 10.222.0.27 "GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a" status: 404 len: 111 microversion: 2.1 time: 0.046797 Jul 24 01:40:06.437979 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2824/5545] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:06 2022] GET /compute/v2.1/servers/2d9486a9-c2ba-4d76-b940-6368fed3d08a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:40:06.461307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:06.463494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:06.471430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.471942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.472932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.473402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.516047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:06.517054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:06.530102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.532045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.533107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:06.534900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:06.813033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:06.820907 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-56ca1395-8941-4136-917f-7819609aafe1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1509 microversion: 2.1 time: 0.384146 Jul 24 01:40:06.824501 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2722/5546] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:06 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:06.872560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:06.881308 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f80ebb4-65db-4336-90e0-46d306570987 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1367 microversion: 2.1 time: 0.369692 Jul 24 01:40:06.883539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2825/5547] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:06 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:07.236630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:07.238293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:07.252132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.252592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:07.253467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.254579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:07.339824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.341037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:07.344975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lazy-loading 'fault' on Instance uuid a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:40:07.408004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6cea44a68f04b52972b770230b5130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0193195c3004cca93fa3f343b4b4f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:07.424096 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf59b595-35ab-4375-85a2-65b6ec45c271 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 200 len: 1317 microversion: 2.1 time: 0.193631 Jul 24 01:40:07.438755 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2723/5548] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:07 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:07.628612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-65902c78-db02-45e7-b303-e237f0fc96ee req-279eec50-d817-4f10-a84e-eda9efec6d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05", "name": "network-vif-deleted", "tag": "bf57cefa-67b9-44ce-a0d3-1efc9c97e743"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:07.647471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-65902c78-db02-45e7-b303-e237f0fc96ee req-279eec50-d817-4f10-a84e-eda9efec6d1f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.649587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-65902c78-db02-45e7-b303-e237f0fc96ee req-279eec50-d817-4f10-a84e-eda9efec6d1f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:07.676160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-65902c78-db02-45e7-b303-e237f0fc96ee req-279eec50-d817-4f10-a84e-eda9efec6d1f service nova] Creating event network-vif-deleted:bf57cefa-67b9-44ce-a0d3-1efc9c97e743 for instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 on n-h2-master-1 Jul 24 01:40:07.688807 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-65902c78-db02-45e7-b303-e237f0fc96ee req-279eec50-d817-4f10-a84e-eda9efec6d1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066460 Jul 24 01:40:07.694789 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2826/5549] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:07.841333 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:07.842889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:07.859807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.861855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:07.866315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.867769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:07.886947 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:07.903031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:07.904509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:07.926403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.926862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:07.929578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:07.930232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:08.173178 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:08.228715 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:08.345294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:08.371369 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5567710d-fa9e-4ed4-af84-6ed9afdd09bf tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1492 microversion: 2.1 time: 0.532362 Jul 24 01:40:08.371986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:08.389160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ecc05d76-2f52-4f0c-bc8b-a43d4a87de7e tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1367 microversion: 2.1 time: 0.492210 Jul 24 01:40:08.390364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2827/5550] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:07 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:08.391006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2724/5551] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:07 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1492 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:08.398203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-296c75eb-65aa-4190-9376-38bb2bb40e15 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:08.398977 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-296c75eb-65aa-4190-9376-38bb2bb40e15 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:08.406448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296c75eb-65aa-4190-9376-38bb2bb40e15 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:08.407221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296c75eb-65aa-4190-9376-38bb2bb40e15 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:08.408391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296c75eb-65aa-4190-9376-38bb2bb40e15 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:08.409107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-296c75eb-65aa-4190-9376-38bb2bb40e15 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:08.447283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:08.447928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] [instance: a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:08.454618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:08.455070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:08.455850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:08.456288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:08.515361 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] HTTP exception thrown: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Request method failure captured: Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 HTTP/1.1 Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KLBGDCRsjPyatY4Hxjo21F-1hn4pSq9kvkvLmlJEgldua06tm-kOvMzymbOP89oXYUoECnILWG_zgoiOxKC06ISGftH0DgTnOFLUH9rmBbPxX7kfYkkE2jswRzURnwVjxB3BMFrofqC4EzCRD1oTh7o9gUwCWKvo6qRZU-oIrULdmg Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a0193195c3004cca93fa3f343b4b4f1e Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1199597393 Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0193195c3004cca93fa3f343b4b4f1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0193195c3004cca93fa3f343b4b4f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0193195c3004cca93fa3f343b4b4f1e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0193195c3004cca93fa3f343b4b4f1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1199597393 Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a0193195c3004cca93fa3f343b4b4f1e Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1199597393 Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1199597393-project Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a6cea44a68f04b52972b770230b5130a Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1199597393-project Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: exception: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05'} Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:08.516937 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:40:08.520992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] Returning 404 to user: Instance a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:40:08.526729 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d94365ea-847e-4d6b-9e13-92101cf1b031 tempest-ServersNegativeTestMultiTenantJSON-1199597393 tempest-ServersNegativeTestMultiTenantJSON-1199597393-project] 10.222.0.27 "GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05" status: 404 len: 111 microversion: 2.1 time: 0.084162 Jul 24 01:40:08.530573 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2725/5552] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:08 2022] GET /compute/v2.1/servers/a1b474ce-6b75-4f5f-97d5-a6c1ff5f3e05 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:40:08.554640 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-296c75eb-65aa-4190-9376-38bb2bb40e15 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action" status: 202 len: 0 microversion: 2.1 time: 0.160065 Jul 24 01:40:08.560815 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2828/5553] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:40:08 2022] POST /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:40:08.569728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:08.570363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:08.586694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:08.591008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:08.598535 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:08.599248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:09.025730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:09.039649 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4de1e277-4e4a-4e24-b1d8-813a3eeb88d6 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1498 microversion: 2.1 time: 0.474663 Jul 24 01:40:09.040902 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2726/5554] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:08 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1498 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:09.408719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:09.410270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:09.422189 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:09.428809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:09.430023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:09.432308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:09.435079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:10.059104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:10.059916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:10.070216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:10.074838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:10.076600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:10.079467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:10.585202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:10.595679 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d9d0358-3fe1-49f3-b237-f73638b96278 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1367 microversion: 2.1 time: 1.192330 Jul 24 01:40:10.606947 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2829/5555] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:09 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1367 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:10.938918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:10.964149 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-70574858-276e-44bf-92e1-8556104ffa1a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1498 microversion: 2.1 time: 0.910113 Jul 24 01:40:10.964737 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2727/5556] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:10 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1498 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:11.388207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9474a364-a3b4-4981-8133-834e75b431ea req-deef2316-9c19-4129-b2f8-b8bad2c89575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea392706-2c21-4d1b-9745-ae358a86e2f6", "name": "network-vif-plugged", "status": "completed", "tag": "5aa7e2e7-b966-4365-9881-676e3ebc4d5a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:11.409452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9474a364-a3b4-4981-8133-834e75b431ea req-deef2316-9c19-4129-b2f8-b8bad2c89575 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:11.411708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9474a364-a3b4-4981-8133-834e75b431ea req-deef2316-9c19-4129-b2f8-b8bad2c89575 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:11.434015 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9474a364-a3b4-4981-8133-834e75b431ea req-deef2316-9c19-4129-b2f8-b8bad2c89575 service nova] Creating event network-vif-plugged:5aa7e2e7-b966-4365-9881-676e3ebc4d5a for instance ea392706-2c21-4d1b-9745-ae358a86e2f6 on n-h2-master-1 Jul 24 01:40:11.450602 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9474a364-a3b4-4981-8133-834e75b431ea req-deef2316-9c19-4129-b2f8-b8bad2c89575 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064468 Jul 24 01:40:11.454563 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2830/5557] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:11.626073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:11.639492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:11.676626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:11.679835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:11.682984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:11.683647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:11.981562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:11.982304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:12.003025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:12.003482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:12.004264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:12.004702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:12.718612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:12.732539 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e9b52855-e808-4139-8de6-ae97f890f7fc tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1367 microversion: 2.1 time: 1.111051 Jul 24 01:40:12.733134 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2728/5558] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:11 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1367 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:12.955375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:12.990538 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-202091d1-41ea-47b0-b115-60de7e47601c tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1498 microversion: 2.1 time: 1.012396 Jul 24 01:40:13.003843 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2831/5559] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:11 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1498 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:13.750977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:13.753160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:13.766251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:13.767058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:13.771128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:13.771586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:14.013475 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:14.014392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:14.036974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:14.039378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:14.040639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:14.049525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:14.094278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:14.104033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-126773ef-d269-4eb9-9782-896ce998fe57 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1367 microversion: 2.1 time: 0.357387 Jul 24 01:40:14.107194 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2729/5560] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:13 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:14.443932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:14.453369 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7d16690d-7571-4e4c-a027-b3b8a7ae0347 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1501 microversion: 2.1 time: 0.446355 Jul 24 01:40:14.465991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2832/5561] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:14 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1501 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:14.472353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:14.472843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:14.497068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:14.502553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:14.503824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:14.507082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:14.538645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:40:14.685487 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb0a5005-3d16-4054-8151-6e0a18ee7b6d tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 204 len: 0 microversion: 2.1 time: 0.216978 Jul 24 01:40:14.686740 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2730/5562] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:40:14 2022] DELETE /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:40:14.695473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:14.696225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:14.707565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:14.708017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:14.712213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:14.712683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:15.070338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:15.075249 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:15.084254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a7d525e5-faae-4b9f-8dd4-4b69694af5a1 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1507 microversion: 2.1 time: 0.393327 Jul 24 01:40:15.088331 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2833/5563] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:14 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:15.124116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:15.124700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:15.140964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:15.141696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:15.142749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:15.143371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:15.427995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:15.445616 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a929759a-05f3-4a7e-bc7e-27fe4bc160f5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1557 microversion: 2.1 time: 0.326306 Jul 24 01:40:15.450151 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2731/5564] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:15 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1557 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:15.472823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24b36697-84c7-41d6-ae98-b0c316ced2d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:15.473539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24b36697-84c7-41d6-ae98-b0c316ced2d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:15.488813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24b36697-84c7-41d6-ae98-b0c316ced2d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:15.489417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24b36697-84c7-41d6-ae98-b0c316ced2d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:15.490713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24b36697-84c7-41d6-ae98-b0c316ced2d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:15.491376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24b36697-84c7-41d6-ae98-b0c316ced2d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:15.644121 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24b36697-84c7-41d6-ae98-b0c316ced2d4 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180703 Jul 24 01:40:15.645478 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2834/5565] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:40:15 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:16.108210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:16.108843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:16.120706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:16.124456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:16.126528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:16.127900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:17.866124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:17.877373 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bdb5486f-f429-4d3a-b11a-3e60f5600e8a tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1507 microversion: 2.1 time: 1.775082 Jul 24 01:40:17.881012 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2732/5566] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:16 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1507 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:18.897619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:18.898204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:18.918148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:18.918896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:18.920034 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:18.920489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:19.045069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:19.056354 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40c74c3b-3792-429d-a3ac-1850e532cd51 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1465 microversion: 2.1 time: 0.161716 Jul 24 01:40:19.061007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2835/5567] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:18 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:19.267701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e6c5a5a9-55c8-4c71-8462-f55f59f39a90 req-3f43edc1-4d20-4b41-8afd-d8da4b8e3403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0686a7-1377-4d35-a57a-b3064e6de961", "name": "network-vif-deleted", "tag": "7cf0ba47-187d-4298-b47b-41da2380b05d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:19.292914 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:19.298772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e6c5a5a9-55c8-4c71-8462-f55f59f39a90 req-3f43edc1-4d20-4b41-8afd-d8da4b8e3403 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:19.302362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e6c5a5a9-55c8-4c71-8462-f55f59f39a90 req-3f43edc1-4d20-4b41-8afd-d8da4b8e3403 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:19.357628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e6c5a5a9-55c8-4c71-8462-f55f59f39a90 req-3f43edc1-4d20-4b41-8afd-d8da4b8e3403 service nova] Creating event network-vif-deleted:7cf0ba47-187d-4298-b47b-41da2380b05d for instance 4f0686a7-1377-4d35-a57a-b3064e6de961 on n-h1-master-1 Jul 24 01:40:19.373635 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e6c5a5a9-55c8-4c71-8462-f55f59f39a90 req-3f43edc1-4d20-4b41-8afd-d8da4b8e3403 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113426 Jul 24 01:40:19.379683 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2733/5568] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:20.074662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:20.075305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:20.088035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:20.088507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:20.105095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:20.108402 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:20.271408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:20.271872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:20.272338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lazy-loading 'fault' on Instance uuid 4f0686a7-1377-4d35-a57a-b3064e6de961 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:40:20.450630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4242cf259f9480b87435fdd16e04610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a373807910a0427bb9ae0955d13bf1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:20.460296 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-273e6a96-0804-4d25-a079-10e1a6c14926 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 200 len: 1303 microversion: 2.1 time: 0.391066 Jul 24 01:40:20.460828 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2836/5569] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:20 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 1303 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:21.471250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6d8abe9a-6847-48d0-af99-55d6005f9dcd req-fb72ad92-ca03-48f3-8471-65814b965ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea392706-2c21-4d1b-9745-ae358a86e2f6", "tag": "5aa7e2e7-b966-4365-9881-676e3ebc4d5a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:21.488838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6d8abe9a-6847-48d0-af99-55d6005f9dcd req-fb72ad92-ca03-48f3-8471-65814b965ae8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:21.491878 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:21.496724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6d8abe9a-6847-48d0-af99-55d6005f9dcd req-fb72ad92-ca03-48f3-8471-65814b965ae8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:21.500325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] [instance: 4f0686a7-1377-4d35-a57a-b3064e6de961] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:21.511831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:21.513460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:21.517728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:21.520864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:21.530727 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6d8abe9a-6847-48d0-af99-55d6005f9dcd req-fb72ad92-ca03-48f3-8471-65814b965ae8 service nova] Creating event network-changed:5aa7e2e7-b966-4365-9881-676e3ebc4d5a for instance ea392706-2c21-4d1b-9745-ae358a86e2f6 on n-h2-master-1 Jul 24 01:40:21.553888 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6d8abe9a-6847-48d0-af99-55d6005f9dcd req-fb72ad92-ca03-48f3-8471-65814b965ae8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086691 Jul 24 01:40:21.557919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] HTTP exception thrown: Instance 4f0686a7-1377-4d35-a57a-b3064e6de961 could not be found. Jul 24 01:40:21.561802 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2734/5570] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Request method failure captured: Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 HTTP/1.1 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KLVf64JMtm-qTiZd8eVobkMbxRBfKJ0KIpXh0yfyyRCRGQirLdAPwEseS_UvRYo-CVeKoiPkDzMgTzBqGLYL5omoY6MK7ldFJU8IGJnM9wBHPDlw-6ZCszmVTSkA04k7wS5HWf41VKTOk6KhvYVYhipy7THrsvxG20tcJKIJP0eam4 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a373807910a0427bb9ae0955d13bf1fa Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestServerAdvancedOps-1452082777 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a373807910a0427bb9ae0955d13bf1fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a373807910a0427bb9ae0955d13bf1fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a373807910a0427bb9ae0955d13bf1fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a373807910a0427bb9ae0955d13bf1fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestServerAdvancedOps-1452082777 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a373807910a0427bb9ae0955d13bf1fa Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestServerAdvancedOps-1452082777 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestServerAdvancedOps-1452082777-project Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: a4242cf259f9480b87435fdd16e04610 Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestServerAdvancedOps-1452082777-project Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 4f0686a7-1377-4d35-a57a-b3064e6de961 could not be found. Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '4f0686a7-1377-4d35-a57a-b3064e6de961'} Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0686a7-1377-4d35-a57a-b3064e6de961 could not be found. Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0686a7-1377-4d35-a57a-b3064e6de961 could not be found. Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:40:21.566448 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0686a7-1377-4d35-a57a-b3064e6de961 could not be found. Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] Returning 404 to user: Instance 4f0686a7-1377-4d35-a57a-b3064e6de961 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-72010f4f-7dda-466b-8028-f1f545875e01 tempest-TestServerAdvancedOps-1452082777 tempest-TestServerAdvancedOps-1452082777-project] 10.222.0.27 "GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961" status: 404 len: 111 microversion: 2.1 time: 0.080671 Jul 24 01:40:21.579971 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2837/5571] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:21 2022] GET /compute/v2.1/servers/4f0686a7-1377-4d35-a57a-b3064e6de961 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:40:33.663853 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:33.665060 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:34.550220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-617648608", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:34.651737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] validate_networks() for [('4b74a05d-85b6-46aa-ba58-96551c2826a4', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:40:36.255266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:40:36.256132 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:40:36.256398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:40:36.256576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:40:36.257193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:40:36.288993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:36.290850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:36.294919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:36.295610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:36.337035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Getting quotas for project faa2aefb6f8846fc9211fec841a4351d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:40:36.344872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Getting quotas for user d7cb0037a91f461f8f39e28fe3c1ba85 and project faa2aefb6f8846fc9211fec841a4351d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:40:36.359245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:40:36.362791 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:40:36.471921 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0df1a562-6908-4711-88a0-f24a7f277dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.811471 Jul 24 01:40:36.474039 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2735/5572] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:40:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:40:36.488735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2cf80403-7a0d-4a75-9990-7e5d1beda4bd tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:36.489369 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2cf80403-7a0d-4a75-9990-7e5d1beda4bd tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:36.511557 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:36.521637 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=20 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:36.690012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2cf80403-7a0d-4a75-9990-7e5d1beda4bd tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:36.701763 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2cf80403-7a0d-4a75-9990-7e5d1beda4bd tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1222 microversion: 2.1 time: 0.218396 Jul 24 01:40:36.702357 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2838/5573] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:36 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:37.721640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0817428c-5a92-4e3f-8f8d-e794588905a5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:37.723859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0817428c-5a92-4e3f-8f8d-e794588905a5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:37.974102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0817428c-5a92-4e3f-8f8d-e794588905a5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:37.982700 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0817428c-5a92-4e3f-8f8d-e794588905a5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1222 microversion: 2.1 time: 0.267339 Jul 24 01:40:37.983292 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2736/5574] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:37 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1222 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:38.999281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:38.999895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:39.037470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:39.038230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:39.039060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:39.039506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:39.227015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:39.238473 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ecf919b4-b26c-4134-b106-e889b2652ce7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1274 microversion: 2.1 time: 0.242896 Jul 24 01:40:39.239080 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2839/5575] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:38 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:40.262246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:40.263169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:40.278822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:40.279285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:40.287396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:40.288196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:40.924355 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:40.941514 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3e25035b-7914-4c4a-9daf-ab6ffb611ffc tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1280 microversion: 2.1 time: 0.682657 Jul 24 01:40:40.944149 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2737/5576] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:40 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1280 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:41.964207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:41.965597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:41.989643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:41.990713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:41.993468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:41.994469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:42.190517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:42.230320 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c8cbdbc-2035-4522-8f92-7fabb2acf7ee tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1280 microversion: 2.1 time: 0.263883 Jul 24 01:40:42.245973 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2840/5577] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:41 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:40:43.252640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:43.254587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:43.262403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:43.275109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:43.276360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:43.277330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:45.146060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:45.199130 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-43b1e08a-427e-4821-a905-ba7421ee611f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1322 microversion: 2.1 time: 1.950484 Jul 24 01:40:45.219603 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2738/5578] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:43 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1322 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:46.224092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:46.239536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:46.287832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:46.287832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:46.287832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:46.293430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:46.694005 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:47.341920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:47.351341 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-acdfb6e2-3750-4226-8a67-03e61b9d9da5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1322 microversion: 2.1 time: 1.134601 Jul 24 01:40:47.355985 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2841/5579] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:46 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1322 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:47.995083 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f0047b0e-c2f9-4ca3-8291-3e4d9c102626 req-ddd09ae1-c155-4502-9261-5d73303df845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da198e7f-4f98-4d3e-99eb-72d3b7c4b249", "tag": "391222be-5600-49e9-8c8b-598086a1ddae"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:48.003541 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:48.004303 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:48.051520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f0047b0e-c2f9-4ca3-8291-3e4d9c102626 req-ddd09ae1-c155-4502-9261-5d73303df845 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:48.056551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f0047b0e-c2f9-4ca3-8291-3e4d9c102626 req-ddd09ae1-c155-4502-9261-5d73303df845 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:48.096780 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f0047b0e-c2f9-4ca3-8291-3e4d9c102626 req-ddd09ae1-c155-4502-9261-5d73303df845 service nova] Creating event network-changed:391222be-5600-49e9-8c8b-598086a1ddae for instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 on n-h1-master-1 Jul 24 01:40:48.104894 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f0047b0e-c2f9-4ca3-8291-3e4d9c102626 req-ddd09ae1-c155-4502-9261-5d73303df845 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114805 Jul 24 01:40:48.135812 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2739/5580] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:40:48.373527 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:48.374279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:48.393758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:48.394230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:48.395035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:48.395480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:49.818270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:49.826460 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d16b3ff-a385-4510-9cb4-25c25248a6df tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1322 microversion: 2.1 time: 1.459656 Jul 24 01:40:49.827066 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2842/5581] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:48 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1322 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:50.845313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:50.846228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:50.867843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:50.868506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:50.870564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:50.871175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:51.608837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:51.621454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a8cedf6-f77b-4bcf-b57d-f36e00f0d963 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1322 microversion: 2.1 time: 0.782367 Jul 24 01:40:51.627037 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2740/5582] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:50 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:52.638662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:52.639536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:52.650632 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:52.651104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:52.652011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:52.652657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:54.016566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:54.029744 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2db6a5d1-4c94-4b29-951c-58a998f6dee6 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1322 microversion: 2.1 time: 1.395759 Jul 24 01:40:54.037094 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2843/5583] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:52 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1322 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:55.055079 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:55.055936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:55.068579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:55.071693 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:55.072877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:55.075574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:55.783398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:55.795918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d6160459-5014-43c4-b8d5-7142a8b57a33 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1322 microversion: 2.1 time: 0.746379 Jul 24 01:40:55.797873 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2741/5584] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:55 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:56.016626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-135aab60-3927-4591-957a-56aa5243c32c req-998118c0-3849-44dd-a5c3-0b909b68ad0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da198e7f-4f98-4d3e-99eb-72d3b7c4b249", "name": "network-vif-plugged", "status": "completed", "tag": "391222be-5600-49e9-8c8b-598086a1ddae"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:56.034218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-135aab60-3927-4591-957a-56aa5243c32c req-998118c0-3849-44dd-a5c3-0b909b68ad0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:56.035246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-135aab60-3927-4591-957a-56aa5243c32c req-998118c0-3849-44dd-a5c3-0b909b68ad0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:56.072821 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-135aab60-3927-4591-957a-56aa5243c32c req-998118c0-3849-44dd-a5c3-0b909b68ad0f service nova] Creating event network-vif-plugged:391222be-5600-49e9-8c8b-598086a1ddae for instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 on n-h1-master-1 Jul 24 01:40:56.083562 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-135aab60-3927-4591-957a-56aa5243c32c req-998118c0-3849-44dd-a5c3-0b909b68ad0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070534 Jul 24 01:40:56.086385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2844/5585] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:40:56.813632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:56.814827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:56.825412 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:56.839289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:56.840765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:56.842008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:57.646693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:57.684888 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-35783bbc-4bf3-4d03-a0c5-2b0933730446 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1322 microversion: 2.1 time: 0.872721 Jul 24 01:40:57.694596 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2742/5586] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:56 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1322 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:58.709523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:58.710659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:58.731850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:58.732416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:58.736771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:58.738018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:59.082009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:59.100890 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-15a8df53-2dfe-4ba0-84ec-ebed42c59fd5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1516 microversion: 2.1 time: 0.396438 Jul 24 01:40:59.101620 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2845/5587] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:58 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:40:59.134220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:40:59.135208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:59.148419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:59.149164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:59.150589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:59.151192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:59.181767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lazy-loading 'flavor' on Instance uuid da198e7f-4f98-4d3e-99eb-72d3b7c4b249 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:40:59.366235 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e362fe38-42f3-4b1f-b153-93d0de47e108 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action" status: 200 len: 32 microversion: 2.1 time: 0.251766 Jul 24 01:40:59.369593 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2743/5588] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:40:59 2022] POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:40:59.377703 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:40:59.378565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:40:59.388320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:59.392022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:59.395116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:40:59.396066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:40:59.981708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:40:59.990659 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d02a2b87-f5dc-475a-baa4-884b2590d401 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.615365 Jul 24 01:40:59.992726 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2846/5589] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:40:59 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:01.015647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:01.016594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:01.032886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:01.033446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:01.034398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:01.035071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:01.627383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:01.636184 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8d3072c2-afd6-4ede-b255-8d11602b5452 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.631128 Jul 24 01:41:01.639793 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2744/5590] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:01 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:02.655980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:02.656860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:02.667879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:02.669388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:02.680787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:02.681495 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:03.023655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:03.036749 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1b46cade-6488-40cf-971c-769cc012e409 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.384533 Jul 24 01:41:03.046832 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2847/5591] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:02 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:04.054158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:04.054876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:04.062063 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:04.064718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:04.065298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:04.066331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:04.066789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:04.074326 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:04.328404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:04.346820 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be192892-5389-4816-9c60-53e142212501 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.296543 Jul 24 01:41:04.352041 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2745/5592] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:04 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:05.369188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:05.369943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:05.387600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:05.388059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:05.388944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:05.396869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:05.689148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:05.699638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a572861-7fc5-43b7-8ac5-f86bb70c6dd9 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.335104 Jul 24 01:41:05.701192 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2848/5593] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:05 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:06.719900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:06.721101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:06.734696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:06.736023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:06.737565 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:06.739971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:07.012567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:07.024095 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd187c32-a3f6-4040-9f22-0a3067b4fc75 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.309154 Jul 24 01:41:07.028001 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2746/5594] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:06 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:08.042550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:08.043170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:08.054705 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=25 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:08.060794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:08.061538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:08.062543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:08.065081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:08.081398 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=57 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:08.516843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:08.543230 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b3d26060-4b2a-4884-b264-4bcef6e84262 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.503524 Jul 24 01:41:08.545096 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2849/5595] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:08 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:09.564477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:09.565737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:09.577483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:09.578248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:09.579215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:09.579828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:09.829076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:09.839439 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d0d1b93c-ac06-4fc8-ac9d-82bec97bbf0f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.281676 Jul 24 01:41:09.852644 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2747/5596] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:09 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:10.872421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:10.873956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:10.900943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:10.906270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:10.907359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:10.910108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:11.510809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:11.522868 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f545eeee-f214-47c6-b681-7f2fedae8037 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.667345 Jul 24 01:41:11.533240 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2850/5597] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:10 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:12.542318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:12.543638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:12.556073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:12.564430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:12.565269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:12.565743 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:12.951172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:12.972963 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-db95b51b-afbf-41f9-853f-03451af09ab3 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.435575 Jul 24 01:41:12.973717 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2748/5598] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:12 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:13.993729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:13.996367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:14.042946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:14.044413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:14.046624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:14.047070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:14.400671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:14.412364 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa6cf900-7da9-480a-8967-a058ca1e2ef5 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.421168 Jul 24 01:41:14.413021 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2851/5599] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:13 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:15.429483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:15.432289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:15.444292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:15.445275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:15.446289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:15.447013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:16.167515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:16.175798 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a904d7c-efd3-4ec4-b18f-78e4add1ce97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.751210 Jul 24 01:41:16.176867 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2749/5600] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:15 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:17.195695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:17.196618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:17.218768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:17.218768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:17.218768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:17.218768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:17.600598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:17.611113 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9fa76054-70c9-44b6-a242-1c2c8887f6c0 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.421256 Jul 24 01:41:17.611704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2852/5601] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:17 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:18.635175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:18.636305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:18.643231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:18.650248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:18.651262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:18.651869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:19.051666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:19.064264 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb8017b1-c17a-4a54-a934-b2da9b4a9379 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.431546 Jul 24 01:41:19.066837 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2750/5602] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:18 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:20.092649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:20.093998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:20.109174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:20.109927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:20.113502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:20.114231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:20.849381 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:20.859110 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-625d7b4c-275f-40de-a4c2-c6a48f036b9a tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.771765 Jul 24 01:41:20.878130 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2853/5603] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:20 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:21.006819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d2b20b25-cba5-4f38-b549-3e8dcd03fd5d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:21.007586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d2b20b25-cba5-4f38-b549-3e8dcd03fd5d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:21.025321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2b20b25-cba5-4f38-b549-3e8dcd03fd5d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:21.026804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2b20b25-cba5-4f38-b549-3e8dcd03fd5d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:21.027773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2b20b25-cba5-4f38-b549-3e8dcd03fd5d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:21.030043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2b20b25-cba5-4f38-b549-3e8dcd03fd5d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:21.083506 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d2b20b25-cba5-4f38-b549-3e8dcd03fd5d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/ips" status: 200 len: 150 microversion: 2.1 time: 0.081033 Jul 24 01:41:21.085251 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2751/5604] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:41:20 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:21.884320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:21.884931 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:21.909039 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:21.909792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:21.914246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:21.914815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:22.405963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:22.418957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-990d7328-72d1-4125-af93-8ac8f4c34f97 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.539422 Jul 24 01:41:22.431419 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2854/5605] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:21 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:23.441524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:23.442830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:23.467389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:23.469766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:23.470906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:23.473723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:23.875209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:23.894669 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-616ce58f-b25f-4e81-8d2b-ad355b98bf52 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.457136 Jul 24 01:41:23.901770 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2752/5606] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:23 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:24.049414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-077f8fd6-dede-4a7a-b804-8d3d4011cc1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0107a032-8cb0-42c1-a14a-d3492acdf739"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:24.063504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-077f8fd6-dede-4a7a-b804-8d3d4011cc1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:24.077033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-077f8fd6-dede-4a7a-b804-8d3d4011cc1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:24.077497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-077f8fd6-dede-4a7a-b804-8d3d4011cc1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:24.089904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-077f8fd6-dede-4a7a-b804-8d3d4011cc1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:24.090369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-077f8fd6-dede-4a7a-b804-8d3d4011cc1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:24.622417 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-077f8fd6-dede-4a7a-b804-8d3d4011cc1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "POST /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578576 Jul 24 01:41:24.626680 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2855/5607] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:41:24 2022] POST /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:24.912903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:24.913714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:24.932415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:24.932897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:24.933742 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:24.934300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:25.476990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:25.491275 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-380a60f2-d166-48bc-ba01-6c8788925a36 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.582881 Jul 24 01:41:25.497394 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2753/5608] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:24 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:26.511707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:26.513029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:26.522891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:26.534599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:26.536136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:26.539436 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:27.314515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:27.324057 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba47bdfc-4202-498d-b8e0-ad346b25541d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.817741 Jul 24 01:41:27.328281 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2856/5609] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:26 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:28.342867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:28.344126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:28.358852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:28.361223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:28.362937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:28.366431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:28.698722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:28.710954 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8466954f-fb98-4526-9704-8565ad779e12 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1522 microversion: 2.1 time: 0.371831 Jul 24 01:41:28.713474 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2754/5610] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:28 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:29.728394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:29.729606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:29.744744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:29.752998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:29.754483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:29.755141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:30.447379 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:41:30.468743 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20d15f54-ca5f-40d1-b057-ee049c6fc371 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1502 microversion: 2.1 time: 0.744139 Jul 24 01:41:30.475279 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2857/5611] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:29 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1502 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:41:30.495531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13a3144c-8b49-415e-a261-87ba1042f23d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'create', calling method: .version_select at 0x7f05ea3c38b0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1904747976", "description": "tempest-description-1026562591"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:32.284262 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13a3144c-8b49-415e-a261-87ba1042f23d tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.792864 Jul 24 01:41:32.286331 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2755/5612] 10.222.0.27 () {60 vars in 1179 bytes} [Sun Jul 24 01:41:30 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:32.300244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1904747976"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:32.301413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:32.331378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:32.332123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:32.337083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:32.339034 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:32.678800 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:41:32.679184 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 01:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action (ip 10.222.0.27) !!! Jul 24 01:41:32.721740 n-d-master-1 devstack@n-api.service[119561]: INFO nova.network.security_group_api [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Adding security group 3bd30f66-50ec-411c-9ad1-78e6bc3b22b1 to port 391222be-5600-49e9-8c8b-598086a1ddae Jul 24 01:41:33.973595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8be3c30b-cf1e-4241-9f82-afdd820d6c8e tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action" status: 202 len: 0 microversion: 2.1 time: 1.678763 Jul 24 01:41:33.978224 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2858/5613] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:41:32 2022] POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action => generated 0 bytes in 1681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:41:33.985123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1904747976"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:33.986757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:34.012755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-dc847d1a-6dad-4dce-b321-c2bf65fdf26a req-9da84740-017b-40ee-9a39-18476ae9a567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da198e7f-4f98-4d3e-99eb-72d3b7c4b249", "tag": "391222be-5600-49e9-8c8b-598086a1ddae"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:34.014044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:34.018655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:34.020709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:34.021562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:34.032387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dc847d1a-6dad-4dce-b321-c2bf65fdf26a req-9da84740-017b-40ee-9a39-18476ae9a567 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:34.032849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dc847d1a-6dad-4dce-b321-c2bf65fdf26a req-9da84740-017b-40ee-9a39-18476ae9a567 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:34.082221 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-dc847d1a-6dad-4dce-b321-c2bf65fdf26a req-9da84740-017b-40ee-9a39-18476ae9a567 service nova] Creating event network-changed:391222be-5600-49e9-8c8b-598086a1ddae for instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 on n-h1-master-1 Jul 24 01:41:34.095451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-dc847d1a-6dad-4dce-b321-c2bf65fdf26a req-9da84740-017b-40ee-9a39-18476ae9a567 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086606 Jul 24 01:41:34.099834 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2859/5614] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 24 01:41:35.404036 n-d-master-1 devstack@n-api.service[119562]: INFO nova.network.security_group_api [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Removing security group 3bd30f66-50ec-411c-9ad1-78e6bc3b22b1 from port 391222be-5600-49e9-8c8b-598086a1ddae Jul 24 01:41:37.454344 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8f019dcf-f0cd-48af-8cf2-6e9a6a84567c tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action" status: 202 len: 0 microversion: 2.1 time: 3.474859 Jul 24 01:41:37.459652 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2756/5615] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:41:33 2022] POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action => generated 0 bytes in 3477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:41:37.466472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c28f747f-2f73-4c76-ac7a-6c25a743e193 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'create', calling method: .version_select at 0x7f05eac48c10>, body: {"pool": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:37.499540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b108790f-95e9-4a81-b422-948ea9bc8fec req-c8432556-77ed-4960-9b00-613bfe2bc96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da198e7f-4f98-4d3e-99eb-72d3b7c4b249", "tag": "391222be-5600-49e9-8c8b-598086a1ddae"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:37.503035 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=22 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:37.537382 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b108790f-95e9-4a81-b422-948ea9bc8fec req-c8432556-77ed-4960-9b00-613bfe2bc96b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:37.537992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b108790f-95e9-4a81-b422-948ea9bc8fec req-c8432556-77ed-4960-9b00-613bfe2bc96b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:37.550911 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=62 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:37.570483 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b108790f-95e9-4a81-b422-948ea9bc8fec req-c8432556-77ed-4960-9b00-613bfe2bc96b service nova] Creating event network-changed:391222be-5600-49e9-8c8b-598086a1ddae for instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 on n-h1-master-1 Jul 24 01:41:37.583662 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b108790f-95e9-4a81-b422-948ea9bc8fec req-c8432556-77ed-4960-9b00-613bfe2bc96b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091157 Jul 24 01:41:37.586922 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2757/5616] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:41:43.726530 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c28f747f-2f73-4c76-ac7a-6c25a743e193 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.265260 Jul 24 01:41:43.727666 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2860/5617] 10.222.0.27 () {60 vars in 1169 bytes} [Sun Jul 24 01:41:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:43.747708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.201"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:43.755334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:43.789796 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:43.790499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:43.797180 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:43.799097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:43.978638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Acquired lock "refresh_cache-da198e7f-4f98-4d3e-99eb-72d3b7c4b249" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:41:45.628881 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=21 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:45.630782 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:45.637665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:45.647049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:45.659461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:45.660163 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:45.670446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:45.671141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:45.935057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lazy-loading 'services' on Instance uuid ea392706-2c21-4d1b-9745-ae358a86e2f6 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:41:46.068237 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3c44dcd9-0dd6-4450-bd59-c525e7d78039 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments/0107a032-8cb0-42c1-a14a-d3492acdf739" status: 202 len: 0 microversion: 2.1 time: 0.439443 Jul 24 01:41:46.069949 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2861/5618] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:41:45 2022] DELETE /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments/0107a032-8cb0-42c1-a14a-d3492acdf739 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:41:46.081296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f3ca8564-4eca-4195-a51e-96b066f11cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:46.102180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f3ca8564-4eca-4195-a51e-96b066f11cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:46.113530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3ca8564-4eca-4195-a51e-96b066f11cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:46.117701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3ca8564-4eca-4195-a51e-96b066f11cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:46.121581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3ca8564-4eca-4195-a51e-96b066f11cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:46.122326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3ca8564-4eca-4195-a51e-96b066f11cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:46.282089 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f3ca8564-4eca-4195-a51e-96b066f11cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183585 Jul 24 01:41:46.285560 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2862/5619] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:46 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:47.296198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f298ea2e-3321-4d55-9008-5be2efaa871f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:47.297936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f298ea2e-3321-4d55-9008-5be2efaa871f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:47.325096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f298ea2e-3321-4d55-9008-5be2efaa871f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:47.327798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f298ea2e-3321-4d55-9008-5be2efaa871f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:47.329440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f298ea2e-3321-4d55-9008-5be2efaa871f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:47.331678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f298ea2e-3321-4d55-9008-5be2efaa871f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:47.470960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f298ea2e-3321-4d55-9008-5be2efaa871f tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174648 Jul 24 01:41:47.471703 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2863/5620] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:47 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:48.486850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7b2a8ae4-58f7-4fc6-ab86-3b03c8e337bf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:48.487698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7b2a8ae4-58f7-4fc6-ab86-3b03c8e337bf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:48.556113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b2a8ae4-58f7-4fc6-ab86-3b03c8e337bf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:48.569525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b2a8ae4-58f7-4fc6-ab86-3b03c8e337bf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:48.570798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b2a8ae4-58f7-4fc6-ab86-3b03c8e337bf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:48.575966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b2a8ae4-58f7-4fc6-ab86-3b03c8e337bf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:48.704187 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7b2a8ae4-58f7-4fc6-ab86-3b03c8e337bf tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224502 Jul 24 01:41:48.711916 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2864/5621] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:48 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:41:48.750031 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Building network info cache for instance {{(pid=119562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:41:48.773172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6e54f684-1abe-455b-8b29-98998666ca99 req-a47aa601-2083-4572-9b0f-63adf76c9729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da198e7f-4f98-4d3e-99eb-72d3b7c4b249", "tag": "391222be-5600-49e9-8c8b-598086a1ddae"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:48.796690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e54f684-1abe-455b-8b29-98998666ca99 req-a47aa601-2083-4572-9b0f-63adf76c9729 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:48.797165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e54f684-1abe-455b-8b29-98998666ca99 req-a47aa601-2083-4572-9b0f-63adf76c9729 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:48.852141 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6e54f684-1abe-455b-8b29-98998666ca99 req-a47aa601-2083-4572-9b0f-63adf76c9729 service nova] Creating event network-changed:391222be-5600-49e9-8c8b-598086a1ddae for instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 on n-h1-master-1 Jul 24 01:41:48.874827 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6e54f684-1abe-455b-8b29-98998666ca99 req-a47aa601-2083-4572-9b0f-63adf76c9729 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100996 Jul 24 01:41:48.878597 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2865/5622] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:49.727739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05c81fce-6432-494e-853a-1c3a89bd7522 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:49.731674 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05c81fce-6432-494e-853a-1c3a89bd7522 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:49.769106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c81fce-6432-494e-853a-1c3a89bd7522 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:49.780138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c81fce-6432-494e-853a-1c3a89bd7522 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:49.781937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c81fce-6432-494e-853a-1c3a89bd7522 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:49.783117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05c81fce-6432-494e-853a-1c3a89bd7522 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:49.832193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05c81fce-6432-494e-853a-1c3a89bd7522 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119358 Jul 24 01:41:49.833608 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2866/5623] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:49 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:50.844837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9afc6b5c-cba0-4c29-810e-c84aeedfeac6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:50.851508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9afc6b5c-cba0-4c29-810e-c84aeedfeac6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:50.869918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9afc6b5c-cba0-4c29-810e-c84aeedfeac6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:50.870644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9afc6b5c-cba0-4c29-810e-c84aeedfeac6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:50.874560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9afc6b5c-cba0-4c29-810e-c84aeedfeac6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:50.875185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9afc6b5c-cba0-4c29-810e-c84aeedfeac6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:50.936980 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9afc6b5c-cba0-4c29-810e-c84aeedfeac6 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096681 Jul 24 01:41:50.938741 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2867/5624] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:50 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:41:51.950413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b71a2f58-811e-402a-b68b-186fa740e926 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:51.952214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b71a2f58-811e-402a-b68b-186fa740e926 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:51.967148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b71a2f58-811e-402a-b68b-186fa740e926 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:51.982478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b71a2f58-811e-402a-b68b-186fa740e926 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:51.983362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b71a2f58-811e-402a-b68b-186fa740e926 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:51.983816 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b71a2f58-811e-402a-b68b-186fa740e926 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:52.074263 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b71a2f58-811e-402a-b68b-186fa740e926 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129547 Jul 24 01:41:52.078265 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2868/5625] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:51 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:52.418339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Updating instance_info_cache with network_info: [{"id": "391222be-5600-49e9-8c8b-598086a1ddae", "address": "fa:16:3e:69:b9:54", "network": {"id": "4b74a05d-85b6-46aa-ba58-96551c2826a4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-410340916-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "faa2aefb6f8846fc9211fec841a4351d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap391222be-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:41:52.429152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Releasing lock "refresh_cache-da198e7f-4f98-4d3e-99eb-72d3b7c4b249" {{(pid=119562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:41:52.439373 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b894866f-7b2e-45a8-9b1d-30096881bf70 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action" status: 202 len: 0 microversion: 2.1 time: 8.703499 Jul 24 01:41:52.440280 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2758/5626] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:41:43 2022] POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action => generated 0 bytes in 8706 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 24 01:41:52.449323 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.201"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:52.841333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:52.849488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:52.849985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:52.851608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:52.854274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:53.087943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d55b07c9-8dad-48f1-b035-3d5584a28370 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:53.088982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d55b07c9-8dad-48f1-b035-3d5584a28370 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:53.116059 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d55b07c9-8dad-48f1-b035-3d5584a28370 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:53.116517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d55b07c9-8dad-48f1-b035-3d5584a28370 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:53.133884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d55b07c9-8dad-48f1-b035-3d5584a28370 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:53.134552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d55b07c9-8dad-48f1-b035-3d5584a28370 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:53.272732 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d55b07c9-8dad-48f1-b035-3d5584a28370 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190816 Jul 24 01:41:53.285901 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2759/5627] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:53 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:53.500189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Acquired lock "refresh_cache-da198e7f-4f98-4d3e-99eb-72d3b7c4b249" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 24 01:41:54.289435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f17da11a-4c9b-4509-986c-46752d519625 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:54.290536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f17da11a-4c9b-4509-986c-46752d519625 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:54.319037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17da11a-4c9b-4509-986c-46752d519625 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:54.319612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17da11a-4c9b-4509-986c-46752d519625 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:54.320618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17da11a-4c9b-4509-986c-46752d519625 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:54.321184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17da11a-4c9b-4509-986c-46752d519625 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:54.399975 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f17da11a-4c9b-4509-986c-46752d519625 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119135 Jul 24 01:41:54.410902 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2760/5628] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:54 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:55.115357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Building network info cache for instance {{(pid=119561) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 24 01:41:55.127516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-aa99512c-28ad-4952-9e98-630571237ea6 req-2629fca2-16bc-4d31-952e-ebc13c557311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da198e7f-4f98-4d3e-99eb-72d3b7c4b249", "tag": "391222be-5600-49e9-8c8b-598086a1ddae"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:41:55.141515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aa99512c-28ad-4952-9e98-630571237ea6 req-2629fca2-16bc-4d31-952e-ebc13c557311 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:55.147968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aa99512c-28ad-4952-9e98-630571237ea6 req-2629fca2-16bc-4d31-952e-ebc13c557311 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:55.172011 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-aa99512c-28ad-4952-9e98-630571237ea6 req-2629fca2-16bc-4d31-952e-ebc13c557311 service nova] Creating event network-changed:391222be-5600-49e9-8c8b-598086a1ddae for instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 on n-h1-master-1 Jul 24 01:41:55.196492 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-aa99512c-28ad-4952-9e98-630571237ea6 req-2629fca2-16bc-4d31-952e-ebc13c557311 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077052 Jul 24 01:41:55.201252 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2761/5629] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:41:55.414014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7597e8bd-8a99-4ac7-a14c-46c9cb451ac5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:55.416518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7597e8bd-8a99-4ac7-a14c-46c9cb451ac5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:55.433118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7597e8bd-8a99-4ac7-a14c-46c9cb451ac5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:55.438330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7597e8bd-8a99-4ac7-a14c-46c9cb451ac5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:55.439699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7597e8bd-8a99-4ac7-a14c-46c9cb451ac5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:55.440376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7597e8bd-8a99-4ac7-a14c-46c9cb451ac5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:55.551528 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7597e8bd-8a99-4ac7-a14c-46c9cb451ac5 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142532 Jul 24 01:41:55.570467 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2762/5630] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:55 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:41:56.577285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32c8bd30-fb29-41e6-afae-6fceb136c12a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:56.579097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-32c8bd30-fb29-41e6-afae-6fceb136c12a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:56.600066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32c8bd30-fb29-41e6-afae-6fceb136c12a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:56.606024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32c8bd30-fb29-41e6-afae-6fceb136c12a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:56.608369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32c8bd30-fb29-41e6-afae-6fceb136c12a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:56.609102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32c8bd30-fb29-41e6-afae-6fceb136c12a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:56.739031 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-32c8bd30-fb29-41e6-afae-6fceb136c12a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165468 Jul 24 01:41:56.746381 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2763/5631] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:56 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:41:57.752693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4aeca190-0a6c-4e99-a6f6-05e57de7b762 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:57.753782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4aeca190-0a6c-4e99-a6f6-05e57de7b762 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:57.766573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4aeca190-0a6c-4e99-a6f6-05e57de7b762 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:57.778597 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4aeca190-0a6c-4e99-a6f6-05e57de7b762 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:57.780820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4aeca190-0a6c-4e99-a6f6-05e57de7b762 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:57.782408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4aeca190-0a6c-4e99-a6f6-05e57de7b762 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:57.869464 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4aeca190-0a6c-4e99-a6f6-05e57de7b762 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112954 Jul 24 01:41:57.870535 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2764/5632] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:57 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:41:57.925419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Updating instance_info_cache with network_info: [{"id": "391222be-5600-49e9-8c8b-598086a1ddae", "address": "fa:16:3e:69:b9:54", "network": {"id": "4b74a05d-85b6-46aa-ba58-96551c2826a4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-410340916-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "faa2aefb6f8846fc9211fec841a4351d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap391222be-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119561) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 24 01:41:57.933718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Releasing lock "refresh_cache-da198e7f-4f98-4d3e-99eb-72d3b7c4b249" {{(pid=119561) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 24 01:41:57.935233 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-65804bc8-3ce0-4db3-aa7e-f60a4bc0b7da tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action" status: 202 len: 0 microversion: 2.1 time: 5.490235 Jul 24 01:41:57.943744 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2869/5633] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:41:52 2022] POST /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249/action => generated 0 bytes in 5499 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 24 01:41:57.950759 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ff2ec00-8826-4c03-bb5a-b238fd02efcd tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '.version_select at 0x7f05ea1bd040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:58.883217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13d8808b-de30-4435-8031-eed5d7efe74a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:58.885776 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-13d8808b-de30-4435-8031-eed5d7efe74a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:58.911576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13d8808b-de30-4435-8031-eed5d7efe74a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:58.912060 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13d8808b-de30-4435-8031-eed5d7efe74a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:58.912897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13d8808b-de30-4435-8031-eed5d7efe74a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:58.913370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13d8808b-de30-4435-8031-eed5d7efe74a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:59.029144 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13d8808b-de30-4435-8031-eed5d7efe74a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150770 Jul 24 01:41:59.038105 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2870/5634] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:41:58 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 01:41:59.357840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:59.358666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:59.365448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:59.377297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:59.383097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:59.383991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:59.471567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:41:59.703772 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6f5b7fe2-27a8-4bed-9f62-5270584ad24d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 204 len: 0 microversion: 2.1 time: 0.350098 Jul 24 01:41:59.711296 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2871/5635] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:41:59 2022] DELETE /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:41:59.731333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:41:59.735162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:41:59.758964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:59.759895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:41:59.762346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:41:59.763795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:00.638762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:42:00.648037 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87d90855-aaf1-40f7-b397-b31723f01716 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1682 microversion: 2.1 time: 0.934965 Jul 24 01:42:00.650982 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2872/5636] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:41:59 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1682 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:42:01.347381 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ff2ec00-8826-4c03-bb5a-b238fd02efcd tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b9d23e9e-77c0-427d-bed2-04c991e86034" status: 202 len: 0 microversion: 2.1 time: 3.400415 Jul 24 01:42:01.349148 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2765/5637] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:41:57 2022] DELETE /compute/v2.1/os-floating-ips/b9d23e9e-77c0-427d-bed2-04c991e86034 => generated 0 bytes in 3403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:42:01.359279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ee5a916-d7cd-4ff3-843a-824a73bf42be tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '.version_select at 0x7f05e9d1ae50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:01.678728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:01.679381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:01.688271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:01.688723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:01.689616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:01.690122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:02.211291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:42:02.232443 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b8c71151-8fe0-4427-adb6-718b7749b9fa tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1682 microversion: 2.1 time: 0.568467 Jul 24 01:42:02.233043 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2766/5638] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:01 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1682 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:42:02.326016 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ee5a916-d7cd-4ff3-843a-824a73bf42be tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3bd30f66-50ec-411c-9ad1-78e6bc3b22b1" status: 202 len: 0 microversion: 2.1 time: 0.971700 Jul 24 01:42:02.327566 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2873/5639] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 01:42:01 2022] DELETE /compute/v2.1/os-security-groups/3bd30f66-50ec-411c-9ad1-78e6bc3b22b1 => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:42:02.337856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:02.338607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:02.351021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:02.354340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:02.356397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:02.359934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:02.429060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:42:02.620820 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-066be480-1dbd-4d88-b3c0-0123de8d906b tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 204 len: 0 microversion: 2.1 time: 0.288834 Jul 24 01:42:02.622500 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2767/5640] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:42:02 2022] DELETE /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:42:02.648997 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:02.650548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:02.671536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:02.672480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:02.675074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:02.676714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:02.974331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:42:02.984627 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e835cb3a-2ad2-4805-bdf0-ef3159902789 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1508 microversion: 2.1 time: 0.357605 Jul 24 01:42:02.988518 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2874/5641] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:02 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:42:03.251156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:03.251928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:03.268163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:03.268850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:03.269936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:03.271272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:03.461513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4611d01617d645579ae3529c8f8f9de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109467986076453b893b8720a2b1144a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:42:03.476429 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-915750fe-70f1-486e-b810-225436e86410 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 200 len: 1614 microversion: 2.1 time: 0.229515 Jul 24 01:42:03.487345 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2768/5642] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:03 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 1614 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:42:03.740674 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8d21ed26-8557-4762-ba9c-ad39f942016a req-4794fb04-a905-4739-a0c4-a54edcef281b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea392706-2c21-4d1b-9745-ae358a86e2f6", "name": "network-vif-deleted", "tag": "5aa7e2e7-b966-4365-9881-676e3ebc4d5a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:42:03.774845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8d21ed26-8557-4762-ba9c-ad39f942016a req-4794fb04-a905-4739-a0c4-a54edcef281b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:03.775719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8d21ed26-8557-4762-ba9c-ad39f942016a req-4794fb04-a905-4739-a0c4-a54edcef281b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:03.812813 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8d21ed26-8557-4762-ba9c-ad39f942016a req-4794fb04-a905-4739-a0c4-a54edcef281b service nova] Creating event network-vif-deleted:5aa7e2e7-b966-4365-9881-676e3ebc4d5a for instance ea392706-2c21-4d1b-9745-ae358a86e2f6 on n-h2-master-1 Jul 24 01:42:03.842039 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8d21ed26-8557-4762-ba9c-ad39f942016a req-4794fb04-a905-4739-a0c4-a54edcef281b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106561 Jul 24 01:42:03.846080 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2875/5643] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:42:04.003627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:04.006336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:04.024760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:04.027208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:04.028052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:04.028511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:04.421710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:42:04.433780 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72ccd0d7-291b-4973-9b97-83c63494e589 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1508 microversion: 2.1 time: 0.435146 Jul 24 01:42:04.436926 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2769/5644] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:03 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1508 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:42:04.505109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:04.505936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:04.515298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:04.522678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:04.539283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:04.552388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:04.596738 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 HTTP/1.1 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ea392706-2c21-4d1b-9745-ae358a86e2f6'} Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:04.626478 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:04.631247 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:04.631247 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:04.631247 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:04.631247 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:04.631247 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:04.631247 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:04.631247 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:04.643477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:04.644609 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c4b304b7-453b-4881-8daf-fb77e0d5516a tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 404 len: 111 microversion: 2.1 time: 0.144926 Jul 24 01:42:04.648481 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2876/5645] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:04 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:04.655193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1ebe70ea-a92a-4351-913f-cd0fb61f2e68 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '.version_select at 0x7f05ea2cf4c0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:04.716876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1ebe70ea-a92a-4351-913f-cd0fb61f2e68 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420280884" status: 202 len: 0 microversion: 2.1 time: 0.065420 Jul 24 01:42:04.717733 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2770/5646] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:42:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420280884 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:42:05.456104 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:05.458308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:05.471280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:05.471744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:05.472616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:05.473522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:05.554968 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:05.897786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7cb0037a91f461f8f39e28fe3c1ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa2aefb6f8846fc9211fec841a4351d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:42:05.914225 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed35bf78-5cdb-4154-b4fc-8e496d3e2b2f tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 200 len: 1466 microversion: 2.1 time: 0.462381 Jul 24 01:42:05.919426 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2877/5647] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:05 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 1466 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:42:05.987941 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7273aede-41d5-49f8-8d53-f2965ce27603 req-aa7183d2-4cf7-4d4a-9297-50c7f9e9bac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da198e7f-4f98-4d3e-99eb-72d3b7c4b249", "name": "network-vif-deleted", "tag": "391222be-5600-49e9-8c8b-598086a1ddae"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:42:06.027086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7273aede-41d5-49f8-8d53-f2965ce27603 req-aa7183d2-4cf7-4d4a-9297-50c7f9e9bac5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:06.031248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7273aede-41d5-49f8-8d53-f2965ce27603 req-aa7183d2-4cf7-4d4a-9297-50c7f9e9bac5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:06.072782 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7273aede-41d5-49f8-8d53-f2965ce27603 req-aa7183d2-4cf7-4d4a-9297-50c7f9e9bac5 service nova] Creating event network-vif-deleted:391222be-5600-49e9-8c8b-598086a1ddae for instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 on n-h1-master-1 Jul 24 01:42:06.086694 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7273aede-41d5-49f8-8d53-f2965ce27603 req-aa7183d2-4cf7-4d4a-9297-50c7f9e9bac5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103794 Jul 24 01:42:06.087375 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2771/5648] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:42:06.934309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:06.944661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] [instance: da198e7f-4f98-4d3e-99eb-72d3b7c4b249] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:06.990081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:06.992329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:06.993197 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:06.997136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:07.039002 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] HTTP exception thrown: Instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 could not be found. Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Request method failure captured: Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 HTTP/1.1 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KMRRbYR-RX6Frm-m4AeFWT_CMbUf5YR5gzkkhzP1YPaE-TDlWb6EYgFMRTSc_tH8vo2Jv0wBlJtsMW2mU1vijIaaY9JMVPexc_PjEt4J2LeB4SGE0Ac2QNpR-LXRXE5edCDSitcA3ftrUBQqbZwyg4mZzqzLYxL45wgXfBiNj5q-xY Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: faa2aefb6f8846fc9211fec841a4351d Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1024272548 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/faa2aefb6f8846fc9211fec841a4351d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa2aefb6f8846fc9211fec841a4351d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_faa2aefb6f8846fc9211fec841a4351d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/faa2aefb6f8846fc9211fec841a4351d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1024272548 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: faa2aefb6f8846fc9211fec841a4351d Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1024272548 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerRescueTestJSONUnderV235-1024272548-project Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: d7cb0037a91f461f8f39e28fe3c1ba85 Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1024272548-project Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: exception: Instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 could not be found. Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'da198e7f-4f98-4d3e-99eb-72d3b7c4b249'} Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 could not be found. Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 could not be found. Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:07.043982 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 could not be found. Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] Returning 404 to user: Instance da198e7f-4f98-4d3e-99eb-72d3b7c4b249 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:07.048832 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e450b28-02f3-408c-bdd3-3f0fb9f5ebc7 tempest-ServerRescueTestJSONUnderV235-1024272548 tempest-ServerRescueTestJSONUnderV235-1024272548-project] 10.222.0.27 "GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249" status: 404 len: 111 microversion: 2.1 time: 0.118105 Jul 24 01:42:07.056631 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2878/5649] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:06 2022] GET /compute/v2.1/servers/da198e7f-4f98-4d3e-99eb-72d3b7c4b249 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:15.025963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:15.026566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:15.042702 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:15.044536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:15.045000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:15.064571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:15.065170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:15.126271 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=76,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:15.140348 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 HTTP/1.1 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ea392706-2c21-4d1b-9745-ae358a86e2f6'} Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:15.142286 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:15.146289 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-19d2d373-5e22-4f8b-83e3-c2f52955eb0d tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 404 len: 111 microversion: 2.1 time: 0.123279 Jul 24 01:42:15.154695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:15.155329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ea392706-2c21-4d1b-9745-ae358a86e2f6] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:15.180485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:15.180949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:15.181814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:15.182372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:15.184876 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2772/5650] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:42:15 2022] DELETE /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:15.272079 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 HTTP/1.1 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ea392706-2c21-4d1b-9745-ae358a86e2f6'} Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:15.277101 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.280959 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:15.280959 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:15.280959 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:15.280959 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:15.280959 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:15.280959 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. Jul 24 01:42:15.280959 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:15.284782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ea392706-2c21-4d1b-9745-ae358a86e2f6 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:15.286494 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-833358b0-f13f-4b23-b237-31f6f1f7d409 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6" status: 404 len: 111 microversion: 2.1 time: 0.137630 Jul 24 01:42:15.290037 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2879/5651] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:15 2022] GET /compute/v2.1/servers/ea392706-2c21-4d1b-9745-ae358a86e2f6 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:24.406300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:24.407486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:24.429983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.431658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.432437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.432895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.512840 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e HTTP/1.1 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ebf7619c-e2c4-4571-be7a-60afc55c8d1e'} Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:24.517411 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.522943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.526707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:24.552497 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c05520b3-bff9-4e1f-85e7-afcca650e311 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 404 len: 111 microversion: 2.1 time: 0.149971 Jul 24 01:42:24.554071 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2773/5652] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:42:24 2022] DELETE /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:24.561941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:24.562574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ebf7619c-e2c4-4571-be7a-60afc55c8d1e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:24.577265 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:24.583741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.584700 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.585970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.586577 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.677071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e HTTP/1.1 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ebf7619c-e2c4-4571-be7a-60afc55c8d1e'} Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.681864 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ebf7619c-e2c4-4571-be7a-60afc55c8d1e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:24.686721 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5093b5ab-2dab-4027-bf0e-8f02c4d0e703 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e" status: 404 len: 111 microversion: 2.1 time: 0.126448 Jul 24 01:42:24.697315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:24.697861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:24.711601 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2880/5653] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:24 2022] GET /compute/v2.1/servers/ebf7619c-e2c4-4571-be7a-60afc55c8d1e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:24.724830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.729267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.746501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.748761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.789912 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d HTTP/1.1 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ec18022f-1f61-4587-9301-b11e0168418d'} Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:24.802661 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.807943 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.812320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:24.819642 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef198fd9-d152-4bfa-92f4-b723f8c0c764 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 404 len: 111 microversion: 2.1 time: 0.129472 Jul 24 01:42:24.830274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:24.831249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: ec18022f-1f61-4587-9301-b11e0168418d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:24.836996 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2774/5654] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:42:24 2022] DELETE /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:24.844978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.858618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.859482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:24.859929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:24.906434 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d HTTP/1.1 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ec18022f-1f61-4587-9301-b11e0168418d'} Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:24.908072 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance ec18022f-1f61-4587-9301-b11e0168418d could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:24.914133 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4a7ef849-24b8-45e2-830a-62e17b5c1dd7 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d" status: 404 len: 111 microversion: 2.1 time: 0.084405 Jul 24 01:42:24.919058 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2881/5655] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:24 2022] GET /compute/v2.1/servers/ec18022f-1f61-4587-9301-b11e0168418d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:32.002480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:32.002999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:32.036287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:32.047155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:32.061908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:32.062509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:32.106043 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd HTTP/1.1 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '83899dfe-0d1b-4320-afe1-6437e34e77cd'} Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:32.108205 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.113601 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.116392 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:32.117438 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb4f71e5-3b05-4cd3-b803-d67e73ba2cc8 tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 404 len: 111 microversion: 2.1 time: 0.119193 Jul 24 01:42:32.118519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2775/5656] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:42:31 2022] DELETE /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:42:32.129155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:42:32.129155 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] [instance: 83899dfe-0d1b-4320-afe1-6437e34e77cd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:42:32.141447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:32.141933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:32.142721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:42:32.143159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:42:32.190083 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] HTTP exception thrown: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Request method failure captured: Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd HTTP/1.1 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KF-zHIu-LQCnUnkejwFhJAC_beQoYlSX6U7AlGbXD7ZktmSN-FoxTyMn7XwnG-XjKII3opgyIXEuHpgtFHBQ9OivsTO9Ef7YzPn-REazaDHVJOWnqs6E7gwTUaovAQSKnnwY-GhY8qimXbqEnRXdIAHsZJ7y0NtS5w4zzz7oFy1Pn0 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/109467986076453b893b8720a2b1144a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_109467986076453b893b8720a2b1144a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/109467986076453b893b8720a2b1144a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 109467986076453b893b8720a2b1144a Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-808453498 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4611d01617d645579ae3529c8f8f9de2 Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-AttachVolumeNegativeTest-808453498-project Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '83899dfe-0d1b-4320-afe1-6437e34e77cd'} Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:42:32.192778 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.196985 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:42:32.196985 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:42:32.196985 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:42:32.196985 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:42:32.196985 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:42:32.196985 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. Jul 24 01:42:32.196985 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:42:32.219244 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] Returning 404 to user: Instance 83899dfe-0d1b-4320-afe1-6437e34e77cd could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:42:32.220854 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b7d9dba0-e36f-46da-8ea0-bce1761f4d1c tempest-AttachVolumeNegativeTest-808453498 tempest-AttachVolumeNegativeTest-808453498-project] 10.222.0.27 "GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd" status: 404 len: 111 microversion: 2.1 time: 0.098495 Jul 24 01:42:32.229771 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2882/5657] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:32 2022] GET /compute/v2.1/servers/83899dfe-0d1b-4320-afe1-6437e34e77cd => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:43:12.245245 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:43:12.246034 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 01:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:43:13.695942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1162193823", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:43:13.710449 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=7 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:13.717066 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=7 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:13.824447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] validate_networks() for None {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:43:14.924830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:43:14.926326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:43:14.927684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:43:14.928525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:43:14.929178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:43:14.971072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:14.971991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:14.973490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:14.975311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:15.039901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Getting quotas for project e2d7da6eee884068adb42a735089bf08. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:43:15.057645 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Getting quotas for user 3a37e2676b9e40dd852e0ccb6c81192b and project e2d7da6eee884068adb42a735089bf08. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:43:15.119543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:43:15.122194 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:43:15.243463 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-34ecb6bd-2ace-43cf-a830-5cfda0d90556 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.559322 Jul 24 01:43:15.253273 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2776/5658] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:43:15.256827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30cbf0d2-58d4-498d-8b76-1ad130d7718a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:15.257463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30cbf0d2-58d4-498d-8b76-1ad130d7718a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:15.270326 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=5 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:15.271528 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:15.545222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30cbf0d2-58d4-498d-8b76-1ad130d7718a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:15.555473 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30cbf0d2-58d4-498d-8b76-1ad130d7718a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1215 microversion: 2.1 time: 0.302889 Jul 24 01:43:15.558459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2883/5659] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:15 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1215 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:16.579105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3156559-9a6f-4e49-9a22-b1ed38fece5f tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:16.580451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e3156559-9a6f-4e49-9a22-b1ed38fece5f tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:16.727329 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e3156559-9a6f-4e49-9a22-b1ed38fece5f tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:16.740211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3156559-9a6f-4e49-9a22-b1ed38fece5f tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1215 microversion: 2.1 time: 0.162437 Jul 24 01:43:16.743917 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2777/5660] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:16 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:17.760551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:17.762823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:17.785085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:17.785843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:17.787050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:17.788119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:17.972994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:17.987600 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-82a9cd56-f753-469e-a612-7704d6762fde tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1267 microversion: 2.1 time: 0.233313 Jul 24 01:43:17.989001 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2884/5661] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:17 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:43:19.007494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:19.008824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:19.039291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:19.045820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:19.047048 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:19.049388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:20.102841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:20.127072 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb2d7af3-b68d-4b77-ba76-5ca945ffd8eb tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1273 microversion: 2.1 time: 1.124877 Jul 24 01:43:20.127977 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2778/5662] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:18 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1273 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:21.147796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:21.148524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:21.163353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:21.163823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:21.169364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:21.175175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:21.946298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:21.957202 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd681dd9-4f1c-4425-847d-406af1087651 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.813836 Jul 24 01:43:21.959470 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2885/5663] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:21 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:22.979389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:22.979389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:22.990870 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:22.993126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:22.994415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:22.995164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:23.706849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:23.722853 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0137d95e-6277-455f-8356-74bedf56249d tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.748307 Jul 24 01:43:23.724289 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2779/5664] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:22 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:24.694351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5fbc99e9-5790-41df-9ea8-5fabcac8068d req-a5520722-a708-4dbf-8952-619a479a228e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84342e0-2ba4-4270-b6b6-a8b8d82c684e", "tag": "4219a556-0a64-4a1a-b74d-492fff311935"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:43:24.717425 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5fbc99e9-5790-41df-9ea8-5fabcac8068d req-a5520722-a708-4dbf-8952-619a479a228e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:24.717926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5fbc99e9-5790-41df-9ea8-5fabcac8068d req-a5520722-a708-4dbf-8952-619a479a228e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:24.732470 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5fbc99e9-5790-41df-9ea8-5fabcac8068d req-a5520722-a708-4dbf-8952-619a479a228e service nova] Creating event network-changed:4219a556-0a64-4a1a-b74d-492fff311935 for instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e on n-h2-master-1 Jul 24 01:43:24.740454 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5fbc99e9-5790-41df-9ea8-5fabcac8068d req-a5520722-a708-4dbf-8952-619a479a228e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055522 Jul 24 01:43:24.747044 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2886/5665] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:43:24.748086 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:24.748716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:24.792260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:24.793134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:24.794225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:24.795107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:25.014493 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:25.374634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:25.391263 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2319351d-5fda-4b27-bf1f-eb0405164f1a tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.648422 Jul 24 01:43:25.394350 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2780/5666] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:24 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:26.408624 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:26.413752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:26.414472 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:26.429191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:26.429653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:26.430466 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:26.430908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:27.104420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:27.113858 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8bf60a90-2257-44aa-a9cf-34630f331b11 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.706717 Jul 24 01:43:27.135306 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2887/5667] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:26 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:28.140102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:28.140728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:28.144722 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:28.160308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:28.160308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:28.160308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:28.160308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:28.539034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:28.547943 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e250ffac-5d93-4a8d-926d-144ca5b89d58 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.411687 Jul 24 01:43:28.550942 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2781/5668] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:28 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:29.569105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:29.571709 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:29.585580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:29.604966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:29.610082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:29.614930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:30.536052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:30.555393 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1dbf62c4-5c4a-42f9-8200-4b40ee290c02 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.984974 Jul 24 01:43:30.558925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2888/5669] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:29 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:31.583490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:31.586048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:31.603776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:31.604380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:31.610029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:31.611718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:32.874424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:32.885010 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d45a7d4-3992-4a1c-b9c6-69baaae85c34 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 1.312218 Jul 24 01:43:32.890871 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2782/5670] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:31 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:33.911751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:33.914175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:33.926686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:33.927783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:33.928797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:33.929316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:34.122453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:34.135471 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-70c8471e-fd78-4e40-97aa-96967493feb5 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.229279 Jul 24 01:43:34.145176 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2889/5671] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:33 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:34.909362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8e186ae4-9b20-46e3-974e-67bd188f589b req-6642adcc-36a0-46d2-93bc-2c11bf47c84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84342e0-2ba4-4270-b6b6-a8b8d82c684e", "name": "network-vif-plugged", "status": "completed", "tag": "4219a556-0a64-4a1a-b74d-492fff311935"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:43:34.926095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8e186ae4-9b20-46e3-974e-67bd188f589b req-6642adcc-36a0-46d2-93bc-2c11bf47c84a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:34.927395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8e186ae4-9b20-46e3-974e-67bd188f589b req-6642adcc-36a0-46d2-93bc-2c11bf47c84a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:35.011980 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8e186ae4-9b20-46e3-974e-67bd188f589b req-6642adcc-36a0-46d2-93bc-2c11bf47c84a service nova] Creating event network-vif-plugged:4219a556-0a64-4a1a-b74d-492fff311935 for instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e on n-h2-master-1 Jul 24 01:43:35.028309 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8e186ae4-9b20-46e3-974e-67bd188f589b req-6642adcc-36a0-46d2-93bc-2c11bf47c84a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128429 Jul 24 01:43:35.036832 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2783/5672] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:43:35.152083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:35.152697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:35.168686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:35.169906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:35.173021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:35.173714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:35.624011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:35.642157 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a1831bb8-6441-4317-b70d-7fdac9068a68 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.493925 Jul 24 01:43:35.642760 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2890/5673] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:35 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:36.660796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:36.661484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:36.690522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:36.691242 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:36.691886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:36.692335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:37.138885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:37.158280 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8c988add-05be-44b7-abff-f5f0fb0dbc15 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1315 microversion: 2.1 time: 0.499317 Jul 24 01:43:37.159730 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2784/5674] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:36 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:38.176727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:38.177352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:38.187884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:38.193949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:38.195079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:38.195691 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:38.512625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:38.524496 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-08a3e1ec-bf04-4409-83a9-88795143b62e tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1465 microversion: 2.1 time: 0.352414 Jul 24 01:43:38.527470 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2891/5675] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:38 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1465 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:38.610720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:38.612757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:38.637144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:38.640793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:38.642212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:38.642864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:38.693213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:43:38.903479 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f23e5031-e0ee-4add-9095-8bde6a470a65 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 204 len: 0 microversion: 2.1 time: 0.315516 Jul 24 01:43:38.905186 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2785/5676] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:43:38 2022] DELETE /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:38.914615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:38.915718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:38.929658 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:38.930442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:38.932871 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:38.933491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:39.721697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:39.746605 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7b0e4c6a-8dc0-4b98-b5b0-a9a5bf330477 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1471 microversion: 2.1 time: 0.835913 Jul 24 01:43:39.748934 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2892/5677] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:38 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1471 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:40.767509 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:40.769403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:40.795848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:40.796360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:40.797448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:40.798017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:41.736744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:41.758505 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb2f6b15-63b8-4481-9d99-d311a21d33c6 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1471 microversion: 2.1 time: 0.996886 Jul 24 01:43:41.762250 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2786/5678] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:40 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1471 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:42.779434 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:42.780988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:42.807839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:42.812708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:42.814339 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:42.814950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:43.045832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a37e2676b9e40dd852e0ccb6c81192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d7da6eee884068adb42a735089bf08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:43:43.077197 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e745d524-077c-4e50-a0f3-c7e623aa44b0 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 200 len: 1429 microversion: 2.1 time: 0.300444 Jul 24 01:43:43.079808 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2893/5679] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:42 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 1429 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:43:43.280906 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-3c7bfc8b-da0a-4892-b8fc-9bc6a1c186b3 req-3370f010-0609-417c-9216-f10d8d1435bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84342e0-2ba4-4270-b6b6-a8b8d82c684e", "name": "network-vif-deleted", "tag": "4219a556-0a64-4a1a-b74d-492fff311935"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:43:43.300461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3c7bfc8b-da0a-4892-b8fc-9bc6a1c186b3 req-3370f010-0609-417c-9216-f10d8d1435bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:43.300994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3c7bfc8b-da0a-4892-b8fc-9bc6a1c186b3 req-3370f010-0609-417c-9216-f10d8d1435bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:43.329829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-3c7bfc8b-da0a-4892-b8fc-9bc6a1c186b3 req-3370f010-0609-417c-9216-f10d8d1435bf service nova] Creating event network-vif-deleted:4219a556-0a64-4a1a-b74d-492fff311935 for instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e on n-h2-master-1 Jul 24 01:43:43.340685 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-3c7bfc8b-da0a-4892-b8fc-9bc6a1c186b3 req-3370f010-0609-417c-9216-f10d8d1435bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070907 Jul 24 01:43:43.342634 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2787/5680] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:43:44.105662 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:43:44.107392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] [instance: d84342e0-2ba4-4270-b6b6-a8b8d82c684e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:43:44.154165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:44.154865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:44.155823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:43:44.158109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:43:44.195936 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] HTTP exception thrown: Instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e could not be found. Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Request method failure captured: Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e HTTP/1.1 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KOtZosxIFbHx1zSwjZ-bqxoLurzIj6HRMzHATYKR9n5H1pi28Dogw6LjndmKBpKFRQw3aPbaOnFfPVciz_-Dhm1tYTBW_n58esiufIkNLMB-K2u2YeC1hJsCoocCKO6RpOjGd3rlzYJZm1p5iOSZM2CYzUwUpogKrHlB5-f96Ldj6c Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e2d7da6eee884068adb42a735089bf08 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesNegativeTest-2003797508 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e2d7da6eee884068adb42a735089bf08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2d7da6eee884068adb42a735089bf08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e2d7da6eee884068adb42a735089bf08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e2d7da6eee884068adb42a735089bf08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesNegativeTest-2003797508 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e2d7da6eee884068adb42a735089bf08 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesNegativeTest-2003797508 Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesNegativeTest-2003797508-project Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 3a37e2676b9e40dd852e0ccb6c81192b Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesNegativeTest-2003797508-project Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: exception: Instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e could not be found. Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'd84342e0-2ba4-4270-b6b6-a8b8d82c684e'} Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e could not be found. Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e could not be found. Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:43:44.199952 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e could not be found. Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:43:44.206069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] Returning 404 to user: Instance d84342e0-2ba4-4270-b6b6-a8b8d82c684e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:43:44.210338 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3312ca5f-ee7e-4fad-9eef-9e0511999229 tempest-VolumesNegativeTest-2003797508 tempest-VolumesNegativeTest-2003797508-project] 10.222.0.27 "GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e" status: 404 len: 111 microversion: 2.1 time: 0.107776 Jul 24 01:43:44.211940 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2894/5681] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:43:44 2022] GET /compute/v2.1/servers/d84342e0-2ba4-4270-b6b6-a8b8d82c684e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:29.063876 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:29.064994 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:29.760224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e9b15f9c-3fca-4732-8aaf-d5897dc2fa4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:29.761831 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:44:29.761831 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 01:44:29.763939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b15f9c-3fca-4732-8aaf-d5897dc2fa4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:29.766192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b15f9c-3fca-4732-8aaf-d5897dc2fa4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:29.769990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b15f9c-3fca-4732-8aaf-d5897dc2fa4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:29.770589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9b15f9c-3fca-4732-8aaf-d5897dc2fa4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:29.938951 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e9b15f9c-3fca-4732-8aaf-d5897dc2fa4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.885046 Jul 24 01:44:29.944816 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2788/5682] 10.222.0.27 () {58 vars in 1184 bytes} [Sun Jul 24 01:44:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:44:30.245324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1393042815", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "fb20cf71-8bc5-4613-8ae3-8174c6e0f31a"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:44:30.318878 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=26 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:30.319719 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=58 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:30.429029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] validate_networks() for [('fb20cf71-8bc5-4613-8ae3-8174c6e0f31a', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:44:31.416849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:44:31.417595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:44:31.417849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:44:31.418272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:44:31.418902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Getting quotas for project 7e1ad4ae9b3846acb6ab2af2690db6f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Getting quotas for user 0b11d226d8fa44f2bc24b219a0098e53 and project 7e1ad4ae9b3846acb6ab2af2690db6f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:44:31.564234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:44:31.735946 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-60f591bc-46ec-485c-b563-d085cb1ce3c4 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443645 Jul 24 01:44:31.735946 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2895/5683] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:44:31.738500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1f4580e-4109-492c-b3c6-6ec1ddc086e8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:31.738500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1f4580e-4109-492c-b3c6-6ec1ddc086e8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:31.859739 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1f4580e-4109-492c-b3c6-6ec1ddc086e8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1329 microversion: 2.1 time: 0.166066 Jul 24 01:44:31.860843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2789/5684] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:31 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1329 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:32.878041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fa16159f-4b37-45b8-87c6-b3355bfbb5fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:32.884781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fa16159f-4b37-45b8-87c6-b3355bfbb5fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:33.083009 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fa16159f-4b37-45b8-87c6-b3355bfbb5fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1329 microversion: 2.1 time: 0.209787 Jul 24 01:44:33.087254 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2896/5685] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:32 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1329 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:34.111147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31ccda92-feb8-47e8-8508-6b5f06f4bc46 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:34.112545 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-31ccda92-feb8-47e8-8508-6b5f06f4bc46 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:34.181370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ccda92-feb8-47e8-8508-6b5f06f4bc46 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:34.182951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ccda92-feb8-47e8-8508-6b5f06f4bc46 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:34.183666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ccda92-feb8-47e8-8508-6b5f06f4bc46 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:34.184122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-31ccda92-feb8-47e8-8508-6b5f06f4bc46 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:34.556270 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-31ccda92-feb8-47e8-8508-6b5f06f4bc46 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1416 microversion: 2.1 time: 0.451519 Jul 24 01:44:34.566466 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2790/5686] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:34 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1416 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:35.576196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d242f9e9-6321-4488-913f-4f7d1f86a81c tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:35.578295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d242f9e9-6321-4488-913f-4f7d1f86a81c tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:35.596909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d242f9e9-6321-4488-913f-4f7d1f86a81c tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:35.597526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d242f9e9-6321-4488-913f-4f7d1f86a81c tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:35.602124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d242f9e9-6321-4488-913f-4f7d1f86a81c tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:35.603921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d242f9e9-6321-4488-913f-4f7d1f86a81c tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:35.794759 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d242f9e9-6321-4488-913f-4f7d1f86a81c tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1422 microversion: 2.1 time: 0.222491 Jul 24 01:44:35.798560 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2897/5687] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:35 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1422 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:36.815005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac8fd3b1-886e-44f6-9ea1-00a99e7d6608 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:36.815813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ac8fd3b1-886e-44f6-9ea1-00a99e7d6608 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:36.840454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac8fd3b1-886e-44f6-9ea1-00a99e7d6608 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:36.848933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac8fd3b1-886e-44f6-9ea1-00a99e7d6608 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:36.852307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac8fd3b1-886e-44f6-9ea1-00a99e7d6608 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:36.855747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ac8fd3b1-886e-44f6-9ea1-00a99e7d6608 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:37.220698 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac8fd3b1-886e-44f6-9ea1-00a99e7d6608 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.410507 Jul 24 01:44:37.221296 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2791/5688] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:36 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:38.242508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-afa4b0f7-bcb8-49c9-8c0b-3add79d1beae tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:38.243830 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-afa4b0f7-bcb8-49c9-8c0b-3add79d1beae tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:38.260338 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa4b0f7-bcb8-49c9-8c0b-3add79d1beae tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:38.262273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa4b0f7-bcb8-49c9-8c0b-3add79d1beae tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:38.264051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa4b0f7-bcb8-49c9-8c0b-3add79d1beae tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:38.265095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afa4b0f7-bcb8-49c9-8c0b-3add79d1beae tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:38.951923 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-afa4b0f7-bcb8-49c9-8c0b-3add79d1beae tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.714874 Jul 24 01:44:38.953261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2898/5689] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:38 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:39.815676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a4470097-1448-40c3-a35a-30f17aadd12e req-f35305d5-559d-499b-bf4b-b1ea0a5a5513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013db979-fed2-43ae-b2db-c0ddfc747d99", "tag": "0b4c8253-3add-4caf-9502-7feb4e0ef6c8"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:44:39.853636 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:39.882828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a4470097-1448-40c3-a35a-30f17aadd12e req-f35305d5-559d-499b-bf4b-b1ea0a5a5513 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:39.887569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a4470097-1448-40c3-a35a-30f17aadd12e req-f35305d5-559d-499b-bf4b-b1ea0a5a5513 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:39.958424 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a4470097-1448-40c3-a35a-30f17aadd12e req-f35305d5-559d-499b-bf4b-b1ea0a5a5513 service nova] Creating event network-changed:0b4c8253-3add-4caf-9502-7feb4e0ef6c8 for instance 013db979-fed2-43ae-b2db-c0ddfc747d99 on n-h1-master-1 Jul 24 01:44:39.970857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f6b4af85-9656-4d2e-b528-407fb3e26645 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:39.971989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f6b4af85-9656-4d2e-b528-407fb3e26645 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:39.981975 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a4470097-1448-40c3-a35a-30f17aadd12e req-f35305d5-559d-499b-bf4b-b1ea0a5a5513 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.595042 Jul 24 01:44:39.983231 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2792/5690] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:44:39.984208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b4af85-9656-4d2e-b528-407fb3e26645 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:39.985072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b4af85-9656-4d2e-b528-407fb3e26645 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:39.986073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b4af85-9656-4d2e-b528-407fb3e26645 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:39.986688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f6b4af85-9656-4d2e-b528-407fb3e26645 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:41.457648 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f6b4af85-9656-4d2e-b528-407fb3e26645 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 1.492899 Jul 24 01:44:41.460740 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2899/5691] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:39 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:42.480716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-563b5e20-f584-461a-bb8b-0033f76c8725 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:42.482039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-563b5e20-f584-461a-bb8b-0033f76c8725 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:42.497686 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:42.519153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-563b5e20-f584-461a-bb8b-0033f76c8725 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:42.519829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-563b5e20-f584-461a-bb8b-0033f76c8725 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:42.523245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-563b5e20-f584-461a-bb8b-0033f76c8725 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:42.525066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-563b5e20-f584-461a-bb8b-0033f76c8725 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:43.432470 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-563b5e20-f584-461a-bb8b-0033f76c8725 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.957216 Jul 24 01:44:43.439187 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2793/5692] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:42 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:44.455703 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7af0d888-6fb7-46ce-ac88-825536250837 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:44.456833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7af0d888-6fb7-46ce-ac88-825536250837 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:44.460561 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:44.471745 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:44.489315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7af0d888-6fb7-46ce-ac88-825536250837 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:44.489804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7af0d888-6fb7-46ce-ac88-825536250837 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:44.490590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7af0d888-6fb7-46ce-ac88-825536250837 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:44.501320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7af0d888-6fb7-46ce-ac88-825536250837 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:44.907188 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7af0d888-6fb7-46ce-ac88-825536250837 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.455654 Jul 24 01:44:44.908533 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2900/5693] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:44 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:44:45.927400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e5f7387-e5d4-43d0-ac39-f6839b460ba7 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:45.931030 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e5f7387-e5d4-43d0-ac39-f6839b460ba7 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:45.968879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e5f7387-e5d4-43d0-ac39-f6839b460ba7 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:45.974863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e5f7387-e5d4-43d0-ac39-f6839b460ba7 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:45.984484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e5f7387-e5d4-43d0-ac39-f6839b460ba7 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:45.985746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e5f7387-e5d4-43d0-ac39-f6839b460ba7 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:46.646359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e5f7387-e5d4-43d0-ac39-f6839b460ba7 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.722243 Jul 24 01:44:46.648509 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2794/5694] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:45 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:47.666806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9faf800-d642-4848-b076-3e4cb795bd73 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:47.668423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9faf800-d642-4848-b076-3e4cb795bd73 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:47.686697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9faf800-d642-4848-b076-3e4cb795bd73 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:47.687491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9faf800-d642-4848-b076-3e4cb795bd73 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:47.690135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9faf800-d642-4848-b076-3e4cb795bd73 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:47.692249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9faf800-d642-4848-b076-3e4cb795bd73 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:48.369664 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9faf800-d642-4848-b076-3e4cb795bd73 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.708650 Jul 24 01:44:48.375164 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2901/5695] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:47 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:49.392289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1d66a3c-c1c2-4a53-977c-8aae685ebf1f tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:49.392928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1d66a3c-c1c2-4a53-977c-8aae685ebf1f tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:49.408552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1d66a3c-c1c2-4a53-977c-8aae685ebf1f tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:49.409023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1d66a3c-c1c2-4a53-977c-8aae685ebf1f tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:49.413370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1d66a3c-c1c2-4a53-977c-8aae685ebf1f tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:49.413927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1d66a3c-c1c2-4a53-977c-8aae685ebf1f tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:49.634116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-63448888-ed43-480f-b3ac-484c3a31c32a req-13f43eac-9fef-4b52-b421-49d13f91e349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013db979-fed2-43ae-b2db-c0ddfc747d99", "name": "network-vif-plugged", "status": "completed", "tag": "0b4c8253-3add-4caf-9502-7feb4e0ef6c8"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:44:49.652563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-63448888-ed43-480f-b3ac-484c3a31c32a req-13f43eac-9fef-4b52-b421-49d13f91e349 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:49.653437 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-63448888-ed43-480f-b3ac-484c3a31c32a req-13f43eac-9fef-4b52-b421-49d13f91e349 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:49.702638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-63448888-ed43-480f-b3ac-484c3a31c32a req-13f43eac-9fef-4b52-b421-49d13f91e349 service nova] Creating event network-vif-plugged:0b4c8253-3add-4caf-9502-7feb4e0ef6c8 for instance 013db979-fed2-43ae-b2db-c0ddfc747d99 on n-h1-master-1 Jul 24 01:44:49.720399 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-63448888-ed43-480f-b3ac-484c3a31c32a req-13f43eac-9fef-4b52-b421-49d13f91e349 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091804 Jul 24 01:44:49.725568 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2902/5696] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:44:50.107296 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1d66a3c-c1c2-4a53-977c-8aae685ebf1f tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.719862 Jul 24 01:44:50.139114 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2795/5697] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:49 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:51.143787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-51e3d86e-a021-4f17-b3c9-c1d86b3293cd tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:51.145624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-51e3d86e-a021-4f17-b3c9-c1d86b3293cd tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:51.155841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51e3d86e-a021-4f17-b3c9-c1d86b3293cd tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:51.156667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51e3d86e-a021-4f17-b3c9-c1d86b3293cd tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:51.157738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51e3d86e-a021-4f17-b3c9-c1d86b3293cd tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:51.158389 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-51e3d86e-a021-4f17-b3c9-c1d86b3293cd tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:51.580009 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-51e3d86e-a021-4f17-b3c9-c1d86b3293cd tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1464 microversion: 2.1 time: 0.440492 Jul 24 01:44:51.582059 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2903/5698] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:51 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1464 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:52.166937 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:44:52.167738 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 01:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:44:52.604621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28b6f673-e93e-41d6-8722-a8f208872999 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:52.606023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-28b6f673-e93e-41d6-8722-a8f208872999 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:52.611630 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:44:52.613325 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 01:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:44:52.630139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b6f673-e93e-41d6-8722-a8f208872999 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:52.632714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b6f673-e93e-41d6-8722-a8f208872999 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:52.634560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b6f673-e93e-41d6-8722-a8f208872999 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:52.637232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28b6f673-e93e-41d6-8722-a8f208872999 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:53.031132 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28b6f673-e93e-41d6-8722-a8f208872999 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1648 microversion: 2.1 time: 0.435816 Jul 24 01:44:53.033627 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2796/5699] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:52 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1648 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:53.060057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-af040aff-dc35-4e0d-96d9-551c8a1f1e30 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:53.061518 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-af040aff-dc35-4e0d-96d9-551c8a1f1e30 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:53.083696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af040aff-dc35-4e0d-96d9-551c8a1f1e30 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:53.088952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af040aff-dc35-4e0d-96d9-551c8a1f1e30 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:53.090943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af040aff-dc35-4e0d-96d9-551c8a1f1e30 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:53.109059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-af040aff-dc35-4e0d-96d9-551c8a1f1e30 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:53.414740 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-af040aff-dc35-4e0d-96d9-551c8a1f1e30 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1648 microversion: 2.1 time: 0.359431 Jul 24 01:44:53.415674 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2904/5700] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:53 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1648 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:44:53.432175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64d2cdf1-f89b-4efe-8432-b2e3285f9e23 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:53.433119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-64d2cdf1-f89b-4efe-8432-b2e3285f9e23 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:53.450656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d2cdf1-f89b-4efe-8432-b2e3285f9e23 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:53.451823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d2cdf1-f89b-4efe-8432-b2e3285f9e23 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:53.456703 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d2cdf1-f89b-4efe-8432-b2e3285f9e23 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:53.457392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64d2cdf1-f89b-4efe-8432-b2e3285f9e23 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:53.819798 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-64d2cdf1-f89b-4efe-8432-b2e3285f9e23 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1648 microversion: 2.1 time: 0.391409 Jul 24 01:44:53.854896 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2797/5701] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:53 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1648 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:54.086346 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1882255551", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "fb20cf71-8bc5-4613-8ae3-8174c6e0f31a"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:44:54.313100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] validate_networks() for [('fb20cf71-8bc5-4613-8ae3-8174c6e0f31a', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:44:55.490320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:44:55.491550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:44:55.492282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:44:55.492998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:44:55.493621 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:44:55.520601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:55.522172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:55.528144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:55.529563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:55.567744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Getting quotas for project 7e1ad4ae9b3846acb6ab2af2690db6f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:44:55.578799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Getting quotas for user 0b11d226d8fa44f2bc24b219a0098e53 and project 7e1ad4ae9b3846acb6ab2af2690db6f9. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:44:55.608968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:44:55.612404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:44:55.819028 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba92c8e9-300c-436e-8eaf-a4b1225b4d0a tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720381 Jul 24 01:44:55.823350 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2905/5702] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:44:55.854750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-480f4764-5713-480f-b67f-c74c6f44927e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:55.867129 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-480f4764-5713-480f-b67f-c74c6f44927e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:56.288454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-480f4764-5713-480f-b67f-c74c6f44927e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1329 microversion: 2.1 time: 0.448647 Jul 24 01:44:56.290460 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2798/5703] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:55 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1329 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:57.331685 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ce877be-4ae2-4419-8264-b9b53a0589d3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:57.332313 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ce877be-4ae2-4419-8264-b9b53a0589d3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:57.351678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ce877be-4ae2-4419-8264-b9b53a0589d3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:57.352368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ce877be-4ae2-4419-8264-b9b53a0589d3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:57.353318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ce877be-4ae2-4419-8264-b9b53a0589d3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:57.354013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ce877be-4ae2-4419-8264-b9b53a0589d3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:57.525180 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ce877be-4ae2-4419-8264-b9b53a0589d3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1338 microversion: 2.1 time: 0.207427 Jul 24 01:44:57.526208 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2906/5704] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:57 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:58.543523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-102dabb3-6f18-4c38-954d-f71a4ef1b679 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:58.544833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-102dabb3-6f18-4c38-954d-f71a4ef1b679 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:58.571245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-102dabb3-6f18-4c38-954d-f71a4ef1b679 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:58.573131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-102dabb3-6f18-4c38-954d-f71a4ef1b679 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:58.574091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-102dabb3-6f18-4c38-954d-f71a4ef1b679 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:58.574540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-102dabb3-6f18-4c38-954d-f71a4ef1b679 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:58.847655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-102dabb3-6f18-4c38-954d-f71a4ef1b679 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1422 microversion: 2.1 time: 0.301962 Jul 24 01:44:58.848935 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2799/5705] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:58 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1422 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:59.867053 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cbfcdd34-5289-4706-8854-698484f714f9 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:44:59.867680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cbfcdd34-5289-4706-8854-698484f714f9 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:44:59.888744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbfcdd34-5289-4706-8854-698484f714f9 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:59.889867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbfcdd34-5289-4706-8854-698484f714f9 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:44:59.891472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbfcdd34-5289-4706-8854-698484f714f9 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:44:59.894194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cbfcdd34-5289-4706-8854-698484f714f9 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:01.197353 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=59 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:01.221049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cbfcdd34-5289-4706-8854-698484f714f9 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 1.357780 Jul 24 01:45:01.226462 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2907/5706] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:44:59 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:01.903390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4545f384-d6e6-4fb1-a580-b09abf5e6551 req-06e969b5-7470-428e-a5c8-8e02a96e7c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89873647-663c-47ad-98bd-f4856b39b53d", "tag": "afcfa852-61f1-4abf-9475-ee386d0d381c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:01.941110 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=31 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:01.950172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4545f384-d6e6-4fb1-a580-b09abf5e6551 req-06e969b5-7470-428e-a5c8-8e02a96e7c44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:01.952507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4545f384-d6e6-4fb1-a580-b09abf5e6551 req-06e969b5-7470-428e-a5c8-8e02a96e7c44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:02.004739 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=53 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:02.011900 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4545f384-d6e6-4fb1-a580-b09abf5e6551 req-06e969b5-7470-428e-a5c8-8e02a96e7c44 service nova] Creating event network-changed:afcfa852-61f1-4abf-9475-ee386d0d381c for instance 89873647-663c-47ad-98bd-f4856b39b53d on n-h2-master-1 Jul 24 01:45:02.037561 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4545f384-d6e6-4fb1-a580-b09abf5e6551 req-06e969b5-7470-428e-a5c8-8e02a96e7c44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147892 Jul 24 01:45:02.040562 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2800/5707] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:45:02.244533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-80f37a65-fa20-4645-90fa-a0fae70b6154 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:02.245160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-80f37a65-fa20-4645-90fa-a0fae70b6154 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:02.248321 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:02.259430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80f37a65-fa20-4645-90fa-a0fae70b6154 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:02.259430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80f37a65-fa20-4645-90fa-a0fae70b6154 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:02.259707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80f37a65-fa20-4645-90fa-a0fae70b6154 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:02.260021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-80f37a65-fa20-4645-90fa-a0fae70b6154 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:02.946568 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-80f37a65-fa20-4645-90fa-a0fae70b6154 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.707302 Jul 24 01:45:02.950742 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2908/5708] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:02 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:03.972220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be0e0007-a52a-408a-b9e2-517d62eea054 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:03.972999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be0e0007-a52a-408a-b9e2-517d62eea054 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:03.981626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be0e0007-a52a-408a-b9e2-517d62eea054 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:03.982961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be0e0007-a52a-408a-b9e2-517d62eea054 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:03.983933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be0e0007-a52a-408a-b9e2-517d62eea054 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:03.984512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be0e0007-a52a-408a-b9e2-517d62eea054 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:04.665477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be0e0007-a52a-408a-b9e2-517d62eea054 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.703436 Jul 24 01:45:04.666382 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2801/5709] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:03 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:05.685505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a1b3dff1-da34-4662-a104-da0ab238d32b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:05.687202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a1b3dff1-da34-4662-a104-da0ab238d32b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:05.718935 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:05.719751 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:05.721545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b3dff1-da34-4662-a104-da0ab238d32b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:05.722138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b3dff1-da34-4662-a104-da0ab238d32b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:05.730733 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b3dff1-da34-4662-a104-da0ab238d32b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:05.731235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a1b3dff1-da34-4662-a104-da0ab238d32b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:06.123618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a1b3dff1-da34-4662-a104-da0ab238d32b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.443994 Jul 24 01:45:06.128204 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2909/5710] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:05 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:07.146401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e0b100a-dd40-4f8d-9ebc-29ee0a268146 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:07.147014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e0b100a-dd40-4f8d-9ebc-29ee0a268146 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:07.150094 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:07.167356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e0b100a-dd40-4f8d-9ebc-29ee0a268146 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:07.167611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e0b100a-dd40-4f8d-9ebc-29ee0a268146 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:07.168408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e0b100a-dd40-4f8d-9ebc-29ee0a268146 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:07.169455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e0b100a-dd40-4f8d-9ebc-29ee0a268146 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:07.590041 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e0b100a-dd40-4f8d-9ebc-29ee0a268146 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.445447 Jul 24 01:45:07.602245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2802/5711] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:07 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:08.611003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4234713a-5b42-4a35-9627-a0d524a4f958 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:08.612309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4234713a-5b42-4a35-9627-a0d524a4f958 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:08.624702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4234713a-5b42-4a35-9627-a0d524a4f958 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:08.627775 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4234713a-5b42-4a35-9627-a0d524a4f958 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:08.628796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4234713a-5b42-4a35-9627-a0d524a4f958 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:08.629448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4234713a-5b42-4a35-9627-a0d524a4f958 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:09.121615 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4234713a-5b42-4a35-9627-a0d524a4f958 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.515024 Jul 24 01:45:09.137911 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2910/5712] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:08 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:10.146226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1d68cb4-37ac-4278-b5f5-f520c18a2e8e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:10.146847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1d68cb4-37ac-4278-b5f5-f520c18a2e8e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:10.165301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1d68cb4-37ac-4278-b5f5-f520c18a2e8e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:10.178395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1d68cb4-37ac-4278-b5f5-f520c18a2e8e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:10.181854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1d68cb4-37ac-4278-b5f5-f520c18a2e8e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:10.182338 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1d68cb4-37ac-4278-b5f5-f520c18a2e8e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:10.649656 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1d68cb4-37ac-4278-b5f5-f520c18a2e8e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.507191 Jul 24 01:45:10.660246 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2803/5713] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:10 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:11.696647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0fdcc0ab-a62e-4917-bd17-d1a02bc3fbc5 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:11.697389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0fdcc0ab-a62e-4917-bd17-d1a02bc3fbc5 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:11.724562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fdcc0ab-a62e-4917-bd17-d1a02bc3fbc5 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:11.725002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fdcc0ab-a62e-4917-bd17-d1a02bc3fbc5 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:11.725851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fdcc0ab-a62e-4917-bd17-d1a02bc3fbc5 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:11.726302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0fdcc0ab-a62e-4917-bd17-d1a02bc3fbc5 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:12.156005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-da1bdd8c-d1c4-4e8e-a961-04e3de1a661d req-51368f1b-53be-44c0-a5dd-ace6a0e00057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89873647-663c-47ad-98bd-f4856b39b53d", "name": "network-vif-plugged", "status": "completed", "tag": "afcfa852-61f1-4abf-9475-ee386d0d381c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:12.190118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-da1bdd8c-d1c4-4e8e-a961-04e3de1a661d req-51368f1b-53be-44c0-a5dd-ace6a0e00057 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:12.190574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-da1bdd8c-d1c4-4e8e-a961-04e3de1a661d req-51368f1b-53be-44c0-a5dd-ace6a0e00057 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:12.211287 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0fdcc0ab-a62e-4917-bd17-d1a02bc3fbc5 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.526647 Jul 24 01:45:12.223349 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2804/5714] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:11 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:12.240604 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-da1bdd8c-d1c4-4e8e-a961-04e3de1a661d req-51368f1b-53be-44c0-a5dd-ace6a0e00057 service nova] Creating event network-vif-plugged:afcfa852-61f1-4abf-9475-ee386d0d381c for instance 89873647-663c-47ad-98bd-f4856b39b53d on n-h2-master-1 Jul 24 01:45:12.270130 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-da1bdd8c-d1c4-4e8e-a961-04e3de1a661d req-51368f1b-53be-44c0-a5dd-ace6a0e00057 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.854536 Jul 24 01:45:12.276077 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2911/5715] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:45:13.229092 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6eb1dc6b-9028-4997-8af8-427182350ff0 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:13.229768 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6eb1dc6b-9028-4997-8af8-427182350ff0 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:13.238704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb1dc6b-9028-4997-8af8-427182350ff0 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:13.239168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb1dc6b-9028-4997-8af8-427182350ff0 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:13.256490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb1dc6b-9028-4997-8af8-427182350ff0 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:13.257010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb1dc6b-9028-4997-8af8-427182350ff0 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:13.587621 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6eb1dc6b-9028-4997-8af8-427182350ff0 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1464 microversion: 2.1 time: 0.362607 Jul 24 01:45:13.599278 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2805/5716] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:13 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:14.608712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3ff607eb-7b7b-4c25-9662-02c93a791d5b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:14.609700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3ff607eb-7b7b-4c25-9662-02c93a791d5b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:14.623031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff607eb-7b7b-4c25-9662-02c93a791d5b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:14.623765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff607eb-7b7b-4c25-9662-02c93a791d5b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:14.630492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff607eb-7b7b-4c25-9662-02c93a791d5b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:14.631216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3ff607eb-7b7b-4c25-9662-02c93a791d5b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:14.955670 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3ff607eb-7b7b-4c25-9662-02c93a791d5b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1648 microversion: 2.1 time: 0.352810 Jul 24 01:45:14.961628 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2912/5717] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:14 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1648 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:14.972149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8182ae14-aee4-4cbe-9214-ce9591274e4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:14.972887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8182ae14-aee4-4cbe-9214-ce9591274e4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:14.997363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8182ae14-aee4-4cbe-9214-ce9591274e4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:14.997688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8182ae14-aee4-4cbe-9214-ce9591274e4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:14.998674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8182ae14-aee4-4cbe-9214-ce9591274e4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:14.999276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8182ae14-aee4-4cbe-9214-ce9591274e4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:15.388278 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8182ae14-aee4-4cbe-9214-ce9591274e4e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1648 microversion: 2.1 time: 0.419168 Jul 24 01:45:15.392289 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2806/5718] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:14 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1648 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:15.409198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb981682-3f06-42aa-9548-bc95e73dba2e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:15.411459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb981682-3f06-42aa-9548-bc95e73dba2e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:15.425620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb981682-3f06-42aa-9548-bc95e73dba2e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:15.427300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb981682-3f06-42aa-9548-bc95e73dba2e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:15.428328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb981682-3f06-42aa-9548-bc95e73dba2e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:15.428918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb981682-3f06-42aa-9548-bc95e73dba2e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:15.744266 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb981682-3f06-42aa-9548-bc95e73dba2e tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1648 microversion: 2.1 time: 0.340090 Jul 24 01:45:15.755922 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2913/5719] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:15 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1648 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:15.761051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:15.761566 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:15.779294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:15.779294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:15.779294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:15.779796 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:15.838445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:45:16.002032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-156d1a81-024b-40a4-95c3-2f6e816f45fb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 204 len: 0 microversion: 2.1 time: 0.243205 Jul 24 01:45:16.008133 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2807/5720] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:45:15 2022] DELETE /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:45:16.013490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-433f6498-f71b-423f-8310-82d1772419b8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:16.014142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-433f6498-f71b-423f-8310-82d1772419b8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:16.025233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-433f6498-f71b-423f-8310-82d1772419b8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:16.025916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-433f6498-f71b-423f-8310-82d1772419b8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:16.026728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-433f6498-f71b-423f-8310-82d1772419b8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:16.030048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-433f6498-f71b-423f-8310-82d1772419b8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:16.350696 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-433f6498-f71b-423f-8310-82d1772419b8 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1654 microversion: 2.1 time: 0.341130 Jul 24 01:45:16.354015 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2914/5721] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:16 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1654 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:45:16.588488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ea2597ac-8133-4a10-b697-b161acd2d88c tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Action: 'create', calling method: .version_select at 0x7f05ea465550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1786708000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJncDwPpAUGox96SVMXjXbD/cqigfH30Z8zlp5roCFvveqiSqh7obOubgXEJtHNiKI781URjar/SMZbiexxFcohLkdYFWg/VXj6mTZXojOnLt81yP6Gp+TFIEvU6d9u+Q=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:16.636778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ea2597ac-8133-4a10-b697-b161acd2d88c tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Getting quotas for project 9594d185ff204f60b15075242c4a9d4c. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:45:16.647140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ea2597ac-8133-4a10-b697-b161acd2d88c tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Getting quotas for user 8f38ad0b87584fb498dc0479b0656b7f and project 9594d185ff204f60b15075242c4a9d4c. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:45:16.697536 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ea2597ac-8133-4a10-b697-b161acd2d88c tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.113257 Jul 24 01:45:16.698553 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2808/5722] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:45:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:45:17.387201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff032454-c19e-407e-b9ba-07a696b20653 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:17.387999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff032454-c19e-407e-b9ba-07a696b20653 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:17.397166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff032454-c19e-407e-b9ba-07a696b20653 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:17.398242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff032454-c19e-407e-b9ba-07a696b20653 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:17.399030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff032454-c19e-407e-b9ba-07a696b20653 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:17.399473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff032454-c19e-407e-b9ba-07a696b20653 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:17.929023 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff032454-c19e-407e-b9ba-07a696b20653 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1654 microversion: 2.1 time: 0.554558 Jul 24 01:45:17.942951 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2915/5723] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:17 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1654 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:18.692273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0fec7856-7b32-4202-ba29-05915a23082d req-3dfe4275-bd77-4a15-aa82-c3f6eea4c28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89873647-663c-47ad-98bd-f4856b39b53d", "name": "network-vif-deleted", "tag": "afcfa852-61f1-4abf-9475-ee386d0d381c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:18.742061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0fec7856-7b32-4202-ba29-05915a23082d req-3dfe4275-bd77-4a15-aa82-c3f6eea4c28f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:18.745933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0fec7856-7b32-4202-ba29-05915a23082d req-3dfe4275-bd77-4a15-aa82-c3f6eea4c28f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:18.831038 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0fec7856-7b32-4202-ba29-05915a23082d req-3dfe4275-bd77-4a15-aa82-c3f6eea4c28f service nova] Creating event network-vif-deleted:afcfa852-61f1-4abf-9475-ee386d0d381c for instance 89873647-663c-47ad-98bd-f4856b39b53d on n-h2-master-1 Jul 24 01:45:18.858527 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0fec7856-7b32-4202-ba29-05915a23082d req-3dfe4275-bd77-4a15-aa82-c3f6eea4c28f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170356 Jul 24 01:45:18.886124 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2809/5724] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:45:18.948891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:18.951513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:18.965761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:18.972294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:18.974433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:18.976502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:19.102773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:19.103850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:19.108655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lazy-loading 'fault' on Instance uuid 89873647-663c-47ad-98bd-f4856b39b53d {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:45:19.280862 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-47a6103b-c420-4650-bed5-4fd8a37f5a00 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 200 len: 1454 microversion: 2.1 time: 0.335862 Jul 24 01:45:19.295179 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2916/5725] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:18 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 1454 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:20.065418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-114157542", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2fe175eb-66e9-40ab-b9de-7a436a662d95", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1786708000", "security_groups": [{"name": "tempest-secgroup-smoke-1232213213"}], "networks": [{"uuid": "92337953-88d6-43f8-aa3b-2af205c3b601"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:20.300495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:20.302402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 89873647-663c-47ad-98bd-f4856b39b53d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:20.325771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:20.328844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:20.331191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:20.333833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:20.368782 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] HTTP exception thrown: Instance 89873647-663c-47ad-98bd-f4856b39b53d could not be found. Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Request method failure captured: Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d HTTP/1.1 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KP8HDbwePSDgSdqO3IyvZKDwJ13HOzoTf3E_EwJwdWMk_AO4-8n3IWQN5pDpDC2ijmZ7WCdA75A6AZdhd4VeUfq04eLuTDUbUBJDqt88qfkSlHbDS7P0ANLLixzQU2mi4hykfY0_mbfyTnKuytZDduMJO1K2h13tGTFfOSD0GQNE98 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 7e1ad4ae9b3846acb6ab2af2690db6f9 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestServerMultinode-223891076 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e1ad4ae9b3846acb6ab2af2690db6f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e1ad4ae9b3846acb6ab2af2690db6f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e1ad4ae9b3846acb6ab2af2690db6f9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e1ad4ae9b3846acb6ab2af2690db6f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestServerMultinode-223891076 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 7e1ad4ae9b3846acb6ab2af2690db6f9 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestServerMultinode-223891076 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestServerMultinode-223891076-project-admin Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 0b11d226d8fa44f2bc24b219a0098e53 Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestServerMultinode-223891076-project-admin Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 89873647-663c-47ad-98bd-f4856b39b53d could not be found. Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '89873647-663c-47ad-98bd-f4856b39b53d'} Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89873647-663c-47ad-98bd-f4856b39b53d could not be found. Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89873647-663c-47ad-98bd-f4856b39b53d could not be found. Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:45:20.370781 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:20.376991 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:45:20.376991 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:45:20.376991 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:45:20.376991 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:45:20.376991 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:45:20.376991 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89873647-663c-47ad-98bd-f4856b39b53d could not be found. Jul 24 01:45:20.376991 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:20.385144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Returning 404 to user: Instance 89873647-663c-47ad-98bd-f4856b39b53d could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:45:20.386563 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a7e88b44-7867-4e0c-8220-09666de60014 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d" status: 404 len: 111 microversion: 2.1 time: 0.092683 Jul 24 01:45:20.388578 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2917/5726] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:20 2022] GET /compute/v2.1/servers/89873647-663c-47ad-98bd-f4856b39b53d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:45:20.404249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:20.411103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:20.431416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:20.437384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:20.440332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:20.446921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:20.453483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] validate_networks() for [('92337953-88d6-43f8-aa3b-2af205c3b601', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:45:20.546171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:45:20.823819 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b5167292-1ab8-43c5-abed-db8ed9bacc1b tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 204 len: 0 microversion: 2.1 time: 0.427950 Jul 24 01:45:20.826622 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2918/5727] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:45:20 2022] DELETE /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:45:20.843579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8c3d2b52-a9fc-4359-9cc2-d9917169c0e2 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:20.846486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c3d2b52-a9fc-4359-9cc2-d9917169c0e2 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:20.862024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c3d2b52-a9fc-4359-9cc2-d9917169c0e2 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:20.863042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c3d2b52-a9fc-4359-9cc2-d9917169c0e2 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:20.864695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c3d2b52-a9fc-4359-9cc2-d9917169c0e2 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:20.866171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c3d2b52-a9fc-4359-9cc2-d9917169c0e2 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:21.901817 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8c3d2b52-a9fc-4359-9cc2-d9917169c0e2 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1654 microversion: 2.1 time: 1.066203 Jul 24 01:45:21.911793 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2919/5728] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:20 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1654 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:22.924750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-208ab84b-f966-43c3-a58b-0ef7e9f51216 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:22.925560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-208ab84b-f966-43c3-a58b-0ef7e9f51216 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:22.945057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-208ab84b-f966-43c3-a58b-0ef7e9f51216 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:22.945716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-208ab84b-f966-43c3-a58b-0ef7e9f51216 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:22.947660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-208ab84b-f966-43c3-a58b-0ef7e9f51216 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:22.950323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-208ab84b-f966-43c3-a58b-0ef7e9f51216 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:23.115597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:45:23.116176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:45:23.116487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:45:23.116907 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:45:23.117326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:45:23.134456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:23.134915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:23.135727 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:23.141465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:23.181831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Getting quotas for project 9594d185ff204f60b15075242c4a9d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:45:23.202813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Getting quotas for user 8f38ad0b87584fb498dc0479b0656b7f and project 9594d185ff204f60b15075242c4a9d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:45:23.310992 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-208ab84b-f966-43c3-a58b-0ef7e9f51216 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1654 microversion: 2.1 time: 0.390223 Jul 24 01:45:23.317800 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2920/5729] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:22 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1654 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:45:23.380587 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:45:23.383122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fe175eb-66e9-40ab-b9de-7a436a662d95',volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:45:23.611484 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-15a1107c-cf30-4011-92f9-0f4c7e4908d2 req-126f5299-2dbe-42a1-96f5-69d3f5f8e30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013db979-fed2-43ae-b2db-c0ddfc747d99", "name": "network-vif-deleted", "tag": "0b4c8253-3add-4caf-9502-7feb4e0ef6c8"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:23.630280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15a1107c-cf30-4011-92f9-0f4c7e4908d2 req-126f5299-2dbe-42a1-96f5-69d3f5f8e30f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:23.630742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15a1107c-cf30-4011-92f9-0f4c7e4908d2 req-126f5299-2dbe-42a1-96f5-69d3f5f8e30f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:23.662406 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-15a1107c-cf30-4011-92f9-0f4c7e4908d2 req-126f5299-2dbe-42a1-96f5-69d3f5f8e30f service nova] Creating event network-vif-deleted:0b4c8253-3add-4caf-9502-7feb4e0ef6c8 for instance 013db979-fed2-43ae-b2db-c0ddfc747d99 on n-h1-master-1 Jul 24 01:45:23.687660 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-96c28ad4-a666-4612-9bee-a3ac604a2006 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.653245 Jul 24 01:45:23.692104 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2810/5730] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:45:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 3674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:45:23.692319 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-15a1107c-cf30-4011-92f9-0f4c7e4908d2 req-126f5299-2dbe-42a1-96f5-69d3f5f8e30f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084500 Jul 24 01:45:23.705026 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2921/5731] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:45:23.707368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7da94a73-b7fb-4d7d-8ea0-1a513151157e tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:23.714636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7da94a73-b7fb-4d7d-8ea0-1a513151157e tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:23.988775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7da94a73-b7fb-4d7d-8ea0-1a513151157e tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:24.039130 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7da94a73-b7fb-4d7d-8ea0-1a513151157e tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1098 microversion: 2.1 time: 0.340819 Jul 24 01:45:24.039672 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2811/5732] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:23 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1098 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:24.335312 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:24.336030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:24.352002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:24.352760 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:24.353737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:24.362605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:24.522813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:24.523616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:24.524100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lazy-loading 'fault' on Instance uuid 013db979-fed2-43ae-b2db-c0ddfc747d99 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:45:24.805227 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79b86d4c-7d41-4ba5-a391-83ddbc2406cb tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 200 len: 1454 microversion: 2.1 time: 0.473768 Jul 24 01:45:24.810881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2922/5733] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:24 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 1454 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:45:25.057459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:25.058130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:25.084157 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:25.085581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:25.099699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:25.101848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:25.372372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:25.388129 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c286dbc7-2343-4b96-b1dd-cb0a64976836 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1140 microversion: 2.1 time: 0.332762 Jul 24 01:45:25.389299 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2812/5734] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:25 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1140 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:25.833604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:25.839214 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] [instance: 013db979-fed2-43ae-b2db-c0ddfc747d99] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:25.872880 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:25.873762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:25.875502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:25.878274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:25.934064 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] HTTP exception thrown: Instance 013db979-fed2-43ae-b2db-c0ddfc747d99 could not be found. Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Request method failure captured: Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 HTTP/1.1 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KP8HDbwePSDgSdqO3IyvZKDwJ13HOzoTf3E_EwJwdWMk_AO4-8n3IWQN5pDpDC2ijmZ7WCdA75A6AZdhd4VeUfq04eLuTDUbUBJDqt88qfkSlHbDS7P0ANLLixzQU2mi4hykfY0_mbfyTnKuytZDduMJO1K2h13tGTFfOSD0GQNE98 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 7e1ad4ae9b3846acb6ab2af2690db6f9 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestServerMultinode-223891076 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e1ad4ae9b3846acb6ab2af2690db6f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e1ad4ae9b3846acb6ab2af2690db6f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e1ad4ae9b3846acb6ab2af2690db6f9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e1ad4ae9b3846acb6ab2af2690db6f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestServerMultinode-223891076 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 7e1ad4ae9b3846acb6ab2af2690db6f9 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestServerMultinode-223891076 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestServerMultinode-223891076-project-admin Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 0b11d226d8fa44f2bc24b219a0098e53 Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestServerMultinode-223891076-project-admin Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 013db979-fed2-43ae-b2db-c0ddfc747d99 could not be found. Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '013db979-fed2-43ae-b2db-c0ddfc747d99'} Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013db979-fed2-43ae-b2db-c0ddfc747d99 could not be found. Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013db979-fed2-43ae-b2db-c0ddfc747d99 could not be found. Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:45:25.944193 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013db979-fed2-43ae-b2db-c0ddfc747d99 could not be found. Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:45:25.949017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] Returning 404 to user: Instance 013db979-fed2-43ae-b2db-c0ddfc747d99 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:45:25.951766 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dca039a9-000a-403f-b05e-baa49b299ef3 tempest-TestServerMultinode-223891076 tempest-TestServerMultinode-223891076-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99" status: 404 len: 111 microversion: 2.1 time: 0.123566 Jul 24 01:45:25.960550 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2923/5735] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:25 2022] GET /compute/v2.1/servers/013db979-fed2-43ae-b2db-c0ddfc747d99 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:45:26.407336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:26.408547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:26.430110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:26.435830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:26.436869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:26.438253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:26.735228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:26.743453 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa8ee859-88d1-43b0-9c67-77379bda2603 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1214 microversion: 2.1 time: 0.341692 Jul 24 01:45:26.754454 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2813/5736] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:26 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1214 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:27.772800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:27.773316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:27.790246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:27.798327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:27.802246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:27.802922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:28.504965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:28.513487 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:28.520300 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-def5e230-1ad6-41c4-b1c1-b80a50d0d248 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1214 microversion: 2.1 time: 0.752120 Jul 24 01:45:28.520908 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2924/5737] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:27 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1214 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:29.538304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:29.538917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:29.548325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:29.564458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:29.565310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:29.565790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:30.833916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:30.848561 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c8258f98-5ce3-4f0a-b1a6-9d45b818f749 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1214 microversion: 2.1 time: 1.310515 Jul 24 01:45:30.849732 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2814/5738] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:29 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1214 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:31.866279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:31.869266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:31.898440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:31.901663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:31.903231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:31.910767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:32.363221 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:32.379291 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e8da6280-ea9f-4203-a52f-f15b54ddc49b tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1214 microversion: 2.1 time: 0.514697 Jul 24 01:45:32.383034 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2925/5739] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:31 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1214 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:33.396889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:33.397610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:33.413921 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:33.415176 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:33.417403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:33.420544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:33.421452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:33.423443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:34.031792 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:34.139405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:34.141753 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:34.157875 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-904dc24c-d45b-4760-a2f4-bf0878285207 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1282 microversion: 2.1 time: 0.763387 Jul 24 01:45:34.158564 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2815/5740] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:33 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1282 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:35.177409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:35.178578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:35.191008 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:35.228796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:35.234629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:35.235515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:35.235988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:36.384138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:36.397378 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97560f6c-60d5-4674-b710-673fb44fd544 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1282 microversion: 2.1 time: 1.225427 Jul 24 01:45:36.415181 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2926/5741] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:35 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1282 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:36.926235 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-30e8d106-09b5-41ae-846a-7e0da7aa857f req-9981fd12-8505-4d23-bf47-8a42f4352ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253a26a4-58cb-4805-9d28-c77dc4ea7cce", "tag": "71dc45b3-ad63-4c9d-8736-45982aaf755c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:36.965822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-30e8d106-09b5-41ae-846a-7e0da7aa857f req-9981fd12-8505-4d23-bf47-8a42f4352ee5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:36.966510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-30e8d106-09b5-41ae-846a-7e0da7aa857f req-9981fd12-8505-4d23-bf47-8a42f4352ee5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:37.016451 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-30e8d106-09b5-41ae-846a-7e0da7aa857f req-9981fd12-8505-4d23-bf47-8a42f4352ee5 service nova] Creating event network-changed:71dc45b3-ad63-4c9d-8736-45982aaf755c for instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce on n-h2-master-1 Jul 24 01:45:37.030120 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-30e8d106-09b5-41ae-846a-7e0da7aa857f req-9981fd12-8505-4d23-bf47-8a42f4352ee5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104997 Jul 24 01:45:37.031086 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2816/5742] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:45:37.414142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:37.414906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:37.426760 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:37.427144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:37.427937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:37.428398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:38.175314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:38.192128 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f34aa4a-b420-4da0-abff-edf956f72460 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1270 microversion: 2.1 time: 0.781741 Jul 24 01:45:38.193686 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2927/5743] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:37 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1270 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:39.213312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:39.214156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:39.238046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:39.240291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:39.241263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:39.245152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:40.996586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:41.006136 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-944758dd-6bb5-4a1b-82a9-aae1c2142f9d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1270 microversion: 2.1 time: 1.799031 Jul 24 01:45:41.018367 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2817/5744] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:39 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1270 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:42.022920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:42.023534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:42.040109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:42.048963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:42.050613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:42.051216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:43.086973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:43.103242 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb50c091-8037-4be2-80c9-9d18cddd9bef tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1270 microversion: 2.1 time: 1.084341 Jul 24 01:45:43.103857 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2928/5745] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:42 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1270 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:44.123070 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:44.123772 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:44.146971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:44.147428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:44.148237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:44.156092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:45.099805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:45.110161 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-193399af-b124-473a-a435-85eb9168a272 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1270 microversion: 2.1 time: 0.991792 Jul 24 01:45:45.120891 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2818/5746] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:44 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1270 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:45.641859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-014579bb-4660-4e53-8c5d-874d7051fca3 req-0b4272b0-c5f5-4c94-abbc-a8d73cb13c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a26a4-58cb-4805-9d28-c77dc4ea7cce", "name": "network-vif-plugged", "status": "completed", "tag": "71dc45b3-ad63-4c9d-8736-45982aaf755c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:45.660468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-014579bb-4660-4e53-8c5d-874d7051fca3 req-0b4272b0-c5f5-4c94-abbc-a8d73cb13c73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:45.660921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-014579bb-4660-4e53-8c5d-874d7051fca3 req-0b4272b0-c5f5-4c94-abbc-a8d73cb13c73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:45.715657 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-014579bb-4660-4e53-8c5d-874d7051fca3 req-0b4272b0-c5f5-4c94-abbc-a8d73cb13c73 service nova] Creating event network-vif-plugged:71dc45b3-ad63-4c9d-8736-45982aaf755c for instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce on n-h2-master-1 Jul 24 01:45:45.729702 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-014579bb-4660-4e53-8c5d-874d7051fca3 req-0b4272b0-c5f5-4c94-abbc-a8d73cb13c73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092128 Jul 24 01:45:45.731217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2929/5747] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:45:46.128245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:46.129592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:46.138105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:46.158490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:46.159759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:46.160555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:47.073263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:47.081148 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-57eef7c4-8714-4371-8f5b-cb2702d402a4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1270 microversion: 2.1 time: 0.956733 Jul 24 01:45:47.081771 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2819/5748] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:46 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1270 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:48.099988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:48.101600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:48.116141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:48.122403 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:48.123641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:48.125061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:48.648066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:48.662729 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8c6355ca-559c-439d-b0d0-c4d876386dd4 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1270 microversion: 2.1 time: 0.567072 Jul 24 01:45:48.665463 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2930/5749] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:48 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1270 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:49.687969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:49.688613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:49.703640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:49.704607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:49.712209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:49.713130 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:50.324834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:50.338552 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0d1a18a4-fc72-42ee-8d96-bdd9bfa38869 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1458 microversion: 2.1 time: 0.661927 Jul 24 01:45:50.362401 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2820/5750] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:49 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1458 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:50.378571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:45:50.380118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:45:50.395635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:50.396367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:50.397413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:50.400916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:51.173073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:45:51.182199 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-34108f84-d447-4219-ab3c-fdbed103ce34 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1458 microversion: 2.1 time: 0.807478 Jul 24 01:45:51.182841 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2931/5751] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:45:50 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1458 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:45:58.560716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4a0e1ae2-67a5-4eee-847c-cabb329a2e94 req-a7020d50-649b-491e-bec7-b41504fcd35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253a26a4-58cb-4805-9d28-c77dc4ea7cce", "tag": "71dc45b3-ad63-4c9d-8736-45982aaf755c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:45:58.574757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4a0e1ae2-67a5-4eee-847c-cabb329a2e94 req-a7020d50-649b-491e-bec7-b41504fcd35e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:45:58.584920 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4a0e1ae2-67a5-4eee-847c-cabb329a2e94 req-a7020d50-649b-491e-bec7-b41504fcd35e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:45:58.621793 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4a0e1ae2-67a5-4eee-847c-cabb329a2e94 req-a7020d50-649b-491e-bec7-b41504fcd35e service nova] Creating event network-changed:71dc45b3-ad63-4c9d-8736-45982aaf755c for instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce on n-h2-master-1 Jul 24 01:45:58.627743 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4a0e1ae2-67a5-4eee-847c-cabb329a2e94 req-a7020d50-649b-491e-bec7-b41504fcd35e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071702 Jul 24 01:45:58.632512 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2821/5752] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:46:04.284404 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=11 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:04.285505 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=39 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:04.832706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0265e954-1c7e-4fc7-a4fe-c8dfadac5ce8 req-28b1469d-0554-4aa5-b5dd-eb15f1ec180c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253a26a4-58cb-4805-9d28-c77dc4ea7cce", "tag": "71dc45b3-ad63-4c9d-8736-45982aaf755c"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:04.846122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0265e954-1c7e-4fc7-a4fe-c8dfadac5ce8 req-28b1469d-0554-4aa5-b5dd-eb15f1ec180c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:04.846983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0265e954-1c7e-4fc7-a4fe-c8dfadac5ce8 req-28b1469d-0554-4aa5-b5dd-eb15f1ec180c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:04.864950 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0265e954-1c7e-4fc7-a4fe-c8dfadac5ce8 req-28b1469d-0554-4aa5-b5dd-eb15f1ec180c service nova] Creating event network-changed:71dc45b3-ad63-4c9d-8736-45982aaf755c for instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce on n-h2-master-1 Jul 24 01:46:04.884922 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0265e954-1c7e-4fc7-a4fe-c8dfadac5ce8 req-28b1469d-0554-4aa5-b5dd-eb15f1ec180c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.594829 Jul 24 01:46:04.886993 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2932/5753] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:46:06.919770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-442616d8-79aa-4286-b707-e9af373f51a6 req-51a7f2de-f843-4360-89a5-c476b25056c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253a26a4-58cb-4805-9d28-c77dc4ea7cce", "tag": "71dc45b3-ad63-4c9d-8736-45982aaf755c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:06.930694 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=14 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:06.950234 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-442616d8-79aa-4286-b707-e9af373f51a6 req-51a7f2de-f843-4360-89a5-c476b25056c9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:06.950716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-442616d8-79aa-4286-b707-e9af373f51a6 req-51a7f2de-f843-4360-89a5-c476b25056c9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:07.017004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-442616d8-79aa-4286-b707-e9af373f51a6 req-51a7f2de-f843-4360-89a5-c476b25056c9 service nova] Creating event network-changed:71dc45b3-ad63-4c9d-8736-45982aaf755c for instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce on n-h2-master-1 Jul 24 01:46:07.028172 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-442616d8-79aa-4286-b707-e9af373f51a6 req-51a7f2de-f843-4360-89a5-c476b25056c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115633 Jul 24 01:46:07.030125 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2822/5754] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:46:31.391077 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-1f0ffd85-6bb8-4b9d-bcaa-afcca803ddf0 req-e06493ac-36e4-4817-b23a-0e5d30dff194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253a26a4-58cb-4805-9d28-c77dc4ea7cce", "tag": "71dc45b3-ad63-4c9d-8736-45982aaf755c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:31.393954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:31.396514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:31.414203 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:31.419742 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=31 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:31.421067 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:31.426504 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:31.434335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:31.436793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:31.439078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:31.439556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:31.441058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1f0ffd85-6bb8-4b9d-bcaa-afcca803ddf0 req-e06493ac-36e4-4817-b23a-0e5d30dff194 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:31.441516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-1f0ffd85-6bb8-4b9d-bcaa-afcca803ddf0 req-e06493ac-36e4-4817-b23a-0e5d30dff194 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:31.511510 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-1f0ffd85-6bb8-4b9d-bcaa-afcca803ddf0 req-e06493ac-36e4-4817-b23a-0e5d30dff194 service nova] Creating event network-changed:71dc45b3-ad63-4c9d-8736-45982aaf755c for instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce on n-h2-master-1 Jul 24 01:46:31.553003 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-1f0ffd85-6bb8-4b9d-bcaa-afcca803ddf0 req-e06493ac-36e4-4817-b23a-0e5d30dff194 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164180 Jul 24 01:46:31.559905 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2823/5755] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:46:31.579167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:46:31.820598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4e19d93b-5893-441a-9855-ad9aa32a9443 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "DELETE /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 204 len: 0 microversion: 2.1 time: 0.441300 Jul 24 01:46:31.822478 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2933/5756] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:46:31 2022] DELETE /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:46:31.833613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:31.835599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:31.849556 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:31.853886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:31.855290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:31.856857 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:32.239054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:32.249876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cb541722-5256-49df-a2af-0fa3d243e305 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1583 microversion: 2.1 time: 0.422755 Jul 24 01:46:32.250485 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2824/5757] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:31 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1583 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:33.231613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-40fe3cae-4a4f-42ff-89d6-7b522167230e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Action: 'create', calling method: .version_select at 0x7f05e9c6bdc0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-929724029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIOu6AIagu7LRpOBfJMqqpmkdyBDReg4fN4vyEGFdmJBwlxMRG6GE1h/EPX+bFvf4SGVBEFwhEwLwTngvD9jJtidV4hswmNfc9tKIm1J855r0WK6RE+8bAF+RmkexuXzQ=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:33.258806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-40fe3cae-4a4f-42ff-89d6-7b522167230e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Getting quotas for project 101695253c6e40569d3cb5b391fccd61. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:46:33.268352 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:33.268959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:33.282595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:33.286965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:33.288216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:33.289467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-40fe3cae-4a4f-42ff-89d6-7b522167230e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Getting quotas for user c4b34bec387d42859f416aa3df7a7d0e and project 101695253c6e40569d3cb5b391fccd61. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:46:33.290107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:33.388117 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-40fe3cae-4a4f-42ff-89d6-7b522167230e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.580636 Jul 24 01:46:33.388789 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2934/5758] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:46:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:46:33.752989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:33.767847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a306a47b-d7db-4515-8b7d-bdefe0051a94 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1583 microversion: 2.1 time: 0.503206 Jul 24 01:46:33.779512 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2825/5759] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:33 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1583 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:46:34.788835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:34.790911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:34.809234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:34.811550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:34.812710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:34.819973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:35.210465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:35.228536 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b16e2cb6-3ab8-4fcc-ae4b-30ac0805f3af tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1464 microversion: 2.1 time: 0.446721 Jul 24 01:46:35.238677 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2935/5760] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:34 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1464 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:36.246274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:36.246896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:36.256286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:36.257151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:36.258262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:36.258856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:36.786323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:36.814249 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-501a117b-001e-43fd-b767-b061640c15d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1464 microversion: 2.1 time: 0.571822 Jul 24 01:46:36.841112 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2826/5761] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:36 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1464 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:37.832600 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:37.833226 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:37.845066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:37.845066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:37.869247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:37.871433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:38.001957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:38.021054 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-03eba984-a177-465c-a01c-da1bd2803d3d tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1396 microversion: 2.1 time: 0.192424 Jul 24 01:46:38.027059 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2936/5762] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:37 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1396 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:38.265229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ad261d78-c7fd-473d-8caa-d5938e66ad2d req-e96eccf1-3781-47f1-9b0f-2c02b836176a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a26a4-58cb-4805-9d28-c77dc4ea7cce", "name": "network-vif-deleted", "tag": "71dc45b3-ad63-4c9d-8736-45982aaf755c"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:38.282467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ad261d78-c7fd-473d-8caa-d5938e66ad2d req-e96eccf1-3781-47f1-9b0f-2c02b836176a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:38.285402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ad261d78-c7fd-473d-8caa-d5938e66ad2d req-e96eccf1-3781-47f1-9b0f-2c02b836176a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:38.310514 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ad261d78-c7fd-473d-8caa-d5938e66ad2d req-e96eccf1-3781-47f1-9b0f-2c02b836176a service nova] Creating event network-vif-deleted:71dc45b3-ad63-4c9d-8736-45982aaf755c for instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce on n-h2-master-1 Jul 24 01:46:38.320167 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ad261d78-c7fd-473d-8caa-d5938e66ad2d req-e96eccf1-3781-47f1-9b0f-2c02b836176a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072897 Jul 24 01:46:38.322672 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2827/5763] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:46:39.045444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:39.046239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:39.061915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:39.062399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:39.063215 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:39.063656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:39.540498 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-450134176", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-929724029", "security_groups": [{"name": "tempest-secgroup-smoke-1594141053"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "6045218c-d6ee-4d03-8294-6d618dbb9081"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:39.811964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:39.829557 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ec12af8-cb54-4da0-b770-58b06383cc70 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1229 microversion: 2.1 time: 0.790433 Jul 24 01:46:39.830277 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2937/5764] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:39 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1229 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:40.042419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] validate_networks() for [('6045218c-d6ee-4d03-8294-6d618dbb9081', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:46:40.850824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:40.851601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:40.868993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:40.869605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:40.870647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:40.871091 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:41.075827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:41.097337 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-179b5bc3-8517-4a3c-bfd2-1b01b1f42d05 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1229 microversion: 2.1 time: 0.251776 Jul 24 01:46:41.100092 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2938/5765] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:40 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1229 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:41.320893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Getting quotas for project 101695253c6e40569d3cb5b391fccd61. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:46:41.333905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Getting quotas for user c4b34bec387d42859f416aa3df7a7d0e and project 101695253c6e40569d3cb5b391fccd61. Resources: dict_keys(['metadata_items']) {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:46:41.373237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:46:41.373683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:46:41.378166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:46:41.378757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:46:41.379530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:46:41.423039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:41.423694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:41.426765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:41.427220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:41.473585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Getting quotas for project 101695253c6e40569d3cb5b391fccd61. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:46:41.485595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Getting quotas for user c4b34bec387d42859f416aa3df7a7d0e and project 101695253c6e40569d3cb5b391fccd61. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:46:41.521407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:46:41.524373 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:46:41.633200 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-233096ec-3ec8-4107-a3c0-26bd25296daa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.098935 Jul 24 01:46:41.650504 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2828/5766] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:46:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:46:41.671415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b98ecbb5-6366-4332-86cd-a2baf4e40ba0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:41.674099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b98ecbb5-6366-4332-86cd-a2baf4e40ba0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:41.990212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b98ecbb5-6366-4332-86cd-a2baf4e40ba0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:42.006427 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b98ecbb5-6366-4332-86cd-a2baf4e40ba0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1301 microversion: 2.1 time: 0.349400 Jul 24 01:46:42.007047 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2939/5767] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:41 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1301 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:42.117152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:42.118088 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:42.137977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:42.138720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:42.142479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:42.143506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:42.752611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:42.764879 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ede84af-4c24-4b17-bea2-aed2f2c18ddc tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1229 microversion: 2.1 time: 0.652145 Jul 24 01:46:42.766599 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2829/5768] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:42 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1229 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:43.026091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:43.027308 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:43.044191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:43.045087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:43.046088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:43.047018 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:43.243693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:43.258514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d1bc9dd8-9653-4b0f-826d-27c3990648c7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1297 microversion: 2.1 time: 0.237782 Jul 24 01:46:43.266466 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2940/5769] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:43 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1297 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:43.787953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:43.788846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:43.807168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:43.807632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:43.808445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:43.808884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:44.242026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:44.260461 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aed29d81-36ed-4e20-ac86-e7b3f386aed6 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1229 microversion: 2.1 time: 0.481585 Jul 24 01:46:44.261072 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2830/5770] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:43 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1229 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:44.288384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:44.290273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:44.305386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:44.306293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:44.307379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:44.308045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:44.523011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:44.552839 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b436e013-c3c9-491f-b423-4cea0df081aa tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1359 microversion: 2.1 time: 0.269764 Jul 24 01:46:44.569262 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2941/5771] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:44 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:45.297146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:45.299549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:45.311762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:45.313219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:45.314329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:45.315019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:45.575571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:45.576199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:45.585148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:45.585840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:45.587005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:45.587608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:45.940187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:45.951584 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4d6052bb-462d-437e-84bb-7324f19f10e5 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1229 microversion: 2.1 time: 0.676085 Jul 24 01:46:45.962008 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2831/5772] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:45 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1229 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:46:46.363123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:46.381005 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-85917e4b-a2ce-4ebe-a619-a33ccd78438e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.810828 Jul 24 01:46:46.400744 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2942/5773] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:45 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:46:46.969524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:46.970198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:46.987360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:46.987819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:46.988621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:46.991641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:47.403826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:47.405691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:47.419656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:47.421155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:47.426120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:47.429443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:47.971497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f38ad0b87584fb498dc0479b0656b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594d185ff204f60b15075242c4a9d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:47.991332 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3ab988c-9070-4e86-8dc6-9992bef1f964 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 200 len: 1229 microversion: 2.1 time: 1.026604 Jul 24 01:46:47.996981 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2832/5774] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:46 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 1229 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:46:48.999860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:49.010633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:49.011201 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c2b5399-daea-4267-af99-f18162b36658 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 1.611652 Jul 24 01:46:49.011303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] [instance: 253a26a4-58cb-4805-9d28-c77dc4ea7cce] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:49.021458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:49.021957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:49.023733 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2943/5775] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:47 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:49.030774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:49.032247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:49.087907 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] HTTP exception thrown: Instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce could not be found. Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Request method failure captured: Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce HTTP/1.1 Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KMYgqu8RqTSTAzB_O5vVuGxu1voN9WNKJ-WlyFUNazUy820CQcv4yNAdAnEK8486OQggyzHTCx1Tbun7UbLJ90Y62T5kwcbzBwvstZTThee_QKIML_mk3-F18Xez5gDOQPDOVsH6NK3K85P4nFIq3qp_Ya55kV0yRZwbhkrsjteqaU Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9594d185ff204f60b15075242c4a9d4c Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBackupRestore-232280889 Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9594d185ff204f60b15075242c4a9d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9594d185ff204f60b15075242c4a9d4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9594d185ff204f60b15075242c4a9d4c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9594d185ff204f60b15075242c4a9d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBackupRestore-232280889 Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9594d185ff204f60b15075242c4a9d4c Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBackupRestore-232280889 Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBackupRestore-232280889-project Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 8f38ad0b87584fb498dc0479b0656b7f Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBackupRestore-232280889-project Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce could not be found. Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '253a26a4-58cb-4805-9d28-c77dc4ea7cce'} Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce could not be found. Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce could not be found. Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:46:49.112580 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce could not be found. Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Returning 404 to user: Instance 253a26a4-58cb-4805-9d28-c77dc4ea7cce could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:46:49.116911 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a7cbc09-fa42-46cd-b545-14bdb9eb75d9 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce" status: 404 len: 111 microversion: 2.1 time: 0.109101 Jul 24 01:46:49.126327 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2833/5776] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:49 2022] GET /compute/v2.1/servers/253a26a4-58cb-4805-9d28-c77dc4ea7cce => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:46:50.032909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:50.034211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:50.055928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:50.059317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:50.065145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:50.065942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:50.627433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:50.660052 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0258e1ec-8e47-44dd-8e6a-2d8b56174b03 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.631283 Jul 24 01:46:50.677784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2944/5777] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:50 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:50.757168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7c48e43f-7a20-4ba0-9d16-c0c9daac317a req-671a12f0-1d9d-43e9-9f32-a4c81fc9c673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6285dba2-9791-4a1a-9f93-de7819c97c49", "tag": "3e1aa996-bf95-4309-b9ad-c4002223f0a0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:50.778520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-53099e44-e59a-4c8a-928a-d8cf7d0db021 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] Calling method '.version_select at 0x7f05e9c4f9d0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:50.793193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7c48e43f-7a20-4ba0-9d16-c0c9daac317a req-671a12f0-1d9d-43e9-9f32-a4c81fc9c673 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:50.793651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7c48e43f-7a20-4ba0-9d16-c0c9daac317a req-671a12f0-1d9d-43e9-9f32-a4c81fc9c673 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:50.825161 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-53099e44-e59a-4c8a-928a-d8cf7d0db021 tempest-TestVolumeBackupRestore-232280889 tempest-TestVolumeBackupRestore-232280889-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1786708000" status: 202 len: 0 microversion: 2.1 time: 0.056338 Jul 24 01:46:50.825780 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2945/5778] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:46:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1786708000 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:46:50.846756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7c48e43f-7a20-4ba0-9d16-c0c9daac317a req-671a12f0-1d9d-43e9-9f32-a4c81fc9c673 service nova] Creating event network-changed:3e1aa996-bf95-4309-b9ad-c4002223f0a0 for instance 6285dba2-9791-4a1a-9f93-de7819c97c49 on n-h1-master-1 Jul 24 01:46:50.865917 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7c48e43f-7a20-4ba0-9d16-c0c9daac317a req-671a12f0-1d9d-43e9-9f32-a4c81fc9c673 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113732 Jul 24 01:46:50.869860 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2834/5779] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:46:51.690840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:51.697223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:51.731572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:51.732357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:51.733368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:51.735247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:51.994830 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:53.809746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:53.832549 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7366b87-b602-4c35-9fdb-25beb7b4f8a3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 2.153709 Jul 24 01:46:53.833214 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2946/5780] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:51 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:54.853795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:54.856722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:54.875868 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:54.876784 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:54.889531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:54.890040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:54.891197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:54.891695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:55.788745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:55.813922 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-614b9dcc-a60b-4258-a6aa-eaeeb49857e3 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.965411 Jul 24 01:46:55.815944 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2835/5781] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:54 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:56.563614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-17443a76-6cfe-4327-95c8-fff5148ff028 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'create', calling method: .version_select at 0x7f05e9c6b820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1437542195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpZo9pRYrI9X6B4r0sRCir5N/8F5/x7CZO79YwwsqOSp+Kjov7CaLZ9rnU/q7U4MqB4E1NNWEnOTjRl59/cHIcgODSzkPyPFTmEelJAgW41z6jfu3kAgE1u+1Jewz9ksg=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:56.616721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-17443a76-6cfe-4327-95c8-fff5148ff028 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:46:56.629805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-17443a76-6cfe-4327-95c8-fff5148ff028 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for user 49542098be914013837bfe2310608c31 and project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:46:56.686368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-17443a76-6cfe-4327-95c8-fff5148ff028 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.128190 Jul 24 01:46:56.687062 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2947/5782] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:46:56 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:46:56.834371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:56.835978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:56.856490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:56.860279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:56.863366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:56.867056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:57.179427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:57.188912 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a6e8b511-36f4-4fc4-b6bd-e44af43497a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.359136 Jul 24 01:46:57.203060 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2836/5783] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:56 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:58.207908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:46:58.208702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:46:58.228593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:58.232550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:58.236670 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:46:58.240800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:46:59.008448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:46:59.017011 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fed8799f-46f1-4363-8d00-6006a2331171 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.815081 Jul 24 01:46:59.021277 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2948/5784] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:46:58 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:46:59.363729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-51779903", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "7a2561df-f900-48b2-b096-cab8f9b54084"}], "key_name": "tempest-TestNetworkBasicOps-1437542195", "security_groups": [{"name": "tempest-secgroup-smoke-1770199160"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:46:59.624388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] validate_networks() for [('7a2561df-f900-48b2-b096-cab8f9b54084', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:47:00.037739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:00.038567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:00.059302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:00.062398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:00.067148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:00.071739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:00.884909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:00.897062 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7e6649b-5879-41bd-a89c-1fb27c00c1fe tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.863131 Jul 24 01:47:00.897997 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2949/5785] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:00 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:01.567225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:47:01.567803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:47:01.568293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:47:01.569098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:47:01.569533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:47:01.571998 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:01.615117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:01.617335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:01.622270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:01.624771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:01.725989 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=65 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:01.766396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:47:01.794864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for user 49542098be914013837bfe2310608c31 and project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:47:01.874873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:47:01.877248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:47:01.915880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:01.916451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:01.937808 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:01.964440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:01.964924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:01.965778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:01.966662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:02.038153 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:02.066196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b391b7a-6d25-4720-9f96-80ffe5dc35c6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.706822 Jul 24 01:47:02.075809 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2837/5786] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:46:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:47:02.087555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e034cc7b-8679-46a4-9f3e-c94a3086233d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:02.088262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e034cc7b-8679-46a4-9f3e-c94a3086233d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:02.717377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e034cc7b-8679-46a4-9f3e-c94a3086233d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:02.740197 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e034cc7b-8679-46a4-9f3e-c94a3086233d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1247 microversion: 2.1 time: 0.661068 Jul 24 01:47:02.742448 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2838/5787] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:02 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1247 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:03.245309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:03.253635 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-981199d2-416e-449a-8032-da5a84cc41a0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 1.342676 Jul 24 01:47:03.266116 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2950/5788] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:01 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:47:03.768463 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:03.770143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:03.807677 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:03.810459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:03.811969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:03.816415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:04.271201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:04.272230 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:04.295771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:04.296552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:04.303679 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:04.304506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:04.380370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:04.391739 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e8c431fb-70e4-4dd7-86fd-f61b7662e46d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1299 microversion: 2.1 time: 0.636102 Jul 24 01:47:04.392359 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2839/5789] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:03 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1299 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:47:04.878760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:04.893170 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c84cafae-0ccf-4a2d-a7e2-5304815b39e0 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.625820 Jul 24 01:47:04.896803 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2951/5790] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:04 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:05.045028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-216561e7-209f-4b5a-97a5-3f06f3bfbdc9 req-9e8362a3-69eb-4ca1-97f1-26a7c13ab8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6285dba2-9791-4a1a-9f93-de7819c97c49", "name": "network-vif-plugged", "status": "completed", "tag": "3e1aa996-bf95-4309-b9ad-c4002223f0a0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:47:05.058250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-216561e7-209f-4b5a-97a5-3f06f3bfbdc9 req-9e8362a3-69eb-4ca1-97f1-26a7c13ab8c2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:05.074462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-216561e7-209f-4b5a-97a5-3f06f3bfbdc9 req-9e8362a3-69eb-4ca1-97f1-26a7c13ab8c2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:05.100744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-216561e7-209f-4b5a-97a5-3f06f3bfbdc9 req-9e8362a3-69eb-4ca1-97f1-26a7c13ab8c2 service nova] Creating event network-vif-plugged:3e1aa996-bf95-4309-b9ad-c4002223f0a0 for instance 6285dba2-9791-4a1a-9f93-de7819c97c49 on n-h1-master-1 Jul 24 01:47:05.127859 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-216561e7-209f-4b5a-97a5-3f06f3bfbdc9 req-9e8362a3-69eb-4ca1-97f1-26a7c13ab8c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086594 Jul 24 01:47:05.134096 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2840/5791] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:47:05.410791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:05.411417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:05.432727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:05.433193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:05.434085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:05.434526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:05.914364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:05.915236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:05.926838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:05.929666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:05.931269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:05.934540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:06.357870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:06.367155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32527e2c-d724-4583-983b-410ca4177c01 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1305 microversion: 2.1 time: 0.960697 Jul 24 01:47:06.379100 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2952/5792] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:05 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1305 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:06.669945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:06.684762 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-340f7b19-ccec-4bcd-ac40-62292e901b79 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1427 microversion: 2.1 time: 0.773337 Jul 24 01:47:06.696670 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2841/5793] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:05 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1427 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:47:07.393980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:07.394796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:07.405578 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:07.408963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:07.410171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:07.411390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:07.412986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:07.703937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:07.704561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:07.722060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:07.722569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:07.723387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:07.723817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:07.863211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:07.872820 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d1a4b648-efa4-43d2-8435-107ee6c2af62 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 0.484895 Jul 24 01:47:07.873427 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2953/5794] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:07 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:08.165778 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:08.182146 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-427fc3e4-0c9e-4013-b0dc-c82b4f0a67dc tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1606 microversion: 2.1 time: 0.474247 Jul 24 01:47:08.186084 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2842/5795] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:07 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1606 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:08.200576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:08.201382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:08.213829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:08.216386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:08.217880 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:08.220519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:08.655918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:08.675245 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-655b8119-0613-49e3-9bf5-4b89d1729502 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1606 microversion: 2.1 time: 0.480225 Jul 24 01:47:08.685713 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2954/5796] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:08 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1606 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:08.701076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:08.701715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:08.717434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:08.726095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:08.727701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:08.728210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:08.891252 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:08.892024 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:08.931199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:08.933897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:08.938410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:08.940500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:09.563144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:09.577521 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-944598f4-2242-4e79-b9b1-9ab39b1dcf37 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1606 microversion: 2.1 time: 0.880167 Jul 24 01:47:09.587159 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2843/5797] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:08 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1606 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:10.095991 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:10.111228 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d09959f4-5661-4df6-a863-343fda55c74a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 1.225327 Jul 24 01:47:10.112371 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2955/5798] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:08 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:47:10.324219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-30ddee8e-239c-48af-b31d-230bc8e93480 req-df5c4d28-e16c-459f-ba89-aa59e9c7f62d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae1ccb0-1320-4c89-918e-2d7c137132c7", "tag": "b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:47:10.347775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-30ddee8e-239c-48af-b31d-230bc8e93480 req-df5c4d28-e16c-459f-ba89-aa59e9c7f62d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:10.348240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-30ddee8e-239c-48af-b31d-230bc8e93480 req-df5c4d28-e16c-459f-ba89-aa59e9c7f62d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:10.385512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-30ddee8e-239c-48af-b31d-230bc8e93480 req-df5c4d28-e16c-459f-ba89-aa59e9c7f62d service nova] Creating event network-changed:b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451 for instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 on n-h2-master-1 Jul 24 01:47:10.397050 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-30ddee8e-239c-48af-b31d-230bc8e93480 req-df5c4d28-e16c-459f-ba89-aa59e9c7f62d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078085 Jul 24 01:47:10.399846 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2844/5799] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:47:11.132488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:11.133709 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:11.146558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:11.147028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:11.147849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:11.148336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:11.972519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:11.982212 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-666aea41-77d7-4199-8516-47ed59a3c797 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 0.856859 Jul 24 01:47:11.992750 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2956/5800] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:11 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:13.000016 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:13.000818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:13.004692 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:13.009805 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:13.026836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:13.027285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:13.028085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:13.028531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:13.686869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:13.716525 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dc08c4b1-05c6-4e73-9607-13ef864097fe tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 0.720538 Jul 24 01:47:13.720295 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2845/5801] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:12 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:14.287568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-af3e6d54-ed25-4f47-8ebe-9a63a9e3f4bd req-aecccd74-334b-4e67-b618-24fe90d3da7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6285dba2-9791-4a1a-9f93-de7819c97c49", "tag": "3e1aa996-bf95-4309-b9ad-c4002223f0a0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:47:14.303081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-af3e6d54-ed25-4f47-8ebe-9a63a9e3f4bd req-aecccd74-334b-4e67-b618-24fe90d3da7e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:14.303532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-af3e6d54-ed25-4f47-8ebe-9a63a9e3f4bd req-aecccd74-334b-4e67-b618-24fe90d3da7e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:14.319274 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-af3e6d54-ed25-4f47-8ebe-9a63a9e3f4bd req-aecccd74-334b-4e67-b618-24fe90d3da7e service nova] Creating event network-changed:3e1aa996-bf95-4309-b9ad-c4002223f0a0 for instance 6285dba2-9791-4a1a-9f93-de7819c97c49 on n-h1-master-1 Jul 24 01:47:14.328709 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-af3e6d54-ed25-4f47-8ebe-9a63a9e3f4bd req-aecccd74-334b-4e67-b618-24fe90d3da7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045613 Jul 24 01:47:14.329655 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2957/5802] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:47:14.736873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:14.737514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:14.746794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:14.749560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:14.750909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:14.753120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:15.965301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:15.977799 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6dde3e68-f049-44a9-abb6-64c42a3de03e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 1.244479 Jul 24 01:47:15.989832 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2846/5803] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:14 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:16.998692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:16.999911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:17.006948 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:17.007844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:17.009500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:17.010138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:17.392047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:17.401973 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c33f6d0-9119-457d-8c54-fe334fad200f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 0.410133 Jul 24 01:47:17.406779 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2958/5804] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:16 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:18.423089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:18.423708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:18.433545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:18.434016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:18.442702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:18.443351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:18.809135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-be51ccef-345b-41b4-92ed-f25252416ffd req-7912d842-b7d5-4e7b-98d4-b968e9136dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae1ccb0-1320-4c89-918e-2d7c137132c7", "name": "network-vif-plugged", "status": "completed", "tag": "b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:47:18.831357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-be51ccef-345b-41b4-92ed-f25252416ffd req-7912d842-b7d5-4e7b-98d4-b968e9136dcc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:18.841386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-be51ccef-345b-41b4-92ed-f25252416ffd req-7912d842-b7d5-4e7b-98d4-b968e9136dcc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:18.873214 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-be51ccef-345b-41b4-92ed-f25252416ffd req-7912d842-b7d5-4e7b-98d4-b968e9136dcc service nova] Creating event network-vif-plugged:b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451 for instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 on n-h2-master-1 Jul 24 01:47:18.888235 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-be51ccef-345b-41b4-92ed-f25252416ffd req-7912d842-b7d5-4e7b-98d4-b968e9136dcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084877 Jul 24 01:47:18.890723 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2959/5805] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:47:19.005271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:19.017843 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-69ace84c-5fa1-4941-b7ba-f4d499b7d84a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 0.598449 Jul 24 01:47:19.029085 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2847/5806] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:18 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:20.050933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:20.053519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:20.075382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:20.076059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:20.076934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:20.077561 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:21.102280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:21.119235 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1e5f343f-59ca-4f9a-98dd-004905988667 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1373 microversion: 2.1 time: 1.085345 Jul 24 01:47:21.120223 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2960/5807] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:20 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1373 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:22.138786 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:22.139414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:22.181496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:22.182142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:22.183093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:22.183715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:22.765377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:22.777896 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-acaf8a91-19e9-4eb4-b014-84575d51da88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1544 microversion: 2.1 time: 0.643952 Jul 24 01:47:22.779119 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2848/5808] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:22 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1544 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:22.802781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:22.803978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:22.811553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:22.812235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:22.813259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:22.816628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:23.547137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:47:23.559481 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f467eff-8c94-45b5-ab21-fcd812fe09f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1544 microversion: 2.1 time: 0.768298 Jul 24 01:47:23.574604 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2961/5809] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:47:22 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1544 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:47:28.680868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9a0821b9-9b22-4420-87f5-3a25e91399f9 req-6553faee-3b4f-4103-be52-e5c57a881d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae1ccb0-1320-4c89-918e-2d7c137132c7", "tag": "b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:47:28.701043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9a0821b9-9b22-4420-87f5-3a25e91399f9 req-6553faee-3b4f-4103-be52-e5c57a881d27 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:28.701856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9a0821b9-9b22-4420-87f5-3a25e91399f9 req-6553faee-3b4f-4103-be52-e5c57a881d27 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:28.732011 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9a0821b9-9b22-4420-87f5-3a25e91399f9 req-6553faee-3b4f-4103-be52-e5c57a881d27 service nova] Creating event network-changed:b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451 for instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 on n-h2-master-1 Jul 24 01:47:28.746196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9a0821b9-9b22-4420-87f5-3a25e91399f9 req-6553faee-3b4f-4103-be52-e5c57a881d27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069492 Jul 24 01:47:28.747096 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2849/5810] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:47:44.311338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-661e5d8f-75d0-41cf-8407-a85b53341077 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:47:44.311952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-661e5d8f-75d0-41cf-8407-a85b53341077 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:44.324202 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=23 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:44.324911 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=63 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:44.326443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661e5d8f-75d0-41cf-8407-a85b53341077 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:44.327621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661e5d8f-75d0-41cf-8407-a85b53341077 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:44.327743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661e5d8f-75d0-41cf-8407-a85b53341077 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:44.328102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661e5d8f-75d0-41cf-8407-a85b53341077 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:44.426224 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-661e5d8f-75d0-41cf-8407-a85b53341077 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.119021 Jul 24 01:47:44.434018 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2962/5811] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:47:44 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49/os-server-password => generated 116 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:47:55.230978 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:55.232233 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=55 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:55.237402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0867eafe-4ea4-4157-bea2-d174b328dbfd tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:47:55.241001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0867eafe-4ea4-4157-bea2-d174b328dbfd tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:47:55.258474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0867eafe-4ea4-4157-bea2-d174b328dbfd tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:55.261400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0867eafe-4ea4-4157-bea2-d174b328dbfd tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:55.263858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0867eafe-4ea4-4157-bea2-d174b328dbfd tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:55.266301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0867eafe-4ea4-4157-bea2-d174b328dbfd tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:55.370614 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0867eafe-4ea4-4157-bea2-d174b328dbfd tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7/action" status: 200 len: 24571 microversion: 2.1 time: 0.142090 Jul 24 01:47:55.384093 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2850/5812] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:47:55 2022] POST /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7/action => generated 24571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:47:58.513556 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-735366725", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "30853efa-358e-433f-8f9c-edf3f3ce7372", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dc256e9-ed96-441b-9223-c863c318c2b9"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:47:58.543586 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:58.544361 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:58.673305 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] validate_networks() for [('3dc256e9-ed96-441b-9223-c863c318c2b9', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:47:59.598699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:47:59.599247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:47:59.600676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:47:59.601304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:47:59.602134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:47:59.614774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:59.616802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:59.618958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:47:59.619420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:47:59.644089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:47:59.653489 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:47:59.749762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:47:59.752424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30853efa-358e-433f-8f9c-edf3f3ce7372',volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:47:59.952939 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [22a8e29a-6f87-43f1-a848-a48f068275f2] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 01:48:00.961138 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [22a8e29a-6f87-43f1-a848-a48f068275f2] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55196. Jul 24 01:48:00.965798 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1fc624af-7885-46c4-9520-a941bff947c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.457706 Jul 24 01:48:00.971169 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2963/5813] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:47:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:48:00.977852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-989b7c77-4853-4344-8137-74404eaff772 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:00.978569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-989b7c77-4853-4344-8137-74404eaff772 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:01.094017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-989b7c77-4853-4344-8137-74404eaff772 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:01.103584 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-989b7c77-4853-4344-8137-74404eaff772 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1056 microversion: 2.1 time: 0.130635 Jul 24 01:48:01.112541 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2851/5814] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:00 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1056 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:02.121979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:02.122617 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:02.136565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:02.142231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:02.144396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:02.154109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:02.811342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:02.824391 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-14ed9f43-a6fa-4503-a180-60e2ffa05943 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1154 microversion: 2.1 time: 0.706850 Jul 24 01:48:02.835519 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2964/5815] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:02 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1154 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:03.846799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:03.846799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:03.857046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:03.867980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:03.868985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:03.869434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:04.306905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:04.320627 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-298edbe2-1e99-47e7-b148-d1749b7439eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1214 microversion: 2.1 time: 0.480450 Jul 24 01:48:04.335426 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2852/5816] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:03 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1214 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:05.018455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7e23dc9e-58bd-4ebb-8b18-a5cc5577475a req-016de338-3968-49f9-9add-1ad712425a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f03137-d4ce-46e2-8f1a-4e8533a55011", "tag": "b7c56c1d-06da-49c9-a674-dd13ce6e64ec"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:48:05.035415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7e23dc9e-58bd-4ebb-8b18-a5cc5577475a req-016de338-3968-49f9-9add-1ad712425a06 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:05.037086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7e23dc9e-58bd-4ebb-8b18-a5cc5577475a req-016de338-3968-49f9-9add-1ad712425a06 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:05.051100 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7e23dc9e-58bd-4ebb-8b18-a5cc5577475a req-016de338-3968-49f9-9add-1ad712425a06 service nova] Creating event network-changed:b7c56c1d-06da-49c9-a674-dd13ce6e64ec for instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 on n-h2-master-1 Jul 24 01:48:05.058514 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7e23dc9e-58bd-4ebb-8b18-a5cc5577475a req-016de338-3968-49f9-9add-1ad712425a06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044677 Jul 24 01:48:05.062861 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2965/5817] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:48:05.338752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:05.339388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:05.360523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:05.360995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:05.367826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:05.368324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:05.854160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:05.873019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9149d3c8-aa9e-4ec0-8461-a50922951081 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1214 microversion: 2.1 time: 0.538985 Jul 24 01:48:05.875910 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2853/5818] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:05 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1214 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:48:06.894086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:06.894806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:06.905693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:06.907293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:06.908357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:06.914928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:07.199589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:07.210441 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-383a99c9-a660-4622-953e-656fdd9ec1a4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1214 microversion: 2.1 time: 0.321621 Jul 24 01:48:07.213125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2966/5819] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:06 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:08.231975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:08.232606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:08.244707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:08.246108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:08.249169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:08.250398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:08.417190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:08.427006 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cbd02979-74ac-42c8-9751-e269ef4b04a8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1214 microversion: 2.1 time: 0.202491 Jul 24 01:48:08.427834 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2854/5820] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:08 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:09.447114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:09.447864 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:09.465076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:09.466963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:09.468027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:09.469536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:09.630863 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:09.665307 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:09.790722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:09.799815 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac680e86-961a-4f5c-9528-d96088921190 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1214 microversion: 2.1 time: 0.359314 Jul 24 01:48:09.807779 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2967/5821] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:09 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1214 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:10.826019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:10.827245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:10.835295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:10.838458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:10.839316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:10.839754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:11.105962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:11.108534 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:11.123560 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5bb9569a-cd4e-4424-b446-992746250984 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.303189 Jul 24 01:48:11.124506 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2855/5822] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:10 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:12.142453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:12.143243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:12.164234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:12.164705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:12.165514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:12.166111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:12.179191 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:48:12.180437 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 01:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:48:12.408818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:12.422672 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e938e0b-e553-44f9-b29d-c68a83e7e3b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.281914 Jul 24 01:48:12.423577 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2968/5823] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:12 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:13.440312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:13.441518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:13.450674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:13.451632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:13.451927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:13.452371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:13.699573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:13.707820 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8477c4cc-eabe-44b3-ba64-cf4850a63eb2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.271263 Jul 24 01:48:13.709305 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2856/5824] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:13 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:14.731639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:14.732726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:14.739741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:14.740261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:14.741335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:14.741598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:14.996460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:15.012598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-105a75cd-5a05-493c-b031-45b4d7201d67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.286716 Jul 24 01:48:15.027550 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2969/5825] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:14 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:16.030477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:16.031237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:16.038553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:16.039100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:16.039886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:16.040326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:16.179955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:16.189996 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa2b7d21-0e7c-47ba-a32a-50f55d27f23c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.163333 Jul 24 01:48:16.190727 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2857/5826] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:16 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:17.208056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:17.209567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:17.217921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:17.218681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:17.219607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:17.220159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:17.387768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:17.404539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64bcda47-9d6a-400b-8d3e-d9d0d14b0384 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.199708 Jul 24 01:48:17.406058 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2970/5827] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:17 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:18.423360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:18.423991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:18.432743 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:18.433206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:18.434133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:18.434561 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:18.594087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:18.603731 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-40dba3bb-c70c-450e-a7e9-899271e320d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.184445 Jul 24 01:48:18.609725 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2858/5828] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:18 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:48:19.620773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:19.621505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:19.645636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:19.646985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:19.647416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:19.647856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:20.004448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:20.014764 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-181015e6-97a9-4bc3-b58f-f535949b6f76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.397767 Jul 24 01:48:20.026594 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2971/5829] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:19 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:21.044633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:21.046344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:21.054600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:21.055059 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:21.066953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:21.067456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:21.569363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:21.578019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e09685c-1d4b-42a3-af3a-6cba9490707a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.537105 Jul 24 01:48:21.589530 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2859/5830] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:21 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:22.596302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:22.596925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:22.611257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:22.611838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:22.618538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:22.619099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:22.840511 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:22.857328 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e1d9919e-6ada-465f-ad90-e96aeb4a5f6e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.264210 Jul 24 01:48:22.859243 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2972/5831] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:22 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:23.876536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:23.877956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:23.891308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:23.892077 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:23.893447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:23.894122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:24.301974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:24.314236 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6d52d78-6202-4a96-b69f-d62a79227a5a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.442119 Jul 24 01:48:24.315908 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2860/5832] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:23 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:25.028164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ad595a22-529a-4da7-b282-f0d437be8df7 req-74e9e4ea-466c-45ce-bbcf-2b56e3249278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f03137-d4ce-46e2-8f1a-4e8533a55011", "name": "network-vif-plugged", "status": "completed", "tag": "b7c56c1d-06da-49c9-a674-dd13ce6e64ec"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:48:25.049882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ad595a22-529a-4da7-b282-f0d437be8df7 req-74e9e4ea-466c-45ce-bbcf-2b56e3249278 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:25.050698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ad595a22-529a-4da7-b282-f0d437be8df7 req-74e9e4ea-466c-45ce-bbcf-2b56e3249278 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:25.063945 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ad595a22-529a-4da7-b282-f0d437be8df7 req-74e9e4ea-466c-45ce-bbcf-2b56e3249278 service nova] Creating event network-vif-plugged:b7c56c1d-06da-49c9-a674-dd13ce6e64ec for instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 on n-h2-master-1 Jul 24 01:48:25.074688 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ad595a22-529a-4da7-b282-f0d437be8df7 req-74e9e4ea-466c-45ce-bbcf-2b56e3249278 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049875 Jul 24 01:48:25.075668 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2973/5833] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:48:25.332354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:25.333997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:25.338640 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=25 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:25.351064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:25.351538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:25.352454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:25.352783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:25.361298 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=59 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:25.722949 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:25.740339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c8b05f4b-888a-471c-9358-331d3982c8fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.408978 Jul 24 01:48:25.741824 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2861/5834] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:25 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:26.761535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:26.764590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:26.779874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:26.780733 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:26.781863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:26.782565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:27.332557 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:27.350459 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9929ee58-834f-4828-9cca-02f0671fc138 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1202 microversion: 2.1 time: 0.596452 Jul 24 01:48:27.351617 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2974/5835] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:26 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1202 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:28.369266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:28.369915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:28.392555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:28.393091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:28.396691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:28.397337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:28.946521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:28.969726 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b1676a3-9d32-4182-9d69-de7334d2bf57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1389 microversion: 2.1 time: 0.604241 Jul 24 01:48:28.970654 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2862/5836] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:28 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1389 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:48:28.992610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:28.993243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:29.000970 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:29.008843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:29.009349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:29.010199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:29.010656 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:29.033742 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=61 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:29.498431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:29.509248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5490523-72fb-4bc6-a757-1b4887d86662 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1389 microversion: 2.1 time: 0.520436 Jul 24 01:48:29.510487 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2975/5837] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:28 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1389 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:29.525422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:29.526790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:29.541746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:29.542553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:29.543603 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:29.544282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:29.837480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:29.853894 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-40528a15-53f5-4ed2-8e45-80e37e0e9e13 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1389 microversion: 2.1 time: 0.331604 Jul 24 01:48:29.856295 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2863/5838] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:29 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1389 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:29.872419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:29.872923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:29.881911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:29.882367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:29.883159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:29.883634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:29.937740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:48:30.116639 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5db5e3dd-6f87-41fa-b3dc-ede54e02d9df tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 204 len: 0 microversion: 2.1 time: 0.247194 Jul 24 01:48:30.117607 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2976/5839] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:48:29 2022] DELETE /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:48:30.126375 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:30.127374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:30.134498 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:30.135309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:30.136416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:30.137222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:30.413159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:30.435540 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c306835d-f33d-4585-a7cc-04725d4038b6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1395 microversion: 2.1 time: 0.313674 Jul 24 01:48:30.438473 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2864/5840] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:30 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1395 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:31.457152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:31.458195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:31.486664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:31.487406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:31.488364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:31.494240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:32.092776 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:32.106033 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4f06e3d-1ed5-449d-a056-5e03980e20e2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1395 microversion: 2.1 time: 0.652170 Jul 24 01:48:32.107384 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2977/5841] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:31 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1395 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:33.123554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:33.124179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:33.133760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:33.134216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:33.149898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:33.150374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:33.586820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:33.601010 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da0d04fd-ffd0-4b97-9fd2-0717e37282db tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1395 microversion: 2.1 time: 0.481119 Jul 24 01:48:33.603393 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2865/5842] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:33 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1395 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:33.709510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b10bc6a3-6f02-43e4-92fd-75662922aab5 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'create', calling method: .version_select at 0x7f05e9bd1a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1451927543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMxQB2mJvlT7LKJfCV7BCZPNPrSJP5q2Yt3yqrmlo8rdpXtPQGP8BVH0oJ/s/cxXlucl7ybMdZ67G/e5UzybCm1POPG57YJuKfvyaWcxkfA+Ol0RQ3xBrJczR2YoEdjRQ=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:48:33.771145 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-b10bc6a3-6f02-43e4-92fd-75662922aab5 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:48:33.790209 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-b10bc6a3-6f02-43e4-92fd-75662922aab5 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for user 49542098be914013837bfe2310608c31 and project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:48:33.845927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b10bc6a3-6f02-43e4-92fd-75662922aab5 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.141184 Jul 24 01:48:33.846918 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2978/5843] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:48:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:48:33.961150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-920e2654-37f2-4cad-a5b2-ee86d0dc8c66 req-276ff177-ed53-41d0-897a-9777397a618b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f03137-d4ce-46e2-8f1a-4e8533a55011", "name": "network-vif-deleted", "tag": "b7c56c1d-06da-49c9-a674-dd13ce6e64ec"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:48:33.998056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-920e2654-37f2-4cad-a5b2-ee86d0dc8c66 req-276ff177-ed53-41d0-897a-9777397a618b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:33.998526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-920e2654-37f2-4cad-a5b2-ee86d0dc8c66 req-276ff177-ed53-41d0-897a-9777397a618b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:34.099609 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-920e2654-37f2-4cad-a5b2-ee86d0dc8c66 req-276ff177-ed53-41d0-897a-9777397a618b service nova] Creating event network-vif-deleted:b7c56c1d-06da-49c9-a674-dd13ce6e64ec for instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 on n-h2-master-1 Jul 24 01:48:34.124543 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-920e2654-37f2-4cad-a5b2-ee86d0dc8c66 req-276ff177-ed53-41d0-897a-9777397a618b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167289 Jul 24 01:48:34.130212 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2866/5844] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:48:34.623536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:34.624535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:34.632213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:34.632941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:34.633988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:34.635130 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:34.841116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:34.863357 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45d0d625-b203-4e9b-ab2f-6bce6377ae3e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1187 microversion: 2.1 time: 0.245404 Jul 24 01:48:34.866770 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2979/5845] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:34 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1187 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:35.883713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:35.884430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:35.899906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:35.900769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:35.905104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:35.905886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:36.173418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:36.182059 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2857bc23-033c-481c-9f84-7c040975ec75 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1187 microversion: 2.1 time: 0.303517 Jul 24 01:48:36.197298 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2867/5846] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:35 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1187 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:36.270901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-635190546", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "f6570771-1dba-474e-97ba-b4d252167548"}], "key_name": "tempest-TestNetworkBasicOps-1451927543", "security_groups": [{"name": "tempest-secgroup-smoke-914735393"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:48:36.618609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] validate_networks() for [('f6570771-1dba-474e-97ba-b4d252167548', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:48:37.207921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:37.209295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:37.218869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:37.219330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:37.220325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:37.220769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:37.372164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:37.399444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1a49778-c0c9-439b-a92a-56a7b778620e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1187 microversion: 2.1 time: 0.186775 Jul 24 01:48:37.413134 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2868/5847] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:37 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1187 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:37.940485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:48:37.940947 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:48:37.941392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:48:37.942433 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:48:37.944479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:48:37.965185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:37.965639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:37.970794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:37.972997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:38.013596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:48:38.023135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for user 49542098be914013837bfe2310608c31 and project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:48:38.059444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:48:38.061958 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:48:38.151190 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-323ceb04-1f72-4c42-a3d2-8a0862762499 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.885599 Jul 24 01:48:38.152217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2980/5848] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:48:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:48:38.162312 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2cd7e2cb-aa80-416a-b38b-ff7390c12053 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:38.163208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2cd7e2cb-aa80-416a-b38b-ff7390c12053 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:38.300578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2cd7e2cb-aa80-416a-b38b-ff7390c12053 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:38.312472 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2cd7e2cb-aa80-416a-b38b-ff7390c12053 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1248 microversion: 2.1 time: 0.151765 Jul 24 01:48:38.313188 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2869/5849] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:38 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1248 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:38.424267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:38.425350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:38.443980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:38.448911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:38.451202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:38.451633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:38.791871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:38.815705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0234a0b8-a755-49da-a7ee-fa5a0f3dd3cc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1187 microversion: 2.1 time: 0.399567 Jul 24 01:48:38.816785 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2981/5850] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:38 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1187 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:39.329871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:39.330491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:39.339135 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:39.339894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:39.340871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:39.341610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:39.445461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:39.454161 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ea63b63-9ed5-49ed-bc7d-9d528c751a88 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1300 microversion: 2.1 time: 0.128335 Jul 24 01:48:39.455373 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2870/5851] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:39 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:39.840748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:39.841539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:39.861028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:39.870424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:39.871441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:39.872082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:40.061367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:40.074024 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-39d3d620-9780-4fe1-b3cb-da9b0b9bceec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1187 microversion: 2.1 time: 0.244606 Jul 24 01:48:40.085872 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2982/5852] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:39 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1187 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:40.471388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:40.472004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:40.479244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:40.486393 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:40.487430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:40.488137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:40.604003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:40.617008 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-525aea5a-8384-4002-bd32-9fd422ae65b9 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1306 microversion: 2.1 time: 0.149334 Jul 24 01:48:40.618041 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2871/5853] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:40 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1306 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:41.099337 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:41.110276 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:41.133012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:41.133345 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:41.137780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:41.139284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:41.295172 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:41.308172 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a63c089b-2c54-4b3e-b4d3-be5b9cdb1073 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 200 len: 1187 microversion: 2.1 time: 0.219311 Jul 24 01:48:41.312571 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2983/5854] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:41 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 1187 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:41.635239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:41.635865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:41.642916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:41.643592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:41.644876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:41.645856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:41.714285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:41.725847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-525b6439-65a8-460c-ac1d-5700170466d4 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1306 microversion: 2.1 time: 0.094348 Jul 24 01:48:41.726703 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2872/5855] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:41 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:48:42.330426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:42.334448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: a8f03137-d4ce-46e2-8f1a-4e8533a55011] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:42.355834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:42.356302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:42.357376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:42.357885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:42.389063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 could not be found. Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 HTTP/1.1 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: exception: Instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 could not be found. Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a8f03137-d4ce-46e2-8f1a-4e8533a55011'} Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 could not be found. Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 could not be found. Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:48:42.391536 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 could not be found. Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance a8f03137-d4ce-46e2-8f1a-4e8533a55011 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:48:42.395909 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea5c4fd8-82e1-4096-bc3b-7a07233acd9a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011" status: 404 len: 111 microversion: 2.1 time: 0.068537 Jul 24 01:48:42.414054 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2984/5856] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:42 2022] GET /compute/v2.1/servers/a8f03137-d4ce-46e2-8f1a-4e8533a55011 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:48:42.745520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:42.747604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:42.767339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-dd27ebdd-c5cc-4536-9f76-7e11c57e39ad req-cd0c4ab7-0a41-477f-a0e0-ff6c354f6eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4", "tag": "516927a7-3cb7-4f49-935a-1b8d66448c4a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:48:42.781953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:42.787859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:42.789041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:42.789504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:42.793986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dd27ebdd-c5cc-4536-9f76-7e11c57e39ad req-cd0c4ab7-0a41-477f-a0e0-ff6c354f6eb7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:42.794433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dd27ebdd-c5cc-4536-9f76-7e11c57e39ad req-cd0c4ab7-0a41-477f-a0e0-ff6c354f6eb7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:42.839579 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-dd27ebdd-c5cc-4536-9f76-7e11c57e39ad req-cd0c4ab7-0a41-477f-a0e0-ff6c354f6eb7 service nova] Creating event network-changed:516927a7-3cb7-4f49-935a-1b8d66448c4a for instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 on n-h1-master-1 Jul 24 01:48:42.847478 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-dd27ebdd-c5cc-4536-9f76-7e11c57e39ad req-cd0c4ab7-0a41-477f-a0e0-ff6c354f6eb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085092 Jul 24 01:48:42.849984 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2985/5857] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:48:43.171851 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:43.189802 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-819ae79b-a771-434f-ba89-daa0e5ec91c1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1373 microversion: 2.1 time: 0.448321 Jul 24 01:48:43.191128 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2873/5858] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:42 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1373 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:44.213927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:44.215333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:44.236594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:44.243002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:44.244183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:44.244865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:44.576323 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:44.601548 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b2e67b96-acd8-4f41-ace4-178f7d70687b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1373 microversion: 2.1 time: 0.396250 Jul 24 01:48:44.604390 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2986/5859] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:44 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1373 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:45.621572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:45.622928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:45.634468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:45.635208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:45.636333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:45.637056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:45.855563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:45.887849 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-908b1925-d0e1-43f7-b100-32b0baa10800 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1373 microversion: 2.1 time: 0.270788 Jul 24 01:48:45.893636 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2874/5860] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:45 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1373 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:46.915428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:46.916060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:46.928385 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:46.932126 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:46.940587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:46.941051 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:47.224216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:47.234076 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c88e9423-4f65-4d6e-b5a2-835b4a475a1c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1373 microversion: 2.1 time: 0.324453 Jul 24 01:48:47.235279 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2987/5861] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:46 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1373 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:47.461533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7aa5ff63-d0ff-4c3f-b64f-64ea04028fed req-d72cd779-f4ee-4e23-a36a-b04a2a66bab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4", "name": "network-vif-plugged", "status": "completed", "tag": "516927a7-3cb7-4f49-935a-1b8d66448c4a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:48:47.480643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7aa5ff63-d0ff-4c3f-b64f-64ea04028fed req-d72cd779-f4ee-4e23-a36a-b04a2a66bab4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:47.481129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7aa5ff63-d0ff-4c3f-b64f-64ea04028fed req-d72cd779-f4ee-4e23-a36a-b04a2a66bab4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:47.502409 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7aa5ff63-d0ff-4c3f-b64f-64ea04028fed req-d72cd779-f4ee-4e23-a36a-b04a2a66bab4 service nova] Creating event network-vif-plugged:516927a7-3cb7-4f49-935a-1b8d66448c4a for instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 on n-h1-master-1 Jul 24 01:48:47.521718 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7aa5ff63-d0ff-4c3f-b64f-64ea04028fed req-d72cd779-f4ee-4e23-a36a-b04a2a66bab4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064865 Jul 24 01:48:47.522677 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2875/5862] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:48:48.255564 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:48.257095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:48.274056 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:48.275069 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:48.282087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:48.282554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:48.283336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:48.283953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:48.642616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:48.651502 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-140fc136-bd32-478f-b09d-0bf2d588c06a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1373 microversion: 2.1 time: 0.402818 Jul 24 01:48:48.652979 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2988/5863] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:48 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1373 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:48:49.669360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:49.670298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:49.677589 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:49.681067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:49.681848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:49.683109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:49.683660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:49.889305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:49.897579 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9d81a549-5384-4c7d-b6dc-448eb3e2bc24 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1545 microversion: 2.1 time: 0.232933 Jul 24 01:48:49.916005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:48:49.917957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:48:49.923486 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2876/5864] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:49 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1545 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:48:49.927634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:49.928101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:49.929317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:48:49.929809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:48:50.106553 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:48:50.129781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-292430b0-6b6a-4029-aa76-c9ce5714243d tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1545 microversion: 2.1 time: 0.216758 Jul 24 01:48:50.130684 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2989/5865] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:48:49 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1545 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:13.292068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-941845872", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5e7dfb9a-b5ff-43a4-9920-ae694b81eff0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3dc256e9-ed96-441b-9223-c863c318c2b9"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:13.306272 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=33 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:13.307571 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=81 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:13.407206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] validate_networks() for [('3dc256e9-ed96-441b-9223-c863c318c2b9', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:49:13.804716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:49:13.805152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:49:13.805632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:49:13.806067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:49:13.806493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:49:13.817159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:13.817971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:13.818778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:13.819376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:13.840276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:49:13.846225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:49:13.861301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:49:13.863971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5e7dfb9a-b5ff-43a4-9920-ae694b81eff0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:49:13.980902 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [f30e318c-da03-4a1f-bd21-dfcfe9520e48] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 01:49:14.992903 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [f30e318c-da03-4a1f-bd21-dfcfe9520e48] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56416. Jul 24 01:49:14.997910 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-57574560-9df0-47a3-9b0c-fd399fadca0a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709586 Jul 24 01:49:14.998964 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2877/5866] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:49:15.014865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98b5a2d0-af99-4ba7-9515-15bef94901ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:15.023437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98b5a2d0-af99-4ba7-9515-15bef94901ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:15.041586 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:15.045260 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:15.172028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-98b5a2d0-af99-4ba7-9515-15bef94901ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:15.181189 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98b5a2d0-af99-4ba7-9515-15bef94901ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1056 microversion: 2.1 time: 0.175400 Jul 24 01:49:15.181802 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2990/5867] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:15 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1056 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:16.105462 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:16.106332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:16.114322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:16.114979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:16.115874 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:16.116767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:16.151232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:49:16.197925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:16.198552 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:16.209719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:16.210172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:16.211015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:16.211400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:16.255900 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f50d9973-45dc-4d55-8b75-5d047636dede tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 204 len: 0 microversion: 2.1 time: 0.155525 Jul 24 01:49:16.259974 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2878/5868] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:49:16 2022] DELETE /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:49:16.268991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:16.270246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:16.280199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:16.281018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:16.282151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:16.283066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:16.292731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:16.301151 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b2c09d56-4794-4843-8347-e789c81e38e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1108 microversion: 2.1 time: 0.107051 Jul 24 01:49:16.301774 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2991/5869] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:16 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1108 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:16.564492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:16.576365 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8595d1da-bdfa-49d4-8e2b-5deff57f5d95 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1551 microversion: 2.1 time: 0.312692 Jul 24 01:49:16.577299 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2879/5870] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:16 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1551 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:17.320069 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:17.321257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:17.353586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:17.355812 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:17.367939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:17.377366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:17.596058 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:17.596951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:17.608574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:17.610418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:17.611479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:17.612646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:17.674232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:17.682276 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b682323-a409-4dfc-a6e2-1c5b13846cb4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.367911 Jul 24 01:49:17.686065 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2992/5871] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:17 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:17.934273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:17.943295 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3d685e4-c2ed-4224-b41d-d562951a4003 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1551 microversion: 2.1 time: 0.351143 Jul 24 01:49:17.947839 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2880/5872] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:17 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1551 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:18.699404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:18.699986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:18.708922 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:18.714459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:18.715302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:18.715729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:18.794042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5c86f8ec-d458-4268-8d4a-a51a06934068 req-cbd36b18-08bb-4a7d-9c34-0e825876ab44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4", "name": "network-vif-deleted", "tag": "516927a7-3cb7-4f49-935a-1b8d66448c4a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:18.810772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5c86f8ec-d458-4268-8d4a-a51a06934068 req-cbd36b18-08bb-4a7d-9c34-0e825876ab44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:18.811226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5c86f8ec-d458-4268-8d4a-a51a06934068 req-cbd36b18-08bb-4a7d-9c34-0e825876ab44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:18.850766 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5c86f8ec-d458-4268-8d4a-a51a06934068 req-cbd36b18-08bb-4a7d-9c34-0e825876ab44 service nova] Creating event network-vif-deleted:516927a7-3cb7-4f49-935a-1b8d66448c4a for instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 on n-h1-master-1 Jul 24 01:49:18.867491 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5c86f8ec-d458-4268-8d4a-a51a06934068 req-cbd36b18-08bb-4a7d-9c34-0e825876ab44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080735 Jul 24 01:49:18.872090 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2881/5873] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 24 01:49:18.964208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:18.965276 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:18.975847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:18.977302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:18.981337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:18.982336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:19.041869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:19.051548 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97b4c452-c9b0-42e1-9e61-e69bed5214e6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.356096 Jul 24 01:49:19.052864 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2993/5874] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:18 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:19.063666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:19.064379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:19.065784 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lazy-loading 'fault' on Instance uuid 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:49:19.132834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:19.155925 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8422fc11-b235-4f99-a9af-1cd618baee4b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 200 len: 1338 microversion: 2.1 time: 0.195990 Jul 24 01:49:19.160241 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2882/5875] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:18 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:20.069702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:20.071150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:20.090022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:20.090776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:20.092052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:20.092647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:20.179611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:20.180240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:20.196272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:20.196992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:20.198003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:20.198625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:20.244452 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] HTTP exception thrown: Instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 could not be found. Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Request method failure captured: Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 HTTP/1.1 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KRyg7ItJfbkCvgMOqCN5TxyQxZhC1ndM_3d1uPeVBq5uRZUUCa1zQCo-51fli8nn1yCcb5jLsP-Y3ZbO2L_xbxsKyCs44tUB73iDrcybxd3MTswTGBiS8G2RHZaxTMXl8WKefCA0f5N20TBapok6mZJIqZ9ehidR3xAZsB4c87-Pwg Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: f4b5a847051449df8fc6a3f05dbb3d59 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4b5a847051449df8fc6a3f05dbb3d59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: f4b5a847051449df8fc6a3f05dbb3d59 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkBasicOps-1267508913-project Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 49542098be914013837bfe2310608c31 Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkBasicOps-1267508913-project Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 could not be found. Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4'} Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 could not be found. Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 could not be found. Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:49:20.246180 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 could not be found. Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:20.251119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Returning 404 to user: Instance 2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:49:20.254978 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8707fc3c-9403-42ee-aa22-1fb15ab0ec36 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4" status: 404 len: 111 microversion: 2.1 time: 0.080749 Jul 24 01:49:20.255867 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2883/5876] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:20 2022] GET /compute/v2.1/servers/2e1ab9e3-1214-42e5-9ee6-2d4f17887aa4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:49:20.462039 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:20.473361 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a449e9df-4313-41d2-a99b-2b1dacce623f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.406636 Jul 24 01:49:20.473999 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2994/5877] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:20 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:20.647187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24315816-b769-48e9-90ec-e33e6cbe606a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '.version_select at 0x7f05eaf41d30>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:20.724179 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-24315816-b769-48e9-90ec-e33e6cbe606a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1451927543" status: 202 len: 0 microversion: 2.1 time: 0.081570 Jul 24 01:49:20.726130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2884/5878] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:49:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1451927543 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:49:20.907943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a8361989-fa16-44e6-a35c-e5181d3ac8d4 req-fbd6333e-07f3-4a70-b436-be08bb4ef6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a49263-7fda-4780-a788-235e7df7fda4", "tag": "3d2714f3-3e55-4fd6-9d36-66e461752ae6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:20.919563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a8361989-fa16-44e6-a35c-e5181d3ac8d4 req-fbd6333e-07f3-4a70-b436-be08bb4ef6d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:20.923870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a8361989-fa16-44e6-a35c-e5181d3ac8d4 req-fbd6333e-07f3-4a70-b436-be08bb4ef6d7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:20.950663 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a8361989-fa16-44e6-a35c-e5181d3ac8d4 req-fbd6333e-07f3-4a70-b436-be08bb4ef6d7 service nova] Creating event network-changed:3d2714f3-3e55-4fd6-9d36-66e461752ae6 for instance 50a49263-7fda-4780-a788-235e7df7fda4 on n-h2-master-1 Jul 24 01:49:20.963272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a8361989-fa16-44e6-a35c-e5181d3ac8d4 req-fbd6333e-07f3-4a70-b436-be08bb4ef6d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059345 Jul 24 01:49:20.970094 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2995/5879] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:49:21.491127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:21.491746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:21.512327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:21.512813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:21.513639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:21.514106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:22.014873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:22.022697 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e425aac-e44b-41b3-934f-358e1b354ebf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.536237 Jul 24 01:49:22.023507 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2885/5880] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:21 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:23.042342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:23.043650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:23.064474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:23.066364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:23.076921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:23.078301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:23.445218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:23.460977 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-170d9f32-5039-47dd-bca5-658b3f9450dd tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.423284 Jul 24 01:49:23.461631 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2996/5881] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:23 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:23.880917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6a9e0831-7f44-4648-a91b-b2f9c1dcf966 req-d858c2d9-e3c0-48e0-be48-2e24375197ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae1ccb0-1320-4c89-918e-2d7c137132c7", "tag": "b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:23.886441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:23.890095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:23.892404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6a9e0831-7f44-4648-a91b-b2f9c1dcf966 req-d858c2d9-e3c0-48e0-be48-2e24375197ab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:23.895589 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6a9e0831-7f44-4648-a91b-b2f9c1dcf966 req-d858c2d9-e3c0-48e0-be48-2e24375197ab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:23.901887 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:23.902861 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:23.910358 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:23.911370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:23.912410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:23.913042 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:23.946068 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6a9e0831-7f44-4648-a91b-b2f9c1dcf966 req-d858c2d9-e3c0-48e0-be48-2e24375197ab service nova] Creating event network-changed:b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451 for instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 on n-h2-master-1 Jul 24 01:49:23.970812 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6a9e0831-7f44-4648-a91b-b2f9c1dcf966 req-d858c2d9-e3c0-48e0-be48-2e24375197ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093669 Jul 24 01:49:23.972486 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2997/5882] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:49:23.977899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:49:24.333298 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b556455f-2e16-4915-8989-76b1d5128315 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 204 len: 0 microversion: 2.1 time: 0.456777 Jul 24 01:49:24.340143 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2886/5883] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:49:23 2022] DELETE /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:49:24.355070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:24.358329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:24.391346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:24.391876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:24.394380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:24.395463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:24.491537 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:24.502994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:24.523883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:24.524013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:24.524764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:24.525213 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:24.893534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:24.914024 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e1f080f7-6c14-4728-a2b0-5f733f00e156 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1669 microversion: 2.1 time: 0.571892 Jul 24 01:49:24.929940 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2998/5884] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:24 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1669 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:25.026522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:25.042820 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f7fdcdf4-00a3-4700-a547-420e251ff907 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.562856 Jul 24 01:49:25.044993 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2887/5885] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:24 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:25.937827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:25.939236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:25.952982 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:25.956647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:25.957348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:25.958329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:25.958916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:26.065427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:26.070161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:26.106724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:26.107187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:26.107992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:26.114569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:26.501591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:26.512927 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-51cb5e03-2489-4b71-85ea-e6c39f3ce696 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.451988 Jul 24 01:49:26.518621 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2888/5886] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:26 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:26.576312 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:26.600474 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86a21839-2fac-473f-8667-97c04be5500c tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 200 len: 1669 microversion: 2.1 time: 0.666408 Jul 24 01:49:26.622625 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 2999/5887] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:25 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 1669 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:27.039472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-6a8f5c11-7db9-4c2c-9532-bad5e9937c35 req-62990db3-7615-4d69-b09e-c5301382398a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae1ccb0-1320-4c89-918e-2d7c137132c7", "name": "network-vif-deleted", "tag": "b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:27.056935 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6a8f5c11-7db9-4c2c-9532-bad5e9937c35 req-62990db3-7615-4d69-b09e-c5301382398a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:27.057790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-6a8f5c11-7db9-4c2c-9532-bad5e9937c35 req-62990db3-7615-4d69-b09e-c5301382398a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:27.092080 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-6a8f5c11-7db9-4c2c-9532-bad5e9937c35 req-62990db3-7615-4d69-b09e-c5301382398a service nova] Creating event network-vif-deleted:b5e6ef00-7a0f-4a1a-8aac-5cf797f1f451 for instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 on n-h2-master-1 Jul 24 01:49:27.102298 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-6a8f5c11-7db9-4c2c-9532-bad5e9937c35 req-62990db3-7615-4d69-b09e-c5301382398a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066757 Jul 24 01:49:27.103214 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2889/5888] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:49:27.543877 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:27.545344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:27.572283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:27.578136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:27.578783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:27.579178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:27.620284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:27.620993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: 3ae1ccb0-1320-4c89-918e-2d7c137132c7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:27.655794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:27.663961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:27.666291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:27.666789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:27.689633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] HTTP exception thrown: Instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 could not be found. Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Request method failure captured: Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 HTTP/1.1 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KRyg7ItJfbkCvgMOqCN5TxyQxZhC1ndM_3d1uPeVBq5uRZUUCa1zQCo-51fli8nn1yCcb5jLsP-Y3ZbO2L_xbxsKyCs44tUB73iDrcybxd3MTswTGBiS8G2RHZaxTMXl8WKefCA0f5N20TBapok6mZJIqZ9ehidR3xAZsB4c87-Pwg Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: f4b5a847051449df8fc6a3f05dbb3d59 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4b5a847051449df8fc6a3f05dbb3d59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: f4b5a847051449df8fc6a3f05dbb3d59 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkBasicOps-1267508913-project Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 49542098be914013837bfe2310608c31 Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkBasicOps-1267508913-project Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 could not be found. Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '3ae1ccb0-1320-4c89-918e-2d7c137132c7'} Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 could not be found. Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 could not be found. Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:49:27.691878 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:27.696897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:49:27.696897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:49:27.696897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:49:27.696897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:49:27.696897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:49:27.696897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 could not be found. Jul 24 01:49:27.696897 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:49:27.698250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Returning 404 to user: Instance 3ae1ccb0-1320-4c89-918e-2d7c137132c7 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:49:27.699126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-74f2652d-cc8b-4ae0-8cb4-5c8dd500b4d8 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7" status: 404 len: 111 microversion: 2.1 time: 0.083485 Jul 24 01:49:27.699699 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2890/5889] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:27 2022] GET /compute/v2.1/servers/3ae1ccb0-1320-4c89-918e-2d7c137132c7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:49:28.013181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:28.021783 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f6fa113-2f99-4b95-a70f-1893cda16ee5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.482047 Jul 24 01:49:28.030482 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3000/5890] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:27 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:28.040715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dae3e06f-9cad-4bde-a35a-9ff8044a6f75 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '.version_select at 0x7f05eaff6dc0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:28.110748 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dae3e06f-9cad-4bde-a35a-9ff8044a6f75 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1437542195" status: 202 len: 0 microversion: 2.1 time: 0.076965 Jul 24 01:49:28.112178 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2891/5891] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1437542195 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:49:29.045763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:29.046378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:29.062364 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:29.063110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:29.064558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:29.065226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:29.862786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:29.873322 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-897e7552-a226-47c7-a53d-5291e4802ab2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.832458 Jul 24 01:49:29.874472 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3001/5892] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:29 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:30.891293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:30.893592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:30.911041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:30.911745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:30.912739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:30.913351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:31.175761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:31.185473 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02dfb840-dca9-4f1c-bb04-0ba0fd2d3f3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.298066 Jul 24 01:49:31.188092 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2892/5893] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:30 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:32.202450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:32.203706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:32.211366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:32.212044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:32.212985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:32.213584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:32.394682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:32.404254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88c1e05c-eb02-4681-a9df-1f3f63a24c99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.205544 Jul 24 01:49:32.419539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3002/5894] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:32 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:33.422664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:33.423283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:33.435630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:33.436947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:33.438343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:33.438792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:33.663163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:33.676739 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04b54f4f-8de0-4d7a-a9a3-82df5df89860 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.257018 Jul 24 01:49:33.687470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2893/5895] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:33 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:34.702970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:34.704373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:34.739643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:34.740659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:34.747715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:34.748255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:34.995338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:35.011836 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-59a62001-5745-4458-a7b6-43f249e81f17 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.319342 Jul 24 01:49:35.012425 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3003/5896] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:34 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:36.030479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:36.031331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:36.047574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:36.048355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:36.052409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:36.054089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:36.279041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:36.288857 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-024b6c2c-43c5-4ee5-bdf1-bb4ec5565a2f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.264066 Jul 24 01:49:36.290784 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2894/5897] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:36 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:37.309748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:37.310893 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:37.327641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:37.328422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:37.330929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:37.331613 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:37.678713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:37.727556 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-880bd63c-cf9f-462e-99e9-c1cb8ea2d8fc tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.408168 Jul 24 01:49:37.728400 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3004/5898] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:37 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:38.754922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:38.756198 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:38.771631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:38.772531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:38.775067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:38.776480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:38.781298 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:39.140304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:39.161556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1bb37a0e-949f-4120-b8e7-5e20662cb66a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.418709 Jul 24 01:49:39.172974 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2895/5899] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:38 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:40.179194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:40.179819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:40.188329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:40.188784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:40.190710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:40.191329 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:40.620351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:40.633634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f86fb31d-df3b-4fc4-b554-afc2e0134637 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1168 microversion: 2.1 time: 0.458996 Jul 24 01:49:40.639176 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3005/5900] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:40 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1168 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:41.665569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-27d22e7e-1958-4092-bd10-fffb85bd3880 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'create', calling method: .version_select at 0x7f05ea3c3160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1923238969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+NuNPod7N+UUs0IqvaAj2Jng+YsPhFiWhoFH01/lICQxem4/em131DXQKBfU/+TZn9Nb8bOk0NX2+tHtRNZ4O8BTLAdnO0Jra0ucU0DqJ0KFvBsPkG+5FLg8tkKd4wsA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:41.676703 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:41.677405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:41.694963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:41.695584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:41.696504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:41.696616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-27d22e7e-1958-4092-bd10-fffb85bd3880 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:49:41.696947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:41.703289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-27d22e7e-1958-4092-bd10-fffb85bd3880 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for user 49542098be914013837bfe2310608c31 and project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:49:41.738064 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-27d22e7e-1958-4092-bd10-fffb85bd3880 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.089072 Jul 24 01:49:41.739175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2896/5901] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:49:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:49:41.953471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:41.966668 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc2681d9-e4b9-41e1-b51a-d4d2d032350b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.302150 Jul 24 01:49:41.982491 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3006/5902] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:41 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:42.987097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:42.987723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:43.003185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:43.009574 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:43.011069 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:43.011690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:43.414480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:43.426446 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-016b0eb5-5c3f-4f1d-b600-8875951c0539 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.443502 Jul 24 01:49:43.435486 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2897/5903] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:42 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:43.769853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-288923728", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "bda21b26-dfe2-4096-bf97-133277774b7c"}], "key_name": "tempest-TestNetworkBasicOps-1923238969", "security_groups": [{"name": "tempest-secgroup-smoke-2108490690"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:43.916164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] validate_networks() for [('bda21b26-dfe2-4096-bf97-133277774b7c', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:49:44.450000 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:44.452061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:44.467445 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:44.481302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:44.482463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:44.483548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:44.484058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:44.840153 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:44.843207 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:49:44.843874 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:49:44.844417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:49:44.844921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:49:44.845572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:49:44.857062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:44.857698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:44.858602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:44.859089 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-875a5ec4-8e7d-4dea-bd2c-7cabca2bf5e7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.419699 Jul 24 01:49:44.859219 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:44.861006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2898/5904] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:44 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:44.882747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:49:44.889383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Getting quotas for user 49542098be914013837bfe2310608c31 and project f4b5a847051449df8fc6a3f05dbb3d59. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:49:44.905422 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:49:44.910351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:49:44.976105 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-34422e9a-dfc2-47a5-94ac-964f60920584 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.211061 Jul 24 01:49:44.977311 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3007/5905] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:49:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:49:44.988675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4509e7ed-cd26-4ac9-a692-9ff32caceed1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:44.989157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4509e7ed-cd26-4ac9-a692-9ff32caceed1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:45.088412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4509e7ed-cd26-4ac9-a692-9ff32caceed1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:45.096828 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4509e7ed-cd26-4ac9-a692-9ff32caceed1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1248 microversion: 2.1 time: 0.113471 Jul 24 01:49:45.103275 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2899/5906] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:44 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1248 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:45.879648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:45.893359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:45.896757 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:45.901992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:45.903070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:45.904124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:45.904724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:45.908794 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=91 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:46.111777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:46.119697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:46.121756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:46.126490 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93a56279-c9de-4b33-b495-e00a695ccd67 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.253178 Jul 24 01:49:46.127736 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3008/5907] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:45 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:46.133934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:46.139709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:46.141000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:46.141960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:46.246605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:46.257746 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94f39e4d-991e-4d91-8559-9e209788bb32 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1308 microversion: 2.1 time: 0.141614 Jul 24 01:49:46.259489 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2900/5908] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:46 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:47.144774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:47.145520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:47.159665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:47.160122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:47.160920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:47.172830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:47.274818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:47.275585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:47.283737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:47.284346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:47.285261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:47.286182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:47.347661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:47.357175 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23df106c-0f76-43fb-a188-87fa47b5a1b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.217365 Jul 24 01:49:47.362991 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3009/5909] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:47 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:47.466495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:47.476202 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c912690-a8dc-4e89-816a-c1812c2dd4a6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1374 microversion: 2.1 time: 0.205140 Jul 24 01:49:47.477716 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2901/5910] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:47 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:48.333193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-cb24ce9a-251c-498d-b140-985afdbeeee3 req-3ff0c6a7-fd37-4da9-8467-c586a778a4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0695a5-60a1-4e63-8f57-543be0cf0a4e", "tag": "e06210d3-5f4d-409d-915f-b710c968d30b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:48.373457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:48.378831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cb24ce9a-251c-498d-b140-985afdbeeee3 req-3ff0c6a7-fd37-4da9-8467-c586a778a4c8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:48.378831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-cb24ce9a-251c-498d-b140-985afdbeeee3 req-3ff0c6a7-fd37-4da9-8467-c586a778a4c8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:48.379040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:48.399275 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-cb24ce9a-251c-498d-b140-985afdbeeee3 req-3ff0c6a7-fd37-4da9-8467-c586a778a4c8 service nova] Creating event network-changed:e06210d3-5f4d-409d-915f-b710c968d30b for instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e on n-h1-master-1 Jul 24 01:49:48.402198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:48.403056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:48.404002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:48.404473 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-cb24ce9a-251c-498d-b140-985afdbeeee3 req-3ff0c6a7-fd37-4da9-8467-c586a778a4c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079616 Jul 24 01:49:48.405058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:48.405807 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3010/5911] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:49:48.496871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:48.497773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:48.517414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:48.519160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:48.521421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:48.527928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:48.809987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:48.819796 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2756a605-8ac8-4cc0-9210-5bd0f0e22a04 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.450161 Jul 24 01:49:48.820620 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2902/5912] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:48 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:48.866061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:48.874800 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e01685ea-93c7-479d-963f-ab26633b236b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1374 microversion: 2.1 time: 0.383230 Jul 24 01:49:48.875519 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3011/5913] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:48 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1374 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:49.840197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:49.840845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:49.849305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:49.850034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:49.850844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:49.851280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:49.893157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:49.894566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:49.922532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:49.931674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:49.931674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:49.931674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:50.147689 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:50.152026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:50.172673 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad94c2fb-e388-48c2-b34a-100fe1b1d556 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1374 microversion: 2.1 time: 0.283551 Jul 24 01:49:50.175674 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ddbcb916-26a7-4be0-8f0f-b94014d269b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.339300 Jul 24 01:49:50.176436 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2903/5914] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:49 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:50.186481 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3012/5915] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:49 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1374 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:51.201415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:51.202122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:51.204175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:51.204905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:51.219081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:51.219905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:51.220855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:51.221368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:51.221714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:51.227210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:51.227210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:51.227210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:51.455237 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:51.468169 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a72dee01-da20-408f-8134-001b42814803 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.278656 Jul 24 01:49:51.471675 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2904/5916] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:51 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:51.909477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:51.917910 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-602af00f-ccee-4eed-8116-115b6b3feb64 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1374 microversion: 2.1 time: 0.726887 Jul 24 01:49:51.921702 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3013/5917] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:51 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1374 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:52.491045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:52.491766 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:52.499210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:52.499721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:52.500575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:52.501085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:52.650628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:52.659889 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-12b41f53-81d3-43fd-ad58-4bd39616203d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.175380 Jul 24 01:49:52.660471 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2905/5918] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:52 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:52.917127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-15fd12bf-8380-49b1-a851-6209ba907f79 req-6eec3363-8225-4a51-95a9-45b18de02852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a49263-7fda-4780-a788-235e7df7fda4", "name": "network-vif-plugged", "status": "completed", "tag": "3d2714f3-3e55-4fd6-9d36-66e461752ae6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:52.934894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:52.935515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:52.941499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15fd12bf-8380-49b1-a851-6209ba907f79 req-6eec3363-8225-4a51-95a9-45b18de02852 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:52.945005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:52.945631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:52.946626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:52.947277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-15fd12bf-8380-49b1-a851-6209ba907f79 req-6eec3363-8225-4a51-95a9-45b18de02852 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:52.954245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:52.995238 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-15fd12bf-8380-49b1-a851-6209ba907f79 req-6eec3363-8225-4a51-95a9-45b18de02852 service nova] Creating event network-vif-plugged:3d2714f3-3e55-4fd6-9d36-66e461752ae6 for instance 50a49263-7fda-4780-a788-235e7df7fda4 on n-h2-master-1 Jul 24 01:49:53.002601 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-15fd12bf-8380-49b1-a851-6209ba907f79 req-6eec3363-8225-4a51-95a9-45b18de02852 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088818 Jul 24 01:49:53.003838 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3014/5919] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:49:53.206853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:53.223893 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80d0abee-2f0f-48e4-b6d0-20194be43c6f tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1374 microversion: 2.1 time: 0.292672 Jul 24 01:49:53.228318 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2906/5920] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:52 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1374 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:53.681068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:53.681816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:53.691116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:53.692057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:53.696452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:53.697818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:53.840122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:53.848058 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-54386520-2616-4b38-a114-ebc5547a5e8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1202 microversion: 2.1 time: 0.175267 Jul 24 01:49:53.850014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3015/5921] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:53 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:54.244266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:54.244889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:54.252688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:54.253209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:54.254034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:54.254484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:54.413832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:54.421773 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7277301f-db85-48d2-b883-f6c094491227 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1374 microversion: 2.1 time: 0.181328 Jul 24 01:49:54.422545 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2907/5922] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:54 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:54.865469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:54.867064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:54.873710 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:54.876063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:54.877429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:54.878751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:54.879309 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:54.900858 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:55.026225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2d76e0e6-3f9c-433c-9116-5afb96f2fbcc req-3f1431c3-d717-4536-88ce-ff8038358dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0695a5-60a1-4e63-8f57-543be0cf0a4e", "name": "network-vif-plugged", "status": "completed", "tag": "e06210d3-5f4d-409d-915f-b710c968d30b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:55.031015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:55.043862 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d82387a-a3ed-48e1-b4ac-93fe1fb6d1d2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1389 microversion: 2.1 time: 0.183282 Jul 24 01:49:55.047739 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3016/5923] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:54 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1389 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:55.053204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2d76e0e6-3f9c-433c-9116-5afb96f2fbcc req-3f1431c3-d717-4536-88ce-ff8038358dee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.053640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2d76e0e6-3f9c-433c-9116-5afb96f2fbcc req-3f1431c3-d717-4536-88ce-ff8038358dee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.064116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:55.066885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:55.068351 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2d76e0e6-3f9c-433c-9116-5afb96f2fbcc req-3f1431c3-d717-4536-88ce-ff8038358dee service nova] Creating event network-vif-plugged:e06210d3-5f4d-409d-915f-b710c968d30b for instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e on n-h1-master-1 Jul 24 01:49:55.074510 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2d76e0e6-3f9c-433c-9116-5afb96f2fbcc req-3f1431c3-d717-4536-88ce-ff8038358dee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054321 Jul 24 01:49:55.075296 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2908/5924] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:49:55.078737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.079277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.080845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.081349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.246675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:55.257698 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-977940e1-1227-4394-b325-1c402af1af70 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1389 microversion: 2.1 time: 0.197805 Jul 24 01:49:55.258421 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3017/5925] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:55 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1389 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:55.271243 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:55.276544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:55.277250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:55.284721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.285182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.286132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.286485 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.438414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:55.439037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:55.446064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.446529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.447317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.447765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.546548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:55.555610 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-717ee429-6fd3-4625-aeeb-4db796f7f5fb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1389 microversion: 2.1 time: 0.285243 Jul 24 01:49:55.556210 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2909/5926] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:55 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1389 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:55.653987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:55.654873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:55.667330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:55.671434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.674825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.676246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.676973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.678011 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5078f157-2558-4678-a607-f2fe095a9e3b tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1374 microversion: 2.1 time: 0.243358 Jul 24 01:49:55.687876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3018/5927] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:55 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:55.718741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:49:55.813105 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ed9ebd9-56d4-45a4-bad3-a2109560cd30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 204 len: 0 microversion: 2.1 time: 0.166131 Jul 24 01:49:55.815102 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2910/5928] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:49:55 2022] DELETE /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:49:55.822944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:55.823560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:55.830534 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.831130 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.831801 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:55.832235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:55.975265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:55.985403 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8520c046-788f-4b7b-b000-6471c2c98529 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1395 microversion: 2.1 time: 0.166402 Jul 24 01:49:55.986085 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3019/5929] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:55 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1395 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:56.696272 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:56.696991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:56.704524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:56.706255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:56.707197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:56.707649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:56.867223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:56.876416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-708dcf15-6125-40c7-82d9-38b58476b51e tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1546 microversion: 2.1 time: 0.184494 Jul 24 01:49:56.878843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2911/5930] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:56 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:56.896009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:56.896868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:56.906453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:56.907002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:56.907834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:56.908627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:57.004477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:57.005450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:57.037179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:57.042529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:57.043943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:57.045209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:57.093523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:57.102216 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e320f80e-3231-421e-aece-0cf5819eafe1 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1546 microversion: 2.1 time: 0.212147 Jul 24 01:49:57.103330 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3020/5931] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:56 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:57.259867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:57.263500 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:57.270758 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-78fe8dc1-c993-46c6-a6b8-0776e764fe8d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1395 microversion: 2.1 time: 0.271817 Jul 24 01:49:57.280550 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2912/5932] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:56 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1395 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:49:58.288967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:58.289714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:58.319995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:58.320565 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:58.321598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:58.322146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:58.461409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:58.473454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f6cc059-4af3-4321-95da-1cb6dc6e5d9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1187 microversion: 2.1 time: 0.189345 Jul 24 01:49:58.474092 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2913/5933] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:58 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1187 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:49:58.514502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-30916dd9-6daf-408d-a6bf-3146dc5e1da1 req-dbe84df7-3169-46ea-b0b2-50511b29b662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a49263-7fda-4780-a788-235e7df7fda4", "name": "network-vif-deleted", "tag": "3d2714f3-3e55-4fd6-9d36-66e461752ae6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:58.523479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-30916dd9-6daf-408d-a6bf-3146dc5e1da1 req-dbe84df7-3169-46ea-b0b2-50511b29b662 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:58.524253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-30916dd9-6daf-408d-a6bf-3146dc5e1da1 req-dbe84df7-3169-46ea-b0b2-50511b29b662 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:58.539553 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-30916dd9-6daf-408d-a6bf-3146dc5e1da1 req-dbe84df7-3169-46ea-b0b2-50511b29b662 service nova] Creating event network-vif-deleted:3d2714f3-3e55-4fd6-9d36-66e461752ae6 for instance 50a49263-7fda-4780-a788-235e7df7fda4 on n-h2-master-1 Jul 24 01:49:58.545763 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-30916dd9-6daf-408d-a6bf-3146dc5e1da1 req-dbe84df7-3169-46ea-b0b2-50511b29b662 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409991 Jul 24 01:49:58.546939 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3021/5934] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:49:59.434458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f7050c8a-f28e-4ebe-a1df-16f546077d29 req-a6ca01ee-2a51-4850-85ce-508e303921c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0695a5-60a1-4e63-8f57-543be0cf0a4e", "tag": "e06210d3-5f4d-409d-915f-b710c968d30b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:49:59.445535 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f7050c8a-f28e-4ebe-a1df-16f546077d29 req-a6ca01ee-2a51-4850-85ce-508e303921c1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:59.446030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f7050c8a-f28e-4ebe-a1df-16f546077d29 req-a6ca01ee-2a51-4850-85ce-508e303921c1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:59.464062 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f7050c8a-f28e-4ebe-a1df-16f546077d29 req-a6ca01ee-2a51-4850-85ce-508e303921c1 service nova] Creating event network-changed:e06210d3-5f4d-409d-915f-b710c968d30b for instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e on n-h1-master-1 Jul 24 01:49:59.496683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:49:59.497299 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:49:59.501625 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f7050c8a-f28e-4ebe-a1df-16f546077d29 req-a6ca01ee-2a51-4850-85ce-508e303921c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068777 Jul 24 01:49:59.504709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:59.505182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:59.508728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:49:59.511153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:49:59.518560 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2914/5935] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:49:59.660444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:49:59.675716 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-04c20df4-09ef-457d-a5e5-a7fe2639611f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1187 microversion: 2.1 time: 0.184097 Jul 24 01:49:59.677050 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3022/5936] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:49:59 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1187 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:50:00.695920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:00.696763 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:00.710578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:00.719656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:00.726434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:00.740005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:00.871575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:00.881579 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-574c9a7d-28ef-4e56-858f-d07c0d52cbe0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1187 microversion: 2.1 time: 0.192592 Jul 24 01:50:00.883103 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2915/5937] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:00 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1187 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:01.899221 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:01.899771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:01.908519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:01.919970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:01.923239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:01.924241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:02.039309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:02.047558 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b60bc63b-8156-4714-af17-62cbfd5f83eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1187 microversion: 2.1 time: 0.152680 Jul 24 01:50:02.050355 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3023/5938] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:01 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1187 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:03.067889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:03.068423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:03.076068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:03.076532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:03.077321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:03.077814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:03.147997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:03.156713 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-afb2bf51-774f-43b1-bd31-559a197a24be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 200 len: 1187 microversion: 2.1 time: 0.092840 Jul 24 01:50:03.157308 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2916/5939] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:03 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:50:04.176626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:04.178025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:04.185967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:04.186434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:04.187226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:04.187673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:04.206966 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 HTTP/1.1 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '50a49263-7fda-4780-a788-235e7df7fda4'} Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:04.208976 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf847765-53d6-4da2-b3fe-c5299993d079 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 404 len: 111 microversion: 2.1 time: 0.040899 Jul 24 01:50:04.214676 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3024/5940] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:04 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:50:08.509970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:08.511177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:08.521576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:08.522437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:08.523472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:08.524285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:08.546604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 HTTP/1.1 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '50a49263-7fda-4780-a788-235e7df7fda4'} Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:50:08.553034 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-021c62ee-7243-4b2f-8a0a-3025b1fd21a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 404 len: 111 microversion: 2.1 time: 0.051986 Jul 24 01:50:08.557000 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2917/5941] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:50:08 2022] DELETE /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:50:08.565012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:08.565755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 50a49263-7fda-4780-a788-235e7df7fda4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:08.582426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:08.582898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:08.585212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:08.586464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:08.606416 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 HTTP/1.1 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '50a49263-7fda-4780-a788-235e7df7fda4'} Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:08.608378 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.612342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:08.612342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:08.612342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:08.612342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:50:08.612342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:50:08.612342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. Jul 24 01:50:08.612342 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:08.614599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 50a49263-7fda-4780-a788-235e7df7fda4 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:50:08.615868 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64e46597-4e93-436c-95ca-dff702bb8592 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4" status: 404 len: 111 microversion: 2.1 time: 0.056053 Jul 24 01:50:08.617088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3025/5942] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:08 2022] GET /compute/v2.1/servers/50a49263-7fda-4780-a788-235e7df7fda4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:50:13.063754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ac35edea-4369-466e-b5a1-a11c61970fb5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: .version_select at 0x7f05ea425a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-895198930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODRy6v0+mE0rDkAyvCG7CBhmlaZDyPNwCGe3zJ1LcxhuyubUI+Tise5/SOZVgppYfzVfzGrNzO0oC0BbbkIPRwrz8TE+dW+Jh20RN6wxSwvwvQKOV9CPLvZoVxIcFz3qA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:13.079020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ac35edea-4369-466e-b5a1-a11c61970fb5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:50:13.087328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ac35edea-4369-466e-b5a1-a11c61970fb5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:50:13.123876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ac35edea-4369-466e-b5a1-a11c61970fb5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.242616 Jul 24 01:50:13.123876 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2918/5943] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:50:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:13.339290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-554481990", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "cab01b91-9ef8-44b8-862e-b8272142462d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:13.416110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] validate_networks() for [('cab01b91-9ef8-44b8-862e-b8272142462d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:50:13.917463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:50:13.920274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:50:13.920810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:50:13.921236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:50:13.921659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:50:13.939306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:13.939829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:13.941162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:13.941278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:13.960715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Getting quotas for project e6205931cc6a41f990d36b703e7b7467. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:50:13.966094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Getting quotas for user e9c6b9605c8f4c6a81352db2cefad8cd and project e6205931cc6a41f990d36b703e7b7467. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:50:13.980064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:50:13.982663 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:50:14.030209 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1776b227-b736-463b-be43-59968adba2f5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695230 Jul 24 01:50:14.031492 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3026/5944] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:50:14.044308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fc485f92-c558-42a0-a6e9-d3254273e761 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:14.045472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fc485f92-c558-42a0-a6e9-d3254273e761 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:14.187438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fc485f92-c558-42a0-a6e9-d3254273e761 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:14.197449 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fc485f92-c558-42a0-a6e9-d3254273e761 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1218 microversion: 2.1 time: 0.158286 Jul 24 01:50:14.198931 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2919/5945] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:14 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:15.217335 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:15.226645 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:15.234428 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:15.235116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:15.236677 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:15.237313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:15.311850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:15.322420 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-227a395c-92a7-401d-8b87-7fe7fcdce200 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1270 microversion: 2.1 time: 0.109786 Jul 24 01:50:15.323059 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3027/5946] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:15 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:16.342351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:16.345985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:16.356219 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:16.359155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:16.359866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:16.360677 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:16.362403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:16.686049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:16.694531 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f3abfc9-43c2-401e-a7b5-c60c8faba665 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.357703 Jul 24 01:50:16.704513 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2920/5947] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:16 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:17.561850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e535ab4d-165c-4e19-a0a1-b15ee58d500d req-8a38b89e-b613-4370-bcbe-3dca41439fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23eea98-5cca-4464-9b61-31bb42c3f980", "tag": "776a5c09-e19e-4ade-b652-66caf8732817"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:17.587088 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:17.598413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e535ab4d-165c-4e19-a0a1-b15ee58d500d req-8a38b89e-b613-4370-bcbe-3dca41439fe9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:17.599106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e535ab4d-165c-4e19-a0a1-b15ee58d500d req-8a38b89e-b613-4370-bcbe-3dca41439fe9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:17.614158 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:17.617057 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e535ab4d-165c-4e19-a0a1-b15ee58d500d req-8a38b89e-b613-4370-bcbe-3dca41439fe9 service nova] Creating event network-changed:776a5c09-e19e-4ade-b652-66caf8732817 for instance c23eea98-5cca-4464-9b61-31bb42c3f980 on n-h2-master-1 Jul 24 01:50:17.622763 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e535ab4d-165c-4e19-a0a1-b15ee58d500d req-8a38b89e-b613-4370-bcbe-3dca41439fe9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068299 Jul 24 01:50:17.624326 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3028/5948] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:17.712211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:17.713428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:17.723183 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:17.734214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:17.735472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:17.736200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:17.978790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:17.992201 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ad3dcd7-0f84-4e23-86f8-eec756949b35 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.282456 Jul 24 01:50:17.993158 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2921/5949] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:17 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:19.021274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:19.022042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:19.031630 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:19.032366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:19.033911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:19.039351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:19.374141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:19.383946 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32bb3cc1-a8f4-424d-ad6a-1b53e196d56a tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.377310 Jul 24 01:50:19.384816 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3029/5950] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:19 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:20.400480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:20.401977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:20.410280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:20.410983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:20.411954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:20.412562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:20.881175 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:20.893093 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cfbd9f1c-b308-4c74-93f2-2ffc69e4239c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.495607 Jul 24 01:50:20.908288 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2922/5951] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:20 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:21.450330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-375409227", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "1d8ed6f3-9235-47c3-8baf-cd4ab03a1b3b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-895198930", "security_groups": [{"name": "tempest-secgroup-smoke-1597251743"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:21.713051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] validate_networks() for [('1d8ed6f3-9235-47c3-8baf-cd4ab03a1b3b', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:50:21.810374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0935e6d0-0492-4af2-96ec-c73803d8dc7a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:21.812386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0935e6d0-0492-4af2-96ec-c73803d8dc7a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:21.822903 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0935e6d0-0492-4af2-96ec-c73803d8dc7a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:21.823601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0935e6d0-0492-4af2-96ec-c73803d8dc7a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:21.824581 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0935e6d0-0492-4af2-96ec-c73803d8dc7a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:21.825232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0935e6d0-0492-4af2-96ec-c73803d8dc7a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:21.893953 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0935e6d0-0492-4af2-96ec-c73803d8dc7a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e/action" status: 200 len: 24559 microversion: 2.1 time: 0.087098 Jul 24 01:50:21.895023 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2923/5952] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:50:21 2022] POST /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e/action => generated 24559 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:50:21.911777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:21.912424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:21.921187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:21.923656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:21.924674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:21.925294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:22.578663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:22.590200 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff95a564-c601-48c0-af5d-c48785b87216 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.683119 Jul 24 01:50:22.607187 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2924/5953] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:21 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:50:22.710233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:50:22.711403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:50:22.712454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:50:22.712901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:50:22.713773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:50:22.727990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:22.728959 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:22.730155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:22.731024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:22.753132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:50:22.760009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:50:22.776257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:50:22.778968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:50:22.874194 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ea69dbc-c540-45a4-978b-0650e4ec62c2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.435668 Jul 24 01:50:22.874891 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3030/5954] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:50:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:50:22.886460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0a320f25-3536-4739-8211-70a6bd2cd7b8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:22.887245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0a320f25-3536-4739-8211-70a6bd2cd7b8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:22.989336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a320f25-3536-4739-8211-70a6bd2cd7b8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:22.998109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0a320f25-3536-4739-8211-70a6bd2cd7b8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1265 microversion: 2.1 time: 0.116618 Jul 24 01:50:23.001276 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2925/5955] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:22 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:50:23.613640 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:23.614314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:23.630090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:23.630556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:23.631359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:23.633946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:23.904544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:23.917383 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7962791-aa41-4b16-b66b-45c2c82c30ad tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.306580 Jul 24 01:50:23.919568 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3031/5956] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:23 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:24.018692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:24.019315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:24.027209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:24.027914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:24.028895 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:24.029341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:24.104196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:24.113320 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-475e57fe-92d3-44e7-b006-f7bac66a2d63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1317 microversion: 2.1 time: 0.099181 Jul 24 01:50:24.114051 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2926/5957] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:24 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:24.935949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:24.936589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:24.944941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:24.945397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:24.955181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:24.956862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:25.130950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-31ae4251-d5cc-4191-a979-47e4114bb779 req-7365be81-7883-42c0-844a-3a1e9ffe0d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23eea98-5cca-4464-9b61-31bb42c3f980", "name": "network-vif-plugged", "status": "completed", "tag": "776a5c09-e19e-4ade-b652-66caf8732817"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:25.141974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-31ae4251-d5cc-4191-a979-47e4114bb779 req-7365be81-7883-42c0-844a-3a1e9ffe0d13 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:25.142936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-31ae4251-d5cc-4191-a979-47e4114bb779 req-7365be81-7883-42c0-844a-3a1e9ffe0d13 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:25.176092 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-31ae4251-d5cc-4191-a979-47e4114bb779 req-7365be81-7883-42c0-844a-3a1e9ffe0d13 service nova] Creating event network-vif-plugged:776a5c09-e19e-4ade-b652-66caf8732817 for instance c23eea98-5cca-4464-9b61-31bb42c3f980 on n-h2-master-1 Jul 24 01:50:25.181718 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-31ae4251-d5cc-4191-a979-47e4114bb779 req-7365be81-7883-42c0-844a-3a1e9ffe0d13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137374 Jul 24 01:50:25.182686 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2927/5958] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:50:25.190905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:25.191632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:25.200850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:25.201321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:25.202148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:25.202593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:25.244963 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:25.258633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2abc0ccc-1e29-49b4-8a1f-16494dfdf98f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.326529 Jul 24 01:50:25.259447 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3032/5959] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:24 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:25.497998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:25.509507 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a93dad8-e431-4cac-a0f2-b9f1c11d5269 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.324519 Jul 24 01:50:25.510947 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2928/5960] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:25 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:26.276413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:26.277419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:26.286756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:26.287415 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:26.288796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:26.289875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:26.505192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-bb0aa158-0d53-46a3-942b-9520dd623ef7 req-e03e7388-4e08-4513-aa19-0309b530fbec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:26.529064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bb0aa158-0d53-46a3-942b-9520dd623ef7 req-e03e7388-4e08-4513-aa19-0309b530fbec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:26.529744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bb0aa158-0d53-46a3-942b-9520dd623ef7 req-e03e7388-4e08-4513-aa19-0309b530fbec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:26.543042 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-bb0aa158-0d53-46a3-942b-9520dd623ef7 req-e03e7388-4e08-4513-aa19-0309b530fbec service nova] Creating event network-changed:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h2-master-1 Jul 24 01:50:26.544686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:26.549393 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-bb0aa158-0d53-46a3-942b-9520dd623ef7 req-e03e7388-4e08-4513-aa19-0309b530fbec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050331 Jul 24 01:50:26.550578 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2929/5961] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:26.555420 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-12ad8203-a33a-4c40-ad73-6a34562de68d tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1318 microversion: 2.1 time: 0.283525 Jul 24 01:50:26.556013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3033/5962] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:26 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:26.557869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:26.558736 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:26.566617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:26.567314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:26.568287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:26.569029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:26.759730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:26.769132 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-024f5ff8-6172-4382-bef1-b8d582e2e100 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.216908 Jul 24 01:50:26.769753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2930/5963] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:26 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:27.572833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:27.575589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:27.583981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:27.584690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:27.585647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:27.586762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:27.784059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:27.786644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:27.787303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:27.793296 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-906f37f0-ad42-4ff6-b73c-1141c1149424 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1507 microversion: 2.1 time: 0.224498 Jul 24 01:50:27.794010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:27.794464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:27.795289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:27.795761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:27.807844 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3034/5964] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:27 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:27.943299 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:27.956444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a656bae-2424-4af2-93cd-db8e8ca9c415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.174241 Jul 24 01:50:27.957037 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2931/5965] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:27 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:28.349832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7704892a-6308-4b9d-a5c4-4d6d5622694a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:28.350826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7704892a-6308-4b9d-a5c4-4d6d5622694a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:28.357153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7704892a-6308-4b9d-a5c4-4d6d5622694a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:28.357607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7704892a-6308-4b9d-a5c4-4d6d5622694a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:28.358551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7704892a-6308-4b9d-a5c4-4d6d5622694a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:28.358997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7704892a-6308-4b9d-a5c4-4d6d5622694a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:28.411924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7704892a-6308-4b9d-a5c4-4d6d5622694a tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "POST /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e/action" status: 200 len: 32625 microversion: 2.1 time: 0.066260 Jul 24 01:50:28.416719 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3035/5966] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:50:28 2022] POST /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e/action => generated 32625 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:50:28.973948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:28.974581 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:28.982232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:28.982948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:28.983974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:28.984423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:28.989034 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=79 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:29.191469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:29.199783 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a6b2e43-ca14-4b6c-98e8-0151b3d94240 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.231281 Jul 24 01:50:29.200583 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2932/5967] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:28 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:30.013537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:30.014170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:30.029121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-25a30555-72b4-4cfd-a7ad-8b7734e88162 req-532b2d8d-3aa3-453c-affb-6265918bc2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0695a5-60a1-4e63-8f57-543be0cf0a4e", "tag": "e06210d3-5f4d-409d-915f-b710c968d30b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:30.038359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:30.038750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:30.039538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:30.039992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:30.044199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-25a30555-72b4-4cfd-a7ad-8b7734e88162 req-532b2d8d-3aa3-453c-affb-6265918bc2ec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:30.044652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-25a30555-72b4-4cfd-a7ad-8b7734e88162 req-532b2d8d-3aa3-453c-affb-6265918bc2ec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:30.072585 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-25a30555-72b4-4cfd-a7ad-8b7734e88162 req-532b2d8d-3aa3-453c-affb-6265918bc2ec service nova] Creating event network-changed:e06210d3-5f4d-409d-915f-b710c968d30b for instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e on n-h1-master-1 Jul 24 01:50:30.078838 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-25a30555-72b4-4cfd-a7ad-8b7734e88162 req-532b2d8d-3aa3-453c-affb-6265918bc2ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053649 Jul 24 01:50:30.080653 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2933/5968] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:30.097521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:50:30.221951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:30.222697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:30.238833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:30.240980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:30.243170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:30.246559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:30.281584 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-59a88c36-48d2-4f35-bff2-e256bd5c2da0 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 204 len: 0 microversion: 2.1 time: 0.272204 Jul 24 01:50:30.283515 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3036/5969] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:50:30 2022] DELETE /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:50:30.295795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:30.297538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:30.317492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:30.330154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:30.331223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:30.331800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:30.589127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:30.604148 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d44716f6-bd38-4767-9b42-ed9334562175 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.389611 Jul 24 01:50:30.605166 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2934/5970] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:30 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:30.621246 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:30.634628 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67e63963-f301-405d-ad60-1655841fce52 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1671 microversion: 2.1 time: 0.346484 Jul 24 01:50:30.635930 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3037/5971] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:30 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1671 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:31.629635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:31.629635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:31.642776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:31.643618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:31.652443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:31.653085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:31.661175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:31.661632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:31.666530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:31.666992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:31.667780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:31.677299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:32.144481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:32.152420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49542098be914013837bfe2310608c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5a847051449df8fc6a3f05dbb3d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:32.159598 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c4ad0e72-39b2-4a5b-9f44-a0d64127fe03 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.538669 Jul 24 01:50:32.160441 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2935/5972] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:31 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:32.166660 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4be28dab-e7ad-47e9-9022-9cdc347fd1f3 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 200 len: 1671 microversion: 2.1 time: 0.518056 Jul 24 01:50:32.167471 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3038/5973] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:31 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 1671 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:32.463147 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-921cb0d2-8b74-4689-8ce1-2f39ddd2d9a6 req-52187bed-ce13-42c8-be99-4f5dd46b82c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0695a5-60a1-4e63-8f57-543be0cf0a4e", "name": "network-vif-deleted", "tag": "e06210d3-5f4d-409d-915f-b710c968d30b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:32.473462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-921cb0d2-8b74-4689-8ce1-2f39ddd2d9a6 req-52187bed-ce13-42c8-be99-4f5dd46b82c8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:32.474227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-921cb0d2-8b74-4689-8ce1-2f39ddd2d9a6 req-52187bed-ce13-42c8-be99-4f5dd46b82c8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:32.490407 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-921cb0d2-8b74-4689-8ce1-2f39ddd2d9a6 req-52187bed-ce13-42c8-be99-4f5dd46b82c8 service nova] Creating event network-vif-deleted:e06210d3-5f4d-409d-915f-b710c968d30b for instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e on n-h1-master-1 Jul 24 01:50:32.497554 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-921cb0d2-8b74-4689-8ce1-2f39ddd2d9a6 req-52187bed-ce13-42c8-be99-4f5dd46b82c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037659 Jul 24 01:50:32.497704 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2936/5974] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:33.132957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-23161b41-cc4c-41fb-bef2-c8976227b52a req-7ec07a47-fb00-483e-be98-ed64b4b49a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "name": "network-vif-plugged", "status": "completed", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:33.138740 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:33.143387 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:33.157446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-23161b41-cc4c-41fb-bef2-c8976227b52a req-7ec07a47-fb00-483e-be98-ed64b4b49a61 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:33.160606 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-23161b41-cc4c-41fb-bef2-c8976227b52a req-7ec07a47-fb00-483e-be98-ed64b4b49a61 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:33.179256 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:33.179975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:33.192515 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=8 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:33.194318 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-23161b41-cc4c-41fb-bef2-c8976227b52a req-7ec07a47-fb00-483e-be98-ed64b4b49a61 service nova] Creating event network-vif-plugged:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h2-master-1 Jul 24 01:50:33.195773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:33.196294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:33.199013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:33.199470 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:33.208144 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-23161b41-cc4c-41fb-bef2-c8976227b52a req-7ec07a47-fb00-483e-be98-ed64b4b49a61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079465 Jul 24 01:50:33.210836 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3039/5975] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:50:33.218029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:33.219370 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] [instance: fa0695a5-60a1-4e63-8f57-543be0cf0a4e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:33.226742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:33.229335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:33.230444 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:33.231852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:33.281401 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] HTTP exception thrown: Instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e could not be found. Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Request method failure captured: Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e HTTP/1.1 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KRyg7ItJfbkCvgMOqCN5TxyQxZhC1ndM_3d1uPeVBq5uRZUUCa1zQCo-51fli8nn1yCcb5jLsP-Y3ZbO2L_xbxsKyCs44tUB73iDrcybxd3MTswTGBiS8G2RHZaxTMXl8WKefCA0f5N20TBapok6mZJIqZ9ehidR3xAZsB4c87-Pwg Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: f4b5a847051449df8fc6a3f05dbb3d59 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4b5a847051449df8fc6a3f05dbb3d59", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b5a847051449df8fc6a3f05dbb3d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: f4b5a847051449df8fc6a3f05dbb3d59 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestNetworkBasicOps-1267508913 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestNetworkBasicOps-1267508913-project Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 49542098be914013837bfe2310608c31 Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestNetworkBasicOps-1267508913-project Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: exception: Instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e could not be found. Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'fa0695a5-60a1-4e63-8f57-543be0cf0a4e'} Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e could not be found. Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e could not be found. Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:50:33.292194 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e could not be found. Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Returning 404 to user: Instance fa0695a5-60a1-4e63-8f57-543be0cf0a4e could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:50:33.297380 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-659430c6-58af-46a5-8648-66bf5b7f7937 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e" status: 404 len: 111 microversion: 2.1 time: 0.083234 Jul 24 01:50:33.301841 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3040/5976] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:33 2022] GET /compute/v2.1/servers/fa0695a5-60a1-4e63-8f57-543be0cf0a4e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:50:33.466174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:33.474544 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e31575e-cc08-49cc-b8ee-8831e1e6e903 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.301649 Jul 24 01:50:33.478350 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2937/5977] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:33 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:33.528528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22f00dd5-91ea-47a1-9f86-01a2ba30dea6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] Calling method '.version_select at 0x7f05e9c77940>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:33.585725 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22f00dd5-91ea-47a1-9f86-01a2ba30dea6 tempest-TestNetworkBasicOps-1267508913 tempest-TestNetworkBasicOps-1267508913-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1923238969" status: 202 len: 0 microversion: 2.1 time: 0.060815 Jul 24 01:50:33.586681 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3041/5978] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:50:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1923238969 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:50:34.495795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:34.496667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:34.504383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:34.505171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:34.506216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:34.507261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:34.709977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:34.718545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6235fa2d-c98b-425c-ae9b-1b3c781d7ea9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1391 microversion: 2.1 time: 0.226709 Jul 24 01:50:34.720274 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2938/5979] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:34 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:35.739528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:35.740523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:35.752231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:35.753216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:35.754238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:35.757531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:35.968396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:35.978405 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-923b0192-99f2-4b63-9996-ad0b06f614cf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1563 microversion: 2.1 time: 0.245032 Jul 24 01:50:35.979574 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3042/5980] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:35 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:35.995213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:35.996102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:36.004704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:36.006706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:36.008306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:36.009001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:36.196055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:36.210828 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbcb9ae5-0247-49cb-82d9-83ffc92be002 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1563 microversion: 2.1 time: 0.218427 Jul 24 01:50:36.212352 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2939/5981] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:35 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:36.623978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1034243142", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3a0843f5-35be-461e-8c4f-f019be42e4f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3dc256e9-ed96-441b-9223-c863c318c2b9"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:36.732955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] validate_networks() for [('3dc256e9-ed96-441b-9223-c863c318c2b9', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:50:37.492884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:50:37.493471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:50:37.493846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:50:37.494333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:50:37.494664 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:50:37.508949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:37.509333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:37.510464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:37.511336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:37.562444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:50:37.568480 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:50:37.648876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:50:37.651293 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a0843f5-35be-461e-8c4f-f019be42e4f9',volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:50:37.812183 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-210daeba-8e7b-449e-8345-56e1ffe488a5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193933 Jul 24 01:50:37.824889 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01d3f2a6-a601-4951-a3da-cf948c84ffc9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:37.826099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-01d3f2a6-a601-4951-a3da-cf948c84ffc9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:37.832001 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3043/5982] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:50:37.995296 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-01d3f2a6-a601-4951-a3da-cf948c84ffc9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:38.002998 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01d3f2a6-a601-4951-a3da-cf948c84ffc9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1071 microversion: 2.1 time: 0.182666 Jul 24 01:50:38.003602 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2940/5983] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:37 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1071 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:39.025101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:39.026394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:39.051448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:39.053840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:39.056296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:39.059024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:39.244970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:39.257315 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ee9f50a7-7f61-4fd9-91f7-807f34b606d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1187 microversion: 2.1 time: 0.241653 Jul 24 01:50:39.258981 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3044/5984] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:39 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1187 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:39.615919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:39.617475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:39.625041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b96824af-6051-48e2-be21-abcf4d8bb91a req-8da466ba-cd5b-467a-bb7e-83d56ef0b0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:39.632388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:39.634259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:39.638089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:39.639038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:39.640573 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b96824af-6051-48e2-be21-abcf4d8bb91a req-8da466ba-cd5b-467a-bb7e-83d56ef0b0fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:39.641029 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b96824af-6051-48e2-be21-abcf4d8bb91a req-8da466ba-cd5b-467a-bb7e-83d56ef0b0fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:39.668643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b96824af-6051-48e2-be21-abcf4d8bb91a req-8da466ba-cd5b-467a-bb7e-83d56ef0b0fa service nova] Creating event network-changed:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h2-master-1 Jul 24 01:50:39.680609 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b96824af-6051-48e2-be21-abcf4d8bb91a req-8da466ba-cd5b-467a-bb7e-83d56ef0b0fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059628 Jul 24 01:50:39.686277 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3045/5985] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:50:40.243061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:40.252906 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b977efa4-f19d-404a-acb7-2151f4e70d5d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1563 microversion: 2.1 time: 0.641020 Jul 24 01:50:40.254178 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2941/5986] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:39 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1563 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:40.281284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:40.282855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:40.291723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:40.292475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:40.294319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:40.294960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:40.854627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:40.869494 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-339755ea-ba87-4146-bdc9-823f268d8e7c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1187 microversion: 2.1 time: 0.597535 Jul 24 01:50:40.883705 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3046/5987] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:40 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1187 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:41.890328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:41.891693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:41.905623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:41.906438 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:41.907491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:41.909710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:42.193881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:42.208951 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-501d9ebe-1d55-4ecb-8e82-e5e7cee73f9f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1229 microversion: 2.1 time: 0.323401 Jul 24 01:50:42.218929 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2942/5988] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:41 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1229 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:42.370038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-17520589-a394-44ee-855b-834a86698e53 req-986ac5d9-6794-4786-8a61-69398e8c3e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c9c739-6c27-4da6-8209-3a1bcaf0dfa8", "tag": "223f52b8-9de3-408c-8677-5d6090cdc41e"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:42.384697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-17520589-a394-44ee-855b-834a86698e53 req-986ac5d9-6794-4786-8a61-69398e8c3e44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:42.385500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-17520589-a394-44ee-855b-834a86698e53 req-986ac5d9-6794-4786-8a61-69398e8c3e44 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:42.406822 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-17520589-a394-44ee-855b-834a86698e53 req-986ac5d9-6794-4786-8a61-69398e8c3e44 service nova] Creating event network-changed:223f52b8-9de3-408c-8677-5d6090cdc41e for instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 on n-h1-master-1 Jul 24 01:50:42.419235 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-17520589-a394-44ee-855b-834a86698e53 req-986ac5d9-6794-4786-8a61-69398e8c3e44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052998 Jul 24 01:50:42.420016 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3047/5989] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:43.226752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:43.227825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:43.236195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:43.237073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:43.238186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:43.238950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:43.469023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:43.483990 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cc0d160d-b69b-482b-a3bb-a9171b499d88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1229 microversion: 2.1 time: 0.260919 Jul 24 01:50:43.486388 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2943/5990] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:43 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1229 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:44.504645 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:44.505368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:44.512448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:44.513370 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:44.514218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:44.515478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:44.673819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:44.681765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5aed52ba-e13c-4be3-ae8e-3ccc908242de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1229 microversion: 2.1 time: 0.182926 Jul 24 01:50:44.688286 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3048/5991] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:44 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1229 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:50:45.700015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:45.701331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:45.709141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:45.709590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:45.710389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:45.711429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:45.858651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:45.866197 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dadd700d-9a14-42a0-8ebb-3f116a36fb97 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.171697 Jul 24 01:50:45.867087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2944/5992] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:45 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:46.884615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:46.885265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:46.892362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:46.892954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:46.893747 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:46.894191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:46.896935 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:47.034727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:47.042795 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f08d3348-2764-4ab7-aad3-64468220df94 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.162069 Jul 24 01:50:47.043508 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3049/5993] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:46 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:48.060611 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:48.061381 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:48.064940 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:48.066200 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=54 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:48.072957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:48.073220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:48.074065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:48.074716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:48.287310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:48.300087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c352a01-9901-408a-b8c7-1155f33b047b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.241204 Jul 24 01:50:48.301064 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2945/5994] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:48 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:49.319363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:49.319985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:49.321904 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:49.322580 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:49.324084 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:49.330919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:49.331381 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:49.332177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:49.332619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:49.470851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:49.478962 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1e223603-8c0c-4664-9aed-05f1f9aa77ff tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.163467 Jul 24 01:50:49.479822 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3050/5995] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:49 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:49.723873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6c487e50-eda8-4e75-91f6-f1def15fc22f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d1368aa-d261-4fed-92d2-6ab84ae11537", "device": "/dev/sdb"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:49.725662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6c487e50-eda8-4e75-91f6-f1def15fc22f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:49.732865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c487e50-eda8-4e75-91f6-f1def15fc22f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:49.733317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c487e50-eda8-4e75-91f6-f1def15fc22f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:49.734132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c487e50-eda8-4e75-91f6-f1def15fc22f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:49.734608 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6c487e50-eda8-4e75-91f6-f1def15fc22f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:49.978689 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6c487e50-eda8-4e75-91f6-f1def15fc22f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "POST /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259282 Jul 24 01:50:49.979351 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2946/5996] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:50:49 2022] POST /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:50.497641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:50.498296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:50.506477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:50.508048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:50.508873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:50.510453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:50.678919 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:50.688332 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3670ad6e-f1a7-4a10-b13a-cd7dec4ce7d9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.195761 Jul 24 01:50:50.688929 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3051/5997] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:50 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:51.708885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:51.709512 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:51.716717 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:51.717187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:51.717987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:51.718427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:51.876806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:51.884966 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-217cbece-7843-4a29-a668-fbff30784c93 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.181905 Jul 24 01:50:51.885562 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2947/5998] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:51 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:52.902538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:52.903183 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:52.910322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:52.910777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:52.911546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:52.911985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:53.043112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:53.051292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8aa1060-aa1c-49c8-89e4-1ed3f66b374b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.152687 Jul 24 01:50:53.051869 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3052/5999] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:52 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:54.069161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:54.069921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:54.076899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:54.077359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:54.078251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:54.078701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:54.226597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:54.234933 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f17a3d6d-7414-4b45-8693-0deb71faa1ba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.169736 Jul 24 01:50:54.236609 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2948/6000] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:54 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:50:55.253394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:55.254042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:55.261228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:55.261707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:55.262483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:55.262923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:55.398036 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:55.405781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7b5087e8-5c4f-4638-82c3-08465656200b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.157094 Jul 24 01:50:55.411467 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3053/6001] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:55 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:55.732263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-3ea19774-0e66-4a05-8c44-2fff39153bff req-659cbaee-999a-4720-abff-02a31812cd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c9c739-6c27-4da6-8209-3a1bcaf0dfa8", "name": "network-vif-plugged", "status": "completed", "tag": "223f52b8-9de3-408c-8677-5d6090cdc41e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:55.742046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3ea19774-0e66-4a05-8c44-2fff39153bff req-659cbaee-999a-4720-abff-02a31812cd0c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:55.742504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3ea19774-0e66-4a05-8c44-2fff39153bff req-659cbaee-999a-4720-abff-02a31812cd0c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:55.754451 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-3ea19774-0e66-4a05-8c44-2fff39153bff req-659cbaee-999a-4720-abff-02a31812cd0c service nova] Creating event network-vif-plugged:223f52b8-9de3-408c-8677-5d6090cdc41e for instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 on n-h1-master-1 Jul 24 01:50:55.759425 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-3ea19774-0e66-4a05-8c44-2fff39153bff req-659cbaee-999a-4720-abff-02a31812cd0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031158 Jul 24 01:50:55.760030 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2949/6002] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:50:56.424319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:56.424949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:56.431956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:56.432418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:56.433197 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:56.433643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:56.564554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:56.572076 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-12e7e8e7-27b3-484e-83c4-cd10b0214be8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1217 microversion: 2.1 time: 0.152329 Jul 24 01:50:56.572646 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3054/6003] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:56 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:57.590649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:57.591353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:57.598766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:57.599219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:57.599992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:57.600435 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:57.615892 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:57.734320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:57.742196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0a12ec0a-ba3f-44e1-9acb-c583fa827111 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1404 microversion: 2.1 time: 0.156748 Jul 24 01:50:57.742771 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2950/6004] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:57 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:57.758505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:50:57.759123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:57.766011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:57.767225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:57.768010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:57.768449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:57.899542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:50:57.907706 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ebcca9b-c314-4bf9-b7bd-827647da8988 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1404 microversion: 2.1 time: 0.152528 Jul 24 01:50:57.908387 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3055/6005] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:50:57 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:50:57.924747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-578628905"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:50:57.925816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:50:57.931915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:57.932312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:57.933085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:50:57.933525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:50:58.027220 n-d-master-1 devstack@n-api.service[119562]: INFO nova.compute.api [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Attempting to quiesce instance before volume snapshot. Jul 24 01:50:58.100555 n-d-master-1 devstack@n-api.service[119562]: INFO nova.compute.api [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 24 01:50:58.173699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Creating snapshot from volume 3a0843f5-35be-461e-8c4f-f019be42e4f9. {{(pid=119562) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 24 01:50:59.087705 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7bd297b4-77de-4a57-b444-2639e11077d7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8/action" status: 202 len: 0 microversion: 2.1 time: 1.167636 Jul 24 01:50:59.092944 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2951/6006] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:50:57 2022] POST /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8/action => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 01:51:00.286924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1739012207", "imageRef": "6f96f902-9b1f-482b-9e41-2132e75323d7", "flavorRef": "452", "networks": [{"uuid": "3dc256e9-ed96-441b-9223-c863c318c2b9"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:00.341248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] validate_networks() for [('3dc256e9-ed96-441b-9223-c863c318c2b9', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:51:01.044241 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:51:01.044672 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:51:01.045151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:51:01.045598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:51:01.046041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:51:01.055131 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:01.055585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:01.056396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:01.056840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:01.074109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:51:01.080004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:51:01.092163 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:51:01.094742 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='435bac36-a342-40b4-b735-ac3180562dee',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:51:01.167831 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-972854f8-38bf-4f72-aebf-d2d1b5c94d05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885647 Jul 24 01:51:01.168565 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3056/6007] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 01:51:01.180472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bef692d-eeff-4355-ad72-105b16602c30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:01.181195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3bef692d-eeff-4355-ad72-105b16602c30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:01.242961 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3bef692d-eeff-4355-ad72-105b16602c30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:01.251539 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3bef692d-eeff-4355-ad72-105b16602c30 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1230 microversion: 2.1 time: 0.075400 Jul 24 01:51:01.252153 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2952/6008] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:01 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1230 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:02.269909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:02.271188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:02.278811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:02.280392 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:02.281646 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:02.283195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:02.393976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:02.408956 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2635d867-eebc-4daa-8819-8f701bf83f42 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1300 microversion: 2.1 time: 0.144466 Jul 24 01:51:02.410376 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3057/6009] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:02 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:03.428399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:03.429041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:03.437410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:03.438088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:03.440006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:03.440774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:03.688848 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:03.700633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f50737e-2faf-4855-a04a-62149da6e6a6 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.276461 Jul 24 01:51:03.705930 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2953/6010] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:03 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:03.877805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ec70bfcd-a273-4225-9212-53d56f960ca0 req-35b2aad5-4e01-4583-8ace-466a0091545a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3318e2-633a-40db-956f-73de1cd07dd1", "tag": "0b13468f-4243-4df4-9b91-6c2f32b5962d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:03.889179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ec70bfcd-a273-4225-9212-53d56f960ca0 req-35b2aad5-4e01-4583-8ace-466a0091545a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:03.889928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ec70bfcd-a273-4225-9212-53d56f960ca0 req-35b2aad5-4e01-4583-8ace-466a0091545a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:03.908748 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ec70bfcd-a273-4225-9212-53d56f960ca0 req-35b2aad5-4e01-4583-8ace-466a0091545a service nova] Creating event network-changed:0b13468f-4243-4df4-9b91-6c2f32b5962d for instance ad3318e2-633a-40db-956f-73de1cd07dd1 on n-h2-master-1 Jul 24 01:51:03.915553 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ec70bfcd-a273-4225-9212-53d56f960ca0 req-35b2aad5-4e01-4583-8ace-466a0091545a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041894 Jul 24 01:51:03.916261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3058/6011] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:51:04.717866 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:04.719195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:04.727147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:04.727933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:04.728942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:04.729604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:04.971915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:04.984342 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f58bc404-8834-40f6-9de0-0a906e5ce7b3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.270254 Jul 24 01:51:04.994819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2954/6012] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:04 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:06.003508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:06.004231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:06.011242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:06.011698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:06.012473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:06.012915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:06.172268 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:06.180443 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb585ead-fa34-49e2-bdcf-1e536189eca8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.182174 Jul 24 01:51:06.181302 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3059/6013] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:05 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:07.200922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:07.202059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:07.211320 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:07.212092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:07.212914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:07.214064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:07.449051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:07.459578 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-746f17b5-3f44-447b-b6ab-15d25afb18d4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.264193 Jul 24 01:51:07.460620 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2955/6014] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:07 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:08.478791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:08.479444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:08.488931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:08.490078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:08.491117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:08.491590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:08.697364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:08.711168 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-244ab60c-fad3-4787-8079-2c54e9093b99 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.236282 Jul 24 01:51:08.711766 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3060/6015] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:08 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:09.732853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:09.734229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:09.742408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:09.743163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:09.744339 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:09.745055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:09.921930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:09.932179 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04ff17e5-084b-4300-ab38-11040201f0b9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.203767 Jul 24 01:51:09.933012 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2956/6016] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:09 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:10.950064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:10.951252 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:10.958640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:10.959299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:10.960263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:10.960847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:11.064788 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:11.086974 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:11.107933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:11.118680 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-07762ea8-6951-4daa-a504-9b9f69260418 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.172280 Jul 24 01:51:11.119876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3061/6017] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:10 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:12.097534 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d2791520-642b-4701-b094-0ccd4f02a66f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:12.098541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d2791520-642b-4701-b094-0ccd4f02a66f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:12.102506 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:12.108518 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2791520-642b-4701-b094-0ccd4f02a66f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:12.108996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2791520-642b-4701-b094-0ccd4f02a66f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:12.110480 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2791520-642b-4701-b094-0ccd4f02a66f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:12.111089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2791520-642b-4701-b094-0ccd4f02a66f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:12.136683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:12.137321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:12.145823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:12.146550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:12.147575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:12.148027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:12.179782 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d2791520-642b-4701-b094-0ccd4f02a66f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action" status: 200 len: 24575 microversion: 2.1 time: 0.086905 Jul 24 01:51:12.189559 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2957/6018] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:51:12 2022] POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action => generated 24575 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:51:12.300273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:12.308316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-15db5727-bf97-4a7a-8980-820bed96fdad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.175676 Jul 24 01:51:12.316270 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3062/6019] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:12 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:13.324995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:13.325745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:13.333515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:13.334019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:13.334822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:13.335281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:13.482591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:13.494900 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-213c5206-8b75-4b59-ab86-4aef026b8741 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.174102 Jul 24 01:51:13.495481 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2958/6020] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:13 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:14.512937 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:14.514016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:14.522876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:14.523333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:14.524148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:14.524591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:14.669200 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:14.676925 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13446bae-c31f-4c08-aaa7-42d078169dce tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.168684 Jul 24 01:51:14.677551 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3063/6021] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:14 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:15.041026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:15.041612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:15.047901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:15.048490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:15.049349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:15.049837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:15.140389 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lazy-loading 'services' on Instance uuid c23eea98-5cca-4464-9b61-31bb42c3f980 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:51:15.218430 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-32bc6248-1240-4bfa-a8ce-3e1ab64b0be4 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980/os-volume_attachments/3d1368aa-d261-4fed-92d2-6ab84ae11537" status: 202 len: 0 microversion: 2.1 time: 0.182334 Jul 24 01:51:15.219286 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2959/6022] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:51:15 2022] DELETE /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980/os-volume_attachments/3d1368aa-d261-4fed-92d2-6ab84ae11537 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:51:15.697110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:15.697911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:15.705857 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:15.706525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:15.707498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:15.707979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:15.848641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:15.856378 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33aa9195-e802-40cd-9b82-f92e190e2ef2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.166112 Jul 24 01:51:15.857230 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3064/6023] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:15 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:16.875520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:16.877172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:16.883984 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:16.884456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:16.885258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:16.885738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:17.028881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:17.038113 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6a2711f6-34d6-4cf1-b7b8-92d4326b23f8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1342 microversion: 2.1 time: 0.167978 Jul 24 01:51:17.038941 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2960/6024] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:16 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:18.056084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:18.056702 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:18.064468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:18.064925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:18.065724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:18.066171 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:18.068949 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=88 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:18.217141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:18.225687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c143f6a1-52b9-40c5-925c-1cd8d8014e4b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.173819 Jul 24 01:51:18.226268 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3065/6025] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:18 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:19.244404 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:19.245029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:19.248045 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=34 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:19.254923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:19.255478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:19.256352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:19.257018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:19.400513 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:19.408623 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c1b3218-514c-4db8-9c07-31df7f016a56 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.168184 Jul 24 01:51:19.409240 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2961/6026] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:19 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:20.428562 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:20.433653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:20.439140 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:20.445823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:20.446527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:20.447512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:20.448182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:20.636659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:20.646198 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5870fb7d-9fbd-4e41-8ef1-0ced0696ccb7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.221618 Jul 24 01:51:20.647142 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3066/6027] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:20 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:21.361298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:21.361853 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:21.368769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:21.369241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:21.370070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:21.370535 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:21.396066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:51:21.478130 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94b7129b-43ae-4dc8-8ca7-947274961820 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 204 len: 0 microversion: 2.1 time: 0.120386 Jul 24 01:51:21.478866 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2962/6028] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:51:21 2022] DELETE /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:51:21.488270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:21.489086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:21.497187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:21.497804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:21.498605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:21.499063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:21.636258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:21.644749 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-35626201-cf89-4444-ac27-0dd5b3dcc722 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1513 microversion: 2.1 time: 0.161127 Jul 24 01:51:21.645334 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3067/6029] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:21 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:21.667678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:21.668408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:21.674850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:21.675309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:21.676104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:21.676553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:21.832947 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:21.836572 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:21.841451 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a65b24a-410e-44cd-9a4e-85c863ca2043 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.178269 Jul 24 01:51:21.842058 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2963/6030] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:21 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:22.663468 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:22.664082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:22.671669 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:22.672272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:22.673262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:22.673930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:22.809264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:22.817397 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bba10cef-49fc-47c6-bc63-84b5806fa38f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1513 microversion: 2.1 time: 0.158373 Jul 24 01:51:22.818014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3068/6031] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:22 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:22.859047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:22.860270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:22.868529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:22.868997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:22.869818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:22.870276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:23.003763 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:23.011651 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d91e3a69-a7f8-4c41-9037-ca8f0901bc3f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.156688 Jul 24 01:51:23.012167 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2964/6032] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:22 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:23.834940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:23.835582 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:23.842489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:23.842941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:23.843709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:23.844942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:23.975561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:23.983391 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1edcb50d-bb3f-411b-8c47-2df86be8d942 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1513 microversion: 2.1 time: 0.152430 Jul 24 01:51:23.983962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3069/6033] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:23 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:24.028248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:24.028882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:24.036218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:24.037084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:24.038124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:24.038797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:24.170489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:24.178266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ecf8a95-7769-4b6e-a980-12fcc30dee12 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.153881 Jul 24 01:51:24.178758 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2965/6034] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:24 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:24.885555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f517b969-5ed3-44ed-ae18-c9cabd9a02e9 req-ffd5ccae-2c39-4594-a2be-7a6da1ed32af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23eea98-5cca-4464-9b61-31bb42c3f980", "name": "network-vif-deleted", "tag": "776a5c09-e19e-4ade-b652-66caf8732817"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:24.898574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f517b969-5ed3-44ed-ae18-c9cabd9a02e9 req-ffd5ccae-2c39-4594-a2be-7a6da1ed32af service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:24.899067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f517b969-5ed3-44ed-ae18-c9cabd9a02e9 req-ffd5ccae-2c39-4594-a2be-7a6da1ed32af service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:24.915436 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f517b969-5ed3-44ed-ae18-c9cabd9a02e9 req-ffd5ccae-2c39-4594-a2be-7a6da1ed32af service nova] Creating event network-vif-deleted:776a5c09-e19e-4ade-b652-66caf8732817 for instance c23eea98-5cca-4464-9b61-31bb42c3f980 on n-h2-master-1 Jul 24 01:51:24.921406 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f517b969-5ed3-44ed-ae18-c9cabd9a02e9 req-ffd5ccae-2c39-4594-a2be-7a6da1ed32af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040789 Jul 24 01:51:24.923001 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3070/6035] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:51:25.001166 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:25.001847 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:25.008286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:25.008698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:25.009496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:25.009983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:25.046632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:25.048178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:25.048804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lazy-loading 'fault' on Instance uuid c23eea98-5cca-4464-9b61-31bb42c3f980 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:51:25.091682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:25.102058 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-007bd4df-f179-460c-a3ad-38b6b1401703 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 200 len: 1308 microversion: 2.1 time: 0.105252 Jul 24 01:51:25.102796 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2966/6036] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:24 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:25.195940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:25.196648 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:25.203267 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:25.203744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:25.204498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:25.206045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:25.350802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:25.362634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5da7ca7b-b9fc-456a-ba8e-b46c623ecf60 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.170786 Jul 24 01:51:25.363840 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3071/6037] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:25 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:51:26.119754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:26.120470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: c23eea98-5cca-4464-9b61-31bb42c3f980] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:26.128631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:26.129095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:26.129911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:26.130360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:26.144855 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] HTTP exception thrown: Instance c23eea98-5cca-4464-9b61-31bb42c3f980 could not be found. Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Request method failure captured: Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 HTTP/1.1 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KUOmsMoJJ9JKfvEIUbThF17sWeDWn6uebJKRGFj9VHnrmzn8y6OlrlBsQM7GB-88Invm_iaRU0cEUNJpR2lD9SdJsDVnIXfx-RywKu7jBX5cYfy7bX8wdrV8hgC84CGx43DsYGNmY3fSC-TpyY-t8oLP2pIXtfrxn9Lvod4k43mCNQ Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: e6205931cc6a41f990d36b703e7b7467 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-VolumesSnapshotTestJSON-773136060 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6205931cc6a41f990d36b703e7b7467"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6205931cc6a41f990d36b703e7b7467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6205931cc6a41f990d36b703e7b7467", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6205931cc6a41f990d36b703e7b7467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-VolumesSnapshotTestJSON-773136060 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: e6205931cc6a41f990d36b703e7b7467 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-773136060 Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-VolumesSnapshotTestJSON-773136060-project Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: e9c6b9605c8f4c6a81352db2cefad8cd Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-VolumesSnapshotTestJSON-773136060-project Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c23eea98-5cca-4464-9b61-31bb42c3f980 could not be found. Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c23eea98-5cca-4464-9b61-31bb42c3f980'} Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23eea98-5cca-4464-9b61-31bb42c3f980 could not be found. Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23eea98-5cca-4464-9b61-31bb42c3f980 could not be found. Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:26.146539 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23eea98-5cca-4464-9b61-31bb42c3f980 could not be found. Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Returning 404 to user: Instance c23eea98-5cca-4464-9b61-31bb42c3f980 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c66efabb-e086-4a30-bcf7-a4e7ba9c50a8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980" status: 404 len: 111 microversion: 2.1 time: 0.032406 Jul 24 01:51:26.151782 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2967/6038] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:26 2022] GET /compute/v2.1/servers/c23eea98-5cca-4464-9b61-31bb42c3f980 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:26.380374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:26.381033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:26.388916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:26.389441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:26.390597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:26.391058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:26.537942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:26.545818 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-94cdf9e2-bb7b-4028-bf52-e0b64116fc87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.170122 Jul 24 01:51:26.546587 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3072/6039] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:26 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:27.565289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:27.566120 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:27.573569 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:27.574154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:27.574957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:27.575429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:27.782814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:27.796567 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fd82efe4-b234-498f-8ae2-1397a2a235c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.236024 Jul 24 01:51:27.797478 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2968/6040] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:27 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:28.819868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:28.821199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:28.829066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:28.829625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:28.830488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:28.830958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:28.970949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:28.979286 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6c8ad0c8-f47f-4952-9389-8a2d62b0c178 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.164390 Jul 24 01:51:28.979851 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3073/6041] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:28 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:29.289931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-230f403b-9724-43b6-a3e9-e3f8791a3f52 req-f27c1dec-916d-4995-9cc2-15862e3ed548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3318e2-633a-40db-956f-73de1cd07dd1", "name": "network-vif-plugged", "status": "completed", "tag": "0b13468f-4243-4df4-9b91-6c2f32b5962d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:29.299618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-230f403b-9724-43b6-a3e9-e3f8791a3f52 req-f27c1dec-916d-4995-9cc2-15862e3ed548 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:29.299881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-230f403b-9724-43b6-a3e9-e3f8791a3f52 req-f27c1dec-916d-4995-9cc2-15862e3ed548 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:29.312228 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-230f403b-9724-43b6-a3e9-e3f8791a3f52 req-f27c1dec-916d-4995-9cc2-15862e3ed548 service nova] Creating event network-vif-plugged:0b13468f-4243-4df4-9b91-6c2f32b5962d for instance ad3318e2-633a-40db-956f-73de1cd07dd1 on n-h2-master-1 Jul 24 01:51:29.317853 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-230f403b-9724-43b6-a3e9-e3f8791a3f52 req-f27c1dec-916d-4995-9cc2-15862e3ed548 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031634 Jul 24 01:51:29.318526 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2969/6042] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:51:29.997436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:29.998117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:30.005430 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:30.005916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:30.006713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:30.007177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:30.146336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:30.153802 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a4df9fd0-b3c0-4ceb-9b72-06815fc49207 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1376 microversion: 2.1 time: 0.160474 Jul 24 01:51:30.154378 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3074/6043] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:29 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:31.172495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:31.173218 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:31.180148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.180622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.181408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.182063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.319928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:31.327979 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af020e0a-c07e-4251-a15d-b2ce6a615f33 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1563 microversion: 2.1 time: 0.160625 Jul 24 01:51:31.328552 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2970/6044] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:31 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:31.344604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:31.345235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:31.352624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.353089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.353901 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.354351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.497421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:31.505855 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-effdfa78-34db-4e96-9b99-d8187c5ec97d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1563 microversion: 2.1 time: 0.165207 Jul 24 01:51:31.506440 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3075/6045] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:31 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:31.577434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:31.577981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:31.584468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.584950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.585797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.586256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.615036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:51:31.697961 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-24739fab-b897-4f5b-9533-b595116f39d1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 204 len: 0 microversion: 2.1 time: 0.123903 Jul 24 01:51:31.701463 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2971/6046] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:51:31 2022] DELETE /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:51:31.707387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:31.708016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:31.715066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.715740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.717221 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:31.717866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:31.862038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:31.870095 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-302b7b2a-a92a-4c03-aa08-315e21c17a88 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1569 microversion: 2.1 time: 0.167331 Jul 24 01:51:31.870670 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3076/6047] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:31 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:32.887117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:32.887840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:32.895056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:32.895523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:32.896321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:32.896772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:32.962248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-971133123", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "cab01b91-9ef8-44b8-862e-b8272142462d"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:33.020753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] validate_networks() for [('cab01b91-9ef8-44b8-862e-b8272142462d', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:51:33.046025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:33.057019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-053368cb-3228-4523-9994-cf9b06ad6e77 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1569 microversion: 2.1 time: 0.174115 Jul 24 01:51:33.057750 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2972/6048] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:32 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:33.381085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:51:33.381516 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:51:33.382026 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:51:33.382445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:51:33.382884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:51:33.392304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:33.392756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:33.393559 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:33.394028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:33.412583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Getting quotas for project e6205931cc6a41f990d36b703e7b7467. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:51:33.417881 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Getting quotas for user e9c6b9605c8f4c6a81352db2cefad8cd and project e6205931cc6a41f990d36b703e7b7467. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:51:33.430813 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:51:33.433061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:51:33.478272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ec16bf94-6ba2-432a-9f13-b832b58199e5 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519924 Jul 24 01:51:33.478926 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3077/6049] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:51:33.489376 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0e53e8f-6dc7-469c-a5c1-236ed011cf3c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:33.490090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e0e53e8f-6dc7-469c-a5c1-236ed011cf3c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:33.561692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e0e53e8f-6dc7-469c-a5c1-236ed011cf3c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:33.570538 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e0e53e8f-6dc7-469c-a5c1-236ed011cf3c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1218 microversion: 2.1 time: 0.085072 Jul 24 01:51:33.572106 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2973/6050] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:33 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:51:34.045856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f62932d5-3a16-4aa4-81ea-1e7027f1e294 req-650dda83-d13e-4ccc-910d-a2cc91ecf086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3318e2-633a-40db-956f-73de1cd07dd1", "name": "network-vif-deleted", "tag": "0b13468f-4243-4df4-9b91-6c2f32b5962d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:34.063667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f62932d5-3a16-4aa4-81ea-1e7027f1e294 req-650dda83-d13e-4ccc-910d-a2cc91ecf086 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:34.064127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f62932d5-3a16-4aa4-81ea-1e7027f1e294 req-650dda83-d13e-4ccc-910d-a2cc91ecf086 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:34.074242 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:34.074893 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:34.092495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:34.092976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:34.093815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:34.094289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:34.098444 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f62932d5-3a16-4aa4-81ea-1e7027f1e294 req-650dda83-d13e-4ccc-910d-a2cc91ecf086 service nova] Creating event network-vif-deleted:0b13468f-4243-4df4-9b91-6c2f32b5962d for instance ad3318e2-633a-40db-956f-73de1cd07dd1 on n-h2-master-1 Jul 24 01:51:34.105583 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f62932d5-3a16-4aa4-81ea-1e7027f1e294 req-650dda83-d13e-4ccc-910d-a2cc91ecf086 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066190 Jul 24 01:51:34.118178 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3078/6051] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:51:34.196647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:34.218004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-273b5d90-59fa-43a4-912e-2944bb5319ac tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1527 microversion: 2.1 time: 0.147547 Jul 24 01:51:34.218604 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2974/6052] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:34 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1527 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:34.589806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:34.590510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:34.597985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:34.599111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:34.600540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:34.601240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:34.686042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:34.696528 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fa789fd5-cf5e-4bb3-95be-019a7be9f253 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1270 microversion: 2.1 time: 0.109518 Jul 24 01:51:34.697767 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3079/6053] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:34 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:35.236258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:35.236908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:35.245471 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:35.245997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:35.246829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:35.247302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:35.340216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:35.351274 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6fb1c47f-e35c-4abf-b8ce-aacf709ab2ee tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1361 microversion: 2.1 time: 0.118922 Jul 24 01:51:35.352312 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2975/6054] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:35 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1361 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:35.714831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:35.715605 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:35.727101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:35.728031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:35.728924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:35.730195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:35.938062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:35.948219 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de85f9a8-70b9-434b-a695-905a9516c7d6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.237466 Jul 24 01:51:35.959888 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3080/6055] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:35 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:36.372651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:36.374715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:36.384856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:36.385872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:36.387511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:36.388094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:36.474182 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:36.482986 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-94c96e51-6b96-4793-9213-187fb16ca077 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1361 microversion: 2.1 time: 0.114422 Jul 24 01:51:36.484209 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2976/6056] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:36 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1361 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:36.628579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c7071009-17a6-4a32-8df5-01294cd44c3b req-d45047ee-788f-483d-8ddd-41d521fc89cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4144c144-b659-4c5d-b9ee-8ede12a743a9", "tag": "0dacc3cb-0bcc-49c5-96e7-9506d9cce53d"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:36.644116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c7071009-17a6-4a32-8df5-01294cd44c3b req-d45047ee-788f-483d-8ddd-41d521fc89cc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:36.644660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c7071009-17a6-4a32-8df5-01294cd44c3b req-d45047ee-788f-483d-8ddd-41d521fc89cc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:36.682641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c7071009-17a6-4a32-8df5-01294cd44c3b req-d45047ee-788f-483d-8ddd-41d521fc89cc service nova] Creating event network-changed:0dacc3cb-0bcc-49c5-96e7-9506d9cce53d for instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 on n-h2-master-1 Jul 24 01:51:36.689043 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c7071009-17a6-4a32-8df5-01294cd44c3b req-d45047ee-788f-483d-8ddd-41d521fc89cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064438 Jul 24 01:51:36.690725 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3081/6057] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:51:36.968965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:36.969932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:36.978159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:36.978775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:36.979792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:36.980312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:37.257066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:37.266590 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be4d71fb-7507-4489-9649-40c0be5c25a6 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.301661 Jul 24 01:51:37.267335 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2977/6058] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:36 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:51:37.502159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:37.502811 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:37.510507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:37.510967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:37.511791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:37.512251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:37.582933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:37.591226 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2856323-d40c-41ca-bb90-5cc7aaa45cf4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1361 microversion: 2.1 time: 0.094440 Jul 24 01:51:37.600527 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3082/6059] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:37 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:38.285868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:38.286868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:38.295660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:38.296171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:38.296993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:38.297465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:38.435420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:38.443070 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d3872514-a87c-485f-b62e-14b0a353f44f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.162851 Jul 24 01:51:38.443648 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2978/6060] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:38 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:38.609630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:38.610279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:38.618347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:38.618810 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:38.619602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:38.620044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:38.686454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:38.694872 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d4a5d02-2a0f-409c-9043-e8ceac558891 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1361 microversion: 2.1 time: 0.089399 Jul 24 01:51:38.695466 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3083/6061] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:38 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:39.463206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:39.465507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:39.476510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:39.477479 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:39.478579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:39.479450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:39.636856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:39.645660 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-783fb77a-4e3d-41e8-b61a-28fc7a446aa8 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.189592 Jul 24 01:51:39.646384 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2979/6062] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:39 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:39.711259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:39.711808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:39.719056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:39.719511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:39.720296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:39.720741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:39.736855 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:39.755034 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:39.755491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:39.755952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lazy-loading 'fault' on Instance uuid ad3318e2-633a-40db-956f-73de1cd07dd1 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:51:39.849932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:39.871801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-725578c9-bd66-4b4c-bf68-a6d44d073859 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 200 len: 1366 microversion: 2.1 time: 0.164544 Jul 24 01:51:39.877868 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3084/6063] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:39 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:40.663177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:40.663749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:40.670634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:40.671104 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:40.671886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:40.672333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:40.809573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:40.813223 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:40.819032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b03d151-928a-4d1d-ae32-ada57015da5c tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.159961 Jul 24 01:51:40.819632 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2980/6064] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:40 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:40.888427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:40.889051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:40.896376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:40.896946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:40.897828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:40.898340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:40.912332 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 HTTP/1.1 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ad3318e2-633a-40db-956f-73de1cd07dd1'} Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:40.914171 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29b06ea0-189d-4ffa-9264-452ef9ae375e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 404 len: 111 microversion: 2.1 time: 0.032459 Jul 24 01:51:40.919080 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3085/6065] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:40 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:41.841271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:41.843188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:41.856954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:41.858017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:41.859014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:41.860331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:42.011923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:42.025450 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-33e7fd6c-6ff0-4ace-b5a9-6b1b8942d7cd tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.192030 Jul 24 01:51:42.026372 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2981/6066] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:41 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:42.587012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-724a74b3-3963-4f3e-bc1f-f0c996db5d41 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:42.587652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-724a74b3-3963-4f3e-bc1f-f0c996db5d41 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:42.594676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724a74b3-3963-4f3e-bc1f-f0c996db5d41 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:42.595139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724a74b3-3963-4f3e-bc1f-f0c996db5d41 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:42.595910 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724a74b3-3963-4f3e-bc1f-f0c996db5d41 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:42.596353 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-724a74b3-3963-4f3e-bc1f-f0c996db5d41 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:42.832392 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-724a74b3-3963-4f3e-bc1f-f0c996db5d41 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1833 microversion: 2.1 time: 0.248326 Jul 24 01:51:42.837367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3086/6067] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:42 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1833 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:42.848799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:42.849423 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:42.856546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:42.857271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:42.858098 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:42.858551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:42.992469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:43.000530 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b886843-cf48-4934-9737-7a79d1efb69c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1682 microversion: 2.1 time: 0.155648 Jul 24 01:51:43.001275 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2982/6068] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:42 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:43.042667 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:43.043300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:43.049545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.050040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.051465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.051921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.114532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff44d884-f725-4413-ad87-97e6108f2ac5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:43.115857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff44d884-f725-4413-ad87-97e6108f2ac5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:43.125818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff44d884-f725-4413-ad87-97e6108f2ac5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.126823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff44d884-f725-4413-ad87-97e6108f2ac5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.128158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff44d884-f725-4413-ad87-97e6108f2ac5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.129475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff44d884-f725-4413-ad87-97e6108f2ac5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.210508 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff44d884-f725-4413-ad87-97e6108f2ac5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action" status: 200 len: 32643 microversion: 2.1 time: 0.100969 Jul 24 01:51:43.213756 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2983/6069] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:51:43 2022] POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action => generated 32643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:51:43.262328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:43.274315 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d19faac3-99ce-484f-a53a-69b30253c414 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.235636 Jul 24 01:51:43.275639 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3087/6070] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:43 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:43.362248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-fcf90e0b-86c5-4342-9415-0d0488642f5b req-42c310b3-ab6e-4018-a725-080b4a090801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4144c144-b659-4c5d-b9ee-8ede12a743a9", "name": "network-vif-plugged", "status": "completed", "tag": "0dacc3cb-0bcc-49c5-96e7-9506d9cce53d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:43.373623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fcf90e0b-86c5-4342-9415-0d0488642f5b req-42c310b3-ab6e-4018-a725-080b4a090801 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.374203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-fcf90e0b-86c5-4342-9415-0d0488642f5b req-42c310b3-ab6e-4018-a725-080b4a090801 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.390709 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-fcf90e0b-86c5-4342-9415-0d0488642f5b req-42c310b3-ab6e-4018-a725-080b4a090801 service nova] Creating event network-vif-plugged:0dacc3cb-0bcc-49c5-96e7-9506d9cce53d for instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 on n-h2-master-1 Jul 24 01:51:43.397482 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-fcf90e0b-86c5-4342-9415-0d0488642f5b req-42c310b3-ab6e-4018-a725-080b4a090801 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039702 Jul 24 01:51:43.398925 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2984/6071] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:51:43.447084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:43.447995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:43.455909 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:43.457384 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:43.459243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.459869 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.460943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.461542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.506633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a16eebe673c4b27a4468aea1a4db43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08658a31624318825a55992df8ff12', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:43.507317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] flavor_id is None. Assuming migration. {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 24 01:51:43.507832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 01:51:43.689292 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-425a6df6-85dc-4e23-9a06-34836311d59c tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action" status: 202 len: 0 microversion: 2.1 time: 0.246381 Jul 24 01:51:43.693394 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3088/6072] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:51:43 2022] POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:51:43.696868 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:43.701589 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:43.707854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:43.715132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.716209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.716532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:43.717043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:43.874646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:43.884121 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90243885-b33d-4996-9d80-ae40823062e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1691 microversion: 2.1 time: 0.189259 Jul 24 01:51:43.884721 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2985/6073] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:43 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:44.291454 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:44.292240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:44.298696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:44.299292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:44.300135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:44.301342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:44.490636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:44.501569 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca7bc702-b2cd-48ff-911d-c038d6a966ee tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1318 microversion: 2.1 time: 0.213776 Jul 24 01:51:44.511189 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3089/6074] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:44 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:44.902026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:44.902741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:44.910925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:44.911461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:44.912260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:44.912709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.068358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:45.075941 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e5a765a2-b117-418a-ae65-0ec5fb7bbe1c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1691 microversion: 2.1 time: 0.178327 Jul 24 01:51:45.076508 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2986/6075] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:44 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:45.262109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:45.262612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:45.270251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.270703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.271478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.271916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.298093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:51:45.375544 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9502c443-1f12-48ef-b8c2-e11ade6ed44e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 204 len: 0 microversion: 2.1 time: 0.116952 Jul 24 01:51:45.376221 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3090/6076] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:51:45 2022] DELETE /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:51:45.385972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:45.386718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:45.396649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.396976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.397836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.398833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.521365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:45.522274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:45.537291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.537781 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.538565 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.539212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.660559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:45.669251 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2b19f8f-6869-4a0c-a8e4-0de5e8b48b05 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1410 microversion: 2.1 time: 0.287303 Jul 24 01:51:45.670025 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2987/6077] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:45 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1410 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:45.778588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:45.786615 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f74337e-8865-4aa6-a187-88151eaf9e01 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1507 microversion: 2.1 time: 0.271383 Jul 24 01:51:45.787200 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3091/6078] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:45 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:45.803174 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cdb3491a-8534-4e60-9041-d11f4b6a2d0e tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7ae5657-67cf-4139-afb6-7226f59c7304", "device": "/dev/sdb"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:45.804281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cdb3491a-8534-4e60-9041-d11f4b6a2d0e tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:45.810306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdb3491a-8534-4e60-9041-d11f4b6a2d0e tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.810767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdb3491a-8534-4e60-9041-d11f4b6a2d0e tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:45.811539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdb3491a-8534-4e60-9041-d11f4b6a2d0e tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:45.812038 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdb3491a-8534-4e60-9041-d11f4b6a2d0e tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:46.092160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:46.092809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:46.100346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:46.101058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:46.102041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:46.102744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:46.186605 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cdb3491a-8534-4e60-9041-d11f4b6a2d0e tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "POST /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387300 Jul 24 01:51:46.187421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2988/6079] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 01:51:45 2022] POST /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:51:46.339023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:46.347109 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df35366b-044b-46cd-aa96-86cdbe6aea59 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1691 microversion: 2.1 time: 0.258724 Jul 24 01:51:46.348715 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3092/6080] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:46 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:46.687779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:46.688642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:46.695166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:46.695657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:46.696582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:46.697046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:46.841135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:46.849440 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4374ea0a-0a21-4bf5-b29f-6f1dcea5ec7b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1410 microversion: 2.1 time: 0.166538 Jul 24 01:51:46.850048 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2989/6081] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:46 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:47.366780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:47.368140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:47.382081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-dad62d69-b9ac-4f4f-b664-690fb84bfbeb req-bc90cb2f-679e-4eaa-b3b0-f9230cad70c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c9c739-6c27-4da6-8209-3a1bcaf0dfa8", "name": "network-vif-deleted", "tag": "223f52b8-9de3-408c-8677-5d6090cdc41e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:47.389939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:47.390574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:47.391432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:47.391893 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:47.399146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dad62d69-b9ac-4f4f-b664-690fb84bfbeb req-bc90cb2f-679e-4eaa-b3b0-f9230cad70c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:47.399612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dad62d69-b9ac-4f4f-b664-690fb84bfbeb req-bc90cb2f-679e-4eaa-b3b0-f9230cad70c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:47.421295 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-dad62d69-b9ac-4f4f-b664-690fb84bfbeb req-bc90cb2f-679e-4eaa-b3b0-f9230cad70c6 service nova] Creating event network-vif-deleted:223f52b8-9de3-408c-8677-5d6090cdc41e for instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 on n-h1-master-1 Jul 24 01:51:47.432542 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-dad62d69-b9ac-4f4f-b664-690fb84bfbeb req-bc90cb2f-679e-4eaa-b3b0-f9230cad70c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054802 Jul 24 01:51:47.434305 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2990/6082] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:51:47.546040 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:47.553939 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46cd24d0-7dab-4de7-9eb0-71670b39600e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.191928 Jul 24 01:51:47.554522 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3093/6083] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:47 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:47.866989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:47.867709 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:47.874190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:47.874658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:47.875447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:47.875897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:47.942924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:47.950524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9423c81c-504d-45a5-93f1-22863cb5b6cb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1202 microversion: 2.1 time: 0.088005 Jul 24 01:51:47.951093 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2991/6084] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:47 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:48.264941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:48.265448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:48.272170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.272623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:48.273418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.273890 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:48.303697 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:51:48.385042 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5411c8ca-3d2b-413c-a3a9-651996c79ae8 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 204 len: 0 microversion: 2.1 time: 0.230843 Jul 24 01:51:48.385837 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3094/6085] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:51:48 2022] DELETE /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:51:48.394041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:48.394830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:48.401317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.401825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:48.402622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.403072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:48.541417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:48.549344 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dc975cde-7cc8-4c72-943d-785f400cdf7e tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1731 microversion: 2.1 time: 0.159226 Jul 24 01:51:48.549988 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2992/6086] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:48 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:48.572536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:48.573243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:48.579742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.580194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:48.581012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.581475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:48.723639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:48.731887 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c24d15b-c39b-45cc-94a7-e9d2a56f376f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.163847 Jul 24 01:51:48.733068 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3095/6087] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:48 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:48.967543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:48.968095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:48.975447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.975918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:48.976713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:48.977166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:49.040134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:49.047807 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aaefbc1a-9aab-43a1-b488-acef86692588 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1202 microversion: 2.1 time: 0.084390 Jul 24 01:51:49.048388 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2993/6088] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:48 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1202 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:49.567766 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:49.568383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:49.575469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:49.575954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:49.576813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:49.577158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:49.592305 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:49.749864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:49.750854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:49.755126 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:49.759922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:49.760827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:49.761642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:49.762129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:49.814537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:49.823517 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d47f4326-b513-4b3e-ad12-b59647b0dfbb tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1731 microversion: 2.1 time: 0.259835 Jul 24 01:51:49.831757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3096/6089] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:49 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:50.000437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:50.009016 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffbbb63a-a23c-4b57-aca7-29a10910d7e3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.263176 Jul 24 01:51:50.018236 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2994/6090] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:49 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:51:50.063925 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:50.064655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:50.071975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:50.072527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:50.073376 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:50.073908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:50.156887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:50.170478 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5cc68336-360d-47f4-9e72-e76610f8dbec tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1202 microversion: 2.1 time: 0.110383 Jul 24 01:51:50.173175 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3097/6091] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:50 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1202 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:50.840646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:50.841353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:50.848952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:50.849656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:50.850789 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:50.851302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:51.026348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:51.027144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:51.031132 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:51.036497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:51.037076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:51.037997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:51.038540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:51.206741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:51.219753 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-df30e05f-60f7-4984-a3cc-f90263b89d44 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1731 microversion: 2.1 time: 0.382759 Jul 24 01:51:51.220738 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2995/6092] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:50 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1731 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:51:51.234143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:51.234823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:51.242053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:51.242529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:51.243337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:51.243798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:51.373416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:51.388223 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a991ac46-87bb-4f44-8dca-a74d274faa00 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1202 microversion: 2.1 time: 0.166194 Jul 24 01:51:51.388926 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2996/6093] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:51 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:51.493049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:51.511151 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c2b043b2-eff0-4ff2-915b-e981daddd3ea tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.488750 Jul 24 01:51:51.512429 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3098/6094] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:51 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:51:51.760397 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-dfdb5547-a04c-4dc5-bb86-5ecf6b25c2ba req-07efa3d7-385e-47a1-94ab-39d982983a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6285dba2-9791-4a1a-9f93-de7819c97c49", "name": "network-vif-deleted", "tag": "3e1aa996-bf95-4309-b9ad-c4002223f0a0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:51.772844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dfdb5547-a04c-4dc5-bb86-5ecf6b25c2ba req-07efa3d7-385e-47a1-94ab-39d982983a79 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:51.773411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dfdb5547-a04c-4dc5-bb86-5ecf6b25c2ba req-07efa3d7-385e-47a1-94ab-39d982983a79 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:51.800134 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-dfdb5547-a04c-4dc5-bb86-5ecf6b25c2ba req-07efa3d7-385e-47a1-94ab-39d982983a79 service nova] Creating event network-vif-deleted:3e1aa996-bf95-4309-b9ad-c4002223f0a0 for instance 6285dba2-9791-4a1a-9f93-de7819c97c49 on n-h1-master-1 Jul 24 01:51:51.807599 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-dfdb5547-a04c-4dc5-bb86-5ecf6b25c2ba req-07efa3d7-385e-47a1-94ab-39d982983a79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050958 Jul 24 01:51:51.808521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2997/6095] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:51:52.240901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:52.242393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:52.255675 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:52.256973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:52.258098 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:52.258770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:52.308330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:52.310054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:52.310795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lazy-loading 'fault' on Instance uuid 6285dba2-9791-4a1a-9f93-de7819c97c49 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:51:52.363661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b34bec387d42859f416aa3df7a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101695253c6e40569d3cb5b391fccd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:52.372284 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f253569d-519c-4c1e-b40a-bffa45a209ab tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 200 len: 1387 microversion: 2.1 time: 0.136485 Jul 24 01:51:52.382776 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3099/6096] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:52 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 1387 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:52.407621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:52.408345 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:52.416707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:52.417293 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:52.418199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:52.418731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:52.447820 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:52.506421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:52.517579 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-076df3b1-4275-4099-987a-72559897b98c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1202 microversion: 2.1 time: 0.114134 Jul 24 01:51:52.518174 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2998/6097] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:52 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1202 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:51:52.538342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:52.539186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:52.546264 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:52.546854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:52.547895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:52.548446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:52.712790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:52.726638 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8137ec3d-cf24-4457-976b-7781387107fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.199674 Jul 24 01:51:52.727522 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3100/6098] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:52 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:53.390580 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:53.391211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:53.398090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.398555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.399329 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.399778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.414315 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] HTTP exception thrown: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Request method failure captured: Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 HTTP/1.1 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KRp-W4HKQ1ikTFckhdUtZjddJ19zdWZRnJGZ8BtrjF0yjeN4UZXPdbW7WteqtIFPofyo2IxQl2DIMEmw4fy-XM84KfBzX7xGGG3esil9myf_3aXREg02_tsxcaW3rDVyFeSUq6AWm6KOt04HSlPVOhYl8aL4w-xQY5okbYovBDfsQA Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 101695253c6e40569d3cb5b391fccd61 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_101695253c6e40569d3cb5b391fccd61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 101695253c6e40569d3cb5b391fccd61 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestServerBasicOps-1058260334-project Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: c4b34bec387d42859f416aa3df7a7d0e Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestServerBasicOps-1058260334-project Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '6285dba2-9791-4a1a-9f93-de7819c97c49'} Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:53.416032 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Returning 404 to user: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bcf59a58-59be-4c5f-b05e-d5115c85990b tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 404 len: 111 microversion: 2.1 time: 0.030834 Jul 24 01:51:53.420354 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 2999/6099] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:53 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:53.535450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:53.536258 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:53.543263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.543727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.544510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.544953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.609633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:53.618621 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cd2bb95c-9711-4433-b469-0c390a39372c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 200 len: 1202 microversion: 2.1 time: 0.087238 Jul 24 01:51:53.619462 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3101/6100] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:53 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:53.745250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:53.745849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:53.752507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.752990 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.754545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.755294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.902734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:53.903638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:53.911712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.912294 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.914397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.914855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.932125 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] HTTP exception thrown: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Request method failure captured: Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 HTTP/1.1 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KRp-W4HKQ1ikTFckhdUtZjddJ19zdWZRnJGZ8BtrjF0yjeN4UZXPdbW7WteqtIFPofyo2IxQl2DIMEmw4fy-XM84KfBzX7xGGG3esil9myf_3aXREg02_tsxcaW3rDVyFeSUq6AWm6KOt04HSlPVOhYl8aL4w-xQY5okbYovBDfsQA Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 101695253c6e40569d3cb5b391fccd61 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_101695253c6e40569d3cb5b391fccd61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 101695253c6e40569d3cb5b391fccd61 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestServerBasicOps-1058260334-project Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c4b34bec387d42859f416aa3df7a7d0e Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestServerBasicOps-1058260334-project Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6285dba2-9791-4a1a-9f93-de7819c97c49'} Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:53.933871 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Returning 404 to user: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:53.937834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b7cd2178-adfa-44e4-a167-e53e6f945992 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 404 len: 111 microversion: 2.1 time: 0.036875 Jul 24 01:51:53.939143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3102/6101] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:51:53 2022] DELETE /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:51:53.944169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:53.944796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] [instance: 6285dba2-9791-4a1a-9f93-de7819c97c49] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:53.951254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.951724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.952516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:53.952963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:53.966666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:53.968458 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] HTTP exception thrown: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Request method failure captured: Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 HTTP/1.1 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KRp-W4HKQ1ikTFckhdUtZjddJ19zdWZRnJGZ8BtrjF0yjeN4UZXPdbW7WteqtIFPofyo2IxQl2DIMEmw4fy-XM84KfBzX7xGGG3esil9myf_3aXREg02_tsxcaW3rDVyFeSUq6AWm6KOt04HSlPVOhYl8aL4w-xQY5okbYovBDfsQA Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 101695253c6e40569d3cb5b391fccd61 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_101695253c6e40569d3cb5b391fccd61", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/101695253c6e40569d3cb5b391fccd61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 101695253c6e40569d3cb5b391fccd61 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestServerBasicOps-1058260334 Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestServerBasicOps-1058260334-project Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: c4b34bec387d42859f416aa3df7a7d0e Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestServerBasicOps-1058260334-project Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '6285dba2-9791-4a1a-9f93-de7819c97c49'} Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:53.970103 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Returning 404 to user: Instance 6285dba2-9791-4a1a-9f93-de7819c97c49 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68787c68-4090-455b-8257-a2ca9a7ec9b7 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49" status: 404 len: 111 microversion: 2.1 time: 0.031486 Jul 24 01:51:53.975175 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3103/6102] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:53 2022] GET /compute/v2.1/servers/6285dba2-9791-4a1a-9f93-de7819c97c49 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:53.976087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fedb6c6a-fa34-428a-b9af-400435ec3661 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.234821 Jul 24 01:51:53.977420 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3000/6103] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:53 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:54.155996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-12d2a473-6d3d-46b5-b834-9e74495cb430 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] Calling method '.version_select at 0x7f05eae70550>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:54.181527 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-12d2a473-6d3d-46b5-b834-9e74495cb430 tempest-TestServerBasicOps-1058260334 tempest-TestServerBasicOps-1058260334-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-929724029" status: 202 len: 0 microversion: 2.1 time: 0.029321 Jul 24 01:51:54.182482 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3104/6104] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-929724029 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:51:54.636271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:54.636855 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:54.644475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:54.645097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:54.646331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:54.646424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:54.662295 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 HTTP/1.1 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '45c9c739-6c27-4da6-8209-3a1bcaf0dfa8'} Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:54.664298 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:54.669478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:54.669478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:54.669478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:54.669478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:54.669478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:54.669478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:54.669478 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:54.671504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:54.672788 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63b11cfc-3321-406c-9837-67aa08aec712 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 404 len: 111 microversion: 2.1 time: 0.040601 Jul 24 01:51:54.673551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3001/6105] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:54 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:54.998743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:54.999260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:55.006900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:55.007478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:55.008266 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:55.008703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:55.210362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:55.218383 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e66c5b5c-3088-4511-b8b0-ccedfe135db0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.224814 Jul 24 01:51:55.218968 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3105/6106] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:54 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:56.237190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:56.238536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:56.246112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:56.246589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:56.247404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:56.247867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:56.825740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:56.848884 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-acded0c0-d1f4-4d86-84a1-6993ae46d9e8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.616244 Jul 24 01:51:56.859283 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3002/6107] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:56 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:57.869885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:57.871885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:57.886584 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:57.887703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:57.889631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:57.890270 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:58.169837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:58.181414 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8c7648f-60a0-4fbc-a417-e2a10ef15813 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.317137 Jul 24 01:51:58.186393 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3106/6108] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:57 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:58.964302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:58.965380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:58.973009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:58.973877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:58.974907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:58.975686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:58.991767 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 HTTP/1.1 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: exception: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'ad3318e2-633a-40db-956f-73de1cd07dd1'} Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:58.993737 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:58.998410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:58.999930 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5301ee49-a828-40c1-8f0d-9c82eea57dcb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 404 len: 111 microversion: 2.1 time: 0.039660 Jul 24 01:51:59.000963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3003/6109] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:51:58 2022] DELETE /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:59.009461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:59.010132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: ad3318e2-633a-40db-956f-73de1cd07dd1] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:59.018078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.018540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.020103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.020582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.034265 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 HTTP/1.1 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: exception: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'ad3318e2-633a-40db-956f-73de1cd07dd1'} Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:59.036729 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance ad3318e2-633a-40db-956f-73de1cd07dd1 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b47d15d7-17ce-4ef9-80ba-dbe9afeabaae tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1" status: 404 len: 111 microversion: 2.1 time: 0.032793 Jul 24 01:51:59.041205 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3107/6110] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:59 2022] GET /compute/v2.1/servers/ad3318e2-633a-40db-956f-73de1cd07dd1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:59.204461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:59.205367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:59.219417 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.220030 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.220981 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.226512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.446934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:51:59.460925 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ca1647c6-e214-4f27-b254-c401a86a94e6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.258085 Jul 24 01:51:59.462254 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3004/6111] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:59 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:51:59.569459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:59.570224 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:59.577202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.577822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.578695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.579132 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.594080 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 HTTP/1.1 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '45c9c739-6c27-4da6-8209-3a1bcaf0dfa8'} Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:59.596108 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.600497 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.602689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:59.603555 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c835c6b-6f5a-44d1-93a5-fff51fa7f624 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 404 len: 111 microversion: 2.1 time: 0.038210 Jul 24 01:51:59.604427 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3108/6112] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:51:59 2022] DELETE /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:59.612752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:51:59.613460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:51:59.619660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.620204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.621067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:51:59.621586 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:51:59.635095 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 HTTP/1.1 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '45c9c739-6c27-4da6-8209-3a1bcaf0dfa8'} Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:51:59.636744 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:51:59.641251 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b0a3cba9-4cfd-4e30-a339-9bac10dca8a1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8" status: 404 len: 111 microversion: 2.1 time: 0.029399 Jul 24 01:51:59.642542 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3005/6113] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:51:59 2022] GET /compute/v2.1/servers/45c9c739-6c27-4da6-8209-3a1bcaf0dfa8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:51:59.718753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aaeeb43f-fdd3-4441-8868-8963531ab3e1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: .version_select at 0x7f05eaafbd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1836836593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmiuyIcQUslDP8X6q67PR9MKkCh28eqk4YwjF16QQIBetwej8BO8eDl09D2jlvk5Ty7ytBW7N/AFOWeRo+iEZ6uTGxiYWRJ32OdqMakhx4v/WB3tg2Kj9HUhSQkdJxqow=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:51:59.733605 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-aaeeb43f-fdd3-4441-8868-8963531ab3e1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:51:59.739684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-aaeeb43f-fdd3-4441-8868-8963531ab3e1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:51:59.764055 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aaeeb43f-fdd3-4441-8868-8963531ab3e1 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049517 Jul 24 01:51:59.764665 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3109/6114] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:51:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:52:00.477762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:00.479085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:00.486503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:00.488084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:00.489234 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:00.489890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:00.833612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:00.845162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8614edfd-80da-434c-bafc-55dcce3f827e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.371188 Jul 24 01:52:00.846421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3006/6115] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:00 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:01.865218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:01.865975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:01.886941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:01.887463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:01.888452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:01.889057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:02.165188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:02.176158 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d41c6e3f-cd33-4925-8e92-45fda1bac5e0 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.316340 Jul 24 01:52:02.177633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3110/6116] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:01 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:03.195238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:03.196636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:03.206937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:03.207676 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:03.208532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:03.209056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:03.451238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:03.468170 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1ce33028-02c7-4bf5-9acc-cd473dd322cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1696 microversion: 2.1 time: 0.278345 Jul 24 01:52:03.477824 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3007/6117] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:03 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1696 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:04.446044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ff9000dd-47f5-4ded-a269-99a5dc4d26b3 req-501beaac-9b35-46b1-a86a-df1599fa5df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "name": "network-vif-unplugged", "status": "completed", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:04.462116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ff9000dd-47f5-4ded-a269-99a5dc4d26b3 req-501beaac-9b35-46b1-a86a-df1599fa5df8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:04.463071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ff9000dd-47f5-4ded-a269-99a5dc4d26b3 req-501beaac-9b35-46b1-a86a-df1599fa5df8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:04.486976 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ff9000dd-47f5-4ded-a269-99a5dc4d26b3 req-501beaac-9b35-46b1-a86a-df1599fa5df8 service nova] Creating event network-vif-unplugged:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h1-master-1 Jul 24 01:52:04.487497 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:04.488624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:04.500022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-ff9000dd-47f5-4ded-a269-99a5dc4d26b3 req-501beaac-9b35-46b1-a86a-df1599fa5df8 service nova] Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:52:04.509912 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:04.510563 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:04.511463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:04.511941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:04.519601 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ff9000dd-47f5-4ded-a269-99a5dc4d26b3 req-501beaac-9b35-46b1-a86a-df1599fa5df8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078478 Jul 24 01:52:04.520962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3111/6118] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:05.280675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:05.291183 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8cd2c804-ec44-4054-a526-a7aff0c4f23f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1695 microversion: 2.1 time: 0.807769 Jul 24 01:52:05.294455 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3008/6119] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:04 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1695 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:06.312731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:06.314262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:06.330937 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:06.332313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:06.333118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:06.333561 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:06.568484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-601aa8a9-b359-432b-809f-cf3e1d22c4f3 req-f359a180-7e13-4c5c-85b9-a32954b457b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:06.588619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-601aa8a9-b359-432b-809f-cf3e1d22c4f3 req-f359a180-7e13-4c5c-85b9-a32954b457b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:06.597631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-601aa8a9-b359-432b-809f-cf3e1d22c4f3 req-f359a180-7e13-4c5c-85b9-a32954b457b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:06.631112 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-601aa8a9-b359-432b-809f-cf3e1d22c4f3 req-f359a180-7e13-4c5c-85b9-a32954b457b8 service nova] Creating event network-changed:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h1-master-1 Jul 24 01:52:06.637514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-601aa8a9-b359-432b-809f-cf3e1d22c4f3 req-f359a180-7e13-4c5c-85b9-a32954b457b8 service nova] Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:52:06.644668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:06.658426 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b23d894-771e-4573-81f3-ac02bb125fe9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1695 microversion: 2.1 time: 0.353610 Jul 24 01:52:06.661025 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3112/6120] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:06 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1695 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:06.670686 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-601aa8a9-b359-432b-809f-cf3e1d22c4f3 req-f359a180-7e13-4c5c-85b9-a32954b457b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106582 Jul 24 01:52:06.671909 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3009/6121] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:07.678231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:07.688822 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:07.699212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:07.700012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:07.701261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:07.702137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:07.986570 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:07.999673 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32959709-7f6c-4d6e-8ebf-3bc1e1b2c2ba tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1693 microversion: 2.1 time: 0.327343 Jul 24 01:52:08.001074 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3113/6122] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:07 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1693 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:09.020885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:09.022761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:09.033108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:09.033902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:09.056120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:09.057505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:09.449615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:09.463124 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bc88061b-a4b1-4b69-8f27-fc9b0f3b61a6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1690 microversion: 2.1 time: 0.447220 Jul 24 01:52:09.469011 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3010/6123] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:09 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1690 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:09.481651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f373c35-dc09-4ea8-80c9-40acaf31b8ac tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:09.481651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f373c35-dc09-4ea8-80c9-40acaf31b8ac tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:09.499081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f373c35-dc09-4ea8-80c9-40acaf31b8ac tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:09.501336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f373c35-dc09-4ea8-80c9-40acaf31b8ac tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:09.502193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f373c35-dc09-4ea8-80c9-40acaf31b8ac tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:09.502640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f373c35-dc09-4ea8-80c9-40acaf31b8ac tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:09.635919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f373c35-dc09-4ea8-80c9-40acaf31b8ac tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action" status: 204 len: 0 microversion: 2.1 time: 0.159438 Jul 24 01:52:09.636966 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3114/6124] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:52:09 2022] POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 01:52:09.647021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:09.647984 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:09.658258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:09.659918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:09.661176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:09.661928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:10.058257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:10.071286 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-12b4858a-b2f6-48c9-9d73-72ebc5b9de20 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1690 microversion: 2.1 time: 0.430034 Jul 24 01:52:10.072219 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3011/6125] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:09 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1690 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:11.087533 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:11.096781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:11.098711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:11.116865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:11.117638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:11.118705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:11.119391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:11.697478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:11.714297 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9439d15f-b515-4a5d-b118-7c5a65826d64 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1690 microversion: 2.1 time: 0.627751 Jul 24 01:52:11.727730 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3115/6126] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:11 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1690 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:12.155685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-29bdea22-de09-4eaa-9d4c-c840da7c44db req-7ab22b43-ea0c-4650-88a5-c21d85cfe8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "name": "network-vif-plugged", "status": "completed", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:12.170121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-29bdea22-de09-4eaa-9d4c-c840da7c44db req-7ab22b43-ea0c-4650-88a5-c21d85cfe8c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:12.170590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-29bdea22-de09-4eaa-9d4c-c840da7c44db req-7ab22b43-ea0c-4650-88a5-c21d85cfe8c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:12.200158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-29bdea22-de09-4eaa-9d4c-c840da7c44db req-7ab22b43-ea0c-4650-88a5-c21d85cfe8c6 service nova] Creating event network-vif-plugged:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h1-master-1 Jul 24 01:52:12.206881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-29bdea22-de09-4eaa-9d4c-c840da7c44db req-7ab22b43-ea0c-4650-88a5-c21d85cfe8c6 service nova] Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:52:12.226928 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-29bdea22-de09-4eaa-9d4c-c840da7c44db req-7ab22b43-ea0c-4650-88a5-c21d85cfe8c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074847 Jul 24 01:52:12.227762 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3012/6127] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:12.732777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:12.733401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:12.748416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:12.750813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:12.751813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:12.752259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:12.810265 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:13.100212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:13.114875 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-609c445e-3297-45f0-9482-9d6c33a8a826 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1682 microversion: 2.1 time: 0.386142 Jul 24 01:52:13.115490 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3116/6128] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:12 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1682 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:15.135979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:15.137402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:15.145745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:15.146624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:15.147779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:15.148441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:15.273522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lazy-loading 'services' on Instance uuid 4144c144-b659-4c5d-b9ee-8ede12a743a9 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:52:15.381406 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ca5c0d75-26c5-4ffd-bab4-77a7b8f6e773 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9/os-volume_attachments/e7ae5657-67cf-4139-afb6-7226f59c7304" status: 202 len: 0 microversion: 2.1 time: 0.250365 Jul 24 01:52:15.385797 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3013/6129] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 01:52:15 2022] DELETE /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9/os-volume_attachments/e7ae5657-67cf-4139-afb6-7226f59c7304 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:52:21.970392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:21.970903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:21.974645 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:21.980261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:21.980716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:21.981506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:21.981984 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:22.023291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:52:22.101930 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9a44b26-250d-45e0-ae9d-75ad231f1654 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 204 len: 0 microversion: 2.1 time: 0.135231 Jul 24 01:52:22.102627 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3117/6130] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:52:21 2022] DELETE /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:52:22.111442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:22.112678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:22.116568 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=40 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:22.123107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:22.123639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:22.124442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:22.124894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:22.260177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:22.268039 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c420d79-3957-4f77-9ca4-4b6da7897ef9 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1513 microversion: 2.1 time: 0.161046 Jul 24 01:52:22.269763 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3014/6131] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:22 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:23.287488 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:23.288379 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:23.298174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:23.298729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:23.299978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:23.300441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:23.465527 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:23.474392 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-661db2d7-dfe2-40ec-a759-823888d1a716 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1513 microversion: 2.1 time: 0.193200 Jul 24 01:52:23.474993 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3118/6132] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:23 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:24.454293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b3e985f4-8858-4b3c-9ed3-86c953fb3210 req-dfe2ba58-3370-44f0-80ce-cfeebce0dc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4144c144-b659-4c5d-b9ee-8ede12a743a9", "name": "network-vif-deleted", "tag": "0dacc3cb-0bcc-49c5-96e7-9506d9cce53d"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:24.464558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3e985f4-8858-4b3c-9ed3-86c953fb3210 req-dfe2ba58-3370-44f0-80ce-cfeebce0dc1f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:24.465021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b3e985f4-8858-4b3c-9ed3-86c953fb3210 req-dfe2ba58-3370-44f0-80ce-cfeebce0dc1f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:24.468827 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:24.478115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b3e985f4-8858-4b3c-9ed3-86c953fb3210 req-dfe2ba58-3370-44f0-80ce-cfeebce0dc1f service nova] Creating event network-vif-deleted:0dacc3cb-0bcc-49c5-96e7-9506d9cce53d for instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 on n-h2-master-1 Jul 24 01:52:24.483467 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b3e985f4-8858-4b3c-9ed3-86c953fb3210 req-dfe2ba58-3370-44f0-80ce-cfeebce0dc1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032636 Jul 24 01:52:24.484321 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3015/6133] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:24.492169 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:24.492994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:24.500295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:24.500758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:24.501541 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:24.502016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:24.569084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6b9605c8f4c6a81352db2cefad8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6205931cc6a41f990d36b703e7b7467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:24.576887 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-93fd2f16-a12e-46c5-b3dd-a2c46abfe870 tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 200 len: 1303 microversion: 2.1 time: 0.088885 Jul 24 01:52:24.577466 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3119/6134] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:24 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:25.522818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-511432263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1836836593", "security_groups": [{"name": "tempest-secgroup-smoke-802663545"}], "block_device_mapping_v2": [{"uuid": "19cbea99-dcef-483d-8004-8a581052f486", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dc256e9-ed96-441b-9223-c863c318c2b9"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:25.595138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:25.595843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] [instance: 4144c144-b659-4c5d-b9ee-8ede12a743a9] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:25.604011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:25.604546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:25.605322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:25.605785 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:25.620121 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] HTTP exception thrown: Instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 could not be found. Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Request method failure captured: Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 HTTP/1.1 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KUOmsMoJJ9JKfvEIUbThF17sWeDWn6uebJKRGFj9VHnrmzn8y6OlrlBsQM7GB-88Invm_iaRU0cEUNJpR2lD9SdJsDVnIXfx-RywKu7jBX5cYfy7bX8wdrV8hgC84CGx43DsYGNmY3fSC-TpyY-t8oLP2pIXtfrxn9Lvod4k43mCNQ Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: e6205931cc6a41f990d36b703e7b7467 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-VolumesSnapshotTestJSON-773136060 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e6205931cc6a41f990d36b703e7b7467"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6205931cc6a41f990d36b703e7b7467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e6205931cc6a41f990d36b703e7b7467", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e6205931cc6a41f990d36b703e7b7467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-VolumesSnapshotTestJSON-773136060 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: e6205931cc6a41f990d36b703e7b7467 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-773136060 Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-VolumesSnapshotTestJSON-773136060-project Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: e9c6b9605c8f4c6a81352db2cefad8cd Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-VolumesSnapshotTestJSON-773136060-project Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 could not be found. Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '4144c144-b659-4c5d-b9ee-8ede12a743a9'} Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 could not be found. Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 could not be found. Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:52:25.621824 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 could not be found. Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] Returning 404 to user: Instance 4144c144-b659-4c5d-b9ee-8ede12a743a9 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bc6b7e2d-1c9f-47a0-81fa-53fe2627c87f tempest-VolumesSnapshotTestJSON-773136060 tempest-VolumesSnapshotTestJSON-773136060-project] 10.222.0.27 "GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9" status: 404 len: 111 microversion: 2.1 time: 0.032143 Jul 24 01:52:25.626721 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3120/6135] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:25 2022] GET /compute/v2.1/servers/4144c144-b659-4c5d-b9ee-8ede12a743a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 01:52:25.641437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] validate_networks() for [('3dc256e9-ed96-441b-9223-c863c318c2b9', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:52:26.144867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:52:26.145538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:52:26.146071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:52:26.146500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:52:26.146948 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:52:26.156003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:26.156469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:26.157291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:26.157771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:26.175902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:52:26.181201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:52:26.241240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:52:26.243506 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19cbea99-dcef-483d-8004-8a581052f486',volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:52:26.374243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-10e3c9bf-b816-48cf-ab20-60dfc9a0592b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.857418 Jul 24 01:52:26.374986 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3016/6136] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:52:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:52:26.385202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2dce37db-bc8e-424c-b44c-98fc846fe5ab tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:26.386118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2dce37db-bc8e-424c-b44c-98fc846fe5ab tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:26.462845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2dce37db-bc8e-424c-b44c-98fc846fe5ab tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:26.470206 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2dce37db-bc8e-424c-b44c-98fc846fe5ab tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1094 microversion: 2.1 time: 0.088864 Jul 24 01:52:26.481408 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3121/6137] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:26 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:27.490259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:27.491980 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:27.504093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:27.506070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:27.507659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:27.508589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:27.968212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:27.979638 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0afeeacb-772f-475a-9dff-d6062857ca0c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1210 microversion: 2.1 time: 0.494512 Jul 24 01:52:27.991470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3017/6138] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:27 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1210 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:29.000440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:29.001467 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:29.010307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:29.021538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:29.022792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:29.023802 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:29.291208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:29.301282 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3b713eb7-871e-46b7-9fa5-abe2f51ee29e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1277 microversion: 2.1 time: 0.306334 Jul 24 01:52:29.312211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3122/6139] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:28 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1277 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:29.389802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-12092b12-fd65-4dc2-950b-2e360528096a req-7e0a78d8-e533-413b-b7ff-310ffc2d358b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "395aa6a3-d471-4f3f-a112-a5236d6557b4", "tag": "2052f898-57ce-4a77-a2f1-ead0e7e9f01e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:29.409650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-12092b12-fd65-4dc2-950b-2e360528096a req-7e0a78d8-e533-413b-b7ff-310ffc2d358b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:29.411314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-12092b12-fd65-4dc2-950b-2e360528096a req-7e0a78d8-e533-413b-b7ff-310ffc2d358b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:29.425442 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-12092b12-fd65-4dc2-950b-2e360528096a req-7e0a78d8-e533-413b-b7ff-310ffc2d358b service nova] Creating event network-changed:2052f898-57ce-4a77-a2f1-ead0e7e9f01e for instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 on n-h1-master-1 Jul 24 01:52:29.434803 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-12092b12-fd65-4dc2-950b-2e360528096a req-7e0a78d8-e533-413b-b7ff-310ffc2d358b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048581 Jul 24 01:52:29.436700 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3018/6140] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:30.321271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:30.322529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:30.335281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:30.335997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:30.337404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:30.338061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:30.561201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:30.570506 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cff3ae50-12d8-43cd-b3c6-43e15b9ee6ef tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1277 microversion: 2.1 time: 0.255549 Jul 24 01:52:30.571485 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3123/6141] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:30 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:31.589543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:31.590331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:31.597966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:31.598445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:31.599269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:31.599722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:31.801485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:31.809437 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-145dd6bc-f1b1-4b96-9f2d-d4d513206be4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1277 microversion: 2.1 time: 0.224863 Jul 24 01:52:31.810572 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3019/6142] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:31 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:32.825993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:32.827469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:32.835973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:32.836537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:32.838556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:32.839062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:32.988038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:32.996095 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7703b6f3-3e90-4739-a80a-c47af5d5e172 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.174195 Jul 24 01:52:33.001773 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3124/6143] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:32 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:33.326662 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eb8dfaec-c1d6-4ddf-b21d-c705d04bbbcd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:33.327605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eb8dfaec-c1d6-4ddf-b21d-c705d04bbbcd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:33.335548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8dfaec-c1d6-4ddf-b21d-c705d04bbbcd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:33.336016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8dfaec-c1d6-4ddf-b21d-c705d04bbbcd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:33.336816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8dfaec-c1d6-4ddf-b21d-c705d04bbbcd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:33.337520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb8dfaec-c1d6-4ddf-b21d-c705d04bbbcd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:33.393559 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eb8dfaec-c1d6-4ddf-b21d-c705d04bbbcd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action" status: 200 len: 24574 microversion: 2.1 time: 0.070189 Jul 24 01:52:33.400139 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3020/6144] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:52:33 2022] POST /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d/action => generated 24574 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:52:34.013386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:34.014084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:34.021277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:34.021878 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:34.022723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:34.023239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:34.163025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:34.170825 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f3430123-35b5-4812-8637-689e1840df5e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.161247 Jul 24 01:52:34.171398 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3125/6145] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:34 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:35.189202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:35.190385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:35.197199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:35.197916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:35.198461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:35.198902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:35.336136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:35.344316 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7629ef73-5bee-4492-a886-f46510ba9a8b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.159816 Jul 24 01:52:35.344990 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3021/6146] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:35 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:36.362608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:36.363223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:36.370759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:36.371216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:36.371992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:36.372545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:36.466737 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:36.518927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:36.528268 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b29ed06-0a7c-4865-9f5c-e35115370c37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.170185 Jul 24 01:52:36.535061 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3126/6147] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:36 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:37.545334 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:37.545986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:37.548398 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:37.549074 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:37.555925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:37.556391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:37.557173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:37.557622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:37.691265 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:37.698845 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50914ff9-c8be-4dc3-a5dd-8efaf6decbbe tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.157457 Jul 24 01:52:37.699417 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3022/6148] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:37 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:38.715943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:38.716559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:38.724191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:38.724642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:38.725412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:38.725992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:38.868353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:38.876160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a3da0636-0949-4bde-a84c-fc4f6383b15b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.164087 Jul 24 01:52:38.876746 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3127/6149] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:38 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:39.592679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4dca56e0-b5d1-48cf-9394-6fa2a4483fae tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:39.593311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4dca56e0-b5d1-48cf-9394-6fa2a4483fae tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:39.601345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dca56e0-b5d1-48cf-9394-6fa2a4483fae tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:39.601849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dca56e0-b5d1-48cf-9394-6fa2a4483fae tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:39.602646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dca56e0-b5d1-48cf-9394-6fa2a4483fae tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:39.603100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dca56e0-b5d1-48cf-9394-6fa2a4483fae tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:39.741381 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4dca56e0-b5d1-48cf-9394-6fa2a4483fae tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1833 microversion: 2.1 time: 0.152440 Jul 24 01:52:39.741990 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3023/6150] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:39 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1833 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:39.892835 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:39.894980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:39.902176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:39.902640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:39.903563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:39.904012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:40.140411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:40.149138 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2adc488-1f7f-4665-bb44-45f1f26ac392 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.260536 Jul 24 01:52:40.150171 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3128/6151] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:39 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:40.748330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ac094f6c-1ba5-4d7e-b525-5030a9b23ec7 req-0c724c69-9f34-4632-8212-9408b678c8ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:40.753582 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:40.754760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:40.767692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ac094f6c-1ba5-4d7e-b525-5030a9b23ec7 req-0c724c69-9f34-4632-8212-9408b678c8ec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:40.768462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ac094f6c-1ba5-4d7e-b525-5030a9b23ec7 req-0c724c69-9f34-4632-8212-9408b678c8ec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:40.773753 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:40.774579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:40.775620 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:40.776249 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:40.798323 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ac094f6c-1ba5-4d7e-b525-5030a9b23ec7 req-0c724c69-9f34-4632-8212-9408b678c8ec service nova] Creating event network-changed:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h1-master-1 Jul 24 01:52:40.811219 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ac094f6c-1ba5-4d7e-b525-5030a9b23ec7 req-0c724c69-9f34-4632-8212-9408b678c8ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066550 Jul 24 01:52:40.811855 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3129/6152] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:52:40.820150 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:52:40.942261 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d724388e-0b86-4b2d-a3b4-c5242560abc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 204 len: 0 microversion: 2.1 time: 0.201982 Jul 24 01:52:40.943526 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3024/6153] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:52:40 2022] DELETE /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:52:40.956942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:40.958970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:40.967477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:40.968167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:40.969231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:40.970471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:41.167009 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:41.167677 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:41.167880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:41.178449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:41.179289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:41.180251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:41.180865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:41.181027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a41837d-fdfd-48f7-ac65-93e5c5c7e277 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1688 microversion: 2.1 time: 0.231722 Jul 24 01:52:41.181640 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3130/6154] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:40 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:41.341943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:41.353786 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a6a983fe-7c27-44ab-8724-0170cfc6b0c0 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.191185 Jul 24 01:52:41.364300 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3025/6155] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:41 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:42.198858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:42.199476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:42.206782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:42.207242 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:42.208026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:42.208469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:42.378765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:42.379597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:42.387930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:42.390383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:42.391515 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:42.392203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:42.419054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:42.428979 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3314feec-1305-435b-81d9-dc88eb191b6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 200 len: 1688 microversion: 2.1 time: 0.234024 Jul 24 01:52:42.432536 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3131/6156] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:42 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:42.560441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:42.572340 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7dbb8cbb-f334-4f6c-8aa6-a780ceffc7ad tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.203446 Jul 24 01:52:42.573040 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3026/6157] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:42 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:42.863450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-235ffdba-df6f-4d23-a49b-16a15ebd9881 req-474a8786-fd70-4548-8e91-0fea4b4bd19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d", "name": "network-vif-deleted", "tag": "cfed2c57-b1a1-4899-a81e-b84c296a37f5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:42.871755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-235ffdba-df6f-4d23-a49b-16a15ebd9881 req-474a8786-fd70-4548-8e91-0fea4b4bd19d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:42.872277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-235ffdba-df6f-4d23-a49b-16a15ebd9881 req-474a8786-fd70-4548-8e91-0fea4b4bd19d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:42.876150 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:42.886278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-235ffdba-df6f-4d23-a49b-16a15ebd9881 req-474a8786-fd70-4548-8e91-0fea4b4bd19d service nova] Creating event network-vif-deleted:cfed2c57-b1a1-4899-a81e-b84c296a37f5 for instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d on n-h1-master-1 Jul 24 01:52:42.891698 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-235ffdba-df6f-4d23-a49b-16a15ebd9881 req-474a8786-fd70-4548-8e91-0fea4b4bd19d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182666 Jul 24 01:52:42.892383 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3132/6158] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:43.450408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:43.451220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:43.458947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:43.459436 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:43.460291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:43.460743 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:43.475997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] HTTP exception thrown: Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d could not be found. Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Request method failure captured: Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d HTTP/1.1 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KVUePV44iEzznN_AGm013tPuzitSEnuYqI7R151g-3fwxMLCTiSFAVRkP7_-f2ay4n0r0fCsR957CugnZtLMvDRJDgNqtGfSW-Y6Q7Rgw9mEQbfPe3R1OEc5NObS2fbnG_-FddrCi9sYi9IKWJwdOU3kZyJNWhmkbNudX8vy9YW2Gw Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9cd3d18dd66e4321b11cf7b5fe9a3400", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: ecbfd92ba65f40758afcaf692c8aa33d Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: exception: Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d could not be found. Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d'} Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d could not be found. Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d could not be found. Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:52:43.477761 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d could not be found. Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Returning 404 to user: Instance fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c310c90-7baf-4b75-b29b-6a4cf3419821 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d" status: 404 len: 111 microversion: 2.1 time: 0.033078 Jul 24 01:52:43.483442 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3027/6159] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:43 2022] GET /compute/v2.1/servers/fc8877d9-4f6a-43ad-a071-5ffcb3e31c2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:52:43.592110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:43.593542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:43.602010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:43.602576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:43.603520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:43.604071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:44.083009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:44.091015 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a65378dd-d09a-4434-b881-92502797c00f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.505948 Jul 24 01:52:44.092951 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3133/6160] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:43 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:44.218594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b86445db-92b3-4007-8fd6-f56d0dc6772d req-74e45836-2ae7-425b-b599-4e3c3fae4436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395aa6a3-d471-4f3f-a112-a5236d6557b4", "name": "network-vif-plugged", "status": "completed", "tag": "2052f898-57ce-4a77-a2f1-ead0e7e9f01e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:44.230395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b86445db-92b3-4007-8fd6-f56d0dc6772d req-74e45836-2ae7-425b-b599-4e3c3fae4436 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:44.231289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b86445db-92b3-4007-8fd6-f56d0dc6772d req-74e45836-2ae7-425b-b599-4e3c3fae4436 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:44.297366 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b86445db-92b3-4007-8fd6-f56d0dc6772d req-74e45836-2ae7-425b-b599-4e3c3fae4436 service nova] Creating event network-vif-plugged:2052f898-57ce-4a77-a2f1-ead0e7e9f01e for instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 on n-h1-master-1 Jul 24 01:52:44.306512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b86445db-92b3-4007-8fd6-f56d0dc6772d req-74e45836-2ae7-425b-b599-4e3c3fae4436 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091546 Jul 24 01:52:44.307730 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3028/6161] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:45.109602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:45.110419 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:45.119674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:45.120488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:45.121527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:45.122213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:45.371108 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:45.383489 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-28a9fccf-2f01-4860-b4c0-2717b9c9ceba tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1265 microversion: 2.1 time: 0.278798 Jul 24 01:52:45.393708 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3134/6162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:45 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:52:46.400949 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:46.401698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:46.417576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:46.418142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:46.419571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:46.420072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:46.702564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:46.718538 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c440e8e2-2ae9-47e1-a703-83a26e84d6b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1453 microversion: 2.1 time: 0.322629 Jul 24 01:52:46.719131 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3029/6163] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:46 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1453 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:46.735396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:46.736016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:46.744478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:46.745397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:46.746390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:46.746999 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:47.139401 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:47.149742 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fbfa8db1-b16d-418f-9c6b-408fae8391a3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1453 microversion: 2.1 time: 0.418411 Jul 24 01:52:47.150704 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3135/6164] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:46 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1453 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:47.751195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d3142eb1-af6d-4a72-9ddc-37849f1a6659 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '.version_select at 0x7f05ea203040>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:47.805144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d3142eb1-af6d-4a72-9ddc-37849f1a6659 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-895198930" status: 202 len: 0 microversion: 2.1 time: 0.062296 Jul 24 01:52:47.808426 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3030/6165] 10.222.0.27 () {58 vars in 1280 bytes} [Sun Jul 24 01:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-895198930 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:52:47.837909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-277f23ef-6f1a-4e66-af0e-b5a75fde5046 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: .version_select at 0x7f05eab5d3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-662081216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQeXaQu4zlTaxns7HStr6BpxSaV4Jx85fcutGAs9VHq/QqR5cvmU85AIyrsZ+4oMhzS0G6sHUFgmhGVmtbz3gC7gbLaM6NpN1Hkkxtjl3UYjVwzecwvviTV6YKnN74qXg=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:47.857794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-277f23ef-6f1a-4e66-af0e-b5a75fde5046 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:52:47.869719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-277f23ef-6f1a-4e66-af0e-b5a75fde5046 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:52:47.902513 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-277f23ef-6f1a-4e66-af0e-b5a75fde5046 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.069838 Jul 24 01:52:47.903139 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3136/6166] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:52:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:49.801146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c13a06b4-8752-4be5-9291-6def3ff89b73 req-534cae44-a63d-4a5b-b188-cf522d102fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "395aa6a3-d471-4f3f-a112-a5236d6557b4", "tag": "2052f898-57ce-4a77-a2f1-ead0e7e9f01e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:49.811327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c13a06b4-8752-4be5-9291-6def3ff89b73 req-534cae44-a63d-4a5b-b188-cf522d102fbf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:49.812054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c13a06b4-8752-4be5-9291-6def3ff89b73 req-534cae44-a63d-4a5b-b188-cf522d102fbf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:49.824004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c13a06b4-8752-4be5-9291-6def3ff89b73 req-534cae44-a63d-4a5b-b188-cf522d102fbf service nova] Creating event network-changed:2052f898-57ce-4a77-a2f1-ead0e7e9f01e for instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 on n-h1-master-1 Jul 24 01:52:49.838518 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c13a06b4-8752-4be5-9291-6def3ff89b73 req-534cae44-a63d-4a5b-b188-cf522d102fbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037406 Jul 24 01:52:49.844149 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3031/6167] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:52:55.595939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2078857245", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "9a78cc69-1b78-423c-aca9-abf29a8bd08a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-662081216", "security_groups": [{"name": "tempest-secgroup-smoke-1777118550"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:52:55.609570 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:55.755096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] validate_networks() for [('9a78cc69-1b78-423c-aca9-abf29a8bd08a', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:52:56.308397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:52:56.309386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:52:56.310374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:52:56.311178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:52:56.311967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:52:56.324686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:56.325516 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:56.327229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:56.328016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:56.353558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:52:56.360636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:52:56.376434 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:52:56.379968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:52:56.432304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-13fd4b74-2d7b-4a67-90b4-a5426529e44d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841682 Jul 24 01:52:56.433194 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3137/6168] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:52:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:52:56.445730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-87f6dbad-3d94-43b7-b92b-2111aef47d1f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:56.446856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-87f6dbad-3d94-43b7-b92b-2111aef47d1f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:56.448626 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:56.533525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-87f6dbad-3d94-43b7-b92b-2111aef47d1f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:56.542966 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-87f6dbad-3d94-43b7-b92b-2111aef47d1f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1266 microversion: 2.1 time: 0.103208 Jul 24 01:52:56.554953 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3032/6169] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:56 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:57.561331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:57.562610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:57.575138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:57.575785 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:57.576790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:57.577595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:57.759232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:57.767902 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be4624e8-808e-4019-ae07-8e587733c1b7 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1326 microversion: 2.1 time: 0.211251 Jul 24 01:52:57.785459 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3138/6170] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:57 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1326 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:52:58.789301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:52:58.790049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:52:58.810749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:58.811539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:58.812347 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:52:58.812808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:52:58.816040 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:59.602684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:52:59.611988 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-65b1cf57-48fb-42f2-9d61-5b0ab04d5a38 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1392 microversion: 2.1 time: 0.828937 Jul 24 01:52:59.612765 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3033/6171] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:52:58 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1392 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:00.037086 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-227e3476-f782-4858-86b5-5f31601d287d req-a3931ec1-d85f-4326-a5e0-1f6eae16345f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:53:00.065862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-227e3476-f782-4858-86b5-5f31601d287d req-a3931ec1-d85f-4326-a5e0-1f6eae16345f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:00.068804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-227e3476-f782-4858-86b5-5f31601d287d req-a3931ec1-d85f-4326-a5e0-1f6eae16345f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:00.083940 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-227e3476-f782-4858-86b5-5f31601d287d req-a3931ec1-d85f-4326-a5e0-1f6eae16345f service nova] Creating event network-changed:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:53:00.089630 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-227e3476-f782-4858-86b5-5f31601d287d req-a3931ec1-d85f-4326-a5e0-1f6eae16345f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072431 Jul 24 01:53:00.090445 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3139/6172] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:53:00.630081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:00.630622 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:00.637899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:00.638374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:00.639197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:00.639889 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:00.804346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:00.814059 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8c4bb30e-da0c-4f6a-b6a7-98751f01576f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1392 microversion: 2.1 time: 0.188536 Jul 24 01:53:00.815959 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3034/6173] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:00 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:01.833042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:01.833799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:01.842645 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:01.843108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:01.843887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:01.844350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:01.987357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:01.995758 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7badef0a-60a3-4e68-8d86-5cf30e03c28a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1392 microversion: 2.1 time: 0.168163 Jul 24 01:53:01.996368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3140/6174] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:01 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:03.012724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:03.013646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:03.026209 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:03.026692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:03.029428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:03.032165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:03.209341 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:03.217629 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4070973c-0016-4e89-97bb-bbb4014f7369 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1392 microversion: 2.1 time: 0.208873 Jul 24 01:53:03.218873 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3035/6175] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:03 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:04.236711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:04.237343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:04.244480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:04.244883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:04.245713 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:04.246165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:04.405185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:04.412892 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5845335d-db11-4492-985c-efe0bf63a163 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1392 microversion: 2.1 time: 0.180652 Jul 24 01:53:04.413482 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3141/6176] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:04 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:05.430501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:05.431263 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:05.438564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:05.439073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:05.440508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:05.440965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:05.586877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:05.594863 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ec6180a9-368b-42a6-9875-e6bfb90702a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1392 microversion: 2.1 time: 0.168380 Jul 24 01:53:05.595487 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3036/6177] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:05 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:05.771671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9962f2ab-9e70-43a9-9d19-b104e4c2fca9 req-9b181379-21c6-41b3-a545-bae353e58b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "name": "network-vif-plugged", "status": "completed", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:53:05.782417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9962f2ab-9e70-43a9-9d19-b104e4c2fca9 req-9b181379-21c6-41b3-a545-bae353e58b18 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:05.783711 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9962f2ab-9e70-43a9-9d19-b104e4c2fca9 req-9b181379-21c6-41b3-a545-bae353e58b18 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:05.806153 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9962f2ab-9e70-43a9-9d19-b104e4c2fca9 req-9b181379-21c6-41b3-a545-bae353e58b18 service nova] Creating event network-vif-plugged:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:53:05.812621 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9962f2ab-9e70-43a9-9d19-b104e4c2fca9 req-9b181379-21c6-41b3-a545-bae353e58b18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046140 Jul 24 01:53:05.813416 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3142/6178] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:53:06.613161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:06.613832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:06.616533 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:06.622476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:06.622940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:06.623734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:06.624186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:06.778084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:06.788613 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02511778-cb20-4e2d-ad18-3391e9d30eb1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1392 microversion: 2.1 time: 0.180275 Jul 24 01:53:06.789208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3037/6179] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:06 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:07.809294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:07.810193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:07.812711 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:07.813650 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=10 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:07.823718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:07.824549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:07.825519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:07.826066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:07.985067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:07.995298 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-948b22b1-e41c-4338-ae43-c525a5deae7f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1564 microversion: 2.1 time: 0.191246 Jul 24 01:53:07.996223 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3143/6180] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:07 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:08.013633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:08.014280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:08.023660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:08.024472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:08.025273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:08.025766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:08.183162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:08.194003 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8f8790b0-578c-469c-a1de-e071cd6faf1a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1564 microversion: 2.1 time: 0.185069 Jul 24 01:53:08.194657 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3038/6181] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:08 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:10.231767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:53:10.232392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:10.237288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2a2550c2-7734-493b-bb6b-e396dd295bf1 req-7ca3a7eb-b6d8-4e49-b3cc-264b1d3b11a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:53:10.242200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:10.242904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:10.244159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:10.244833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:10.248661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2a2550c2-7734-493b-bb6b-e396dd295bf1 req-7ca3a7eb-b6d8-4e49-b3cc-264b1d3b11a9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:10.249302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2a2550c2-7734-493b-bb6b-e396dd295bf1 req-7ca3a7eb-b6d8-4e49-b3cc-264b1d3b11a9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:10.263562 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2a2550c2-7734-493b-bb6b-e396dd295bf1 req-7ca3a7eb-b6d8-4e49-b3cc-264b1d3b11a9 service nova] Creating event network-changed:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:53:10.269429 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2a2550c2-7734-493b-bb6b-e396dd295bf1 req-7ca3a7eb-b6d8-4e49-b3cc-264b1d3b11a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038780 Jul 24 01:53:10.270800 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3039/6182] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:53:10.530424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:53:10.545348 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-17702326-cd23-4897-8ed1-b94c6a437954 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1564 microversion: 2.1 time: 0.316481 Jul 24 01:53:10.546516 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3144/6183] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:53:10 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1564 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:53:41.860746 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=17 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:41.861575 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=37 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:41.866303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-37d58b76-235f-42c0-a03f-01597a0261d2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:53:41.867347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-37d58b76-235f-42c0-a03f-01597a0261d2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:53:41.874668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d58b76-235f-42c0-a03f-01597a0261d2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:41.875143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d58b76-235f-42c0-a03f-01597a0261d2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:41.875939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d58b76-235f-42c0-a03f-01597a0261d2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:53:41.876405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-37d58b76-235f-42c0-a03f-01597a0261d2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:53:41.947611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-37d58b76-235f-42c0-a03f-01597a0261d2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action" status: 200 len: 24571 microversion: 2.1 time: 0.088954 Jul 24 01:53:41.949711 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3040/6184] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:53:41 2022] POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:54:12.155420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-91d45615-bbf2-4161-ac85-f1823b78ee39 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:12.156076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-91d45615-bbf2-4161-ac85-f1823b78ee39 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:12.158548 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:12.159263 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=55 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:12.167412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91d45615-bbf2-4161-ac85-f1823b78ee39 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:12.167873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91d45615-bbf2-4161-ac85-f1823b78ee39 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:12.168695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91d45615-bbf2-4161-ac85-f1823b78ee39 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:12.169144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91d45615-bbf2-4161-ac85-f1823b78ee39 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:12.516834 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-91d45615-bbf2-4161-ac85-f1823b78ee39 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1833 microversion: 2.1 time: 0.365778 Jul 24 01:54:12.517428 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3145/6185] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:12 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1833 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:12.534178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:12.535525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:12.538521 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:12.539290 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:12.545483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:12.545979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:12.546768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:12.547220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:12.748546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:12.756731 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-800815ca-e6f1-4111-a0d1-f20d716f15e5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1682 microversion: 2.1 time: 0.226945 Jul 24 01:54:12.757301 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3041/6186] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:12 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:12.844291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-35a18ed0-4e52-4f5a-8455-9644743765df tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:12.845218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-35a18ed0-4e52-4f5a-8455-9644743765df tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:12.851860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35a18ed0-4e52-4f5a-8455-9644743765df tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:12.852313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35a18ed0-4e52-4f5a-8455-9644743765df tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:12.853074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35a18ed0-4e52-4f5a-8455-9644743765df tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:12.853512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35a18ed0-4e52-4f5a-8455-9644743765df tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:12.915600 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-35a18ed0-4e52-4f5a-8455-9644743765df tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action" status: 200 len: 32644 microversion: 2.1 time: 0.075126 Jul 24 01:54:12.916280 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3146/6187] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:54:12 2022] POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action => generated 32644 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:54:13.048585 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:13.049178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:13.056781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:13.057251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:13.058076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:13.058584 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:13.149122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a16eebe673c4b27a4468aea1a4db43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc08658a31624318825a55992df8ff12', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:13.149773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] flavor_id is None. Assuming migration. {{(pid=119562) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 24 01:54:13.150222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119562) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 01:54:13.479092 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-739add95-a524-486a-b677-7023fa08f214 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action" status: 202 len: 0 microversion: 2.1 time: 0.434134 Jul 24 01:54:13.479926 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3042/6188] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:54:13 2022] POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:54:13.489140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:13.490006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:13.497542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:13.498032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:13.499188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:13.499328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:13.678539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:13.686369 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71889cad-7d8b-40a3-b22d-5647136f1984 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1691 microversion: 2.1 time: 0.202228 Jul 24 01:54:13.686934 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3147/6189] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:13 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:14.705390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:14.706247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:14.712866 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:14.713334 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:14.714159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:14.714616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:14.885097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:14.892771 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-25320668-541d-4d90-98d8-2b39e3792f4b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1691 microversion: 2.1 time: 0.192597 Jul 24 01:54:14.893356 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3043/6190] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:14 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:15.909292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:15.909933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:15.917096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:15.917550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:15.918359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:15.918805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:16.048417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:16.056499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e1443784-d0d3-4862-99f1-97fbcfe4c8ad tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.151293 Jul 24 01:54:16.057061 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3148/6191] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:15 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:17.073303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:17.073967 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:17.080782 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:17.081241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:17.082879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:17.083420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:17.221332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:17.229004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5da21e77-0b8d-4711-837b-9a98a0df0197 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.159634 Jul 24 01:54:17.229567 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3044/6192] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:17 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:18.246581 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:18.247195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:18.254176 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:18.254626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:18.255393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:18.255833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:18.387778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:18.395831 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-018a60b6-14a1-41e3-b807-f46e5a116a6a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.153280 Jul 24 01:54:18.396396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3149/6193] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:18 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:19.413026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:19.413602 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:19.420410 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:19.420868 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:19.421642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:19.422111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:19.552477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:19.560191 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e91fd9e-b758-45f7-874e-c02d9611dbff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.151195 Jul 24 01:54:19.560768 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3045/6194] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:19 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:20.578637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:20.579263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:20.587282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:20.587744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:20.588527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:20.588970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:20.736470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:20.744309 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36f234fe-bb74-46cb-8696-5bc4c2ff7415 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.169610 Jul 24 01:54:20.744886 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3150/6195] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:20 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:21.762324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:21.762979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:21.770019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:21.770496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:21.771378 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:21.771839 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:21.903371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:21.911504 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59d222a0-b0f6-4d67-b6d3-b0889aa1c9d9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.152496 Jul 24 01:54:21.912134 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3046/6196] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:21 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:22.930188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:22.930902 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:22.938930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:22.939443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:22.940280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:22.940750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:23.091460 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:23.099606 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-957b3a4d-60ec-4660-b82f-cb176c87ac3c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.174719 Jul 24 01:54:23.100176 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3151/6197] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:22 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:24.118814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:24.119367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:24.127999 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:24.128568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:24.129488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:24.130611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:24.282606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:24.291312 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e19d8465-3b14-44bb-ac37-90f59d7f549d tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.178345 Jul 24 01:54:24.291875 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3047/6198] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:24 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:54:25.310749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:25.311366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:25.318864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:25.319322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:25.320100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:25.320544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:25.459436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:25.467177 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b32ad219-2fc2-4c4f-8c65-53106f200c29 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.160416 Jul 24 01:54:25.467779 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3152/6199] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:25 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:26.485330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:26.485904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:26.493267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:26.493773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:26.494541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:26.494989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:26.627969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:26.636123 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4a04a630-be6e-437e-ade8-ad2826b9af24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1696 microversion: 2.1 time: 0.154992 Jul 24 01:54:26.636873 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3048/6200] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:26 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:27.652432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:27.653090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:27.660487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:27.661099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:27.661914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:27.662362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:27.800818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:27.808676 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33fe32a9-e130-4e0b-838b-01c911cd217e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1695 microversion: 2.1 time: 0.160210 Jul 24 01:54:27.809260 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3153/6201] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:27 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:27.852193 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-39ffd6b8-73cc-4025-b4fb-4a8b86c9822f req-562db6e4-5d14-4141-a657-50ca014ed6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "name": "network-vif-unplugged", "status": "completed", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:27.861991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-39ffd6b8-73cc-4025-b4fb-4a8b86c9822f req-562db6e4-5d14-4141-a657-50ca014ed6fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:27.862519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-39ffd6b8-73cc-4025-b4fb-4a8b86c9822f req-562db6e4-5d14-4141-a657-50ca014ed6fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:27.875324 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-39ffd6b8-73cc-4025-b4fb-4a8b86c9822f req-562db6e4-5d14-4141-a657-50ca014ed6fc service nova] Creating event network-vif-unplugged:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h1-master-1 Jul 24 01:54:27.881396 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-39ffd6b8-73cc-4025-b4fb-4a8b86c9822f req-562db6e4-5d14-4141-a657-50ca014ed6fc service nova] Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:54:27.892393 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-39ffd6b8-73cc-4025-b4fb-4a8b86c9822f req-562db6e4-5d14-4141-a657-50ca014ed6fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044152 Jul 24 01:54:27.893217 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3049/6202] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:54:28.827204 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:28.827948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:28.835173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:28.835615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:28.836388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:28.836834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:28.975626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:28.983221 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0bbfe2de-95a0-4d1c-a716-5c272f861d4f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1695 microversion: 2.1 time: 0.160087 Jul 24 01:54:28.983798 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3154/6203] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:28 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:29.910830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-dfb44921-9bf9-4481-9a9a-2a226db689f0 req-8ff77318-6f48-4835-86a8-5877c7c35291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:29.919268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dfb44921-9bf9-4481-9a9a-2a226db689f0 req-8ff77318-6f48-4835-86a8-5877c7c35291 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:29.919729 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-dfb44921-9bf9-4481-9a9a-2a226db689f0 req-8ff77318-6f48-4835-86a8-5877c7c35291 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:29.931050 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-dfb44921-9bf9-4481-9a9a-2a226db689f0 req-8ff77318-6f48-4835-86a8-5877c7c35291 service nova] Creating event network-changed:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h1-master-1 Jul 24 01:54:29.936288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-dfb44921-9bf9-4481-9a9a-2a226db689f0 req-8ff77318-6f48-4835-86a8-5877c7c35291 service nova] Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:54:29.946998 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-dfb44921-9bf9-4481-9a9a-2a226db689f0 req-8ff77318-6f48-4835-86a8-5877c7c35291 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041086 Jul 24 01:54:29.947580 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3050/6204] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:54:30.000533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:30.001264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:30.008754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:30.009298 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:30.010190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:30.010641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:30.223790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:30.232711 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-727e9204-dcf7-4a02-a3df-31bc56e45722 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1693 microversion: 2.1 time: 0.236242 Jul 24 01:54:30.233487 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3155/6205] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:29 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:31.252785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:31.253520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:31.260416 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:31.260876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:31.261646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:31.262117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:31.402020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:31.409456 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-03e01753-9bf5-4b65-85b4-f0bb4086241b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1690 microversion: 2.1 time: 0.161626 Jul 24 01:54:31.410066 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3051/6206] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:31 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:31.425554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-626b8f59-2f1d-4475-a324-91e160e3808c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:31.426137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-626b8f59-2f1d-4475-a324-91e160e3808c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:31.433689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-626b8f59-2f1d-4475-a324-91e160e3808c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:31.434166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-626b8f59-2f1d-4475-a324-91e160e3808c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:31.434938 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-626b8f59-2f1d-4475-a324-91e160e3808c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:31.435381 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-626b8f59-2f1d-4475-a324-91e160e3808c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:31.545683 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-626b8f59-2f1d-4475-a324-91e160e3808c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action" status: 202 len: 0 microversion: 2.1 time: 0.123837 Jul 24 01:54:31.546325 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3156/6207] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:54:31 2022] POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:54:31.554625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:31.555248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:31.561762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:31.562383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:31.563388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:31.563878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:31.702475 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:31.711055 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-503a1a33-765b-4b5a-9f68-057e3b486245 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1689 microversion: 2.1 time: 0.160396 Jul 24 01:54:31.711631 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3052/6208] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:31 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:32.730976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:32.731692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:32.738335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:32.738834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:32.739608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:32.740052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:32.881883 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:32.889467 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24a22b4a-1d25-4c06-b7ca-27a9692f6880 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1689 microversion: 2.1 time: 0.163812 Jul 24 01:54:32.890072 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3157/6209] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:32 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:33.907411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:33.908045 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:33.916118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:33.916590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:33.917657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:33.918279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:34.049459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:34.057066 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75d5279e-8b31-4143-b737-581212c49cc6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1689 microversion: 2.1 time: 0.153590 Jul 24 01:54:34.057653 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3053/6210] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:33 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:34.526821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d94c9dc9-8a3b-4d51-b33d-ab3d8808b373 req-593850f1-c91f-4291-9214-b9d9b062c7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "name": "network-vif-plugged", "status": "completed", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:34.546965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d94c9dc9-8a3b-4d51-b33d-ab3d8808b373 req-593850f1-c91f-4291-9214-b9d9b062c7db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:34.547410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d94c9dc9-8a3b-4d51-b33d-ab3d8808b373 req-593850f1-c91f-4291-9214-b9d9b062c7db service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:34.560576 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d94c9dc9-8a3b-4d51-b33d-ab3d8808b373 req-593850f1-c91f-4291-9214-b9d9b062c7db service nova] Creating event network-vif-plugged:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:54:34.566263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-d94c9dc9-8a3b-4d51-b33d-ab3d8808b373 req-593850f1-c91f-4291-9214-b9d9b062c7db service nova] Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:54:34.578052 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d94c9dc9-8a3b-4d51-b33d-ab3d8808b373 req-593850f1-c91f-4291-9214-b9d9b062c7db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054911 Jul 24 01:54:34.578757 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3158/6211] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:54:35.074867 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:35.075526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:35.082193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:35.083464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:35.084219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:35.084676 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:35.296307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:35.303976 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72e44434-a557-4bd7-96b4-5ce6caa80080 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1689 microversion: 2.1 time: 0.233043 Jul 24 01:54:35.304551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3054/6212] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:35 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:35.392632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d183a57f-cc5f-48e2-84bd-7080d000ba21 req-bafcc3df-2a58-488b-bb2d-5817070aab15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "name": "network-vif-unplugged", "status": "completed", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:35.401215 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d183a57f-cc5f-48e2-84bd-7080d000ba21 req-bafcc3df-2a58-488b-bb2d-5817070aab15 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:35.401689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d183a57f-cc5f-48e2-84bd-7080d000ba21 req-bafcc3df-2a58-488b-bb2d-5817070aab15 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:35.414236 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d183a57f-cc5f-48e2-84bd-7080d000ba21 req-bafcc3df-2a58-488b-bb2d-5817070aab15 service nova] Creating event network-vif-unplugged:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:54:35.420116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-d183a57f-cc5f-48e2-84bd-7080d000ba21 req-bafcc3df-2a58-488b-bb2d-5817070aab15 service nova] Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:54:35.433010 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d183a57f-cc5f-48e2-84bd-7080d000ba21 req-bafcc3df-2a58-488b-bb2d-5817070aab15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044539 Jul 24 01:54:35.434246 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3159/6213] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:54:36.320548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:36.321181 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:36.328695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:36.329168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:36.329991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:36.330713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:36.530142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:36.539077 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e126be5d-e45d-4dcf-8d24-010302543253 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1689 microversion: 2.1 time: 0.222599 Jul 24 01:54:36.539671 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3055/6214] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:36 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:37.450175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-616c577c-cc62-4c6d-a228-f75b44b5d4d8 req-4c4fdf40-5f8a-4318-afd7-9cff02182860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:37.458546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-616c577c-cc62-4c6d-a228-f75b44b5d4d8 req-4c4fdf40-5f8a-4318-afd7-9cff02182860 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:37.458986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-616c577c-cc62-4c6d-a228-f75b44b5d4d8 req-4c4fdf40-5f8a-4318-afd7-9cff02182860 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:37.470234 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-616c577c-cc62-4c6d-a228-f75b44b5d4d8 req-4c4fdf40-5f8a-4318-afd7-9cff02182860 service nova] Creating event network-changed:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:54:37.475954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-616c577c-cc62-4c6d-a228-f75b44b5d4d8 req-4c4fdf40-5f8a-4318-afd7-9cff02182860 service nova] Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 01:54:37.486852 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-616c577c-cc62-4c6d-a228-f75b44b5d4d8 req-4c4fdf40-5f8a-4318-afd7-9cff02182860 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041626 Jul 24 01:54:37.487434 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3160/6215] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:54:37.557052 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:37.557803 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:37.564804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:37.565391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:37.566211 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:37.566664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:37.586215 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:37.708751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:37.716953 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a259a5cd-8f34-4f7c-ba92-2bb1224412db tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1689 microversion: 2.1 time: 0.163846 Jul 24 01:54:37.717526 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3056/6216] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:37 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:38.736336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:38.737041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:38.744068 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:38.744519 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:38.745279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:38.746089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:38.749036 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:38.886563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:38.894276 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d84dd8e6-86aa-4bf8-99fd-718976c6031c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1689 microversion: 2.1 time: 0.163356 Jul 24 01:54:38.895016 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3161/6217] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:38 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:39.911972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:39.912592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:39.919478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:39.919941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:39.920715 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:39.921164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:40.053964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:40.061517 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-da394f42-e77d-4af9-a2a0-ce5bb603e6cd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1682 microversion: 2.1 time: 0.153563 Jul 24 01:54:40.062119 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3057/6218] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:39 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:42.271571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d5feab75-3e0a-4ead-b4b5-377a718c61ef req-0f605183-3e5b-4588-8747-48a96f3e06e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "name": "network-vif-plugged", "status": "completed", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:42.277531 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=39 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:42.282199 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d5feab75-3e0a-4ead-b4b5-377a718c61ef req-0f605183-3e5b-4588-8747-48a96f3e06e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:42.282649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d5feab75-3e0a-4ead-b4b5-377a718c61ef req-0f605183-3e5b-4588-8747-48a96f3e06e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:42.295272 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-d5feab75-3e0a-4ead-b4b5-377a718c61ef req-0f605183-3e5b-4588-8747-48a96f3e06e5 service nova] Creating event network-vif-plugged:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:54:42.300192 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d5feab75-3e0a-4ead-b4b5-377a718c61ef req-0f605183-3e5b-4588-8747-48a96f3e06e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033437 Jul 24 01:54:42.300815 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3162/6219] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:54:45.615865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:45.616388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:45.618289 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=37 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:45.623784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:45.624246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:45.625032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:45.625476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:45.651490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:54:45.727641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0d3a47e-89ea-4553-b266-ad3e09bd7a7d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 204 len: 0 microversion: 2.1 time: 0.223840 Jul 24 01:54:45.728413 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3058/6220] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:54:45 2022] DELETE /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:54:45.740156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:45.740854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:45.747143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:45.747592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:45.748358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:45.748818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:45.880687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:45.888284 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d3f98f86-7ed4-42bf-bba7-71d76e9165be tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1578 microversion: 2.1 time: 0.155339 Jul 24 01:54:45.888855 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3163/6221] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:45 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:46.906271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:46.906923 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:46.914364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:46.914829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:46.915628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:46.916076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:47.053248 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:47.061206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e22cf978-5d60-4605-87e5-9067ee28df9e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1578 microversion: 2.1 time: 0.159194 Jul 24 01:54:47.061820 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3059/6222] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:46 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:48.084394 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b74a3b8b-e8c3-49f7-ad8a-89aaae42e6dd req-f16933e4-e130-4f28-b002-b0ca07b0409a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395aa6a3-d471-4f3f-a112-a5236d6557b4", "name": "network-vif-deleted", "tag": "2052f898-57ce-4a77-a2f1-ead0e7e9f01e"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:48.085805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:48.088002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:48.095151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b74a3b8b-e8c3-49f7-ad8a-89aaae42e6dd req-f16933e4-e130-4f28-b002-b0ca07b0409a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:48.098823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b74a3b8b-e8c3-49f7-ad8a-89aaae42e6dd req-f16933e4-e130-4f28-b002-b0ca07b0409a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:48.099010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:48.099466 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:48.101631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:48.102323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:48.116290 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b74a3b8b-e8c3-49f7-ad8a-89aaae42e6dd req-f16933e4-e130-4f28-b002-b0ca07b0409a service nova] Creating event network-vif-deleted:2052f898-57ce-4a77-a2f1-ead0e7e9f01e for instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 on n-h1-master-1 Jul 24 01:54:48.136237 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b74a3b8b-e8c3-49f7-ad8a-89aaae42e6dd req-f16933e4-e130-4f28-b002-b0ca07b0409a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056298 Jul 24 01:54:48.137260 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3060/6223] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:54:48.214390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:48.223289 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a18a803-1546-4c38-8531-b2eaccd61d14 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1511 microversion: 2.1 time: 0.147956 Jul 24 01:54:48.224707 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3164/6224] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:48 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:49.242908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:49.243740 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:49.250099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:49.250575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:49.251364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:49.251819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:49.316167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:49.324611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1fd65a9d-46d8-4f3f-a0e6-a4161d167b76 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1225 microversion: 2.1 time: 0.087660 Jul 24 01:54:49.325197 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3061/6225] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:49 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:50.342571 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:50.343178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:50.350528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:50.350986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:50.351765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:50.352210 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:50.418402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:50.426823 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b1189073-8f9e-4d97-bc95-a1daee20022b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1225 microversion: 2.1 time: 0.087523 Jul 24 01:54:50.427580 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3165/6226] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:50 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:51.443650 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:51.444282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:51.451236 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:51.451720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:51.452501 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:51.452953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:51.519770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:51.528131 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2eae248-9f84-4aa3-b8c8-bea1fafc3ab8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1225 microversion: 2.1 time: 0.088430 Jul 24 01:54:51.528704 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3062/6227] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:51 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:52.544725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:52.545376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:52.553127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:52.553586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:52.554406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:52.554852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:52.586497 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:52.586959 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:52.587416 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lazy-loading 'fault' on Instance uuid 395aa6a3-d471-4f3f-a112-a5236d6557b4 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:54:52.634649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:52.637412 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:54:52.638897 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 01:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 (ip 10.222.0.27) !!! Jul 24 01:54:52.643261 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7cd91dc9-d3db-4511-b696-b8d833807854 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 200 len: 1184 microversion: 2.1 time: 0.102693 Jul 24 01:54:52.648391 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3166/6228] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:52 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 1184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:53.661328 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:53.661970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:53.668956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:53.669427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:53.670261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:53.670718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:53.688909 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 HTTP/1.1 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '395aa6a3-d471-4f3f-a112-a5236d6557b4'} Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:54:53.690614 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1d3a05f-5237-4f47-a23a-dd0b004e3028 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 404 len: 111 microversion: 2.1 time: 0.035234 Jul 24 01:54:53.696969 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3063/6229] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:53 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:54:53.743016 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-560846516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1836836593", "security_groups": [{"name": "tempest-secgroup-smoke-802663545"}], "block_device_mapping_v2": [{"uuid": "19cbea99-dcef-483d-8004-8a581052f486", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dc256e9-ed96-441b-9223-c863c318c2b9"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:53.866158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] validate_networks() for [('3dc256e9-ed96-441b-9223-c863c318c2b9', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:54:54.396753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:54:54.397181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:54:54.397660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:54:54.398093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:54:54.398531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:54:54.407562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:54.408012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:54.408811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:54.409246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:54.426908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:54:54.432630 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:54:54.491288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:54:54.493405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19cbea99-dcef-483d-8004-8a581052f486',volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:54:54.625387 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ce45dbd9-1dad-4346-8ee1-a4bbefcee8de tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.886944 Jul 24 01:54:54.626100 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3167/6230] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:54:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:54:54.636210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-148d4d3f-bab6-4c50-b4e5-940c87fc9fe5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:54.637210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-148d4d3f-bab6-4c50-b4e5-940c87fc9fe5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:54.701771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-148d4d3f-bab6-4c50-b4e5-940c87fc9fe5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:54.713125 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-148d4d3f-bab6-4c50-b4e5-940c87fc9fe5 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1094 microversion: 2.1 time: 0.080659 Jul 24 01:54:54.714678 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3064/6231] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:54 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:55.730201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:55.731000 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:55.740063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:55.740868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:55.741783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:55.742299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:55.814234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:55.823201 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-531f645e-5d8a-4b44-a533-c8618ae72cbf tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1210 microversion: 2.1 time: 0.096895 Jul 24 01:54:55.824138 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3168/6232] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:55 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:56.840612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:56.842037 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:56.849801 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:56.850650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:56.851780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:56.852464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:56.944989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c2bcbc42-7c20-47fd-ae6e-661438f11149 req-b7567062-569e-4543-8659-0792a1dfe636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f8f56b-3b29-46d2-9c71-a0f18464d41e", "tag": "2de46efc-ffaa-46b4-a700-9ab1c756596a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:54:56.975754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c2bcbc42-7c20-47fd-ae6e-661438f11149 req-b7567062-569e-4543-8659-0792a1dfe636 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:56.976300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c2bcbc42-7c20-47fd-ae6e-661438f11149 req-b7567062-569e-4543-8659-0792a1dfe636 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:57.002247 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c2bcbc42-7c20-47fd-ae6e-661438f11149 req-b7567062-569e-4543-8659-0792a1dfe636 service nova] Creating event network-changed:2de46efc-ffaa-46b4-a700-9ab1c756596a for instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e on n-h1-master-1 Jul 24 01:54:57.012403 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c2bcbc42-7c20-47fd-ae6e-661438f11149 req-b7567062-569e-4543-8659-0792a1dfe636 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073337 Jul 24 01:54:57.013037 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3169/6233] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:54:57.060209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:57.069759 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e59d02d2-7292-4f41-839e-cb4d87935c79 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1277 microversion: 2.1 time: 0.232764 Jul 24 01:54:57.075188 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3065/6234] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:56 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:58.089820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:58.090540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:58.097962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:58.099194 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:58.100184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:58.100804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:58.259112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:58.266797 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3badcc42-15b7-4fe9-ad65-17df64365360 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1277 microversion: 2.1 time: 0.181268 Jul 24 01:54:58.267385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3170/6235] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:58 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:54:59.283424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:54:59.284047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:54:59.291611 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:59.292074 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:59.292856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:54:59.293330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:54:59.427990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:54:59.435528 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e2091cec-bb79-458d-9a87-f8557eeca714 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1277 microversion: 2.1 time: 0.156044 Jul 24 01:54:59.436112 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3066/6236] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:54:59 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:00.452609 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:00.453367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:00.460580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:00.461043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:00.461905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:00.462348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:00.600885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:00.608518 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c061c88a-1e7b-4198-9f00-621c871cffe2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1277 microversion: 2.1 time: 0.160027 Jul 24 01:55:00.609087 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3171/6237] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:00 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:01.625125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:01.625777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:01.632828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:01.633285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:01.634147 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:01.634598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:01.771871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:01.779467 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-33a5d69b-a5ee-406e-b6aa-e1184079e953 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.158195 Jul 24 01:55:01.780051 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3067/6238] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:01 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:02.796739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:02.797394 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:02.805085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:02.805540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:02.806340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:02.806785 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:02.948382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:02.956027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5a22fe8-1734-485b-a117-07fbe1409607 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.163248 Jul 24 01:55:02.956624 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3172/6239] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:02 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:03.972466 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:03.973008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:03.980591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:03.981066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:03.981884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:03.982345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:04.119280 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:04.126950 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2aa3bd63-2bcf-4623-ac9a-fe3e89f7f14a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.158407 Jul 24 01:55:04.127529 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3068/6240] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:03 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:05.144194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:05.144819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:05.148182 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:05.148893 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:05.155569 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:05.156028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:05.156803 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:05.157250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:05.289085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:05.296709 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9c5ebbc-7469-4cfc-b247-ee6524a0968e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.156462 Jul 24 01:55:05.297291 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3173/6241] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:05 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:06.313500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:06.314186 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:06.316166 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:06.322272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:06.322745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:06.323525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:06.323978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:06.454102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:06.462491 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2430d666-5ce1-4e89-b0e8-d274b2a3595d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.153004 Jul 24 01:55:06.463064 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3069/6242] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:06 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:07.479456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:07.480009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:07.487183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:07.487642 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:07.488410 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:07.488850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:07.624579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:07.632963 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e634cf9-9014-4437-84ae-c835ed153027 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.157570 Jul 24 01:55:07.633542 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3174/6243] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:07 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:08.650269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:08.651292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:08.658093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:08.658556 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:08.659420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:08.659876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:08.662764 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:08.797038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:08.805639 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8071ee66-73d2-4828-aaf6-ef375f7a3a9b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.159599 Jul 24 01:55:08.806259 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3070/6244] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:08 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:09.823302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:09.823950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:09.831000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:09.831459 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:09.832234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:09.832680 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:09.837589 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=74 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:09.969175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:09.977049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32605b41-b860-46ed-9e2c-d12216dd018c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.157406 Jul 24 01:55:09.977630 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3175/6245] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:09 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:10.287081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b4debd34-5709-471d-94e3-7a574d855184 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:10.288084 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b4debd34-5709-471d-94e3-7a574d855184 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:10.294762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4debd34-5709-471d-94e3-7a574d855184 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:10.295227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4debd34-5709-471d-94e3-7a574d855184 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:10.296019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4debd34-5709-471d-94e3-7a574d855184 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:10.296468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4debd34-5709-471d-94e3-7a574d855184 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:10.361315 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b4debd34-5709-471d-94e3-7a574d855184 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action" status: 200 len: 63077 microversion: 2.1 time: 0.079100 Jul 24 01:55:10.361978 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3071/6246] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:55:10 2022] POST /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181/action => generated 63077 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:55:10.811077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6e798cab-49d9-4f91-9e70-3136415b8871 req-58065b96-a8b8-410d-86c2-47db80a3b4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f8f56b-3b29-46d2-9c71-a0f18464d41e", "name": "network-vif-plugged", "status": "completed", "tag": "2de46efc-ffaa-46b4-a700-9ab1c756596a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:10.820044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e798cab-49d9-4f91-9e70-3136415b8871 req-58065b96-a8b8-410d-86c2-47db80a3b4bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:10.820624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e798cab-49d9-4f91-9e70-3136415b8871 req-58065b96-a8b8-410d-86c2-47db80a3b4bf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:10.834356 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6e798cab-49d9-4f91-9e70-3136415b8871 req-58065b96-a8b8-410d-86c2-47db80a3b4bf service nova] Creating event network-vif-plugged:2de46efc-ffaa-46b4-a700-9ab1c756596a for instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e on n-h1-master-1 Jul 24 01:55:10.840303 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6e798cab-49d9-4f91-9e70-3136415b8871 req-58065b96-a8b8-410d-86c2-47db80a3b4bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032588 Jul 24 01:55:10.840915 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3176/6247] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:55:10.994846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:10.995555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:11.002716 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:11.003179 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:11.003952 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:11.004398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:11.136526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:11.144501 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f31834a-b9cb-4e90-8d25-0b026b7526b7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1265 microversion: 2.1 time: 0.153919 Jul 24 01:55:11.145067 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3072/6248] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:10 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:12.163420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:12.164515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:12.171886 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:12.172342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:12.173123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:12.173562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:12.312829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:12.321116 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23febba3-76b9-4c62-b8ce-83db17b6361a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1452 microversion: 2.1 time: 0.162388 Jul 24 01:55:12.321705 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3177/6249] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:12 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:55:12.336673 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:12.337305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:12.344109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:12.344572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:12.345343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:12.345823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:12.475917 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:12.483380 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2e621dd3-8bbe-47a2-8d1f-60bbefcee91f tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1452 microversion: 2.1 time: 0.150519 Jul 24 01:55:12.483960 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3073/6250] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:12 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:14.572744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-614a24c1-1af6-40e2-a397-4a1fc31b23ac req-62a34042-49e5-4255-a95c-d4b08aae625e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f8f56b-3b29-46d2-9c71-a0f18464d41e", "tag": "2de46efc-ffaa-46b4-a700-9ab1c756596a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:14.576336 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:14.582342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-614a24c1-1af6-40e2-a397-4a1fc31b23ac req-62a34042-49e5-4255-a95c-d4b08aae625e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:14.582794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-614a24c1-1af6-40e2-a397-4a1fc31b23ac req-62a34042-49e5-4255-a95c-d4b08aae625e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:14.595217 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-614a24c1-1af6-40e2-a397-4a1fc31b23ac req-62a34042-49e5-4255-a95c-d4b08aae625e service nova] Creating event network-changed:2de46efc-ffaa-46b4-a700-9ab1c756596a for instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e on n-h1-master-1 Jul 24 01:55:14.600965 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-614a24c1-1af6-40e2-a397-4a1fc31b23ac req-62a34042-49e5-4255-a95c-d4b08aae625e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106769 Jul 24 01:55:14.601577 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3178/6251] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:55:26.572798 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:26.573582 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=21 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:26.678095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-99de2377-7e2b-4bc5-86d4-03d0997ff477 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:26.678739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-99de2377-7e2b-4bc5-86d4-03d0997ff477 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:26.685499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99de2377-7e2b-4bc5-86d4-03d0997ff477 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:26.686000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99de2377-7e2b-4bc5-86d4-03d0997ff477 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:26.686787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99de2377-7e2b-4bc5-86d4-03d0997ff477 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:26.687272 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99de2377-7e2b-4bc5-86d4-03d0997ff477 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:26.813801 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-99de2377-7e2b-4bc5-86d4-03d0997ff477 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1833 microversion: 2.1 time: 0.247728 Jul 24 01:55:26.814376 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3074/6252] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:26 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1833 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:27.764383 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=15 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:27.765331 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:27.769811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c3ce4a13-26a5-4ba2-b346-ab87542310ed req-c84e6298-3618-498a-9ffe-b3f38ce2e310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:27.771773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:27.772446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:27.779474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c3ce4a13-26a5-4ba2-b346-ab87542310ed req-c84e6298-3618-498a-9ffe-b3f38ce2e310 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:27.780271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c3ce4a13-26a5-4ba2-b346-ab87542310ed req-c84e6298-3618-498a-9ffe-b3f38ce2e310 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:27.782033 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:27.782588 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:27.783413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:27.784124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:27.792464 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c3ce4a13-26a5-4ba2-b346-ab87542310ed req-c84e6298-3618-498a-9ffe-b3f38ce2e310 service nova] Creating event network-changed:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:55:27.798225 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c3ce4a13-26a5-4ba2-b346-ab87542310ed req-c84e6298-3618-498a-9ffe-b3f38ce2e310 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033112 Jul 24 01:55:27.799234 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3075/6253] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:55:27.818605 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:55:27.906999 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd7e2445-46cc-4a79-a218-4aaf641fcbdb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 204 len: 0 microversion: 2.1 time: 0.145012 Jul 24 01:55:27.907932 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3179/6254] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:55:27 2022] DELETE /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:55:27.917946 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:27.917946 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:27.924375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:27.925145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:27.925974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:27.926447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:28.083136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:28.091281 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c335fc2-c621-4a92-a79d-dd01ceeae4e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1688 microversion: 2.1 time: 0.178641 Jul 24 01:55:28.092078 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3076/6255] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:27 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:29.109184 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:29.110599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:29.120009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:29.120603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:29.121529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:29.122213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:29.280616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:29.289869 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d93c23eb-55f0-45d6-b558-deb0623562ca tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1688 microversion: 2.1 time: 0.185093 Jul 24 01:55:29.290445 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3180/6256] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:29 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:29.993514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-55691c04-17a8-4953-9975-96b24d3d20b4 req-d5acdb94-040c-4650-9535-15c7c703e21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3deb4b11-ebd9-4322-b7d7-8090e5268181", "name": "network-vif-deleted", "tag": "206e384c-cbab-4261-b693-3ca0a18fce0a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:30.002992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-55691c04-17a8-4953-9975-96b24d3d20b4 req-d5acdb94-040c-4650-9535-15c7c703e21d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:30.003454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-55691c04-17a8-4953-9975-96b24d3d20b4 req-d5acdb94-040c-4650-9535-15c7c703e21d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:30.017944 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-55691c04-17a8-4953-9975-96b24d3d20b4 req-d5acdb94-040c-4650-9535-15c7c703e21d service nova] Creating event network-vif-deleted:206e384c-cbab-4261-b693-3ca0a18fce0a for instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 on n-h2-master-1 Jul 24 01:55:30.024320 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-55691c04-17a8-4953-9975-96b24d3d20b4 req-d5acdb94-040c-4650-9535-15c7c703e21d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033863 Jul 24 01:55:30.024933 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3077/6257] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:55:30.308106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:30.308746 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:30.316124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:30.316576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:30.317355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:30.317851 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:30.354872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:30.355331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:30.355795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lazy-loading 'fault' on Instance uuid 3deb4b11-ebd9-4322-b7d7-8090e5268181 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:55:30.402054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:30.409632 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ba371ec6-1621-4a64-8228-8226dcf2c5ff tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 200 len: 1356 microversion: 2.1 time: 0.106179 Jul 24 01:55:30.410484 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3181/6258] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:30 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:31.429690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:31.430363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 3deb4b11-ebd9-4322-b7d7-8090e5268181] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:31.438298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:31.438768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:31.439661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:31.440235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:31.454536 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] HTTP exception thrown: Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 could not be found. Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Request method failure captured: Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 HTTP/1.1 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KVUePV44iEzznN_AGm013tPuzitSEnuYqI7R151g-3fwxMLCTiSFAVRkP7_-f2ay4n0r0fCsR957CugnZtLMvDRJDgNqtGfSW-Y6Q7Rgw9mEQbfPe3R1OEc5NObS2fbnG_-FddrCi9sYi9IKWJwdOU3kZyJNWhmkbNudX8vy9YW2Gw Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9cd3d18dd66e4321b11cf7b5fe9a3400", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: ecbfd92ba65f40758afcaf692c8aa33d Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 could not be found. Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '3deb4b11-ebd9-4322-b7d7-8090e5268181'} Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 could not be found. Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 could not be found. Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:55:31.456249 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 could not be found. Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Returning 404 to user: Instance 3deb4b11-ebd9-4322-b7d7-8090e5268181 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5dd28ab1-2c69-4147-96f5-0a9ad64e20c6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181" status: 404 len: 111 microversion: 2.1 time: 0.033571 Jul 24 01:55:31.461547 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3078/6259] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:31 2022] GET /compute/v2.1/servers/3deb4b11-ebd9-4322-b7d7-8090e5268181 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:55:34.530205 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-15a8c514-cac2-47ec-be83-0bca997e2485 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '.version_select at 0x7f05eacbae50>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:34.557406 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-15a8c514-cac2-47ec-be83-0bca997e2485 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662081216" status: 202 len: 0 microversion: 2.1 time: 0.033955 Jul 24 01:55:34.558449 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3182/6260] 10.222.0.27 () {58 vars in 1280 bytes} [Sun Jul 24 01:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662081216 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:55:34.598094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f7320db-8daf-4384-b1a3-a9950b954972 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: .version_select at 0x7f05ea411b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1103209731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaYve7FdyFsozH93BuikA2K+XQzC12MhWGG2/qRUf0qavQgeCOcWLyEhLOf6ZHXGgbb5x8fE8XxNEKVLz6D882CcbDdtplWZXABuMG37FjlogYFEksEWABc6pyK8phS6Q=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:34.616737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3f7320db-8daf-4384-b1a3-a9950b954972 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:55:34.624370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-3f7320db-8daf-4384-b1a3-a9950b954972 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:55:34.653303 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f7320db-8daf-4384-b1a3-a9950b954972 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059225 Jul 24 01:55:34.653958 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3079/6261] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:55:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:55:40.303892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-211732691", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "86a4bf68-c347-41c9-a097-7de5e028eeb8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1103209731", "security_groups": [{"name": "tempest-secgroup-smoke-1886424683"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:40.406125 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:40.424309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] validate_networks() for [('86a4bf68-c347-41c9-a097-7de5e028eeb8', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:55:40.935670 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:55:40.936844 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:55:40.937533 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:55:40.938806 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:55:40.939078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:55:40.949897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:40.950759 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:40.951738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:40.952362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:40.975842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:55:40.981944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:55:41.002359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:55:41.004846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:55:41.063180 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97c41912-bbda-4190-8c89-7da8c201225c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764243 Jul 24 01:55:41.070126 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3183/6262] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:55:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:55:41.075681 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed2fa353-8313-42cb-b66a-f37013b55dee tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:41.076572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ed2fa353-8313-42cb-b66a-f37013b55dee tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:41.209581 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed2fa353-8313-42cb-b66a-f37013b55dee tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:41.248064 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed2fa353-8313-42cb-b66a-f37013b55dee tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1266 microversion: 2.1 time: 0.177521 Jul 24 01:55:41.260616 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3080/6263] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:41 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:55:42.269149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:42.270580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:42.286564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:42.286698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:42.287397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:42.287838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:42.426220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:42.436881 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b7ffb6ce-5dd1-45d0-a26b-6d737b898e75 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1326 microversion: 2.1 time: 0.172455 Jul 24 01:55:42.438129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3184/6264] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:42 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:43.454802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:43.455531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:43.458637 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=18 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:43.464811 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:43.465934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:43.466917 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:43.467355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:43.623730 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:43.631533 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50b766e3-4844-4552-8485-6f69acbcf2b9 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.180552 Jul 24 01:55:43.632112 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3081/6265] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:43 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:44.598764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6796b733-4299-42b0-b740-747de3fa4a4b req-16973148-aaa8-47ac-96ad-1fcc9ba942b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:44.616969 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6796b733-4299-42b0-b740-747de3fa4a4b req-16973148-aaa8-47ac-96ad-1fcc9ba942b3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:44.617813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6796b733-4299-42b0-b740-747de3fa4a4b req-16973148-aaa8-47ac-96ad-1fcc9ba942b3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:44.631771 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6796b733-4299-42b0-b740-747de3fa4a4b req-16973148-aaa8-47ac-96ad-1fcc9ba942b3 service nova] Creating event network-changed:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h2-master-1 Jul 24 01:55:44.638495 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6796b733-4299-42b0-b740-747de3fa4a4b req-16973148-aaa8-47ac-96ad-1fcc9ba942b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043408 Jul 24 01:55:44.639159 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3185/6266] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:55:44.650640 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:44.651540 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:44.662185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:44.664167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:44.665354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:44.666423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:44.833912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:44.842444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ce818e69-9ac9-41af-a74d-c2cf5f05e7fe tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.198010 Jul 24 01:55:44.843029 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3082/6267] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:44 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:45.861217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:45.861980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:45.868420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:45.868872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:45.869633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:45.870094 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:46.006797 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:46.014416 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5950f5b-7bb4-4d69-943d-26c43f8817a1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.158487 Jul 24 01:55:46.015003 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3186/6268] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:45 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:47.031266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:47.031890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:47.038738 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:47.039200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:47.040531 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:47.041250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:47.180127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:47.189206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e3b6c8d2-7cdb-4981-8c94-22a8f341a25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.161788 Jul 24 01:55:47.189934 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3083/6269] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:47 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:48.206920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:48.207541 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:48.215222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:48.215684 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:48.216503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:48.216949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:48.354236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:48.362271 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5c4ff4d-beb2-4eca-a852-be8c54d4bf69 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.159240 Jul 24 01:55:48.362849 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3187/6270] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:48 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:49.380205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:49.381012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:49.394377 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:49.394754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:49.395558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:49.396007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:49.538108 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:49.546204 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-64a7d5b4-80ef-4f2f-9894-e75e9df88eb4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.170352 Jul 24 01:55:49.546786 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3084/6271] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:49 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:50.564150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:50.564777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:50.572957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:50.573520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:50.574374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:50.574825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:50.677445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d546f13f-fdd8-4aac-a6c9-86bfedfab2f7 req-bacb5d66-47cf-47ff-8d08-cc84479a2dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "name": "network-vif-plugged", "status": "completed", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:50.687543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d546f13f-fdd8-4aac-a6c9-86bfedfab2f7 req-bacb5d66-47cf-47ff-8d08-cc84479a2dec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:50.688020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d546f13f-fdd8-4aac-a6c9-86bfedfab2f7 req-bacb5d66-47cf-47ff-8d08-cc84479a2dec service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:50.701535 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d546f13f-fdd8-4aac-a6c9-86bfedfab2f7 req-bacb5d66-47cf-47ff-8d08-cc84479a2dec service nova] Creating event network-vif-plugged:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h2-master-1 Jul 24 01:55:50.707628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d546f13f-fdd8-4aac-a6c9-86bfedfab2f7 req-bacb5d66-47cf-47ff-8d08-cc84479a2dec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125328 Jul 24 01:55:50.708582 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3085/6272] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:55:50.739010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:50.753044 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97d94879-1ec4-498c-8c5c-470ed0114ead tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.192623 Jul 24 01:55:50.753474 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3188/6273] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:50 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:55:51.767826 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:51.772678 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:51.773388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:51.779933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:51.780395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:51.781168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:51.781615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:51.926546 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:51.934842 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3ce82524-0570-48dd-9b3f-40fed36d0cd6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1392 microversion: 2.1 time: 0.168087 Jul 24 01:55:51.935421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3086/6274] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:51 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:52.952414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:52.953032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:52.955054 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:52.955719 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:52.962502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:52.962953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:52.963718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:52.964153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:53.097635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:53.106169 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c10ef7c0-4846-4cd5-afc0-47a9cc608d49 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1565 microversion: 2.1 time: 0.158351 Jul 24 01:55:53.106747 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3189/6275] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:52 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:53.122677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:53.123307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:53.130193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:53.130652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:53.131429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:53.131876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:53.274135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:53.282184 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1cc170d-98d0-45d9-9564-a81fd918a0de tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1565 microversion: 2.1 time: 0.163430 Jul 24 01:55:53.282766 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3087/6276] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:53 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:55:55.042134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:55:55.043570 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:55:55.043935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7b78fc56-9c60-4279-9bef-ed586fb84f94 req-5a47c0e4-4eae-4b57-87e4-cddf35d15ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:55:55.051729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:55.052336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:55.053342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:55.053790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7b78fc56-9c60-4279-9bef-ed586fb84f94 req-5a47c0e4-4eae-4b57-87e4-cddf35d15ea1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:55:55.054345 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:55.055208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7b78fc56-9c60-4279-9bef-ed586fb84f94 req-5a47c0e4-4eae-4b57-87e4-cddf35d15ea1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:55:55.069005 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7b78fc56-9c60-4279-9bef-ed586fb84f94 req-5a47c0e4-4eae-4b57-87e4-cddf35d15ea1 service nova] Creating event network-changed:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h2-master-1 Jul 24 01:55:55.074929 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7b78fc56-9c60-4279-9bef-ed586fb84f94 req-5a47c0e4-4eae-4b57-87e4-cddf35d15ea1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 Jul 24 01:55:55.076490 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3088/6277] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:55:55.200105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:55:55.208571 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b2c6ce07-dfe3-4fc2-abb6-cb0c0ce1e6b6 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1565 microversion: 2.1 time: 0.171424 Jul 24 01:55:55.209846 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3190/6278] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:55:55 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:56:26.490620 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:26.491310 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=40 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:26.495790 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7b14602e-f264-402c-bd76-504e4fc9d819 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:56:26.496810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7b14602e-f264-402c-bd76-504e4fc9d819 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:26.504873 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b14602e-f264-402c-bd76-504e4fc9d819 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:26.505346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b14602e-f264-402c-bd76-504e4fc9d819 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:26.506172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b14602e-f264-402c-bd76-504e4fc9d819 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:26.506633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b14602e-f264-402c-bd76-504e4fc9d819 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:26.572387 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7b14602e-f264-402c-bd76-504e4fc9d819 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action" status: 200 len: 24575 microversion: 2.1 time: 0.083790 Jul 24 01:56:26.573062 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3089/6279] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:56:26 2022] POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action => generated 24575 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 24 01:56:32.272015 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:56:32.272620 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 01:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 01:56:52.995682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1675671185", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1836836593", "security_groups": [{"name": "tempest-secgroup-smoke-802663545"}], "block_device_mapping_v2": [{"uuid": "48ae1896-5f66-4ed4-825f-44a1f34f214f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3dc256e9-ed96-441b-9223-c863c318c2b9"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:56:53.003847 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:53.004659 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=40 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:53.114051 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] validate_networks() for [('3dc256e9-ed96-441b-9223-c863c318c2b9', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:56:53.489213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:56:53.489635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:56:53.490151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:56:53.490559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:56:53.490991 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:56:53.501200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:53.501647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:53.502472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:53.502932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:53.519471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:56:53.524930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Getting quotas for user 36ad5b8d2523473fa2111be3a6b8523e and project 03e5e1c5805b4c8895ecc39da9838803. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:56:53.583368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:56:53.585498 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48ae1896-5f66-4ed4-825f-44a1f34f214f',volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:56:53.722984 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9ae23a4c-2d10-497a-95e0-5509814c2910 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.731408 Jul 24 01:56:53.723940 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3191/6280] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:56:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:56:53.735492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ccc65d7-3800-4c92-8151-95fd4bf33822 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:53.736499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ccc65d7-3800-4c92-8151-95fd4bf33822 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:53.741854 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:53.742649 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:53.810920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ccc65d7-3800-4c92-8151-95fd4bf33822 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:53.819296 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ccc65d7-3800-4c92-8151-95fd4bf33822 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1095 microversion: 2.1 time: 0.089389 Jul 24 01:56:53.820448 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3090/6281] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:53 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:56:54.837572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:54.838298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:54.846865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:54.847371 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:54.848401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:54.849000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:54.923490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:54.932027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e9f0790c-aa14-4d80-a6aa-c0c81ed36f8c tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1201 microversion: 2.1 time: 0.099377 Jul 24 01:56:54.932695 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3192/6282] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:54 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:56:55.949208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:55.950721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:55.958260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:55.958823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:55.959637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:55.960100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:56.105119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:56.114162 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5989616-2fe7-4039-8339-e377815d2f57 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1278 microversion: 2.1 time: 0.168712 Jul 24 01:56:56.125850 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3091/6283] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:55 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:56:56.360634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7144cf91-8f2c-4831-a554-3099c5baebaa req-b972eb0f-6817-4b07-b97e-8fac74a3f914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646b7091-d79d-49aa-b364-cfa75e8d1623", "tag": "87fdb5b2-1665-40fb-afb2-4ab95ed2073b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:56:56.374283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7144cf91-8f2c-4831-a554-3099c5baebaa req-b972eb0f-6817-4b07-b97e-8fac74a3f914 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:56.374664 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7144cf91-8f2c-4831-a554-3099c5baebaa req-b972eb0f-6817-4b07-b97e-8fac74a3f914 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:56.404539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7144cf91-8f2c-4831-a554-3099c5baebaa req-b972eb0f-6817-4b07-b97e-8fac74a3f914 service nova] Creating event network-changed:87fdb5b2-1665-40fb-afb2-4ab95ed2073b for instance 646b7091-d79d-49aa-b364-cfa75e8d1623 on n-h2-master-1 Jul 24 01:56:56.414335 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7144cf91-8f2c-4831-a554-3099c5baebaa req-b972eb0f-6817-4b07-b97e-8fac74a3f914 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057423 Jul 24 01:56:56.416447 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3193/6284] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:56:56.781860 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:56.782517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:56.792318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:56.792788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:56.794454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:56.795102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:56.936905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:56.947178 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0056b52b-f64c-4b70-b1cb-8f51db4a9b2b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1684 microversion: 2.1 time: 0.176214 Jul 24 01:56:56.947769 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3092/6285] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:56 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:56:57.047028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b53a6b2d-3833-4b5f-8905-2578a32b987c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:56:57.048190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b53a6b2d-3833-4b5f-8905-2578a32b987c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:57.054702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b53a6b2d-3833-4b5f-8905-2578a32b987c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.055273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b53a6b2d-3833-4b5f-8905-2578a32b987c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.056151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b53a6b2d-3833-4b5f-8905-2578a32b987c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.056709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b53a6b2d-3833-4b5f-8905-2578a32b987c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.134634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:57.135988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:57.145631 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b53a6b2d-3833-4b5f-8905-2578a32b987c tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action" status: 200 len: 32654 microversion: 2.1 time: 0.103398 Jul 24 01:56:57.148186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.148767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.153742 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3194/6286] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:56:57 2022] POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action => generated 32654 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:56:57.154962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.156208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.307402 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:57.317234 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-847a6adb-06f4-4f99-9b6e-91926e393b3a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1278 microversion: 2.1 time: 0.186641 Jul 24 01:56:57.322068 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3093/6287] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:57 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:56:57.324539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-561e681a-409c-4ae4-9e55-0d0b7f0c0561 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:57.325852 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-561e681a-409c-4ae4-9e55-0d0b7f0c0561 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:57.333253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561e681a-409c-4ae4-9e55-0d0b7f0c0561 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.333737 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561e681a-409c-4ae4-9e55-0d0b7f0c0561 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.334529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561e681a-409c-4ae4-9e55-0d0b7f0c0561 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.334998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-561e681a-409c-4ae4-9e55-0d0b7f0c0561 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.477828 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-561e681a-409c-4ae4-9e55-0d0b7f0c0561 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1835 microversion: 2.1 time: 0.163283 Jul 24 01:56:57.478578 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3195/6288] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:57 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1835 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:56:57.503990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:56:57.505189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:57.511529 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.512000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.512821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:57.513309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:57.537243 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lazy-loading 'flavor' on Instance uuid 1ee44544-f185-4c52-879e-c7bd7ca29460 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:56:57.550486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Going to try to live migrate instance to another host {{(pid=119562) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 24 01:56:58.334188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:58.334872 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:58.344062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:58.346320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:58.347196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:58.347883 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:58.536333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:58.546737 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4dd41917-2b37-4c0c-bef2-1de42e2d717a tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1278 microversion: 2.1 time: 0.215325 Jul 24 01:56:58.546737 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3196/6289] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:58 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:56:59.086238 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cdeb2d1f-045f-4677-99e2-2c33a33b04fa tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action" status: 202 len: 0 microversion: 2.1 time: 1.587555 Jul 24 01:56:59.086863 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3094/6290] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:56:57 2022] POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action => generated 0 bytes in 1590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 01:56:59.097066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:59.097817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:59.105302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:59.106935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:59.107800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:59.108253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:59.271841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:59.280325 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c06d838-78c1-4743-81cb-10b05f4a0b5a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.187651 Jul 24 01:56:59.281008 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3197/6291] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:59 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:56:59.564604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:56:59.565419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:56:59.573331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:59.573830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:59.574643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:56:59.575846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:56:59.717843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:56:59.726150 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f6192c46-374b-4538-8527-b073d10de546 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1278 microversion: 2.1 time: 0.166473 Jul 24 01:56:59.726901 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3095/6292] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:56:59 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:00.229043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fcad4763-402a-47ba-a1f4-14c0fe9bdb41 req-88f42fb5-da94-47af-b4fe-8f0bed90d9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "name": "network-vif-unplugged", "status": "completed", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:00.245926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fcad4763-402a-47ba-a1f4-14c0fe9bdb41 req-88f42fb5-da94-47af-b4fe-8f0bed90d9e6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:00.247226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fcad4763-402a-47ba-a1f4-14c0fe9bdb41 req-88f42fb5-da94-47af-b4fe-8f0bed90d9e6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:00.264827 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fcad4763-402a-47ba-a1f4-14c0fe9bdb41 req-88f42fb5-da94-47af-b4fe-8f0bed90d9e6 service nova] Creating event network-vif-unplugged:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h2-master-1 Jul 24 01:57:00.278760 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fcad4763-402a-47ba-a1f4-14c0fe9bdb41 req-88f42fb5-da94-47af-b4fe-8f0bed90d9e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057602 Jul 24 01:57:00.280208 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3198/6293] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:57:00.300560 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:00.301245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:00.310151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:00.311549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:00.312768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:00.314865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:00.490607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:00.500730 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47103ff5-6b7f-4395-9c17-068ddc02f5a5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.205422 Jul 24 01:57:00.501300 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3096/6294] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:00 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:00.745485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:00.746749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:00.754202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:00.754661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:00.755455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:00.759988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:00.931504 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:00.940109 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1b7b0c69-6d7f-4bcf-a0cf-bd5fc93b31b4 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1266 microversion: 2.1 time: 0.199361 Jul 24 01:57:00.940617 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3199/6295] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:00 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:01.518715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:01.519374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:01.526270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:01.526737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:01.527520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:01.528128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:01.662100 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:01.669558 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffac8fbc-f0c2-4c8c-8542-2d4b6eaecc8f tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.154746 Jul 24 01:57:01.670180 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3097/6296] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:01 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:01.956447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:01.957317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:01.964359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:01.964877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:01.965605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:01.966072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:02.118364 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:02.126479 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-839a2d2b-40fa-4611-b3b2-1b36afcc09f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1266 microversion: 2.1 time: 0.173830 Jul 24 01:57:02.127549 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3200/6297] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:01 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:02.329989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-f606676b-7567-458b-803c-da752db70023 req-dcb56ca3-ab77-41ec-97fd-68c1287cc4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:02.342475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f606676b-7567-458b-803c-da752db70023 req-dcb56ca3-ab77-41ec-97fd-68c1287cc4d5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:02.343263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-f606676b-7567-458b-803c-da752db70023 req-dcb56ca3-ab77-41ec-97fd-68c1287cc4d5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:02.360111 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-f606676b-7567-458b-803c-da752db70023 req-dcb56ca3-ab77-41ec-97fd-68c1287cc4d5 service nova] Creating event network-changed:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h2-master-1 Jul 24 01:57:02.368461 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-f606676b-7567-458b-803c-da752db70023 req-dcb56ca3-ab77-41ec-97fd-68c1287cc4d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044916 Jul 24 01:57:02.369301 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3098/6298] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:57:02.686129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:02.686744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:02.692920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:02.693381 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:02.694186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:02.694636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:02.833809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:02.843940 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2bdebd9-9512-4a0e-809f-e9803549ae9e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.161885 Jul 24 01:57:02.845119 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3201/6299] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:02 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:03.144718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:03.145481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:03.152244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:03.152739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:03.154118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:03.154617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:03.291308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:03.299394 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72ca0945-7a06-4f09-a625-01ff69800c47 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1266 microversion: 2.1 time: 0.159244 Jul 24 01:57:03.300006 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3099/6300] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:03 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:03.863292 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:03.863906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:03.866743 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:03.867411 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:03.873375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:03.873864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:03.874636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:03.875075 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:04.013936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:04.021399 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31f978ff-7fa1-44dd-ae7a-1e2d0da3dd89 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.162298 Jul 24 01:57:04.022000 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3202/6301] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:03 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:04.316212 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:04.316832 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:04.319325 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:04.325730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:04.326154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:04.326926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:04.327371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:04.460295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:04.468493 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3dcdbb6-c3f8-4d66-b6df-53e2e7a651d3 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1266 microversion: 2.1 time: 0.156108 Jul 24 01:57:04.469065 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3100/6302] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:04 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:05.040242 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:05.040885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:05.048649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:05.049101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:05.049963 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:05.050405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:05.070994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ef9c7690-b215-4705-bc58-37b99d1661e5 req-f71c553e-b925-4487-b417-90455eb21e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646b7091-d79d-49aa-b364-cfa75e8d1623", "name": "network-vif-plugged", "status": "completed", "tag": "87fdb5b2-1665-40fb-afb2-4ab95ed2073b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:05.081138 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ef9c7690-b215-4705-bc58-37b99d1661e5 req-f71c553e-b925-4487-b417-90455eb21e0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:05.081977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ef9c7690-b215-4705-bc58-37b99d1661e5 req-f71c553e-b925-4487-b417-90455eb21e0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:05.097877 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ef9c7690-b215-4705-bc58-37b99d1661e5 req-f71c553e-b925-4487-b417-90455eb21e0f service nova] Creating event network-vif-plugged:87fdb5b2-1665-40fb-afb2-4ab95ed2073b for instance 646b7091-d79d-49aa-b364-cfa75e8d1623 on n-h2-master-1 Jul 24 01:57:05.103638 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ef9c7690-b215-4705-bc58-37b99d1661e5 req-f71c553e-b925-4487-b417-90455eb21e0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036004 Jul 24 01:57:05.104542 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3101/6303] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:57:05.202594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:05.210233 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1213865a-ea4d-41a0-a41d-43ec8c3ca1d8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.173989 Jul 24 01:57:05.210853 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3203/6304] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:05 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:05.487250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:05.487962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:05.494234 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:05.494699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:05.495503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:05.495954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:05.628517 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:05.636675 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-88f4fe50-dbf2-4482-9869-17fd63e8cdb8 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1266 microversion: 2.1 time: 0.155361 Jul 24 01:57:05.637245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3102/6305] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:05 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:06.227590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:06.228213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:06.235619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:06.236083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:06.237125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:06.237571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:06.370507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:06.377991 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0b8f66fe-7e7f-4753-a913-db8bf5105a55 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.154358 Jul 24 01:57:06.378567 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3204/6306] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:06 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:06.653664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:06.654258 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:06.661115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:06.661577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:06.662413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:06.662859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:06.797533 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:06.805147 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b24e382-ec5c-459b-8e76-529000efa278 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1266 microversion: 2.1 time: 0.155474 Jul 24 01:57:06.805735 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3103/6307] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:06 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:07.394725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:07.396901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:07.403935 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:07.404394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:07.405175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:07.405620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:07.493415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-66bd073a-a2a8-4f1f-bde1-8adae841a85c req-2ce393c3-2383-491b-8cd4-c9500031738f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "name": "network-vif-unplugged", "status": "completed", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:07.502309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-66bd073a-a2a8-4f1f-bde1-8adae841a85c req-2ce393c3-2383-491b-8cd4-c9500031738f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:07.502765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-66bd073a-a2a8-4f1f-bde1-8adae841a85c req-2ce393c3-2383-491b-8cd4-c9500031738f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:07.515853 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-66bd073a-a2a8-4f1f-bde1-8adae841a85c req-2ce393c3-2383-491b-8cd4-c9500031738f service nova] Creating event network-vif-unplugged:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h2-master-1 Jul 24 01:57:07.521373 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-66bd073a-a2a8-4f1f-bde1-8adae841a85c req-2ce393c3-2383-491b-8cd4-c9500031738f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031401 Jul 24 01:57:07.521664 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3104/6308] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:57:07.543487 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:07.551864 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0313028a-b24a-4628-854b-8bebeb17ad1e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.161087 Jul 24 01:57:07.552458 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3205/6309] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:07 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:07.829274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:07.830023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:07.836622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:07.837087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:07.837906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:07.838361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:08.307991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:08.316379 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-26e416e9-21ff-42cd-b24e-422e6fd6108b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1454 microversion: 2.1 time: 0.497594 Jul 24 01:57:08.316963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3105/6310] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:07 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1454 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:08.333286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:08.333946 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:08.340045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:08.340506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:08.341432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:08.341914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:08.472739 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:08.480378 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-915cfb0f-2623-4462-8f6b-ee83de2582f2 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1454 microversion: 2.1 time: 0.151094 Jul 24 01:57:08.480964 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3206/6311] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:08 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:08.569688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:08.570639 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:08.577128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:08.577909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:08.578941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:08.579609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:08.794882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:08.803206 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90c60a0e-5b9a-4e44-9c76-dc02e2d12383 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1694 microversion: 2.1 time: 0.237280 Jul 24 01:57:08.804043 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3106/6312] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:08 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1694 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:09.821537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:09.822298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:09.829555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:09.830101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:09.830889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:09.831327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.063849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:10.071384 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff5dbdda-2742-40f8-8c77-798d3b16d217 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1684 microversion: 2.1 time: 0.253830 Jul 24 01:57:10.071968 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3207/6313] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:09 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1684 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:10.088991 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-79a46dae-7584-460a-a28f-7ca406f3a652 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:10.089651 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-79a46dae-7584-460a-a28f-7ca406f3a652 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:10.097182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79a46dae-7584-460a-a28f-7ca406f3a652 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:10.097646 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79a46dae-7584-460a-a28f-7ca406f3a652 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.098458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79a46dae-7584-460a-a28f-7ca406f3a652 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:10.098936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-79a46dae-7584-460a-a28f-7ca406f3a652 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.325733 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:10.333250 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-79a46dae-7584-460a-a28f-7ca406f3a652 tempest-TestNetworkAdvancedServerOps-881756018 tempest-TestNetworkAdvancedServerOps-881756018-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1835 microversion: 2.1 time: 0.247884 Jul 24 01:57:10.334120 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3107/6314] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:10 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1835 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:10.351406 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:10.352029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:10.358320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:10.358778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.359563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:10.360012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.380353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-c7cb5bb5-9989-4f10-adf8-abf141a07e3a req-f1341a99-141f-48e6-8e9b-9f5cb8534bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646b7091-d79d-49aa-b364-cfa75e8d1623", "tag": "87fdb5b2-1665-40fb-afb2-4ab95ed2073b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:10.390562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c7cb5bb5-9989-4f10-adf8-abf141a07e3a req-f1341a99-141f-48e6-8e9b-9f5cb8534bf9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:10.391204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-c7cb5bb5-9989-4f10-adf8-abf141a07e3a req-f1341a99-141f-48e6-8e9b-9f5cb8534bf9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.402289 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-c7cb5bb5-9989-4f10-adf8-abf141a07e3a req-f1341a99-141f-48e6-8e9b-9f5cb8534bf9 service nova] Creating event network-changed:87fdb5b2-1665-40fb-afb2-4ab95ed2073b for instance 646b7091-d79d-49aa-b364-cfa75e8d1623 on n-h2-master-1 Jul 24 01:57:10.407467 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-c7cb5bb5-9989-4f10-adf8-abf141a07e3a req-f1341a99-141f-48e6-8e9b-9f5cb8534bf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031031 Jul 24 01:57:10.408506 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3108/6315] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:57:10.508279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:10.517974 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88b31f25-7123-4729-b6ec-22c2c64bcba5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1684 microversion: 2.1 time: 0.170358 Jul 24 01:57:10.518880 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3208/6316] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:10 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:57:10.611744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3af8dc0c-ece3-4c91-b506-3b4f9adaf907 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:10.612775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3af8dc0c-ece3-4c91-b506-3b4f9adaf907 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:10.619125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3af8dc0c-ece3-4c91-b506-3b4f9adaf907 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:10.619827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3af8dc0c-ece3-4c91-b506-3b4f9adaf907 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.620625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3af8dc0c-ece3-4c91-b506-3b4f9adaf907 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:10.621078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3af8dc0c-ece3-4c91-b506-3b4f9adaf907 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:10.674824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3af8dc0c-ece3-4c91-b506-3b4f9adaf907 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action" status: 200 len: 38632 microversion: 2.1 time: 0.067656 Jul 24 01:57:10.681319 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3109/6317] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:57:10 2022] POST /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460/action => generated 38632 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:57:11.675055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:11.675594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:11.682625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:11.683076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:11.683841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:11.684275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:11.711197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:57:11.714121 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:11.798204 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e001910e-4ca4-4158-aaff-7ec76bf42fe1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 204 len: 0 microversion: 2.1 time: 0.126883 Jul 24 01:57:11.798989 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3209/6318] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:57:11 2022] DELETE /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:57:11.807852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:11.808656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:11.816945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:11.817499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:11.818414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:11.818939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:11.963075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:11.971414 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa8c6019-aa07-4407-9327-62ed3a89d894 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 200 len: 1690 microversion: 2.1 time: 0.167764 Jul 24 01:57:11.972014 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3110/6319] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:11 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:12.444368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-89cad6fa-8bea-4772-9f19-85d822b324fa req-d9866c1d-121a-47b2-9e79-2e56f8281071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:12.453297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-89cad6fa-8bea-4772-9f19-85d822b324fa req-d9866c1d-121a-47b2-9e79-2e56f8281071 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:12.453780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-89cad6fa-8bea-4772-9f19-85d822b324fa req-d9866c1d-121a-47b2-9e79-2e56f8281071 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:12.465435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-89cad6fa-8bea-4772-9f19-85d822b324fa req-d9866c1d-121a-47b2-9e79-2e56f8281071 service nova] Creating event network-changed:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h1-master-1 Jul 24 01:57:12.470687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-89cad6fa-8bea-4772-9f19-85d822b324fa req-d9866c1d-121a-47b2-9e79-2e56f8281071 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031052 Jul 24 01:57:12.471395 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3210/6320] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:57:12.759920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-03fe36a2-1eb0-450e-9ba4-c9910c3c453d req-0eaa99da-83c2-4a67-9973-55f7ae5d822c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee44544-f185-4c52-879e-c7bd7ca29460", "name": "network-vif-deleted", "tag": "104c6aeb-b11c-4ee0-8190-2b79f1c986eb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:12.776305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-03fe36a2-1eb0-450e-9ba4-c9910c3c453d req-0eaa99da-83c2-4a67-9973-55f7ae5d822c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:12.776927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-03fe36a2-1eb0-450e-9ba4-c9910c3c453d req-0eaa99da-83c2-4a67-9973-55f7ae5d822c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:12.791359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-03fe36a2-1eb0-450e-9ba4-c9910c3c453d req-0eaa99da-83c2-4a67-9973-55f7ae5d822c service nova] Creating event network-vif-deleted:104c6aeb-b11c-4ee0-8190-2b79f1c986eb for instance 1ee44544-f185-4c52-879e-c7bd7ca29460 on n-h1-master-1 Jul 24 01:57:12.796516 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-03fe36a2-1eb0-450e-9ba4-c9910c3c453d req-0eaa99da-83c2-4a67-9973-55f7ae5d822c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040528 Jul 24 01:57:12.797897 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3111/6321] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:57:12.991725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:12.993263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 1ee44544-f185-4c52-879e-c7bd7ca29460] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:13.006957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:13.007419 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:13.008206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:13.008648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:13.022994 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] HTTP exception thrown: Instance 1ee44544-f185-4c52-879e-c7bd7ca29460 could not be found. Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Request method failure captured: Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 HTTP/1.1 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KVUePV44iEzznN_AGm013tPuzitSEnuYqI7R151g-3fwxMLCTiSFAVRkP7_-f2ay4n0r0fCsR957CugnZtLMvDRJDgNqtGfSW-Y6Q7Rgw9mEQbfPe3R1OEc5NObS2fbnG_-FddrCi9sYi9IKWJwdOU3kZyJNWhmkbNudX8vy9YW2Gw Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9cd3d18dd66e4321b11cf7b5fe9a3400", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: ecbfd92ba65f40758afcaf692c8aa33d Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 1ee44544-f185-4c52-879e-c7bd7ca29460 could not be found. Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '1ee44544-f185-4c52-879e-c7bd7ca29460'} Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee44544-f185-4c52-879e-c7bd7ca29460 could not be found. Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee44544-f185-4c52-879e-c7bd7ca29460 could not be found. Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:57:13.024675 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee44544-f185-4c52-879e-c7bd7ca29460 could not be found. Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Returning 404 to user: Instance 1ee44544-f185-4c52-879e-c7bd7ca29460 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-458f6028-9226-45d0-81e1-b72e37aa77b1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460" status: 404 len: 111 microversion: 2.1 time: 0.041414 Jul 24 01:57:13.030132 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3211/6322] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:12 2022] GET /compute/v2.1/servers/1ee44544-f185-4c52-879e-c7bd7ca29460 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:57:16.396600 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bdc23bc9-da50-4315-acf7-7e8cbf11693a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '.version_select at 0x7f05eae305e0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:16.416055 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bdc23bc9-da50-4315-acf7-7e8cbf11693a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1103209731" status: 202 len: 0 microversion: 2.1 time: 0.024887 Jul 24 01:57:16.416804 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3112/6323] 10.222.0.27 () {58 vars in 1283 bytes} [Sun Jul 24 01:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1103209731 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:57:16.447085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-978702f7-a8a5-4c70-aea4-e4f49519f6fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: .version_select at 0x7f05eab5b8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1278082649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK315VjVdhTEedxOx5HhFrfh0vKYNIcJKu+PQnZkZ2no6C1i2TgwhbTOkyZak9FwZ10gpjZF/7s6a/SZO27erulgMyenSe4F6tciZIrEiCND2r0Bfv4c/9EPrmjCwP0HaQ=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:16.463573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-978702f7-a8a5-4c70-aea4-e4f49519f6fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:57:16.470083 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-978702f7-a8a5-4c70-aea4-e4f49519f6fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:57:16.493288 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-978702f7-a8a5-4c70-aea4-e4f49519f6fd tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050263 Jul 24 01:57:16.493927 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3212/6324] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 01:57:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:57:22.446201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1424669396", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "b0411164-35ac-42a5-80ca-602e5e6aeeac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1278082649", "security_groups": [{"name": "tempest-secgroup-smoke-1835345863"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:22.571177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] validate_networks() for [('b0411164-35ac-42a5-80ca-602e5e6aeeac', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 01:57:22.782449 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=14 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:23.006268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:57:23.006713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:57:23.007200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:57:23.007964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:57:23.008395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:57:23.017767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:23.018459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:23.019273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:23.019721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:23.036724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 01:57:23.042408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Getting quotas for user ecbfd92ba65f40758afcaf692c8aa33d and project 9cd3d18dd66e4321b11cf7b5fe9a3400. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 01:57:23.055774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 01:57:23.058205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 01:57:23.109622 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8f795d6f-3c29-4382-a4e8-2e5db5ef84eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.669490 Jul 24 01:57:23.111712 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3113/6325] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:57:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 01:57:23.119624 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:23.126079 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7b57a188-12ac-4da1-ab41-d250b83219e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:23.127027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7b57a188-12ac-4da1-ab41-d250b83219e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:23.132458 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:23.198110 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7b57a188-12ac-4da1-ab41-d250b83219e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:23.205939 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7b57a188-12ac-4da1-ab41-d250b83219e1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1267 microversion: 2.1 time: 0.088009 Jul 24 01:57:23.206534 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3213/6326] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:23 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:24.223934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:24.224728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:24.228431 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:24.241925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:24.242385 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:24.243406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:24.254498 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:24.364441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:24.373497 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-871d8e41-fdcf-4d55-b785-1c52a893848e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1327 microversion: 2.1 time: 0.154210 Jul 24 01:57:24.376892 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3114/6327] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:24 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1327 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:25.394598 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:25.395302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:25.410476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:25.411258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:25.412357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:25.413092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:25.573785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:25.582641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c77a3add-4d94-486d-a46c-4b183543824b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1393 microversion: 2.1 time: 0.192537 Jul 24 01:57:25.586768 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3214/6328] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:25 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1393 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:25.935018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e101895a-e176-49a8-a1b0-41a73b006797 req-03beaa22-e510-49d7-8197-e73f1d9d004c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890275ad-aa94-48d7-9840-20a48720b63a", "tag": "291d96e1-849b-49f5-91eb-727f2649c51f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:25.953950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e101895a-e176-49a8-a1b0-41a73b006797 req-03beaa22-e510-49d7-8197-e73f1d9d004c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:25.954392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e101895a-e176-49a8-a1b0-41a73b006797 req-03beaa22-e510-49d7-8197-e73f1d9d004c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:25.968842 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e101895a-e176-49a8-a1b0-41a73b006797 req-03beaa22-e510-49d7-8197-e73f1d9d004c service nova] Creating event network-changed:291d96e1-849b-49f5-91eb-727f2649c51f for instance 890275ad-aa94-48d7-9840-20a48720b63a on n-h2-master-1 Jul 24 01:57:25.976571 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e101895a-e176-49a8-a1b0-41a73b006797 req-03beaa22-e510-49d7-8197-e73f1d9d004c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046112 Jul 24 01:57:25.977518 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3115/6329] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:57:26.599780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:26.600396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:26.607533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:26.607988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:26.608753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:26.609213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:26.749913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:26.757506 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9d1a689-0287-4100-ab51-7477fb79d024 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1393 microversion: 2.1 time: 0.161685 Jul 24 01:57:26.758106 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3215/6330] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:26 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:27.775886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:27.776601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:27.782941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:27.783401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:27.784173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:27.784625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:27.924842 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:27.932770 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3a27a9ee-f938-4848-8911-a979e6c31b3e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1393 microversion: 2.1 time: 0.161928 Jul 24 01:57:27.933356 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3116/6331] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:27 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:28.950873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:28.951523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:28.958556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:28.959090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:28.959875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:28.960313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:29.099856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:29.107513 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-31cf07a8-80eb-4cb4-b26d-f435a37e16e4 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1393 microversion: 2.1 time: 0.160984 Jul 24 01:57:29.108100 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3216/6332] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:28 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:30.124902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:30.125604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:30.132770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:30.133232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:30.134034 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:30.134483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:30.281620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:30.289164 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ed398acf-4095-4434-827a-ec5bb7485c24 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1393 microversion: 2.1 time: 0.168536 Jul 24 01:57:30.289762 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3117/6333] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:30 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:31.125270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-772c02ef-afb0-4224-afe2-b577f9adf7a6 req-af12cbce-6489-44d9-aa20-1e7587bcf87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890275ad-aa94-48d7-9840-20a48720b63a", "name": "network-vif-plugged", "status": "completed", "tag": "291d96e1-849b-49f5-91eb-727f2649c51f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:31.137929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-772c02ef-afb0-4224-afe2-b577f9adf7a6 req-af12cbce-6489-44d9-aa20-1e7587bcf87e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:31.140156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-772c02ef-afb0-4224-afe2-b577f9adf7a6 req-af12cbce-6489-44d9-aa20-1e7587bcf87e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:31.151869 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-772c02ef-afb0-4224-afe2-b577f9adf7a6 req-af12cbce-6489-44d9-aa20-1e7587bcf87e service nova] Creating event network-vif-plugged:291d96e1-849b-49f5-91eb-727f2649c51f for instance 890275ad-aa94-48d7-9840-20a48720b63a on n-h2-master-1 Jul 24 01:57:31.158145 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-772c02ef-afb0-4224-afe2-b577f9adf7a6 req-af12cbce-6489-44d9-aa20-1e7587bcf87e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038408 Jul 24 01:57:31.158962 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3217/6334] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:57:31.306430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:31.307207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:31.314421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:31.314869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:31.315792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:31.316241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:31.466844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:31.474942 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bfd55d21-c38d-40b4-ac8d-a8224e140058 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1393 microversion: 2.1 time: 0.172459 Jul 24 01:57:31.475648 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3118/6335] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:31 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:32.493248 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:32.493998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:32.500751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:32.501206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:32.502011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:32.502452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:32.633121 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:32.641202 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fad83fc8-e605-43e9-aee9-911f22bfd529 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1393 microversion: 2.1 time: 0.153109 Jul 24 01:57:32.641817 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3218/6336] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:32 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:33.659090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:33.659745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:33.662544 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:33.663277 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:33.670675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:33.671145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:33.671941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:33.672421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:33.808244 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:33.816304 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e33bfcb6-54fa-494b-a4b6-2d4bdd1c10bf tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1564 microversion: 2.1 time: 0.161117 Jul 24 01:57:33.816887 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3119/6337] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:33 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:33.832917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:33.833537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:33.835525 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:33.841686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:33.842148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:33.842918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:33.843360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:33.974463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:33.982528 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f67bee3e-8c5d-4a59-82c8-c3bbed293660 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1564 microversion: 2.1 time: 0.153396 Jul 24 01:57:33.983209 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3219/6338] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:33 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:57:35.894057 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:57:35.894774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:57:35.896218 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e1f7d57a-631b-4797-bfa4-a9aaf894c128 req-303d6744-99ca-4ec7-bf73-788b4c4268a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890275ad-aa94-48d7-9840-20a48720b63a", "tag": "291d96e1-849b-49f5-91eb-727f2649c51f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:57:35.901590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:35.902351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:35.903154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:35.904121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:35.906374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e1f7d57a-631b-4797-bfa4-a9aaf894c128 req-303d6744-99ca-4ec7-bf73-788b4c4268a6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:57:35.907283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e1f7d57a-631b-4797-bfa4-a9aaf894c128 req-303d6744-99ca-4ec7-bf73-788b4c4268a6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:57:35.920373 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e1f7d57a-631b-4797-bfa4-a9aaf894c128 req-303d6744-99ca-4ec7-bf73-788b4c4268a6 service nova] Creating event network-changed:291d96e1-849b-49f5-91eb-727f2649c51f for instance 890275ad-aa94-48d7-9840-20a48720b63a on n-h2-master-1 Jul 24 01:57:35.925860 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e1f7d57a-631b-4797-bfa4-a9aaf894c128 req-303d6744-99ca-4ec7-bf73-788b4c4268a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033405 Jul 24 01:57:35.926752 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3220/6339] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:57:36.061972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:57:36.069641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d650f2ee-5043-46ad-8724-8e201ebdd78b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1564 microversion: 2.1 time: 0.179944 Jul 24 01:57:36.070487 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3120/6340] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:57:35 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:07.363069 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=17 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:07.363817 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=34 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:07.368568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a191040-49a4-4c9f-b14e-136c71e333cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:07.369573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a191040-49a4-4c9f-b14e-136c71e333cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:07.377204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a191040-49a4-4c9f-b14e-136c71e333cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:07.377602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a191040-49a4-4c9f-b14e-136c71e333cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:07.378391 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a191040-49a4-4c9f-b14e-136c71e333cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:07.378829 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a191040-49a4-4c9f-b14e-136c71e333cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:07.445976 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a191040-49a4-4c9f-b14e-136c71e333cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a/action" status: 200 len: 24569 microversion: 2.1 time: 0.085165 Jul 24 01:58:07.446615 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3221/6341] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:58:07 2022] POST /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a/action => generated 24569 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:58:37.638992 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=13 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:37.639763 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=40 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:37.645172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:37.646664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:37.653433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:37.653927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:37.654712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:37.655174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:37.737741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 01:58:37.738180 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 01:58:37.738700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 01:58:37.739127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 01:58:37.739549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 01:58:37.799767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:37.806849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:37.807591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:37.808557 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:37.809172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:37.846074 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15e7f4ee-35de-405d-b4a2-da237871e25e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a/action" status: 202 len: 1137 microversion: 2.1 time: 0.208787 Jul 24 01:58:37.853872 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3121/6342] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:58:37 2022] POST /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a/action => generated 1137 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 24 01:58:37.861530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:37.862544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:37.865153 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:37.865887 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:37.872067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:37.872528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:37.873533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:37.874181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:38.100331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:38.108297 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-54c242fa-11ab-45ab-bc12-62879694ad79 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.251248 Jul 24 01:58:38.108932 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3222/6343] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:37 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:58:38.661650 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:38.662338 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:38.664327 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f989465c-f3f0-43cf-820a-9bd380340451 req-466c0890-fc33-4a37-908d-823bc9554509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646b7091-d79d-49aa-b364-cfa75e8d1623", "tag": "87fdb5b2-1665-40fb-afb2-4ab95ed2073b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:38.670153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:38.670703 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:38.671596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:38.672757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:38.675102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f989465c-f3f0-43cf-820a-9bd380340451 req-466c0890-fc33-4a37-908d-823bc9554509 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:38.675627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f989465c-f3f0-43cf-820a-9bd380340451 req-466c0890-fc33-4a37-908d-823bc9554509 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:38.687541 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f989465c-f3f0-43cf-820a-9bd380340451 req-466c0890-fc33-4a37-908d-823bc9554509 service nova] Creating event network-changed:87fdb5b2-1665-40fb-afb2-4ab95ed2073b for instance 646b7091-d79d-49aa-b364-cfa75e8d1623 on n-h2-master-1 Jul 24 01:58:38.693218 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f989465c-f3f0-43cf-820a-9bd380340451 req-466c0890-fc33-4a37-908d-823bc9554509 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032809 Jul 24 01:58:38.694233 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3223/6344] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 01:58:38.702962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:58:38.793765 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-33fad269-4e02-4afc-af07-af54f56343eb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 204 len: 0 microversion: 2.1 time: 0.135928 Jul 24 01:58:38.794864 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3122/6345] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:58:38 2022] DELETE /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:58:38.803486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:38.804196 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:38.810989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:38.811448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:38.812241 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:38.812719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:38.948918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:38.957225 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-472b7fc0-c18a-4feb-b859-8e34c6291ceb tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1578 microversion: 2.1 time: 0.158048 Jul 24 01:58:38.957839 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3224/6346] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:38 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:39.128612 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:39.129344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:39.135454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:39.135928 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:39.136725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:39.137182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:39.274443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:39.282035 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f66b3e9e-d2b3-46fa-9835-f9d464cf177b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.158516 Jul 24 01:58:39.282827 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3123/6347] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:39 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:39.974680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:39.975306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:39.982293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:39.982753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:39.983525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:39.983980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:40.119208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:40.128825 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-32b1c283-cb89-4c75-850f-bbeeed54f1a9 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1578 microversion: 2.1 time: 0.157943 Jul 24 01:58:40.129429 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3225/6348] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:39 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:40.299680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:40.300314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:40.307032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:40.307492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:40.308288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:40.308822 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:40.445067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:40.452604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-683d1079-9f4b-4621-a6cd-ffd4a0586fc2 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.157428 Jul 24 01:58:40.453173 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3124/6349] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:40 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:41.147135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:41.147760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:41.154874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:41.155331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:41.156111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:41.156550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:41.225524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:41.233811 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3f32c934-4ecd-4de9-8b60-94bbfc37c725 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1393 microversion: 2.1 time: 0.091685 Jul 24 01:58:41.234416 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3226/6350] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:41 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1393 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:41.287877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-533746eb-d0ac-420c-8f2f-0c814a46f345 req-37acb275-f36d-4d87-80b2-9d80a2aac9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646b7091-d79d-49aa-b364-cfa75e8d1623", "name": "network-vif-deleted", "tag": "87fdb5b2-1665-40fb-afb2-4ab95ed2073b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:41.296632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-533746eb-d0ac-420c-8f2f-0c814a46f345 req-37acb275-f36d-4d87-80b2-9d80a2aac9ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:41.296761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-533746eb-d0ac-420c-8f2f-0c814a46f345 req-37acb275-f36d-4d87-80b2-9d80a2aac9ad service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:41.308979 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-533746eb-d0ac-420c-8f2f-0c814a46f345 req-37acb275-f36d-4d87-80b2-9d80a2aac9ad service nova] Creating event network-vif-deleted:87fdb5b2-1665-40fb-afb2-4ab95ed2073b for instance 646b7091-d79d-49aa-b364-cfa75e8d1623 on n-h2-master-1 Jul 24 01:58:41.314196 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-533746eb-d0ac-420c-8f2f-0c814a46f345 req-37acb275-f36d-4d87-80b2-9d80a2aac9ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124417 Jul 24 01:58:41.315528 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3125/6351] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:58:41.470090 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:41.470846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:41.477615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:41.478289 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:41.479211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:41.479774 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:41.628102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:41.637110 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fbe67d36-5464-4a19-8f85-30c123084c27 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.170984 Jul 24 01:58:41.637845 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3227/6352] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:41 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:42.252657 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:42.253371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:42.259927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:42.260399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:42.261193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:42.261648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:42.328435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:42.336816 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-531f92a2-ad9d-4d01-8cf1-b69f3e068a2b tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1226 microversion: 2.1 time: 0.089018 Jul 24 01:58:42.337390 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3126/6353] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:42 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:42.655191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:42.655738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:42.662877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:42.663344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:42.664105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:42.664540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:42.799953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:42.807927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0e833de1-5690-44b3-9e00-55ea4f887e7e tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.156649 Jul 24 01:58:42.808525 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3228/6354] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:42 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:43.353572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:43.354232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:43.361117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:43.362424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:43.363218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:43.363672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:43.429910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:43.437832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2952b03-85fe-4d92-8ca1-67994366cb31 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1226 microversion: 2.1 time: 0.088093 Jul 24 01:58:43.438411 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3127/6355] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:43 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:43.825515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:43.826211 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:43.834536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:43.835019 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:43.835804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:43.836249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:43.977752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:43.985455 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f590d7f-36b6-41af-b6f0-b32ba2940673 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.163909 Jul 24 01:58:43.986078 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3229/6356] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:43 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:44.454598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:44.455981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:44.463188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:44.463655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:44.464445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:44.464896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:44.529615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:44.537553 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d41174ff-6ac0-480d-823d-9bed2d6dd933 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1226 microversion: 2.1 time: 0.087027 Jul 24 01:58:44.538243 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3128/6357] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:44 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:45.004117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:45.004745 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:45.011689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:45.012147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:45.012927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:45.013369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:45.153805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:45.162246 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bad5c68-d766-401b-827d-45601eb66e63 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.163098 Jul 24 01:58:45.163062 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3230/6358] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:44 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:45.555512 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:45.558026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:45.565168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:45.565628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:45.566442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:45.566893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:45.597978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:45.598441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:45.598900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lazy-loading 'fault' on Instance uuid 646b7091-d79d-49aa-b364-cfa75e8d1623 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 01:58:45.643213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:45.651788 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e2d84dc-237c-40a9-a0d8-96031a43ca87 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 200 len: 1231 microversion: 2.1 time: 0.101003 Jul 24 01:58:45.652457 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3129/6359] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:45 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:46.180411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:46.181060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:46.188027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:46.188480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:46.189251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:46.190307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:46.323280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:46.331126 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-56a69b73-cfd9-4cb8-9f6a-4a3d104aaa1b tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.154544 Jul 24 01:58:46.331697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3231/6360] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:46 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:46.669953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:46.670577 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 646b7091-d79d-49aa-b364-cfa75e8d1623] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:46.678164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:46.678625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:46.679400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:46.679847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:46.693007 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 646b7091-d79d-49aa-b364-cfa75e8d1623 could not be found. Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 HTTP/1.1 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 646b7091-d79d-49aa-b364-cfa75e8d1623 could not be found. Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '646b7091-d79d-49aa-b364-cfa75e8d1623'} Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646b7091-d79d-49aa-b364-cfa75e8d1623 could not be found. Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646b7091-d79d-49aa-b364-cfa75e8d1623 could not be found. Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:58:46.694676 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646b7091-d79d-49aa-b364-cfa75e8d1623 could not be found. Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 646b7091-d79d-49aa-b364-cfa75e8d1623 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ae155259-f865-4d10-9c89-e864c117cd84 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623" status: 404 len: 111 microversion: 2.1 time: 0.030200 Jul 24 01:58:46.700412 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3130/6361] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:46 2022] GET /compute/v2.1/servers/646b7091-d79d-49aa-b364-cfa75e8d1623 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:58:47.347713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:47.348469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:47.355272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:47.355742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:47.356531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:47.356979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:47.503707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:47.512254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c2a5a2d7-837d-4f7c-931b-47a65dcccaa1 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.168587 Jul 24 01:58:47.512865 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3232/6362] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:47 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:48.530383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:48.531018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:48.538754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:48.539223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:48.540014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:48.540466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:48.674773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:48.682592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eaf45a82-6cc1-4277-9170-a6e277dec105 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.156157 Jul 24 01:58:48.683166 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3131/6363] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:48 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:49.700579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:49.701123 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:49.709062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:49.709528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:49.710350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:49.710804 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:49.856948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:49.865701 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-81994639-1368-4e4e-978a-da1f88e16be5 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1692 microversion: 2.1 time: 0.169154 Jul 24 01:58:49.866475 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3233/6364] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:49 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:50.883631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:50.884149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:50.891140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:50.891604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:50.892415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:50.893322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:51.029080 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:51.037277 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9f571f41-ef20-4c20-8cda-57712b348999 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1698 microversion: 2.1 time: 0.157730 Jul 24 01:58:51.037872 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3132/6365] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:50 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:52.053921 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:52.054536 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:52.061616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:52.062100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:52.062876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:52.063316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:52.305411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:52.313711 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c029698-fc1c-4fae-aa8a-b729869ea88a tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1698 microversion: 2.1 time: 0.263639 Jul 24 01:58:52.315568 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3234/6366] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:52 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1698 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:52.989619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:52.990171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:52.991301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0960545d-f87c-4ece-917a-7765043bd526 req-e656566f-3bbb-4e03-b3c6-5dec46a75d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f8f56b-3b29-46d2-9c71-a0f18464d41e", "tag": "2de46efc-ffaa-46b4-a700-9ab1c756596a"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:52.997352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:52.997871 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:52.999053 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:52.999512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:52.999867 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0960545d-f87c-4ece-917a-7765043bd526 req-e656566f-3bbb-4e03-b3c6-5dec46a75d40 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:53.000325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0960545d-f87c-4ece-917a-7765043bd526 req-e656566f-3bbb-4e03-b3c6-5dec46a75d40 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:53.015091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0960545d-f87c-4ece-917a-7765043bd526 req-e656566f-3bbb-4e03-b3c6-5dec46a75d40 service nova] Creating event network-changed:2de46efc-ffaa-46b4-a700-9ab1c756596a for instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e on n-h1-master-1 Jul 24 01:58:53.021851 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0960545d-f87c-4ece-917a-7765043bd526 req-e656566f-3bbb-4e03-b3c6-5dec46a75d40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034585 Jul 24 01:58:53.022832 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3235/6367] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:58:53.026760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 01:58:53.067353 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:53.128178 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92aa5626-e72a-4280-894d-e3a17cdc624d tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 204 len: 0 microversion: 2.1 time: 0.142261 Jul 24 01:58:53.134318 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3133/6368] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:58:52 2022] DELETE /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 01:58:53.139575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:53.140808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:53.147778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:53.148546 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:53.149340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:53.149986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:53.309081 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:53.317984 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3fcc36c6-888d-4bdd-a9c1-e517313fcb18 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1577 microversion: 2.1 time: 0.183339 Jul 24 01:58:53.318576 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3236/6369] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:53 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:58:53.332091 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:53.332830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:53.338909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:53.339376 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:53.340164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:53.341553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:53.490337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:53.498783 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52e2a7d9-187c-430c-b81d-dfe7736d2003 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1698 microversion: 2.1 time: 0.170570 Jul 24 01:58:53.501708 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3134/6370] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:53 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:53.561351 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a67a71fe-7244-4024-b480-d66dce91c735 req-69a748c8-fc0b-43ee-8681-d6d53be50be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890275ad-aa94-48d7-9840-20a48720b63a", "name": "network-vif-unplugged", "status": "completed", "tag": "291d96e1-849b-49f5-91eb-727f2649c51f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:53.569567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a67a71fe-7244-4024-b480-d66dce91c735 req-69a748c8-fc0b-43ee-8681-d6d53be50be7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:53.570808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a67a71fe-7244-4024-b480-d66dce91c735 req-69a748c8-fc0b-43ee-8681-d6d53be50be7 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:53.584238 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a67a71fe-7244-4024-b480-d66dce91c735 req-69a748c8-fc0b-43ee-8681-d6d53be50be7 service nova] Creating event network-vif-unplugged:291d96e1-849b-49f5-91eb-727f2649c51f for instance 890275ad-aa94-48d7-9840-20a48720b63a on n-h2-master-1 Jul 24 01:58:53.589237 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a67a71fe-7244-4024-b480-d66dce91c735 req-69a748c8-fc0b-43ee-8681-d6d53be50be7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032920 Jul 24 01:58:53.589876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3237/6371] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:58:54.336633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:54.337368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:54.349650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:54.350544 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:54.351615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:54.352070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:54.517106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:54.517910 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:54.526754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:54.527208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:54.527993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:54.528429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:54.962069 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:54.970237 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8369c85f-9136-47d7-a2e1-bde12316bc78 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1577 microversion: 2.1 time: 0.638162 Jul 24 01:58:54.980103 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3135/6372] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:54 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1577 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:55.020203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:55.030256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d391a91-9bf8-463a-8c6c-d49c8270e300 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1683 microversion: 2.1 time: 0.518316 Jul 24 01:58:55.031357 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3238/6373] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:54 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1683 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 01:58:55.133205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8a81783b-d582-474d-b595-f08286fe66bb req-f71257c2-1cdc-429a-9eea-0faf18c0779f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f8f56b-3b29-46d2-9c71-a0f18464d41e", "name": "network-vif-deleted", "tag": "2de46efc-ffaa-46b4-a700-9ab1c756596a"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:55.142092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8a81783b-d582-474d-b595-f08286fe66bb req-f71257c2-1cdc-429a-9eea-0faf18c0779f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:55.143111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8a81783b-d582-474d-b595-f08286fe66bb req-f71257c2-1cdc-429a-9eea-0faf18c0779f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:55.155016 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8a81783b-d582-474d-b595-f08286fe66bb req-f71257c2-1cdc-429a-9eea-0faf18c0779f service nova] Creating event network-vif-deleted:2de46efc-ffaa-46b4-a700-9ab1c756596a for instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e on n-h1-master-1 Jul 24 01:58:55.160109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8a81783b-d582-474d-b595-f08286fe66bb req-f71257c2-1cdc-429a-9eea-0faf18c0779f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030670 Jul 24 01:58:55.160705 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3136/6374] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:58:55.628486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c27c88d9-38ff-45c2-8364-1cdcb8e3975d req-ab0b25bd-1f5e-4065-b0b2-6b437ad2392f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890275ad-aa94-48d7-9840-20a48720b63a", "name": "network-vif-plugged", "status": "completed", "tag": "291d96e1-849b-49f5-91eb-727f2649c51f"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:58:55.637549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c27c88d9-38ff-45c2-8364-1cdcb8e3975d req-ab0b25bd-1f5e-4065-b0b2-6b437ad2392f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:55.638247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c27c88d9-38ff-45c2-8364-1cdcb8e3975d req-ab0b25bd-1f5e-4065-b0b2-6b437ad2392f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:55.650197 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c27c88d9-38ff-45c2-8364-1cdcb8e3975d req-ab0b25bd-1f5e-4065-b0b2-6b437ad2392f service nova] Creating event network-vif-plugged:291d96e1-849b-49f5-91eb-727f2649c51f for instance 890275ad-aa94-48d7-9840-20a48720b63a on n-h2-master-1 Jul 24 01:58:55.655220 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c27c88d9-38ff-45c2-8364-1cdcb8e3975d req-ab0b25bd-1f5e-4065-b0b2-6b437ad2392f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031146 Jul 24 01:58:55.655936 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3239/6375] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 01:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 01:58:55.989682 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:55.990543 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:55.997133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:55.997601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:55.998459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:55.998908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:56.069995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:56.077909 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3317e423-e9da-426a-b8d9-3374e5fe6597 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1225 microversion: 2.1 time: 0.094032 Jul 24 01:58:56.078487 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3137/6376] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:55 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:57.097119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:57.098030 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:57.104772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:57.105231 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:57.106158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:57.106982 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:57.188397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:57.196843 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-affca42f-bafe-4b22-bc38-93519c05d852 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1225 microversion: 2.1 time: 0.105332 Jul 24 01:58:57.197446 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3240/6377] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:57 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:58.214725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:58.215359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:58.223208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:58.223931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:58.224747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:58.225206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:58.292785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:58.300823 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd1870e7-e7bf-47b9-86a8-3df0d4c47457 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1225 microversion: 2.1 time: 0.089982 Jul 24 01:58:58.301634 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3138/6378] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:58 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:58:59.317064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:58:59.317707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:58:59.324729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:59.325255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:59.326256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:58:59.326681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:58:59.331076 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:59.390774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ad5b8d2523473fa2111be3a6b8523e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e5e1c5805b4c8895ecc39da9838803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 01:58:59.399301 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2930d82-8b14-4b3f-8a9b-d2a29bc45ae7 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 200 len: 1225 microversion: 2.1 time: 0.086186 Jul 24 01:58:59.399961 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3241/6379] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:58:59 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 01:59:00.416755 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:59:00.417316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: b3f8f56b-3b29-46d2-9c71-a0f18464d41e] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:59:00.424972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:00.425587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:00.426403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:00.426850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:00.440205 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e could not be found. Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e HTTP/1.1 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e could not be found. Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b3f8f56b-3b29-46d2-9c71-a0f18464d41e'} Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e could not be found. Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e could not be found. Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:59:00.441974 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e could not be found. Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance b3f8f56b-3b29-46d2-9c71-a0f18464d41e could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b43a7524-d87f-4a72-b42a-8ba9916c1f37 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e" status: 404 len: 111 microversion: 2.1 time: 0.030616 Jul 24 01:59:00.448029 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3139/6380] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:59:00 2022] GET /compute/v2.1/servers/b3f8f56b-3b29-46d2-9c71-a0f18464d41e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:59:00.883294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:59:00.883822 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:59:00.890835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:00.891284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:00.892043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:00.892476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:00.905530 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 HTTP/1.1 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '395aa6a3-d471-4f3f-a112-a5236d6557b4'} Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:59:00.907203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-878fdb79-b39c-41f3-a563-34b531056449 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 404 len: 111 microversion: 2.1 time: 0.029277 Jul 24 01:59:00.913188 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3242/6381] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:59:00 2022] DELETE /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:59:00.917718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:59:00.918346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] [instance: 395aa6a3-d471-4f3f-a112-a5236d6557b4] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:59:00.925148 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:00.925571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:00.926368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:00.926815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:00.939835 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] HTTP exception thrown: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Request method failure captured: Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 HTTP/1.1 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KS-xTH-vlJ5iN9jgDs1FaOL6kCJRQMF3VuBZkP_G8n4xemjD1dbvZgC5Mm4_GtrzcpTixNgx3XdW5CWckfSc-p0lmfXlK3jtWPCCly2atkKkcJ3OymXS3jo1gmFpIIHHvhfhd_tPVQZX417EZNFEzEKenpSqYCzpOJG7R7QbD0hISg Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_03e5e1c5805b4c8895ecc39da9838803", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/03e5e1c5805b4c8895ecc39da9838803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 03e5e1c5805b4c8895ecc39da9838803 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestVolumeBootPattern-405769676 Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 36ad5b8d2523473fa2111be3a6b8523e Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestVolumeBootPattern-405769676-project Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '395aa6a3-d471-4f3f-a112-a5236d6557b4'} Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 01:59:00.941297 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Returning 404 to user: Instance 395aa6a3-d471-4f3f-a112-a5236d6557b4 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3f289c54-9aee-4aa2-b6f9-419a2d84f88e tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4" status: 404 len: 111 microversion: 2.1 time: 0.028888 Jul 24 01:59:00.946555 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3140/6382] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:59:00 2022] GET /compute/v2.1/servers/395aa6a3-d471-4f3f-a112-a5236d6557b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 01:59:04.343756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d9dfb8a-e1de-4abf-9cf6-c1e1410fe265 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] Calling method '.version_select at 0x7f05eab64430>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 01:59:04.370628 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d9dfb8a-e1de-4abf-9cf6-c1e1410fe265 tempest-TestVolumeBootPattern-405769676 tempest-TestVolumeBootPattern-405769676-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1836836593" status: 202 len: 0 microversion: 2.1 time: 0.030865 Jul 24 01:59:04.371359 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3243/6383] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1836836593 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 01:59:29.273011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c8edb131-ac7d-4519-8277-fd979c990dc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 01:59:29.273992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c8edb131-ac7d-4519-8277-fd979c990dc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 01:59:29.276488 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:59:29.277158 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:59:29.283046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8edb131-ac7d-4519-8277-fd979c990dc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:29.284286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8edb131-ac7d-4519-8277-fd979c990dc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:29.285085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8edb131-ac7d-4519-8277-fd979c990dc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 01:59:29.285539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8edb131-ac7d-4519-8277-fd979c990dc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 01:59:29.349001 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c8edb131-ac7d-4519-8277-fd979c990dc3 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "POST /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a/action" status: 200 len: 24569 microversion: 2.1 time: 0.079747 Jul 24 01:59:29.349632 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3141/6384] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 01:59:29 2022] POST /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a/action => generated 24569 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 01:59:52.704482 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 01:59:52.705085 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 01:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:00:00.970820 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:00.972280 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:00.976720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-294470e1-4469-435e-94d3-ca1ba7f5e3ac req-bee7825d-5bf0-45d1-92be-48530c3607fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890275ad-aa94-48d7-9840-20a48720b63a", "tag": "291d96e1-849b-49f5-91eb-727f2649c51f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:00.980833 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:00.981014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:00.981431 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:00.981931 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:00.988523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-294470e1-4469-435e-94d3-ca1ba7f5e3ac req-bee7825d-5bf0-45d1-92be-48530c3607fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:00.988844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:00.989025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-294470e1-4469-435e-94d3-ca1ba7f5e3ac req-bee7825d-5bf0-45d1-92be-48530c3607fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:00.989686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:00.990475 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:00.990917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:01.002324 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-294470e1-4469-435e-94d3-ca1ba7f5e3ac req-bee7825d-5bf0-45d1-92be-48530c3607fc service nova] Creating event network-changed:291d96e1-849b-49f5-91eb-727f2649c51f for instance 890275ad-aa94-48d7-9840-20a48720b63a on n-h2-master-1 Jul 24 02:00:01.007630 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-294470e1-4469-435e-94d3-ca1ba7f5e3ac req-bee7825d-5bf0-45d1-92be-48530c3607fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036369 Jul 24 02:00:01.008541 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3142/6385] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:00:01.019418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:00:01.117619 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff92d0bd-8323-4e6c-9190-e2bb6612d1cc tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 204 len: 0 microversion: 2.1 time: 0.145261 Jul 24 02:00:01.117619 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3244/6386] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:00:00 2022] DELETE /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:00:01.130288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:01.131021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:01.137985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:01.138464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:01.139316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:01.139755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:01.509818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:01.517423 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3951a927-cee8-4ba5-b638-dda27045e4eb tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1689 microversion: 2.1 time: 0.391539 Jul 24 02:00:01.518736 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3143/6387] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:01 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1689 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:02.537291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:02.538059 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:02.544917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:02.545398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:02.546196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:02.546643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:02.819760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecbfd92ba65f40758afcaf692c8aa33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:02.828662 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-72cbca28-d0eb-4121-a890-d635df4cb6f8 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 200 len: 1689 microversion: 2.1 time: 0.296558 Jul 24 02:00:02.829246 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3245/6388] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:02 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 1689 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:03.206275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-717f39e1-088e-4076-882f-86a90b6da834 req-1abf0f40-2d6b-48b8-beb1-05def8d01e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890275ad-aa94-48d7-9840-20a48720b63a", "name": "network-vif-deleted", "tag": "291d96e1-849b-49f5-91eb-727f2649c51f"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:03.218517 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-717f39e1-088e-4076-882f-86a90b6da834 req-1abf0f40-2d6b-48b8-beb1-05def8d01e47 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:03.218981 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-717f39e1-088e-4076-882f-86a90b6da834 req-1abf0f40-2d6b-48b8-beb1-05def8d01e47 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:03.230747 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-717f39e1-088e-4076-882f-86a90b6da834 req-1abf0f40-2d6b-48b8-beb1-05def8d01e47 service nova] Creating event network-vif-deleted:291d96e1-849b-49f5-91eb-727f2649c51f for instance 890275ad-aa94-48d7-9840-20a48720b63a on n-h2-master-1 Jul 24 02:00:03.238314 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-717f39e1-088e-4076-882f-86a90b6da834 req-1abf0f40-2d6b-48b8-beb1-05def8d01e47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Jul 24 02:00:03.239674 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3144/6389] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:03.847138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:03.847753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] [instance: 890275ad-aa94-48d7-9840-20a48720b63a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:03.854659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:03.855117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:03.855885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:03.856322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:03.870538 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] HTTP exception thrown: Instance 890275ad-aa94-48d7-9840-20a48720b63a could not be found. Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Request method failure captured: Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a HTTP/1.1 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KVUePV44iEzznN_AGm013tPuzitSEnuYqI7R151g-3fwxMLCTiSFAVRkP7_-f2ay4n0r0fCsR957CugnZtLMvDRJDgNqtGfSW-Y6Q7Rgw9mEQbfPe3R1OEc5NObS2fbnG_-FddrCi9sYi9IKWJwdOU3kZyJNWhmkbNudX8vy9YW2Gw Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9cd3d18dd66e4321b11cf7b5fe9a3400", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cd3d18dd66e4321b11cf7b5fe9a3400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 9cd3d18dd66e4321b11cf7b5fe9a3400 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1835243826 Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: ecbfd92ba65f40758afcaf692c8aa33d Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1835243826-project Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 890275ad-aa94-48d7-9840-20a48720b63a could not be found. Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '890275ad-aa94-48d7-9840-20a48720b63a'} Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890275ad-aa94-48d7-9840-20a48720b63a could not be found. Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890275ad-aa94-48d7-9840-20a48720b63a could not be found. Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:03.872185 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890275ad-aa94-48d7-9840-20a48720b63a could not be found. Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Returning 404 to user: Instance 890275ad-aa94-48d7-9840-20a48720b63a could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6f16f614-f912-47b0-b630-0693d508f642 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a" status: 404 len: 111 microversion: 2.1 time: 0.030829 Jul 24 02:00:03.878191 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3246/6390] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:03 2022] GET /compute/v2.1/servers/890275ad-aa94-48d7-9840-20a48720b63a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:00:06.855698 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-988c0e67-0e6a-4fa4-a5aa-784a10583c34 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] Calling method '.version_select at 0x7f05e87a1430>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:06.875425 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-988c0e67-0e6a-4fa4-a5aa-784a10583c34 tempest-TestNetworkAdvancedServerOps-1835243826 tempest-TestNetworkAdvancedServerOps-1835243826-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1278082649" status: 202 len: 0 microversion: 2.1 time: 0.026910 Jul 24 02:00:06.876156 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3145/6391] 10.222.0.27 () {58 vars in 1283 bytes} [Sun Jul 24 02:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1278082649 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:00:18.780920 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:18.781658 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:18.897318 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1690385741", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:18.950201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] validate_networks() for None {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:00:19.220608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:00:19.221029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:00:19.221501 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:00:19.221936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:00:19.222408 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:00:19.231449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:19.231898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:19.232693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:19.233129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:19.250250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Getting quotas for project 5debb64ab18d47ed9fc1871bec377ab3. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:00:19.256185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Getting quotas for user b8e2ebfa34c44e2b9096ca600743bb4c and project 5debb64ab18d47ed9fc1871bec377ab3. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:00:19.268723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:00:19.271827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:00:19.316686 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-184063d2-c42d-4f23-bfdf-9102e20f188d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540385 Jul 24 02:00:19.317405 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3247/6392] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:00:19.325845 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=10 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:19.326791 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:19.332379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3fc596c0-223b-4e1e-aa1f-5057041e32b1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:19.333824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3fc596c0-223b-4e1e-aa1f-5057041e32b1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:19.392669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3fc596c0-223b-4e1e-aa1f-5057041e32b1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:19.400084 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3fc596c0-223b-4e1e-aa1f-5057041e32b1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1222 microversion: 2.1 time: 0.076067 Jul 24 02:00:19.400656 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3146/6393] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:19 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:20.417717 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:20.418436 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:20.428769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:20.429431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:20.430397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:20.431056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:20.683950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:20.691640 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e414d4f-cd98-4df0-ac5c-4b2006cdec76 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1280 microversion: 2.1 time: 0.278121 Jul 24 02:00:20.701591 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3248/6394] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:20 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1280 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:21.708675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:21.709206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:21.716332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:21.716798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:21.717583 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:21.718062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:21.926363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:21.934502 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a40e13e1-2ff7-4504-b425-afc0511374d4 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1322 microversion: 2.1 time: 0.229937 Jul 24 02:00:21.935079 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3147/6395] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:21 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:22.290134 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-30f123d1-dc63-4e20-b252-c323aaa3e19c req-4cb3d0db-8628-452c-a693-4f655f838a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2068c68-2e8f-4b04-8c26-8366682b573a", "tag": "2f32f770-dbd0-4f23-8f9e-5868a111f235"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:22.305435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-30f123d1-dc63-4e20-b252-c323aaa3e19c req-4cb3d0db-8628-452c-a693-4f655f838a33 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:22.306336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-30f123d1-dc63-4e20-b252-c323aaa3e19c req-4cb3d0db-8628-452c-a693-4f655f838a33 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:22.318701 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-30f123d1-dc63-4e20-b252-c323aaa3e19c req-4cb3d0db-8628-452c-a693-4f655f838a33 service nova] Creating event network-changed:2f32f770-dbd0-4f23-8f9e-5868a111f235 for instance f2068c68-2e8f-4b04-8c26-8366682b573a on n-h2-master-1 Jul 24 02:00:22.324083 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-30f123d1-dc63-4e20-b252-c323aaa3e19c req-4cb3d0db-8628-452c-a693-4f655f838a33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123957 Jul 24 02:00:22.324702 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3249/6396] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:00:22.951240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:22.951869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:22.959493 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:22.959956 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:22.960739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:22.961187 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:23.091072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:23.098930 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3abc332-19f9-45c4-8852-d2737c488b82 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1322 microversion: 2.1 time: 0.151558 Jul 24 02:00:23.099504 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3148/6397] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:22 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:24.117767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:24.118470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:24.124896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:24.125344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:24.126326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:24.126763 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:24.257537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:24.264984 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f704a354-d5f9-4569-92f0-e93ca39d300e tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1322 microversion: 2.1 time: 0.153152 Jul 24 02:00:24.265550 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3250/6398] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:24 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:25.282620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:25.283252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:25.290767 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:25.291230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:25.292003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:25.292449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:25.426975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:25.434343 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6cbe9d93-f9ac-4f38-a268-26267a03d368 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1322 microversion: 2.1 time: 0.155667 Jul 24 02:00:25.434909 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3149/6399] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:25 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:26.451849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:26.452591 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:26.459964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:26.460413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:26.461182 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:26.461619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:26.597116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:26.604876 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9319953-4491-48e6-84bf-6f509dc92586 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1322 microversion: 2.1 time: 0.156926 Jul 24 02:00:26.605464 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3251/6400] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:26 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:27.622300 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:27.622982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:27.629695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:27.630164 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:27.630937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:27.631383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:27.766623 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:27.774643 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2459d1b2-f825-4c39-823e-a9d9aea720ee tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1322 microversion: 2.1 time: 0.156225 Jul 24 02:00:27.775219 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3150/6401] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:27 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:28.000306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-de8adafe-9efb-4fee-bd7c-9d450ce3456f req-8e8d59fc-ef63-43c5-a895-7c1f8d002292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2068c68-2e8f-4b04-8c26-8366682b573a", "name": "network-vif-plugged", "status": "completed", "tag": "2f32f770-dbd0-4f23-8f9e-5868a111f235"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:28.011975 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-de8adafe-9efb-4fee-bd7c-9d450ce3456f req-8e8d59fc-ef63-43c5-a895-7c1f8d002292 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:28.012743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-de8adafe-9efb-4fee-bd7c-9d450ce3456f req-8e8d59fc-ef63-43c5-a895-7c1f8d002292 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:28.024485 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-de8adafe-9efb-4fee-bd7c-9d450ce3456f req-8e8d59fc-ef63-43c5-a895-7c1f8d002292 service nova] Creating event network-vif-plugged:2f32f770-dbd0-4f23-8f9e-5868a111f235 for instance f2068c68-2e8f-4b04-8c26-8366682b573a on n-h2-master-1 Jul 24 02:00:28.029801 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-de8adafe-9efb-4fee-bd7c-9d450ce3456f req-8e8d59fc-ef63-43c5-a895-7c1f8d002292 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 Jul 24 02:00:28.030686 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3252/6402] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:28.793488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:28.794149 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:28.801893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:28.802374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:28.803173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:28.803628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:28.936686 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:28.944197 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5bd3cd4e-c0b4-4b2c-8ccf-213b89f90985 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1322 microversion: 2.1 time: 0.154612 Jul 24 02:00:28.944768 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3151/6403] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:28 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:29.961914 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:29.962805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:29.965376 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:29.966062 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:29.972885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:29.973332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:29.974126 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:29.974566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.106597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:30.114972 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8b32fc5c-afb3-456f-90e4-8671bb8810c1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1472 microversion: 2.1 time: 0.158088 Jul 24 02:00:30.115669 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3253/6404] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:29 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:30.134754 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:30.190488 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc7bf264-95ab-4778-a912-0d539520cfb3 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Calling method '.version_select at 0x7f05ea2ad280>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:30.256053 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cc7bf264-95ab-4778-a912-0d539520cfb3 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/60ba04c9595f473aae79d3702147a917" status: 200 len: 371 microversion: 2.1 time: 0.125821 Jul 24 02:00:30.256623 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3152/6405] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 02:00:30 2022] GET /compute/v2.1/os-quota-sets/60ba04c9595f473aae79d3702147a917 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:30.266777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f0477813-f50f-454b-ad89-e363efd94146 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1412241857", "id": 1442263215, "os-flavor-access:is_public": "True"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:30.268406 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 02:00:30.268406 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 02:00:30.283160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f0477813-f50f-454b-ad89-e363efd94146 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.020100 Jul 24 02:00:30.283730 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3254/6406] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:00:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:30.294526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1442263215"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:30.295563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:30.302248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.302720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.303510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.303973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.436838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '39f0a3f7659f42df8f865b052ecc1af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ba04c9595f473aae79d3702147a917', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:30.443811 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1412241857 {{(pid=119562) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:00:30.450315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.450788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.451614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.452070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.478876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Getting quotas for project 5debb64ab18d47ed9fc1871bec377ab3. Resources: {'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:00:30.483969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Getting quotas for user b8e2ebfa34c44e2b9096ca600743bb4c and project 5debb64ab18d47ed9fc1871bec377ab3. Resources: {'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:00:30.498185 n-d-master-1 devstack@n-api.service[119562]: INFO nova.compute.api [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] ram quota exceeded for 60ba04c9595f473aae79d3702147a917, tried to resize instance. Jul 24 02:00:30.498745 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Request method failure captured: Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a/action HTTP/1.1 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 39 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KeymaTfNyQbYXAyCUNCbRB5kRuOXM2EHoa3rIPJHsSDk8LpPtD4P86d8a7oALJma0IwMKnBIjVhSEijqI3H0Kzt_mGV9cqyUUpSbiDH0yfU9u-Rs6Sr0HhS74gU8TX5af6eU7kdhbTqzzEQ8g5IvcvhFy68nyRh6Q6XSZ6KwMovs0A Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 60ba04c9595f473aae79d3702147a917 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-365497989 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Role: admin,reader,member Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Roles: admin,reader,member Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60ba04c9595f473aae79d3702147a917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60ba04c9595f473aae79d3702147a917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60ba04c9595f473aae79d3702147a917", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60ba04c9595f473aae79d3702147a917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-365497989 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 60ba04c9595f473aae79d3702147a917 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-365497989 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersAdminNegativeTestJSON-365497989-project-admin Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 39f0a3f7659f42df8f865b052ecc1af5 Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-365497989-project-admin Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: {"resize": {"flavorRef": "1442263215"}} Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f2068c68-2e8f-4b04-8c26-8366682b573a', 'body': {'resize': {'flavorRef': '1442263215'}}} Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:00:30.507773 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-30dc0905-ef17-4ca8-8a33-472cc0dcecae tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a/action" status: 403 len: 118 microversion: 2.1 time: 0.218546 Jul 24 02:00:30.513302 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3153/6407] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:00:30 2022] POST /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a/action => generated 118 bytes in 220 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:00:30.518074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2968b287-b74e-45ea-a211-c9780d06de8b tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:30.518833 n-d-master-1 devstack@n-api.service[119561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 02:00:30.518833 n-d-master-1 devstack@n-api.service[119561]: warnings.warn(msg) Jul 24 02:00:30.534634 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2968b287-b74e-45ea-a211-c9780d06de8b tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1442263215" status: 202 len: 0 microversion: 2.1 time: 0.020268 Jul 24 02:00:30.535748 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3255/6408] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 02:00:30 2022] DELETE /compute/v2.1/flavors/1442263215 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:00:30.543518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-68684cb0-3134-49de-967f-6cc80dffd05a tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:30.562496 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-68684cb0-3134-49de-967f-6cc80dffd05a tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022555 Jul 24 02:00:30.563396 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3154/6409] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 02:00:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:30.580165 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-00103d78-a5a7-4f96-8b3c-3445a1c034ab tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Calling method '.version_select at 0x7f05eacbaca0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:30.648418 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-00103d78-a5a7-4f96-8b3c-3445a1c034ab tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/60ba04c9595f473aae79d3702147a917" status: 200 len: 371 microversion: 2.1 time: 0.071930 Jul 24 02:00:30.648930 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3256/6410] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 02:00:30 2022] GET /compute/v2.1/os-quota-sets/60ba04c9595f473aae79d3702147a917 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:30.658971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee43e968-567e-434a-98a9-8e8ee0207318 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1896927159", "id": 2030251201, "os-flavor-access:is_public": "True"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:30.661788 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 02:00:30.661788 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 02:00:30.677846 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee43e968-567e-434a-98a9-8e8ee0207318 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022578 Jul 24 02:00:30.678419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3155/6411] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:00:30 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:30.689827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2030251201"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:30.690846 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:30.696964 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.697413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.698209 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.698647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.830976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '39f0a3f7659f42df8f865b052ecc1af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ba04c9595f473aae79d3702147a917', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:30.838216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1896927159 {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:00:30.844603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.845048 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.845876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.846316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.867466 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Getting quotas for project 5debb64ab18d47ed9fc1871bec377ab3. Resources: {'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:00:30.872491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Getting quotas for user b8e2ebfa34c44e2b9096ca600743bb4c and project 5debb64ab18d47ed9fc1871bec377ab3. Resources: {'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:00:30.884695 n-d-master-1 devstack@n-api.service[119561]: INFO nova.compute.api [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] cores quota exceeded for 60ba04c9595f473aae79d3702147a917, tried to resize instance. Jul 24 02:00:30.885533 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Request method failure captured: Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a/action HTTP/1.1 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 39 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KeymaTfNyQbYXAyCUNCbRB5kRuOXM2EHoa3rIPJHsSDk8LpPtD4P86d8a7oALJma0IwMKnBIjVhSEijqI3H0Kzt_mGV9cqyUUpSbiDH0yfU9u-Rs6Sr0HhS74gU8TX5af6eU7kdhbTqzzEQ8g5IvcvhFy68nyRh6Q6XSZ6KwMovs0A Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 60ba04c9595f473aae79d3702147a917 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-365497989 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Role: admin,reader,member Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Roles: admin,reader,member Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60ba04c9595f473aae79d3702147a917"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60ba04c9595f473aae79d3702147a917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60ba04c9595f473aae79d3702147a917", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60ba04c9595f473aae79d3702147a917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminNegativeTestJSON-365497989 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 60ba04c9595f473aae79d3702147a917 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-365497989 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminNegativeTestJSON-365497989-project-admin Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 39f0a3f7659f42df8f865b052ecc1af5 Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminNegativeTestJSON-365497989-project-admin Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: {"resize": {"flavorRef": "2030251201"}} Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f2068c68-2e8f-4b04-8c26-8366682b573a', 'body': {'resize': {'flavorRef': '2030251201'}}} Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:00:30.895634 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22c96f86-9d5c-4399-9b9f-8807e2fa31a7 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a/action" status: 403 len: 113 microversion: 2.1 time: 0.211212 Jul 24 02:00:30.904225 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3257/6412] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:00:30 2022] POST /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a/action => generated 113 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:00:30.908908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ad3cd01-49f9-48ee-b4cc-bf494d1bcb74 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:30.908908 n-d-master-1 devstack@n-api.service[119562]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 02:00:30.908908 n-d-master-1 devstack@n-api.service[119562]: warnings.warn(msg) Jul 24 02:00:30.923463 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ad3cd01-49f9-48ee-b4cc-bf494d1bcb74 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2030251201" status: 202 len: 0 microversion: 2.1 time: 0.021418 Jul 24 02:00:30.924017 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3156/6413] 10.222.0.27 () {58 vars in 1160 bytes} [Sun Jul 24 02:00:30 2022] DELETE /compute/v2.1/flavors/2030251201 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:00:30.931810 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-33fa83a0-3bb3-47fe-bdc5-16ef03533293 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:30.950633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-33fa83a0-3bb3-47fe-bdc5-16ef03533293 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022429 Jul 24 02:00:30.951194 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3258/6414] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 02:00:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:30.968283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:30.968808 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:30.975688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.976158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:30.976942 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:30.977396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:31.006780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:00:31.331244 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d3f10559-1913-4f32-a816-6c4c1eb9c162 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 204 len: 0 microversion: 2.1 time: 0.366511 Jul 24 02:00:31.332543 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3157/6415] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:00:30 2022] DELETE /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:00:31.340771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:31.341402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:31.349069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:31.349532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:31.350346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:31.350795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:31.483280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:31.491254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d562fcd4-a15d-40fc-b758-8ea2f7646a2d tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1478 microversion: 2.1 time: 0.154488 Jul 24 02:00:31.491833 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3259/6416] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:31 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1478 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:00:32.509130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:32.509787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:32.517207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:32.517686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:32.518465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:32.518908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:32.656812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:32.665387 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a1dd5ffe-41e8-45d1-a960-7252e9fc5ed1 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1478 microversion: 2.1 time: 0.160572 Jul 24 02:00:32.665973 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3158/6417] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:32 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:33.350316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fd6579c2-efd8-453d-ab7c-2683ca151929 req-c481af48-c0f6-45be-9b0d-5a8ebcfa195f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2068c68-2e8f-4b04-8c26-8366682b573a", "name": "network-vif-deleted", "tag": "2f32f770-dbd0-4f23-8f9e-5868a111f235"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:33.359914 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fd6579c2-efd8-453d-ab7c-2683ca151929 req-c481af48-c0f6-45be-9b0d-5a8ebcfa195f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:33.360362 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fd6579c2-efd8-453d-ab7c-2683ca151929 req-c481af48-c0f6-45be-9b0d-5a8ebcfa195f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:33.379408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fd6579c2-efd8-453d-ab7c-2683ca151929 req-c481af48-c0f6-45be-9b0d-5a8ebcfa195f service nova] Creating event network-vif-deleted:2f32f770-dbd0-4f23-8f9e-5868a111f235 for instance f2068c68-2e8f-4b04-8c26-8366682b573a on n-h2-master-1 Jul 24 02:00:33.384818 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fd6579c2-efd8-453d-ab7c-2683ca151929 req-c481af48-c0f6-45be-9b0d-5a8ebcfa195f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039284 Jul 24 02:00:33.385448 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3260/6418] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:33.682653 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:33.683209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:33.690170 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:33.690694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:33.691483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:33.691938 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:33.723384 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:33.723773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:33.724245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lazy-loading 'fault' on Instance uuid f2068c68-2e8f-4b04-8c26-8366682b573a {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:00:33.766870 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8e2ebfa34c44e2b9096ca600743bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5debb64ab18d47ed9fc1871bec377ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:33.776164 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef8a1b85-7d69-4a22-a103-ca53b50c135c tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 200 len: 1312 microversion: 2.1 time: 0.097268 Jul 24 02:00:33.776630 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3159/6419] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:33 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:34.795064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:34.795765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] [instance: f2068c68-2e8f-4b04-8c26-8366682b573a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:34.802251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:34.802701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:34.803470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:34.803907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:34.817065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] HTTP exception thrown: Instance f2068c68-2e8f-4b04-8c26-8366682b573a could not be found. Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Request method failure captured: Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a HTTP/1.1 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KeyV_ouQ1gnk159Te1PxEDEt3JQ03bPMdGs4vpcXSzAsavRNSEAtvVH4yBIl1JQyXn9xyopR80aOwIO43W6QqlcQj9e80b1q4zvu4j4mzZncPCGwFbF9BQevDbpWt78tbewIx_J0QXVx40YZy9CFEF1VnxMmODgJSm4j2ggKiDzp5Q Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 5debb64ab18d47ed9fc1871bec377ab3 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1936364373 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5debb64ab18d47ed9fc1871bec377ab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5debb64ab18d47ed9fc1871bec377ab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5debb64ab18d47ed9fc1871bec377ab3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5debb64ab18d47ed9fc1871bec377ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1936364373 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 5debb64ab18d47ed9fc1871bec377ab3 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1936364373 Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersAdminNegativeTestJSON-1936364373-project Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b8e2ebfa34c44e2b9096ca600743bb4c Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1936364373-project Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: exception: Instance f2068c68-2e8f-4b04-8c26-8366682b573a could not be found. Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'f2068c68-2e8f-4b04-8c26-8366682b573a'} Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2068c68-2e8f-4b04-8c26-8366682b573a could not be found. Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2068c68-2e8f-4b04-8c26-8366682b573a could not be found. Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:34.819270 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2068c68-2e8f-4b04-8c26-8366682b573a could not be found. Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] Returning 404 to user: Instance f2068c68-2e8f-4b04-8c26-8366682b573a could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-470d5b45-192b-4d8f-8b0d-85c413290839 tempest-ServersAdminNegativeTestJSON-1936364373 tempest-ServersAdminNegativeTestJSON-1936364373-project] 10.222.0.27 "GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a" status: 404 len: 111 microversion: 2.1 time: 0.030946 Jul 24 02:00:34.824777 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3261/6420] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:34 2022] GET /compute/v2.1/servers/f2068c68-2e8f-4b04-8c26-8366682b573a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:00:40.811425 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:40.813449 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:40.934525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1464654768", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "6f010d8e-be3e-4b76-aef5-d64619be294e"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:40.993157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] validate_networks() for [('6f010d8e-be3e-4b76-aef5-d64619be294e', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:00:41.421401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:00:41.421954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:00:41.422450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:00:41.422877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:00:41.423304 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:00:41.433619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:41.434118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:41.434936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:41.435387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:41.453379 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Getting quotas for project a34fd57f6ade4b8aa075b57ceedf9d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:00:41.458981 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Getting quotas for user ee6cfbf69ec74ad1877cd21f10801726 and project a34fd57f6ade4b8aa075b57ceedf9d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:00:41.471838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:00:41.474886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:00:41.523173 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0aa4b1c0-e33a-4ddf-9d2c-3a3d703231d0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717497 Jul 24 02:00:41.524014 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3160/6421] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:00:41.533927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c5c0d143-1cb0-43b3-a7d7-0f8a75296983 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:41.534543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c5c0d143-1cb0-43b3-a7d7-0f8a75296983 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:41.549342 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:41.550665 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:41.615611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c5c0d143-1cb0-43b3-a7d7-0f8a75296983 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:41.624366 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c5c0d143-1cb0-43b3-a7d7-0f8a75296983 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1215 microversion: 2.1 time: 0.094369 Jul 24 02:00:41.625243 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3262/6422] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:41 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:42.642051 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:42.642918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:42.650328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:42.651506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:42.652578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:42.653267 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:42.750267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:42.758388 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8ea4e2f5-f077-4870-8f6f-40bac4b39737 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1273 microversion: 2.1 time: 0.120497 Jul 24 02:00:42.758957 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3161/6423] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:42 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:43.781939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:43.782981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:43.793239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:43.798342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:43.799401 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:43.800081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:44.050843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:44.069058 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7dc03bc-b1d5-4296-8bfa-249c211f0741 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1315 microversion: 2.1 time: 0.296810 Jul 24 02:00:44.069846 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3263/6424] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:43 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:44.158126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-3fba8c2b-3218-4c80-b8c3-ac1d041cec61 req-a3740a54-5dbc-46f8-b995-db8b19669eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004df0a2-b60a-4e45-b8eb-929c4e1d141f", "tag": "01e2d84d-4bbd-4a5f-bba2-d9fadbddb149"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:44.178171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3fba8c2b-3218-4c80-b8c3-ac1d041cec61 req-a3740a54-5dbc-46f8-b995-db8b19669eab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:44.179003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3fba8c2b-3218-4c80-b8c3-ac1d041cec61 req-a3740a54-5dbc-46f8-b995-db8b19669eab service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:44.191730 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-3fba8c2b-3218-4c80-b8c3-ac1d041cec61 req-a3740a54-5dbc-46f8-b995-db8b19669eab service nova] Creating event network-changed:01e2d84d-4bbd-4a5f-bba2-d9fadbddb149 for instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f on n-h2-master-1 Jul 24 02:00:44.198528 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-3fba8c2b-3218-4c80-b8c3-ac1d041cec61 req-a3740a54-5dbc-46f8-b995-db8b19669eab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051263 Jul 24 02:00:44.200052 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3162/6425] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:45.086665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:45.087281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:45.095232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:45.095720 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:45.096446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:45.096882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:45.235029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:45.243884 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88234114-a71f-4beb-a9a3-031dd80c8a80 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1315 microversion: 2.1 time: 0.161127 Jul 24 02:00:45.244469 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3264/6426] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:45 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:46.262638 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:46.263367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:46.269636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:46.270140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:46.270932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:46.271395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:46.401409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:46.408893 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ff102a5-2cf1-4f90-b8f7-4ef904b8255a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1315 microversion: 2.1 time: 0.151426 Jul 24 02:00:46.409484 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3163/6427] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:46 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:47.426045 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:47.426673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:47.434192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:47.434643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:47.435407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:47.435844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:47.567956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:47.576697 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0f283b89-43ca-4bf3-85f4-765124380cd3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1315 microversion: 2.1 time: 0.154617 Jul 24 02:00:47.577276 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3265/6428] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:47 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:48.594506 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:48.595138 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:48.602392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:48.602855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:48.603637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:48.604167 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:48.734909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:48.743372 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-61075321-c1fc-4e63-97a9-7e6d5351e250 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1315 microversion: 2.1 time: 0.152702 Jul 24 02:00:48.743939 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3164/6429] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:48 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:49.759982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:49.760614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:49.763286 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:49.769471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:49.769949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:49.770721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:49.771151 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:49.775176 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=72 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:49.905018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:49.913228 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-342004a1-193f-4b30-ae41-5757f160ec75 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1315 microversion: 2.1 time: 0.157035 Jul 24 02:00:49.913829 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3266/6430] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:49 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:50.146418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-a7efa497-0472-483a-9056-2bbd40640913 req-fde883a7-1cee-481f-8aa0-dfd23c9c0c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004df0a2-b60a-4e45-b8eb-929c4e1d141f", "name": "network-vif-plugged", "status": "completed", "tag": "01e2d84d-4bbd-4a5f-bba2-d9fadbddb149"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:50.151170 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:50.157418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a7efa497-0472-483a-9056-2bbd40640913 req-fde883a7-1cee-481f-8aa0-dfd23c9c0c37 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:50.157902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-a7efa497-0472-483a-9056-2bbd40640913 req-fde883a7-1cee-481f-8aa0-dfd23c9c0c37 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:50.161882 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:50.170870 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-a7efa497-0472-483a-9056-2bbd40640913 req-fde883a7-1cee-481f-8aa0-dfd23c9c0c37 service nova] Creating event network-vif-plugged:01e2d84d-4bbd-4a5f-bba2-d9fadbddb149 for instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f on n-h2-master-1 Jul 24 02:00:50.176488 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-a7efa497-0472-483a-9056-2bbd40640913 req-fde883a7-1cee-481f-8aa0-dfd23c9c0c37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100714 Jul 24 02:00:50.177074 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3165/6431] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:00:50.930206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:50.930833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:50.937762 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:50.938226 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:50.939001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:50.939448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:51.081320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:51.089483 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f1cc711a-a3e8-4144-b560-4c1a36e8df60 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1315 microversion: 2.1 time: 0.163392 Jul 24 02:00:51.090110 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3267/6432] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:50 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:52.105036 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:52.105849 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:52.110561 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:52.111275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:52.121696 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:52.122163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:52.122955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:52.123405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:52.258704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:52.266077 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-17894b15-2f9c-4610-a66c-75d88223c23a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1501 microversion: 2.1 time: 0.162766 Jul 24 02:00:52.266637 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3166/6433] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:52 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:52.282834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:00:52.283863 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:52.285818 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:52.292912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:52.293369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:52.294181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:52.294627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:52.322515 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:52.328322 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:00:52.335100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:00:52.335613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:00:52.336098 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:00:52.336519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:00:52.336938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:00:52.399180 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25a6c09e-f16d-4be2-b1e9-5f839a2aaf2a tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "POST /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f/action" status: 202 len: 0 microversion: 2.1 time: 0.120223 Jul 24 02:00:52.399797 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3268/6434] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:00:52 2022] POST /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:00:52.408050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:52.408696 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:52.416079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:52.416554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:52.417360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:52.417838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:52.552692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:52.561822 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-772db1e3-c226-4eb2-8ac3-ad9d3c4b5c36 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1510 microversion: 2.1 time: 0.157626 Jul 24 02:00:52.562643 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3167/6435] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:52 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:53.581213 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:53.582072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:53.589470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:53.590026 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:53.590837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:53.591288 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:53.733329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:53.742288 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-37de236a-be99-4f2a-9a08-d22f72a779d4 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1510 microversion: 2.1 time: 0.165838 Jul 24 02:00:53.742904 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3269/6436] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:53 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:54.760441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:54.761200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:54.768465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:54.769049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:54.769948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:54.770476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:54.905297 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:54.913454 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf6ac180-0299-4d5a-ac17-ba84cdd3c4ae tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.157202 Jul 24 02:00:54.914073 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3168/6437] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:54 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:55.931277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:55.931901 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:55.938928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:55.939384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:55.940157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:55.940599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:56.076094 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:56.083563 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-551a7ce6-9d35-4a23-8dc0-6510ea1159da tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.156814 Jul 24 02:00:56.084652 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3270/6438] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:55 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:57.101953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:57.102595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:57.109316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:57.109820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:57.110617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:57.111073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:57.249869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:57.257954 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4252eee0-8ffd-49e8-ab4f-629b4c8b403c tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.160594 Jul 24 02:00:57.258537 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3169/6439] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:57 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:58.274101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:58.274767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:58.281599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:58.282081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:58.282843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:58.283276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:58.414998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:00:58.422501 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d3d78b9-aabe-4ae3-8504-d42ce4aea848 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.152532 Jul 24 02:00:58.423077 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3271/6440] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:58 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:00:59.439480 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:00:59.440064 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:00:59.449643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:59.450150 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:59.450951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:00:59.451404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:00:59.996167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:00.003728 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b4e6275a-705b-4713-b928-ff34eccb31df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.568228 Jul 24 02:01:00.013654 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3170/6441] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:00:59 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:01.021281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:01.021932 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:01.029336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:01.029823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:01.030599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:01.031040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:01.167143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:01.175157 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5066fa7e-b6a8-4c63-bd57-16fe7dd8e8a3 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.157622 Jul 24 02:01:01.175676 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3272/6442] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:01 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:02.192230 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:02.192871 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:02.200413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:02.200877 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:02.201649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:02.202120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:02.334195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:02.341937 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-75acd2c1-7c8d-479f-a804-59dc46d8a498 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.153569 Jul 24 02:01:02.342513 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3171/6443] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:02 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:03.359926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:03.360555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:03.370057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:03.370457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:03.371324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:03.371683 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:03.517637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:03.526049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c8e6cee8-8050-4d1f-b991-2f61023a38c0 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.170168 Jul 24 02:01:03.526629 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3273/6444] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:03 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:04.543106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:04.543751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:04.550774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:04.551247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:04.552040 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:04.552497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:04.684245 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:04.691823 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2dbc92a2-bbc7-4da4-b576-476d5b3cd23d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.152710 Jul 24 02:01:04.692389 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3172/6445] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:04 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:05.708675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:05.709192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:05.716901 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:05.717359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:05.718165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:05.718605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:05.852955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:05.860448 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a42bcd6b-d920-4072-9e63-0fe1e0a96039 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.156109 Jul 24 02:01:05.861052 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3274/6446] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:05 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:06.877314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:06.878033 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:06.886047 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:06.886507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:06.887286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:06.887734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:07.021382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:07.029086 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e29be1d4-fe53-425a-98f9-8acb99865de5 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.155815 Jul 24 02:01:07.029665 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3173/6447] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:06 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:08.046787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:08.047385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:08.054692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:08.055158 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:08.055930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:08.056373 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:08.189632 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:08.198193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d1af8918-4fb1-450a-a6f4-498255690736 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.155325 Jul 24 02:01:08.198771 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3275/6448] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:08 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:09.215725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:09.216282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:09.223818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:09.224293 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:09.225599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:09.226325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:09.356302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:09.364104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a52aea7a-04a9-4751-a637-f7fcc3a0d071 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.152372 Jul 24 02:01:09.364679 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3174/6449] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:09 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:10.381093 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:10.382476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:10.389342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:10.389827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:10.390593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:10.391027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:10.522238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:10.529665 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a8591f3b-33e2-4b21-aa30-5886e1f0f52b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.152513 Jul 24 02:01:10.530251 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3276/6450] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:10 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:11.547877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:11.548516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:11.555827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:11.556304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:11.557096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:11.557555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:11.687436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:11.695740 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-689a2c44-7317-4dad-87ad-3b39d02d3971 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.151946 Jul 24 02:01:11.696323 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3175/6451] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:11 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:12.713376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:12.714023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:12.720943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:12.721395 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:12.722201 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:12.722643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:12.850373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:12.858353 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2086590c-2f62-4659-9fbc-fb2b8c828735 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.149901 Jul 24 02:01:12.858926 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3277/6452] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:12 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:13.875028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:13.875658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:13.883831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:13.884294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:13.885152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:13.888216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:14.023428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:14.030949 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1746c57-d764-44be-b1b0-49b90dd6dfa2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.159874 Jul 24 02:01:14.031515 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3176/6453] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:13 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:15.047892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:15.048732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:15.055806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:15.056261 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:15.057031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:15.057468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:15.191350 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:15.199630 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-388fe0e8-5182-4f2a-a859-84c010379767 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.155697 Jul 24 02:01:15.200211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3278/6454] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:15 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:16.217988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:16.218993 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:16.226642 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:16.227105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:16.227892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:16.228341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:16.364400 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:16.372524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d445baaf-1f6e-4ca7-8363-580cd0b52de1 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.159371 Jul 24 02:01:16.373038 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3177/6455] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:16 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:17.389448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:17.390099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:17.397116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:17.398156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:17.399326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:17.399767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:17.548854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:17.557329 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f35764a0-b9ba-4fe8-9090-6848bf2310df tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.171754 Jul 24 02:01:17.557954 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3279/6456] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:17 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:18.574801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:18.575441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:18.583851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:18.584319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:18.585852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:18.586323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:18.722526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:18.730180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-20ef7e8c-3d88-456b-a6f6-af13f88c794e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.159353 Jul 24 02:01:18.730753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3178/6457] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:18 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:19.749494 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:19.750084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:19.757448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:19.757981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:19.758754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:19.759190 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:19.904359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:19.906666 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:19.913411 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-34a59c32-a9e6-4bdc-a10b-ec435650d860 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.168022 Jul 24 02:01:19.914117 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3280/6458] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:19 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:20.931472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:20.932131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:20.939325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:20.939790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:20.940577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:20.941023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:21.083692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:21.092461 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a8ff1f24-e87f-476e-aeed-71db2f7d811b tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1515 microversion: 2.1 time: 0.165728 Jul 24 02:01:21.093167 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3179/6459] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:20 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:22.089329 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-93be36bd-e458-47e8-bd7c-e3fa17b7509e req-cb6ae757-a6aa-48d9-b413-fa981bcde531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004df0a2-b60a-4e45-b8eb-929c4e1d141f", "name": "network-vif-unplugged", "status": "completed", "tag": "01e2d84d-4bbd-4a5f-bba2-d9fadbddb149"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:22.095233 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=34 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:22.101300 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-93be36bd-e458-47e8-bd7c-e3fa17b7509e req-cb6ae757-a6aa-48d9-b413-fa981bcde531 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:22.101746 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-93be36bd-e458-47e8-bd7c-e3fa17b7509e req-cb6ae757-a6aa-48d9-b413-fa981bcde531 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:22.110059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:22.110742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:22.119974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:22.120712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:22.122392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:22.123043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:22.124400 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-93be36bd-e458-47e8-bd7c-e3fa17b7509e req-cb6ae757-a6aa-48d9-b413-fa981bcde531 service nova] Creating event network-vif-unplugged:01e2d84d-4bbd-4a5f-bba2-d9fadbddb149 for instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f on n-h1-master-1 Jul 24 02:01:22.132409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-93be36bd-e458-47e8-bd7c-e3fa17b7509e req-cb6ae757-a6aa-48d9-b413-fa981bcde531 service nova] Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:01:22.147928 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=86 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:22.150251 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-93be36bd-e458-47e8-bd7c-e3fa17b7509e req-cb6ae757-a6aa-48d9-b413-fa981bcde531 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065994 Jul 24 02:01:22.151380 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3281/6460] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:01:22.273687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:22.286209 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59e1cbd7-5c2c-4afa-b10e-ab7bce6b675d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1514 microversion: 2.1 time: 0.180004 Jul 24 02:01:22.286969 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3180/6461] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:22 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:01:23.304696 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:23.305403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:23.312647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:23.313103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:23.313902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:23.314354 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:23.446208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:23.453739 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-34e92602-7fa0-4e5a-ab50-621742d16af6 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1512 microversion: 2.1 time: 0.153458 Jul 24 02:01:23.454322 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3282/6462] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:23 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:24.182499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-33e2aec2-75f6-4ee0-a831-c5675b5947b4 req-a60f1be2-1950-4e44-8d9a-69b7cd505e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004df0a2-b60a-4e45-b8eb-929c4e1d141f", "tag": "01e2d84d-4bbd-4a5f-bba2-d9fadbddb149"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:24.186889 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=32 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:24.192621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-33e2aec2-75f6-4ee0-a831-c5675b5947b4 req-a60f1be2-1950-4e44-8d9a-69b7cd505e6c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:24.193088 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-33e2aec2-75f6-4ee0-a831-c5675b5947b4 req-a60f1be2-1950-4e44-8d9a-69b7cd505e6c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:24.204539 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-33e2aec2-75f6-4ee0-a831-c5675b5947b4 req-a60f1be2-1950-4e44-8d9a-69b7cd505e6c service nova] Creating event network-changed:01e2d84d-4bbd-4a5f-bba2-d9fadbddb149 for instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f on n-h1-master-1 Jul 24 02:01:24.210064 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-33e2aec2-75f6-4ee0-a831-c5675b5947b4 req-a60f1be2-1950-4e44-8d9a-69b7cd505e6c service nova] Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:01:24.220883 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-33e2aec2-75f6-4ee0-a831-c5675b5947b4 req-a60f1be2-1950-4e44-8d9a-69b7cd505e6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042622 Jul 24 02:01:24.221543 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3181/6463] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:01:24.472047 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:24.472908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:24.481225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:24.481989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:24.482834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:24.483282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:24.711987 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:24.720101 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-76221fa1-fb0c-4666-8bf0-09141537591d tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1509 microversion: 2.1 time: 0.251919 Jul 24 02:01:24.720815 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3283/6464] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:24 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:24.737747 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:24.738627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:24.745923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:24.746389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:24.747182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:24.747830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:24.776689 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:01:24.830104 n-d-master-1 devstack@n-api.service[119562]: INFO nova.compute.api [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Found an unconfirmed migration during delete, id: 16, status: finished Jul 24 02:01:26.249019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-642604da-88c7-4af7-8fe6-ee04ba928fe9 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "DELETE /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 204 len: 0 microversion: 2.1 time: 1.515239 Jul 24 02:01:26.249757 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3182/6465] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:01:24 2022] DELETE /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 0 bytes in 1517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:01:26.259699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:26.260259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:26.266583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:26.266906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:26.267674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:26.268113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:26.398072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:26.405491 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e36bc628-1795-4697-a365-8016d149411f tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1501 microversion: 2.1 time: 0.151748 Jul 24 02:01:26.406093 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3284/6466] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:26 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:27.423720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:27.424435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:27.431765 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:27.432223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:27.432994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:27.433442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:27.574661 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6cfbf69ec74ad1877cd21f10801726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:27.582366 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6cbe4390-7cfc-49a3-8c34-cc6684e316c2 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 200 len: 1501 microversion: 2.1 time: 0.163029 Jul 24 02:01:27.582948 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3183/6467] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:27 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:28.026399 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e37a698a-88e8-44ff-8dfc-206824f0310d req-8a3a4690-875d-4307-a2f5-61190ba3fb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004df0a2-b60a-4e45-b8eb-929c4e1d141f", "name": "network-vif-deleted", "tag": "01e2d84d-4bbd-4a5f-bba2-d9fadbddb149"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:28.044481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e37a698a-88e8-44ff-8dfc-206824f0310d req-8a3a4690-875d-4307-a2f5-61190ba3fb95 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:28.044941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e37a698a-88e8-44ff-8dfc-206824f0310d req-8a3a4690-875d-4307-a2f5-61190ba3fb95 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:28.057894 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e37a698a-88e8-44ff-8dfc-206824f0310d req-8a3a4690-875d-4307-a2f5-61190ba3fb95 service nova] Creating event network-vif-deleted:01e2d84d-4bbd-4a5f-bba2-d9fadbddb149 for instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f on n-h1-master-1 Jul 24 02:01:28.063215 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e37a698a-88e8-44ff-8dfc-206824f0310d req-8a3a4690-875d-4307-a2f5-61190ba3fb95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041366 Jul 24 02:01:28.067659 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3285/6468] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:01:28.599796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:28.600595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:28.607510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:28.607976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:28.608758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:28.609238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:28.622690 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] HTTP exception thrown: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Request method failure captured: Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f HTTP/1.1 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KfIiSKax3h5H5HP753yroe7ZhB9x_-WUusKrJ4jZ1x49WUlZyUro5LeRuLiKg-X2QJJwOsyFSMpC1Sl2H9umZvfXEMZkevoG1dcKhjzorMy5j-9hUXuJQ3Ktd8NbPd8_BzQ8Ra9moJa7Mez0Qdr2rsvCSdh5i0pJV58iHcoOPBhBXw Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a34fd57f6ade4b8aa075b57ceedf9d5d Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a34fd57f6ade4b8aa075b57ceedf9d5d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a34fd57f6ade4b8aa075b57ceedf9d5d Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-1181603777-project Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: ee6cfbf69ec74ad1877cd21f10801726 Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-1181603777-project Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '004df0a2-b60a-4e45-b8eb-929c4e1d141f'} Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:01:28.624342 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Returning 404 to user: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-11a11f18-58ab-476c-aa64-5ceb43cae3bd tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 404 len: 111 microversion: 2.1 time: 0.029912 Jul 24 02:01:28.630044 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3184/6469] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:28 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:01:28.641073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:28.641659 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:28.648786 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:28.649238 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:28.650021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:28.650456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:28.666608 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] HTTP exception thrown: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Request method failure captured: Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f HTTP/1.1 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KfIiSKax3h5H5HP753yroe7ZhB9x_-WUusKrJ4jZ1x49WUlZyUro5LeRuLiKg-X2QJJwOsyFSMpC1Sl2H9umZvfXEMZkevoG1dcKhjzorMy5j-9hUXuJQ3Ktd8NbPd8_BzQ8Ra9moJa7Mez0Qdr2rsvCSdh5i0pJV58iHcoOPBhBXw Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: a34fd57f6ade4b8aa075b57ceedf9d5d Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a34fd57f6ade4b8aa075b57ceedf9d5d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: a34fd57f6ade4b8aa075b57ceedf9d5d Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-DeleteServersTestJSON-1181603777-project Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: ee6cfbf69ec74ad1877cd21f10801726 Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-DeleteServersTestJSON-1181603777-project Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '004df0a2-b60a-4e45-b8eb-929c4e1d141f'} Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:01:28.668238 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Returning 404 to user: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cea45144-53a4-4e62-9ba6-60f9d490c961 tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "DELETE /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 404 len: 111 microversion: 2.1 time: 0.032844 Jul 24 02:01:28.673254 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3286/6470] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:01:28 2022] DELETE /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:01:28.679515 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:28.680156 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] [instance: 004df0a2-b60a-4e45-b8eb-929c4e1d141f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:28.686299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:28.686777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:28.687570 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:28.688037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:28.702101 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] HTTP exception thrown: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Request method failure captured: Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f HTTP/1.1 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KfIiSKax3h5H5HP753yroe7ZhB9x_-WUusKrJ4jZ1x49WUlZyUro5LeRuLiKg-X2QJJwOsyFSMpC1Sl2H9umZvfXEMZkevoG1dcKhjzorMy5j-9hUXuJQ3Ktd8NbPd8_BzQ8Ra9moJa7Mez0Qdr2rsvCSdh5i0pJV58iHcoOPBhBXw Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: a34fd57f6ade4b8aa075b57ceedf9d5d Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a34fd57f6ade4b8aa075b57ceedf9d5d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34fd57f6ade4b8aa075b57ceedf9d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: a34fd57f6ade4b8aa075b57ceedf9d5d Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1181603777 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-DeleteServersTestJSON-1181603777-project Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: ee6cfbf69ec74ad1877cd21f10801726 Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-DeleteServersTestJSON-1181603777-project Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '004df0a2-b60a-4e45-b8eb-929c4e1d141f'} Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:01:28.703767 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] Returning 404 to user: Instance 004df0a2-b60a-4e45-b8eb-929c4e1d141f could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d693b390-e341-419a-8aa8-7724317c443e tempest-DeleteServersTestJSON-1181603777 tempest-DeleteServersTestJSON-1181603777-project] 10.222.0.27 "GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f" status: 404 len: 111 microversion: 2.1 time: 0.029653 Jul 24 02:01:28.709453 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3185/6471] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:28 2022] GET /compute/v2.1/servers/004df0a2-b60a-4e45-b8eb-929c4e1d141f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:01:37.540447 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2090398316", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2356d471-49be-47ce-93b5-e3c5a6a5c90b"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:37.594278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] validate_networks() for [('2356d471-49be-47ce-93b5-e3c5a6a5c90b', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:01:37.965450 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:01:37.965909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:01:37.966547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:01:37.966957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:01:37.967366 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:01:37.977023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:37.977476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:37.978335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:37.978780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:37.997201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Getting quotas for project 017ae15508e74480a8c6ced05bf424df. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:01:38.002511 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Getting quotas for user 0c2a363c5ed84a84b2e4f00c8aa3b34f and project 017ae15508e74480a8c6ced05bf424df. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:01:38.015555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:01:38.017879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:01:38.064431 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e4cc275a-54b2-497b-93e6-4083c27bd060 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648018 Jul 24 02:01:38.065089 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3287/6472] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:01:38.075428 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e0b40408-7719-4ddf-8939-906f9dd250df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:38.076222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e0b40408-7719-4ddf-8939-906f9dd250df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:38.136754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e0b40408-7719-4ddf-8939-906f9dd250df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:38.143612 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e0b40408-7719-4ddf-8939-906f9dd250df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1218 microversion: 2.1 time: 0.071928 Jul 24 02:01:38.153042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3186/6473] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:38 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:01:39.161894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:39.164420 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:39.175504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:39.176191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:39.177647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:39.178175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:39.247684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:39.256046 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-07e23ef6-c17c-4d96-a45a-2a2dcf2c1c45 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1276 microversion: 2.1 time: 0.098387 Jul 24 02:01:39.256939 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3288/6474] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:39 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:40.276552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:40.277957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:40.285861 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:40.288469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:40.289247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:40.290279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:40.290832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:40.455309 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:40.464937 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fb0bcc41-1163-40d3-82ba-6ae4a95dda76 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1318 microversion: 2.1 time: 0.194685 Jul 24 02:01:40.466072 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3187/6475] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:40 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:40.539245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-bfcec94a-dd57-4a3a-aea6-bd746aae99fa req-417d41ef-a321-47c0-993b-bcc449cc44b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8752192f-7f03-4c01-947c-e20a62bc1a91", "tag": "efcb4291-2ece-4b43-b8cc-6a32097ae9e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:40.550718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bfcec94a-dd57-4a3a-aea6-bd746aae99fa req-417d41ef-a321-47c0-993b-bcc449cc44b2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:40.551224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-bfcec94a-dd57-4a3a-aea6-bd746aae99fa req-417d41ef-a321-47c0-993b-bcc449cc44b2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:40.568796 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-bfcec94a-dd57-4a3a-aea6-bd746aae99fa req-417d41ef-a321-47c0-993b-bcc449cc44b2 service nova] Creating event network-changed:efcb4291-2ece-4b43-b8cc-6a32097ae9e3 for instance 8752192f-7f03-4c01-947c-e20a62bc1a91 on n-h1-master-1 Jul 24 02:01:40.587964 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-bfcec94a-dd57-4a3a-aea6-bd746aae99fa req-417d41ef-a321-47c0-993b-bcc449cc44b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052551 Jul 24 02:01:40.589193 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3289/6476] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:01:41.482168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:41.482810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:41.490060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:41.491039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:41.491830 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:41.492290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:41.625316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:41.632944 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d6b3dfd-e3c2-4e0d-83ad-b0641eb85a01 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1318 microversion: 2.1 time: 0.154694 Jul 24 02:01:41.633505 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3188/6477] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:41 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:42.651476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:42.652173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:42.659383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:42.659861 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:42.660723 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:42.661157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:42.791154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:42.798553 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-962cbff2-a15c-41e0-9150-2db29a2db396 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1318 microversion: 2.1 time: 0.152369 Jul 24 02:01:42.799129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3290/6478] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:42 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:43.815405 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:43.816049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:43.823695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:43.824175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:43.824968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:43.825429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:43.959470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:43.967601 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3350f82-17f3-4184-ae34-e53e67981c7f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1318 microversion: 2.1 time: 0.156146 Jul 24 02:01:43.968185 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3189/6479] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:43 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:44.984528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:44.985141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:44.993234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:44.993738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:44.994506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:44.994946 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:45.125867 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:45.133491 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0a5d9605-573a-457a-b704-29515933dba5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1318 microversion: 2.1 time: 0.152833 Jul 24 02:01:45.134093 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3291/6480] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:44 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:46.150209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:46.151176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:46.157931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:46.158389 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:46.159172 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:46.159707 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:46.219496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9c4c7201-617d-428e-bb68-e406d4b2eed9 req-00592b19-75e4-40f3-ab01-c6e8ce59074e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8752192f-7f03-4c01-947c-e20a62bc1a91", "name": "network-vif-plugged", "status": "completed", "tag": "efcb4291-2ece-4b43-b8cc-6a32097ae9e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:46.232336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9c4c7201-617d-428e-bb68-e406d4b2eed9 req-00592b19-75e4-40f3-ab01-c6e8ce59074e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:46.232827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9c4c7201-617d-428e-bb68-e406d4b2eed9 req-00592b19-75e4-40f3-ab01-c6e8ce59074e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:46.245071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9c4c7201-617d-428e-bb68-e406d4b2eed9 req-00592b19-75e4-40f3-ab01-c6e8ce59074e service nova] Creating event network-vif-plugged:efcb4291-2ece-4b43-b8cc-6a32097ae9e3 for instance 8752192f-7f03-4c01-947c-e20a62bc1a91 on n-h1-master-1 Jul 24 02:01:46.250191 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9c4c7201-617d-428e-bb68-e406d4b2eed9 req-00592b19-75e4-40f3-ab01-c6e8ce59074e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035400 Jul 24 02:01:46.250969 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3292/6481] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:01:46.307311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:46.315261 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e1ff3d8-c9c7-458a-ac71-c9efa809c34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1318 microversion: 2.1 time: 0.169536 Jul 24 02:01:46.315778 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3190/6482] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:46 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:47.333767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:47.334481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:47.341537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:47.342036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:47.342845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:47.343290 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:47.479538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:47.487183 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24a60809-6692-4c43-b083-d20496474deb tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1318 microversion: 2.1 time: 0.158550 Jul 24 02:01:47.487767 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3293/6483] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:47 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:48.504429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:48.505119 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:48.508626 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:48.514241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.514711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:48.515496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.515945 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:48.650127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:48.657720 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-460772ea-0e8a-46c4-a1ce-612d61228ba3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1507 microversion: 2.1 time: 0.157225 Jul 24 02:01:48.658291 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3191/6484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:48 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:48.674077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:48.674623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:48.676586 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:48.677271 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:48.684973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.685424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:48.686217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.686654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:48.821495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:48.829049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f305191-8d20-49e1-8d7e-a7f6e448600a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1507 microversion: 2.1 time: 0.159030 Jul 24 02:01:48.829628 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3294/6485] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:48 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:48.845023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-98ae5487-56a0-43ea-9b81-0e98ef9fdc6c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:48.846247 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-98ae5487-56a0-43ea-9b81-0e98ef9fdc6c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:48.852505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98ae5487-56a0-43ea-9b81-0e98ef9fdc6c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.852968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98ae5487-56a0-43ea-9b81-0e98ef9fdc6c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:48.853777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98ae5487-56a0-43ea-9b81-0e98ef9fdc6c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.854227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-98ae5487-56a0-43ea-9b81-0e98ef9fdc6c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:48.916919 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-98ae5487-56a0-43ea-9b81-0e98ef9fdc6c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "PUT /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1079 microversion: 2.1 time: 0.075753 Jul 24 02:01:48.917598 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3192/6486] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 02:01:48 2022] PUT /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1079 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:48.932103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:48.932682 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:48.938789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.939265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:48.940032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:48.940476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:49.070466 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:49.078160 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-04395d1c-4d6f-4d98-8f57-a8873e68bf69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1505 microversion: 2.1 time: 0.150440 Jul 24 02:01:49.078911 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3295/6487] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:48 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:49.094190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:49.094830 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:49.100859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:49.101996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:49.102792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:49.103252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:49.238986 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:49.246671 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-69e57b21-0fa9-4ee0-8633-4cfff352f862 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1505 microversion: 2.1 time: 0.156444 Jul 24 02:01:49.247243 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3193/6488] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:49 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:49.263687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:01:49.264686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:49.270952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:49.271416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:49.272187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:49.272631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:49.300975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:49.307440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Old instance type m1.heat2, new instance type m1.heat {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:01:49.313817 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:01:49.314247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:01:49.314725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:01:49.315135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:01:49.315547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:01:49.379569 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-351fabdc-6e03-4784-8cda-542f408a711f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "POST /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91/action" status: 202 len: 0 microversion: 2.1 time: 0.119857 Jul 24 02:01:49.380362 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3296/6489] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:01:49 2022] POST /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 02:01:49.389059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:49.389799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:49.400525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:49.401368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:49.402855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:49.403815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:49.541430 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:49.549036 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dbc4c338-b95d-442e-834d-479e73c53453 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1516 microversion: 2.1 time: 0.163962 Jul 24 02:01:49.549606 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3194/6490] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:49 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:50.567635 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:50.568257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:50.574981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:50.575439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:50.576887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:50.577379 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:50.724266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:50.734139 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff2120fd-037b-4577-befb-5c710a6ebd0f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1516 microversion: 2.1 time: 0.171491 Jul 24 02:01:50.734759 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3297/6491] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:50 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:51.752121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:51.752753 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:51.759848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:51.760314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:51.761094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:51.761545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:51.899226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:51.906898 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80ae99b2-2dcf-4b3b-8f8e-7af1ebe6b34d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.158653 Jul 24 02:01:51.907476 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3195/6492] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:51 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:52.924265 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:52.924886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:52.927675 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:52.934904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:52.935359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:52.936120 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:52.936557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:52.940609 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:53.074015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:53.081499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eaccc20b-cc87-458f-855e-74b55a2c6971 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.161127 Jul 24 02:01:53.082101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3298/6493] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:52 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:54.098904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:54.099559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:54.106619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:54.107086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:54.107892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:54.108340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:54.242437 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:54.250086 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee3929fc-dc16-40c6-8837-13e2ebff0670 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.155236 Jul 24 02:01:54.250687 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3196/6494] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:54 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:55.268235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:55.268757 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:55.276447 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:55.276898 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:55.277665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:55.278125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:55.415567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:55.423298 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-19a7d01c-0a9b-4e04-8cf8-59b1f5bf9104 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.159143 Jul 24 02:01:55.423882 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3299/6495] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:55 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:56.440406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:56.440996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:56.443699 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:56.449125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:56.449590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:56.450392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:56.450844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:56.583856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:56.592027 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-440c8407-4309-4eef-8e6e-6c52c2fa814a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.155637 Jul 24 02:01:56.592603 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3197/6496] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:56 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:57.609270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:57.609920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:57.617875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:57.618332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:57.619107 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:57.619551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:57.751084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:57.758909 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bde89e4d-6884-4bdd-bb56-22d080ae3500 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.153608 Jul 24 02:01:57.759479 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3300/6497] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:57 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:58.776054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:58.776690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:58.783511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:58.783976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:58.784749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:58.785199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:58.920271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:01:58.927714 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5dc605a6-3ca8-47a9-99c4-707f30b1b414 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.155617 Jul 24 02:01:58.928288 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3198/6498] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:58 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:01:59.944514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:01:59.946136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:01:59.953005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:59.953487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:01:59.954296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:01:59.954734 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:00.085161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:00.092923 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4c31ee4-9f55-48fe-a27f-64fd48e2e908 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.152477 Jul 24 02:02:00.093500 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3301/6499] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:01:59 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:01.110042 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:01.110797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:01.118472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:01.118949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:01.119780 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:01.120210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:01.255702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:01.263832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1586430-8edf-45c1-b02c-c5bc9594797b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.157805 Jul 24 02:02:01.264406 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3199/6500] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:01 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:02.280827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:02.281474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:02.289245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:02.289724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:02.290503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:02.290951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:02.420398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:02.428003 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8263fae-7457-4297-b60d-95237f3d013a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.151136 Jul 24 02:02:02.428573 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3302/6501] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:02 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:03.444958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:03.445752 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:03.452618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:03.453079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:03.453897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:03.454345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:03.592743 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:03.600460 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6370897e-02ed-455b-9985-56ef247ddae8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.159946 Jul 24 02:02:03.601165 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3200/6502] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:03 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:04.618320 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:04.619002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:04.626377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:04.626835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:04.627609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:04.628053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:04.764911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:04.772412 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a44a84a7-63c6-4529-842f-a79806fb0357 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.158053 Jul 24 02:02:04.772986 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3303/6503] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:04 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:05.790255 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:05.790886 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:05.798983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:05.799444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:05.800344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:05.800797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:05.932231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:05.939865 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f905b4f4-1c97-420d-a5a7-6c7c34ac57cf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.153621 Jul 24 02:02:05.940437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3201/6504] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:05 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:06.957041 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:06.957755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:06.964854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:06.965306 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:06.966101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:06.966925 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:07.099056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:07.106620 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-76a40db7-d931-454e-83ee-fb5d343a96f5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.153571 Jul 24 02:02:07.107785 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3304/6505] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:06 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:08.124415 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:08.125126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:08.132185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:08.132660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:08.133454 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:08.134013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:08.263049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:08.267179 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:08.272074 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-86854fac-6980-400b-90fc-a8f91e1afc81 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.151641 Jul 24 02:02:08.272651 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3202/6506] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:08 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:09.289336 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:09.289998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:09.297064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:09.297522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:09.298323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:09.298767 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:09.430982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:09.438537 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f842f4f6-f46f-4f2d-8789-320e3053e1f2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.153161 Jul 24 02:02:09.439106 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3305/6507] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:09 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:10.456723 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:10.457362 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:10.464651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:10.465125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:10.465939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:10.467158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:10.597531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:10.605042 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7409e18e-42cd-4279-bed2-546996b6c218 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.153377 Jul 24 02:02:10.605611 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3203/6508] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:10 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:11.623855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:11.624479 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:11.631607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:11.632061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:11.632832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:11.633275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:11.767397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:11.774943 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d106ddec-9112-473b-8724-ad5325ea9a1f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.155994 Jul 24 02:02:11.775521 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3306/6509] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:11 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:12.792251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:12.792884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:12.799993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:12.800463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:12.801248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:12.801725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:12.932681 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:12.940792 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1281b50b-5cc4-4f38-b93e-d9bd0dc9efdf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.152439 Jul 24 02:02:12.941319 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3204/6510] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:12 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:13.957782 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:13.958405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:13.965398 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:13.965901 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:13.967303 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:13.967744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:14.096195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:14.104318 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-971e222c-d4a9-481b-968b-0375f509965c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.150572 Jul 24 02:02:14.104893 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3307/6511] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:13 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:15.122001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:15.122663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:15.129925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:15.130399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:15.131194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:15.131651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:15.264968 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:15.272578 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-23e15693-9698-473e-834e-a492a8b5ea4a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.154520 Jul 24 02:02:15.273149 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3205/6512] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:15 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:16.290178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:16.290801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:16.298465 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:16.298919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:16.299694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:16.300139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:16.431837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:16.439444 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a5f77f6-7add-48a9-aeb6-f4a6dbf92511 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.153185 Jul 24 02:02:16.440025 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3308/6513] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:16 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:17.457295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:17.457912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:17.464808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:17.465276 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:17.466270 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:17.467244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:17.597637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:17.605177 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d0d97b5b-6278-4a2f-bd61-c9d075ca490e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.151927 Jul 24 02:02:17.605776 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3206/6514] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:17 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:18.623567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:18.624181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:18.631079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:18.631525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:18.632286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:18.632725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:18.765186 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:18.772684 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-91ba4e75-a310-4a6c-9094-3948a1e6e739 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.153660 Jul 24 02:02:18.773255 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3309/6515] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:18 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:19.790586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:19.791213 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:19.799177 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:19.799640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:19.800414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:19.800859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:19.933719 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:19.941941 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92307d77-b489-427e-8fe3-c6886b831de9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.155234 Jul 24 02:02:19.942512 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3207/6516] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:19 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:20.959990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:20.960391 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:20.967766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:20.968224 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:20.969073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:20.969490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:21.112288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:21.120182 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd696a18-d400-4650-ab34-c5def0d944ff tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.164737 Jul 24 02:02:21.121144 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3310/6517] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:20 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:22.137694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:22.138387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:22.145278 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:22.145770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:22.146546 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:22.146997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:22.280398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:22.289019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c40fe72b-1f42-4132-969b-3e27fbe0324a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1521 microversion: 2.1 time: 0.155201 Jul 24 02:02:22.289606 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3208/6518] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:22 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:23.306544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:23.307188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:23.310612 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=26 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:23.316349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:23.316815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:23.317755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:23.318045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:23.322984 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=78 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:23.516465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:23.524059 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d80faca9-4a17-4c10-8f0b-c8383824145b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1520 microversion: 2.1 time: 0.221568 Jul 24 02:02:23.524644 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3311/6519] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:23 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:23.825634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-44d7e325-e99f-406f-8906-0a029a2fec00 req-c880b6fd-b193-4e81-b847-44d145dd591a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8752192f-7f03-4c01-947c-e20a62bc1a91", "name": "network-vif-unplugged", "status": "completed", "tag": "efcb4291-2ece-4b43-b8cc-6a32097ae9e3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:23.835684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-44d7e325-e99f-406f-8906-0a029a2fec00 req-c880b6fd-b193-4e81-b847-44d145dd591a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:23.836146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-44d7e325-e99f-406f-8906-0a029a2fec00 req-c880b6fd-b193-4e81-b847-44d145dd591a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:23.848282 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-44d7e325-e99f-406f-8906-0a029a2fec00 req-c880b6fd-b193-4e81-b847-44d145dd591a service nova] Creating event network-vif-unplugged:efcb4291-2ece-4b43-b8cc-6a32097ae9e3 for instance 8752192f-7f03-4c01-947c-e20a62bc1a91 on n-h2-master-1 Jul 24 02:02:23.854178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-44d7e325-e99f-406f-8906-0a029a2fec00 req-c880b6fd-b193-4e81-b847-44d145dd591a service nova] Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:02:23.867201 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-44d7e325-e99f-406f-8906-0a029a2fec00 req-c880b6fd-b193-4e81-b847-44d145dd591a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045532 Jul 24 02:02:23.867963 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3209/6520] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:02:24.541352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:24.541998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:24.549253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:24.549742 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:24.550522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:24.550960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:24.694819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:24.703989 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f638337d-2387-450a-81a1-d7e60862b7a2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1520 microversion: 2.1 time: 0.166623 Jul 24 02:02:24.704874 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3312/6521] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:24 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:25.722681 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:25.723435 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:25.729759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:25.730235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:25.731019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:25.732243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:25.868667 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:25.876506 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-80223fb7-ad77-4771-8719-7681b3ee4584 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1518 microversion: 2.1 time: 0.159040 Jul 24 02:02:25.877195 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3210/6522] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:25 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:25.882254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c2849e9f-3f31-4a63-9281-b10f4be8b5d1 req-428d711f-c4fb-4d39-9620-e8e1d4e9b235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8752192f-7f03-4c01-947c-e20a62bc1a91", "tag": "efcb4291-2ece-4b43-b8cc-6a32097ae9e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:25.891439 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c2849e9f-3f31-4a63-9281-b10f4be8b5d1 req-428d711f-c4fb-4d39-9620-e8e1d4e9b235 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:25.891882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c2849e9f-3f31-4a63-9281-b10f4be8b5d1 req-428d711f-c4fb-4d39-9620-e8e1d4e9b235 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:25.903067 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c2849e9f-3f31-4a63-9281-b10f4be8b5d1 req-428d711f-c4fb-4d39-9620-e8e1d4e9b235 service nova] Creating event network-changed:efcb4291-2ece-4b43-b8cc-6a32097ae9e3 for instance 8752192f-7f03-4c01-947c-e20a62bc1a91 on n-h2-master-1 Jul 24 02:02:25.908944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-c2849e9f-3f31-4a63-9281-b10f4be8b5d1 req-428d711f-c4fb-4d39-9620-e8e1d4e9b235 service nova] Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:02:25.919900 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c2849e9f-3f31-4a63-9281-b10f4be8b5d1 req-428d711f-c4fb-4d39-9620-e8e1d4e9b235 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041272 Jul 24 02:02:25.920487 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3313/6523] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:02:26.893261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:26.893921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:26.896810 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=28 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:26.902449 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:26.902981 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:26.904325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:26.904787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:27.038919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:27.047133 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-13ba596e-d275-497f-af31-aa7d2c588eef tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1518 microversion: 2.1 time: 0.157869 Jul 24 02:02:27.047706 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3211/6524] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:26 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:02:28.066326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:28.066978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:28.073235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:28.073707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:28.074471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:28.074908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:28.209861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:28.218675 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c841495c-a3e7-44a7-a327-96e6455f930d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1515 microversion: 2.1 time: 0.157901 Jul 24 02:02:28.219255 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3314/6525] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:28 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:28.234921 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04c41501-110f-4417-875b-9b567847c6f9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:28.235524 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04c41501-110f-4417-875b-9b567847c6f9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:28.242605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c41501-110f-4417-875b-9b567847c6f9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:28.243081 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c41501-110f-4417-875b-9b567847c6f9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:28.243875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c41501-110f-4417-875b-9b567847c6f9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:28.244333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04c41501-110f-4417-875b-9b567847c6f9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:28.301298 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04c41501-110f-4417-875b-9b567847c6f9 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "POST /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91/action" status: 204 len: 0 microversion: 2.1 time: 0.070312 Jul 24 02:02:28.301956 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3212/6526] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:02:28 2022] POST /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:02:28.310778 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:28.311417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:28.317709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:28.318043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:28.318903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:28.319397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:28.454434 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:28.462082 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5d5b3d79-976d-4592-a32d-a39a468ebfa2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1515 microversion: 2.1 time: 0.155831 Jul 24 02:02:28.462663 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3315/6527] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:28 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:28.737699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-350e533e-7c18-4d2f-8f8d-4e12cec1395b req-6da4cb71-c7bf-4e91-b3e3-f2d0fe68b6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8752192f-7f03-4c01-947c-e20a62bc1a91", "name": "network-vif-plugged", "status": "completed", "tag": "efcb4291-2ece-4b43-b8cc-6a32097ae9e3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:28.750658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-350e533e-7c18-4d2f-8f8d-4e12cec1395b req-6da4cb71-c7bf-4e91-b3e3-f2d0fe68b6fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:28.751129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-350e533e-7c18-4d2f-8f8d-4e12cec1395b req-6da4cb71-c7bf-4e91-b3e3-f2d0fe68b6fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:28.764401 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-350e533e-7c18-4d2f-8f8d-4e12cec1395b req-6da4cb71-c7bf-4e91-b3e3-f2d0fe68b6fb service nova] Creating event network-vif-plugged:efcb4291-2ece-4b43-b8cc-6a32097ae9e3 for instance 8752192f-7f03-4c01-947c-e20a62bc1a91 on n-h2-master-1 Jul 24 02:02:28.770368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-350e533e-7c18-4d2f-8f8d-4e12cec1395b req-6da4cb71-c7bf-4e91-b3e3-f2d0fe68b6fb service nova] Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:02:28.781811 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-350e533e-7c18-4d2f-8f8d-4e12cec1395b req-6da4cb71-c7bf-4e91-b3e3-f2d0fe68b6fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049268 Jul 24 02:02:28.782587 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3213/6528] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:02:29.479217 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:29.480565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:29.487461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:29.488173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:29.489234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:29.489698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:29.627565 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:29.635085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d896e93e-6b6c-44fb-93e6-baaa711782ca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1507 microversion: 2.1 time: 0.159695 Jul 24 02:02:29.635661 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3316/6529] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:29 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:29.652701 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:29.653924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:29.660191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:29.660659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:29.661441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:29.661922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:29.799377 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:29.806975 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbaba5cf-ca04-402e-bd65-6ec15d9a0eee tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1507 microversion: 2.1 time: 0.159410 Jul 24 02:02:29.807552 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3214/6530] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:29 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:29.826824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0160a861-0761-40ab-8aa2-aea3e0a611c0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'create', calling method: .version_select at 0x7f05ea2f1e50>, body: {"keypair": {"name": "tempest-keypair-94600061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEk0der9LaFJSZ0klK0EFtXrVoMlKvMSGl5wV8PpcbCF7sKBMJNGgmgZdtgsI9t+3O89AacAd+xiP/leyss7WbB+B6LnjPESbvytLnCDz3cEYc4rWFyJIzUsEDNRfSuFMQ=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:29.840727 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-0160a861-0761-40ab-8aa2-aea3e0a611c0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Getting quotas for project 017ae15508e74480a8c6ced05bf424df. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:02:29.845940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-0160a861-0761-40ab-8aa2-aea3e0a611c0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Getting quotas for user 0c2a363c5ed84a84b2e4f00c8aa3b34f and project 017ae15508e74480a8c6ced05bf424df. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:02:29.871184 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0160a861-0761-40ab-8aa2-aea3e0a611c0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048392 Jul 24 02:02:29.874246 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3317/6531] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:02:29 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:02:31.353133 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:31.353825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:31.361076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:31.361543 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:31.362377 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:31.362836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:31.494676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:31.502807 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ee9fba6-5c6d-4a8a-8121-d8dbbb6fc45c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 200 len: 1507 microversion: 2.1 time: 0.153678 Jul 24 02:02:31.503376 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3215/6532] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:31 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:31.520122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:31.520633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:31.527279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:31.527727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:31.529006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:31.529530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:31.553845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:02:31.628255 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d48c4d49-292f-4dd8-a422-873efbb0dc6b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 204 len: 0 microversion: 2.1 time: 0.112528 Jul 24 02:02:31.628881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3318/6533] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:02:31 2022] DELETE /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:02:31.685594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-18471772", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "2356d471-49be-47ce-93b5-e3c5a6a5c90b"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:31.736477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] validate_networks() for [('2356d471-49be-47ce-93b5-e3c5a6a5c90b', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:02:32.106762 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:02:32.107197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:02:32.107688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:02:32.108107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:02:32.108530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:02:32.118571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:32.119032 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:32.119840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:32.120483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:32.137471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Getting quotas for project 017ae15508e74480a8c6ced05bf424df. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:02:32.143467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Getting quotas for user 0c2a363c5ed84a84b2e4f00c8aa3b34f and project 017ae15508e74480a8c6ced05bf424df. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:02:32.155833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:02:32.158148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:02:32.202042 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bae3edf5-9824-4845-bc7a-51fa210a189b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520205 Jul 24 02:02:32.202621 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3216/6534] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:02:32.213235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-460b14c5-4bdb-4e50-a18f-6f626b15d384 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:32.213990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-460b14c5-4bdb-4e50-a18f-6f626b15d384 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:32.269236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-460b14c5-4bdb-4e50-a18f-6f626b15d384 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:32.276049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-460b14c5-4bdb-4e50-a18f-6f626b15d384 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1216 microversion: 2.1 time: 0.067063 Jul 24 02:02:32.276620 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3319/6535] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:32 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:33.295393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:33.296142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:33.303279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:33.303756 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:33.304554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:33.305010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:33.381990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:33.390573 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c040dde-1f08-4b38-8d87-9d1411ded34b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1268 microversion: 2.1 time: 0.100899 Jul 24 02:02:33.390993 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3217/6536] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:33 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:02:33.757561 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-13f057b1-580f-4bd5-9270-024b03afcccb req-c072bb04-c4b5-4d67-87f3-8e1a61d74b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8752192f-7f03-4c01-947c-e20a62bc1a91", "name": "network-vif-deleted", "tag": "efcb4291-2ece-4b43-b8cc-6a32097ae9e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:33.775853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-13f057b1-580f-4bd5-9270-024b03afcccb req-c072bb04-c4b5-4d67-87f3-8e1a61d74b82 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:33.776323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-13f057b1-580f-4bd5-9270-024b03afcccb req-c072bb04-c4b5-4d67-87f3-8e1a61d74b82 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:33.790101 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-13f057b1-580f-4bd5-9270-024b03afcccb req-c072bb04-c4b5-4d67-87f3-8e1a61d74b82 service nova] Creating event network-vif-deleted:efcb4291-2ece-4b43-b8cc-6a32097ae9e3 for instance 8752192f-7f03-4c01-947c-e20a62bc1a91 on n-h2-master-1 Jul 24 02:02:33.796595 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-13f057b1-580f-4bd5-9270-024b03afcccb req-c072bb04-c4b5-4d67-87f3-8e1a61d74b82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042858 Jul 24 02:02:33.797564 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3320/6537] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:02:34.408916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:34.409636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:34.420369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:34.420834 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:34.421636 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:34.422109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:34.556834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:34.565555 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5735cf9b-0575-4113-b107-23ea1e24a544 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.160599 Jul 24 02:02:34.566175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3218/6538] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:34 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:34.845437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-52b7b5ff-8366-49fc-b7fd-ae75cdd65883 req-d55feec6-f542-42dd-9ccf-211d6b5c8dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d219bce9-a31b-43a2-949a-89f1ba959edd", "tag": "04e2a83a-d50e-45e9-95a7-86cbd8dfa673"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:34.858435 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-52b7b5ff-8366-49fc-b7fd-ae75cdd65883 req-d55feec6-f542-42dd-9ccf-211d6b5c8dc1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:34.858887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-52b7b5ff-8366-49fc-b7fd-ae75cdd65883 req-d55feec6-f542-42dd-9ccf-211d6b5c8dc1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:34.875927 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-52b7b5ff-8366-49fc-b7fd-ae75cdd65883 req-d55feec6-f542-42dd-9ccf-211d6b5c8dc1 service nova] Creating event network-changed:04e2a83a-d50e-45e9-95a7-86cbd8dfa673 for instance d219bce9-a31b-43a2-949a-89f1ba959edd on n-h2-master-1 Jul 24 02:02:34.880712 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-52b7b5ff-8366-49fc-b7fd-ae75cdd65883 req-d55feec6-f542-42dd-9ccf-211d6b5c8dc1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046426 Jul 24 02:02:34.881346 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3321/6539] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:02:35.583804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:35.584445 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:35.591665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:35.592136 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:35.592941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:35.593401 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:35.723356 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:35.725844 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:35.733398 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-71f67e39-b5e4-4ee6-98bc-3f9d7dd57008 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.153666 Jul 24 02:02:35.734003 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3219/6540] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:35 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:36.752465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:36.753173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:36.759629 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:36.760093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:36.760863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:36.761305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:36.890509 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:36.897918 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-daf35d1e-e0ff-4b13-9290-703a6a6909b4 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.151063 Jul 24 02:02:36.898607 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3322/6541] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:36 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:37.915306 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:37.915937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:37.924138 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:37.924609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:37.925394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:37.925891 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:38.060916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:38.068607 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6e8710a6-15c0-40d8-889e-ca584966f855 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.157588 Jul 24 02:02:38.069188 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3220/6542] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:37 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:39.085694 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:39.086321 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:39.093983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:39.094441 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:39.095215 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:39.095657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:39.225202 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:39.233358 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-38e943a2-b814-4b5f-beb0-4f62208fa847 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.151647 Jul 24 02:02:39.233959 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3323/6543] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:39 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:40.251554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:40.252222 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:40.259073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:40.259540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:40.260327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:40.260781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:40.395146 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:40.402674 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1b76d9e-4c64-4cde-890f-a9bfad5d16b6 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.156166 Jul 24 02:02:40.404350 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3221/6544] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:40 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:41.420457 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:41.421060 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:41.428030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:41.428482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:41.429240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:41.429699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:41.558551 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:41.566658 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e90992b1-4563-4b9b-950c-7e2fb9c7c8d3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.150229 Jul 24 02:02:41.567236 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3324/6545] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:41 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:42.583845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:42.584507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:42.587324 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:42.588055 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:42.594749 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:42.595220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:42.596013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:42.597451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:42.731057 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:42.739102 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9851b2d1-8c2c-4196-b507-37be0eced1f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.158937 Jul 24 02:02:42.739680 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3222/6546] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:42 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:42.762690 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ee89b6ab-d5b2-4e6d-8ba7-941979ce8678 req-b6483c46-2c6b-4831-af7c-e7166f7d3f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d219bce9-a31b-43a2-949a-89f1ba959edd", "name": "network-vif-plugged", "status": "completed", "tag": "04e2a83a-d50e-45e9-95a7-86cbd8dfa673"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:42.766745 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:42.776509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ee89b6ab-d5b2-4e6d-8ba7-941979ce8678 req-b6483c46-2c6b-4831-af7c-e7166f7d3f5e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:42.776957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ee89b6ab-d5b2-4e6d-8ba7-941979ce8678 req-b6483c46-2c6b-4831-af7c-e7166f7d3f5e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:42.790737 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ee89b6ab-d5b2-4e6d-8ba7-941979ce8678 req-b6483c46-2c6b-4831-af7c-e7166f7d3f5e service nova] Creating event network-vif-plugged:04e2a83a-d50e-45e9-95a7-86cbd8dfa673 for instance d219bce9-a31b-43a2-949a-89f1ba959edd on n-h2-master-1 Jul 24 02:02:42.796629 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ee89b6ab-d5b2-4e6d-8ba7-941979ce8678 req-b6483c46-2c6b-4831-af7c-e7166f7d3f5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038051 Jul 24 02:02:42.797238 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3325/6547] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:02:43.756393 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:43.757020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:43.764725 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:43.765181 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:43.765980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:43.766429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:43.899845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:43.907913 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f689fbce-a47e-4229-a4f0-afa1c89bec3a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1316 microversion: 2.1 time: 0.155406 Jul 24 02:02:43.908485 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3223/6548] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:43 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:44.925628 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:44.926356 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:44.933473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:44.934054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:44.934820 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:44.935252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:45.063088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:45.070613 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2790acd-2a59-439d-9dda-e49c03525695 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1506 microversion: 2.1 time: 0.149317 Jul 24 02:02:45.071181 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3326/6549] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:44 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:45.086858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:45.087491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:45.095184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:45.095704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:45.096488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:45.096936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:45.563060 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:45.570793 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e4f5a27-814d-477e-b410-46eb308271f8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1506 microversion: 2.1 time: 0.487893 Jul 24 02:02:45.571364 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3224/6550] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:45 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:45.588838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:02:45.589950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:45.596991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:45.597446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:45.598247 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:45.598688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:45.629888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:45.635595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Old instance type m1.heat2, new instance type m1.heat {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:02:45.642695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:02:45.643121 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:02:45.643597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:02:45.644003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:02:45.644413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:02:45.712051 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e1d92a34-73a0-4f2f-8f4c-47dee637786b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "POST /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd/action" status: 202 len: 0 microversion: 2.1 time: 0.127613 Jul 24 02:02:45.712619 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3327/6551] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:02:45 2022] POST /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:02:45.720792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:45.721436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:45.727432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:45.727916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:45.728719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:45.729176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:45.862019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:45.869800 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-773ca7e1-2d3e-4e22-98f7-b294d6e0ad5c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1513 microversion: 2.1 time: 0.152884 Jul 24 02:02:45.870377 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3225/6552] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:45 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:46.891463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:46.892087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:46.898523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:46.899011 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:46.899791 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:46.900216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:47.039444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:47.047021 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30fd0380-959b-4968-9d60-9a1da9919de5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1513 microversion: 2.1 time: 0.162580 Jul 24 02:02:47.047599 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3328/6553] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:46 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:48.064599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:48.065229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:48.072282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:48.072746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:48.073523 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:48.073996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:48.204711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:48.212202 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-06fc4964-0649-4c5f-a23c-9b301280990f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.151607 Jul 24 02:02:48.212768 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3226/6554] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:48 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:02:49.230058 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:49.231178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:49.238155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:49.238865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:49.239635 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:49.240076 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:49.242746 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:49.373597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:49.381052 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-48a2c299-e2b4-480b-846c-a6511e04fde2 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.154991 Jul 24 02:02:49.381627 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3329/6555] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:49 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:50.398130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:50.398688 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:50.405730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:50.406199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:50.406977 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:50.407429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:50.539704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:50.547829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4dae9c47-8b81-4091-8395-2698faef1ad0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.153708 Jul 24 02:02:50.548410 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3227/6556] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:50 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:51.565092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:51.565764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:51.572795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:51.573251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:51.574103 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:51.575082 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:51.707563 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:51.715151 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-285b423e-f1a2-4778-b2ce-74520146d0df tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.153831 Jul 24 02:02:51.715812 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3330/6557] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:51 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:52.732089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:52.732728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:52.740043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:52.740513 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:52.741297 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:52.741784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:52.872777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:52.880547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0e7928e-81b5-4fca-8636-a467f6ae520a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.153159 Jul 24 02:02:52.881124 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3228/6558] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:52 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:53.897568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:53.898233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:53.901007 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:53.907086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:53.907542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:53.908315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:53.908757 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:54.039122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:54.047209 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9977194a-c322-434d-a69f-6a5230c67e69 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.153570 Jul 24 02:02:54.047782 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3331/6559] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:53 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:55.064745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:55.065382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:55.072350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:55.072825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:55.073613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:55.074098 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:55.210814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:55.218622 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ee8d7267-3d2b-40e4-887d-eed497a2f96e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.157906 Jul 24 02:02:55.219926 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3229/6560] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:55 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:56.236412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:56.237025 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:56.244320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:56.244768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:56.245522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:56.246044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:56.376063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:56.383502 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5f142bb-aa62-403b-bc49-0eb2b65f6dca tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.150972 Jul 24 02:02:56.384076 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3332/6561] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:56 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:57.401014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:57.401648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:57.404073 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:57.410630 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:57.411096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:57.411876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:57.412326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:57.546935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:57.554542 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ac47af3-8072-44ac-883e-9125612dcb8f tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.158121 Jul 24 02:02:57.555123 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3230/6562] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:57 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:58.572441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:58.573056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:58.580961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:58.581412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:58.582207 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:58.582643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:58.714197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:58.722067 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed95a8c4-a49e-4046-9302-dc5737209b38 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.153529 Jul 24 02:02:58.722658 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3333/6563] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:58 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:02:59.739687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:02:59.740307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:02:59.748459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:59.748927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:59.749731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:02:59.750185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:02:59.888325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:02:59.896123 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-20f93046-42bb-4c49-92d9-10ddd6f92ac3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.160616 Jul 24 02:02:59.896742 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3231/6564] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:02:59 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:00.913915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:00.914528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:00.921262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:00.921738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:00.922502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:00.922940 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:01.055538 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:01.064347 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69369dbc-4843-4576-a6a4-85ccd1af20a5 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.154541 Jul 24 02:03:01.064916 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3334/6565] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:00 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:02.081414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:02.082067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:02.089058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:02.089629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:02.091283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:02.091741 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:02.222725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:02.230571 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0d05c9e0-f744-4948-8bd6-2fde7d4f9d51 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.153025 Jul 24 02:03:02.231397 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3232/6566] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:02 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:03.248432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:03.248971 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:03.255892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:03.256344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:03.257102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:03.257536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:03.390708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:03.398429 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-706cd54f-e965-4b6e-a656-b769fa578a65 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.154050 Jul 24 02:03:03.399017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3335/6567] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:03 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:04.416851 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:04.417387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:04.425854 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:04.426319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:04.427111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:04.427564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:04.573190 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:04.587727 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-83f77d37-3538-4418-b647-9c74de2ec7c8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.171409 Jul 24 02:03:04.588349 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3233/6568] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:04 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:05.605897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:05.606520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:05.613327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:05.614097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:05.614872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:05.615323 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:05.749168 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:05.756631 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-25703536-b8c7-4d12-9a27-79a0fb57ba4c tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.154885 Jul 24 02:03:05.757244 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3336/6569] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:05 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:06.773621 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:06.774271 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:06.781899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:06.782364 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:06.783141 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:06.783589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:06.912228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:06.920556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4e1e74ef-d0a0-4573-8a6e-c270afc21da0 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.150853 Jul 24 02:03:06.921122 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3234/6570] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:06 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:07.938063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:07.938675 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:07.945690 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:07.946153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:07.946912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:07.947346 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:08.075254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:08.082787 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a673513-e6f2-4636-bc83-937d8da890bc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.149277 Jul 24 02:03:08.083368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3337/6571] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:07 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:09.099856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:09.100567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:09.107762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:09.108225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:09.109001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:09.109450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:09.112051 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=92 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:09.244708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:09.253048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9547b796-b131-437a-9be5-a6a159a4889a tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.157093 Jul 24 02:03:09.253644 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3235/6572] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:09 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:10.270089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:10.270704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:10.278088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:10.279161 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:10.279934 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:10.280371 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:10.408965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:10.416483 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c95434b-5092-4b2d-b6d1-a7ac6114dd05 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.150249 Jul 24 02:03:10.417057 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3338/6573] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:10 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:11.434141 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:11.435411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:11.442302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:11.442768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:11.443548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:11.443998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:11.577049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:11.584633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-00d5eec2-73d2-45e0-a579-0cdc9231e0ce tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.154423 Jul 24 02:03:11.585210 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3236/6574] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:11 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:12.204512 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:03:12.204699 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:03:12.602906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:12.603540 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:12.611334 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:12.611782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:12.612618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:12.613055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:12.745780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:12.753320 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf4fb27e-f658-41c6-9840-832238240454 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.154364 Jul 24 02:03:12.753925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3339/6575] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:12 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:13.770297 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:13.770933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:13.778057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:13.779174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:13.779996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:13.780453 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:13.916269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:13.924588 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-841eda44-d5e3-479d-9d01-cf1eca9f3fbf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1518 microversion: 2.1 time: 0.158211 Jul 24 02:03:13.925166 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3237/6576] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:13 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:14.942365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:14.943578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:14.943735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d4020b43-26b7-48e4-92a8-3d19dca9b2de req-76c10268-b357-4a92-9013-bc588e893176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d219bce9-a31b-43a2-949a-89f1ba959edd", "name": "network-vif-unplugged", "status": "completed", "tag": "04e2a83a-d50e-45e9-95a7-86cbd8dfa673"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:14.951692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:14.952586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:14.953591 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:14.954090 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:14.954610 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d4020b43-26b7-48e4-92a8-3d19dca9b2de req-76c10268-b357-4a92-9013-bc588e893176 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:14.955204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d4020b43-26b7-48e4-92a8-3d19dca9b2de req-76c10268-b357-4a92-9013-bc588e893176 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:14.969285 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d4020b43-26b7-48e4-92a8-3d19dca9b2de req-76c10268-b357-4a92-9013-bc588e893176 service nova] Creating event network-vif-unplugged:04e2a83a-d50e-45e9-95a7-86cbd8dfa673 for instance d219bce9-a31b-43a2-949a-89f1ba959edd on n-h1-master-1 Jul 24 02:03:14.975159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-d4020b43-26b7-48e4-92a8-3d19dca9b2de req-76c10268-b357-4a92-9013-bc588e893176 service nova] Instance d219bce9-a31b-43a2-949a-89f1ba959edd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:03:14.987502 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d4020b43-26b7-48e4-92a8-3d19dca9b2de req-76c10268-b357-4a92-9013-bc588e893176 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047634 Jul 24 02:03:14.989291 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3238/6577] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:03:15.108546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:15.129007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9b45992a-abac-4a1c-b40b-e205d9ef3e62 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1517 microversion: 2.1 time: 0.190786 Jul 24 02:03:15.129606 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3340/6578] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:14 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:03:16.148529 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:16.149251 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:16.155810 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:16.156282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:16.157068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:16.157547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:16.291172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:16.299832 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-915ebc46-dc8c-410a-a132-e3fdb677f39b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1515 microversion: 2.1 time: 0.156542 Jul 24 02:03:16.300409 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3239/6579] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:16 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:17.007221 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2d26061f-d2f0-4a07-a81d-1573cbefab71 req-1bcd27d4-41c0-4042-92c3-1b7c6bf934f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d219bce9-a31b-43a2-949a-89f1ba959edd", "tag": "04e2a83a-d50e-45e9-95a7-86cbd8dfa673"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:17.016916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2d26061f-d2f0-4a07-a81d-1573cbefab71 req-1bcd27d4-41c0-4042-92c3-1b7c6bf934f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:17.017352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2d26061f-d2f0-4a07-a81d-1573cbefab71 req-1bcd27d4-41c0-4042-92c3-1b7c6bf934f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:17.028674 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2d26061f-d2f0-4a07-a81d-1573cbefab71 req-1bcd27d4-41c0-4042-92c3-1b7c6bf934f1 service nova] Creating event network-changed:04e2a83a-d50e-45e9-95a7-86cbd8dfa673 for instance d219bce9-a31b-43a2-949a-89f1ba959edd on n-h1-master-1 Jul 24 02:03:17.034162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-2d26061f-d2f0-4a07-a81d-1573cbefab71 req-1bcd27d4-41c0-4042-92c3-1b7c6bf934f1 service nova] Instance d219bce9-a31b-43a2-949a-89f1ba959edd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:03:17.045736 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2d26061f-d2f0-4a07-a81d-1573cbefab71 req-1bcd27d4-41c0-4042-92c3-1b7c6bf934f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042281 Jul 24 02:03:17.046336 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3341/6580] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:03:17.317646 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:17.318944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:17.327809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:17.328455 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:17.329287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:17.329762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:17.470634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:17.478660 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ba05fd7-f457-40bb-ab3e-2b430bbf093b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1512 microversion: 2.1 time: 0.165435 Jul 24 02:03:17.479261 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3240/6581] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:17 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:17.495676 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46afaf37-a426-403c-ad4f-04cebf95cbbc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:17.496296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46afaf37-a426-403c-ad4f-04cebf95cbbc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:17.502826 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46afaf37-a426-403c-ad4f-04cebf95cbbc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:17.503277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46afaf37-a426-403c-ad4f-04cebf95cbbc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:17.504038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46afaf37-a426-403c-ad4f-04cebf95cbbc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:17.504468 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46afaf37-a426-403c-ad4f-04cebf95cbbc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:17.563183 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46afaf37-a426-403c-ad4f-04cebf95cbbc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "POST /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd/action" status: 204 len: 0 microversion: 2.1 time: 0.071637 Jul 24 02:03:17.563847 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3342/6582] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:03:17 2022] POST /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:03:17.573014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:17.573896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:17.583661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:17.584598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:17.586605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:17.587094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:17.817473 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:17.828145 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5a056e35-0c00-47c2-8924-4d3648e9b5e8 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1512 microversion: 2.1 time: 0.259059 Jul 24 02:03:17.828824 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3241/6583] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:17 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:03:18.846430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:18.847216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:18.854531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:18.854990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:18.855764 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:18.856206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:18.992819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:19.001219 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1eb2ec67-7f6b-4682-917b-fc7f7835310d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1512 microversion: 2.1 time: 0.160269 Jul 24 02:03:19.001838 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3343/6584] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:18 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:20.018825 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:20.019469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:20.026623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.027097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.027899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.028360 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.166801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:20.175628 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f8062755-39bd-46e3-a300-b6074c147050 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1504 microversion: 2.1 time: 0.161319 Jul 24 02:03:20.176208 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3242/6585] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:20 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:20.192636 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:20.193870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:20.200793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.201248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.202620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.203052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.207117 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:20.337403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:20.345773 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1755937c-78a3-4475-991d-66515248d2d1 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1504 microversion: 2.1 time: 0.157238 Jul 24 02:03:20.346348 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3344/6586] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:20 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:20.361944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:20.362526 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:20.368847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.369315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.370142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.370596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.511735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:20.520282 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff295796-8e52-4b99-889b-4c0f0850ad7b tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1504 microversion: 2.1 time: 0.162802 Jul 24 02:03:20.520868 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3243/6587] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:20 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:20.537229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:20.537760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:20.543862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.544321 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.545122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.545568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.572823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:03:20.663823 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bbead753-875a-4845-a0dd-3d540da2789e tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 204 len: 0 microversion: 2.1 time: 0.129817 Jul 24 02:03:20.664570 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3345/6588] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:03:20 2022] DELETE /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:03:20.686914 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:20.687724 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:20.695570 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.696101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.696996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.697548 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.727708 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:03:20.742223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a5d22f63-99b9-4b3a-8669-7e86f71672d9 req-b4d9fde6-99cd-4da0-974f-f7f6c01d25ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d219bce9-a31b-43a2-949a-89f1ba959edd", "name": "network-vif-plugged", "status": "completed", "tag": "04e2a83a-d50e-45e9-95a7-86cbd8dfa673"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:20.760024 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a5d22f63-99b9-4b3a-8669-7e86f71672d9 req-b4d9fde6-99cd-4da0-974f-f7f6c01d25ee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.761056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a5d22f63-99b9-4b3a-8669-7e86f71672d9 req-b4d9fde6-99cd-4da0-974f-f7f6c01d25ee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.775793 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a5d22f63-99b9-4b3a-8669-7e86f71672d9 req-b4d9fde6-99cd-4da0-974f-f7f6c01d25ee service nova] Creating event network-vif-plugged:04e2a83a-d50e-45e9-95a7-86cbd8dfa673 for instance d219bce9-a31b-43a2-949a-89f1ba959edd on n-h1-master-1 Jul 24 02:03:20.783830 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a5d22f63-99b9-4b3a-8669-7e86f71672d9 req-b4d9fde6-99cd-4da0-974f-f7f6c01d25ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047579 Jul 24 02:03:20.784669 n-d-master-1 devstack@n-api.service[119562]: INFO nova.compute.api [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Instance is already in deleting state, ignoring this request Jul 24 02:03:20.785625 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-39a48dd0-26cf-4201-b575-0416e507f9f3 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 204 len: 0 microversion: 2.1 time: 0.103453 Jul 24 02:03:20.785776 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3346/6589] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:03:20.789529 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3244/6590] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:03:20 2022] DELETE /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:03:20.795824 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:20.796526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:20.802830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.803277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.804074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:20.804508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:20.943774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:20.951455 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4336b523-c03f-4535-a41b-050201b6b528 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1510 microversion: 2.1 time: 0.160546 Jul 24 02:03:20.952149 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3347/6591] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:20 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:03:21.968573 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:21.969286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:21.976332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:21.976797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:21.977593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:21.978071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:22.112504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c2a363c5ed84a84b2e4f00c8aa3b34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017ae15508e74480a8c6ced05bf424df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:22.121300 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3842161f-a52e-4a79-b811-0c1da48cccfe tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 200 len: 1510 microversion: 2.1 time: 0.156662 Jul 24 02:03:22.131332 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3245/6592] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:21 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:22.423072 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c54e615c-dbe4-489c-8d58-34b184ddfc42 req-c3dbd720-f305-42db-875f-637bdb7ec3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d219bce9-a31b-43a2-949a-89f1ba959edd", "name": "network-vif-deleted", "tag": "04e2a83a-d50e-45e9-95a7-86cbd8dfa673"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:22.433083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c54e615c-dbe4-489c-8d58-34b184ddfc42 req-c3dbd720-f305-42db-875f-637bdb7ec3df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:22.433661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c54e615c-dbe4-489c-8d58-34b184ddfc42 req-c3dbd720-f305-42db-875f-637bdb7ec3df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:22.446021 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c54e615c-dbe4-489c-8d58-34b184ddfc42 req-c3dbd720-f305-42db-875f-637bdb7ec3df service nova] Creating event network-vif-deleted:04e2a83a-d50e-45e9-95a7-86cbd8dfa673 for instance d219bce9-a31b-43a2-949a-89f1ba959edd on n-h1-master-1 Jul 24 02:03:22.451082 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c54e615c-dbe4-489c-8d58-34b184ddfc42 req-c3dbd720-f305-42db-875f-637bdb7ec3df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032263 Jul 24 02:03:22.452327 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3348/6593] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:03:23.139219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:23.139963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: d219bce9-a31b-43a2-949a-89f1ba959edd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:23.146972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:23.147445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:23.148229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:23.148687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:23.162487 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] HTTP exception thrown: Instance d219bce9-a31b-43a2-949a-89f1ba959edd could not be found. Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Request method failure captured: Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd HTTP/1.1 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KgB86oIaw87tq9BM8BRe3y7Vlfrpc-ZLwal3pWkp4iN32zWrrEfwHE5nSQXtwbjmUrjP5QUzyzMQ1Smf2EncApn2C77jNLeis9te_YbNvWfpRMC8nd4Qo2kARCqR11mYEcrIitmIfoNi2AiyiCamXGkSGgFzJ9IGS-uKsqPQAN4sc8 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 017ae15508e74480a8c6ced05bf424df Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_017ae15508e74480a8c6ced05bf424df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 017ae15508e74480a8c6ced05bf424df Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerDiskConfigTestJSON-1405572395-project Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 0c2a363c5ed84a84b2e4f00c8aa3b34f Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405572395-project Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: exception: Instance d219bce9-a31b-43a2-949a-89f1ba959edd could not be found. Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'd219bce9-a31b-43a2-949a-89f1ba959edd'} Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d219bce9-a31b-43a2-949a-89f1ba959edd could not be found. Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d219bce9-a31b-43a2-949a-89f1ba959edd could not be found. Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:03:23.164182 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d219bce9-a31b-43a2-949a-89f1ba959edd could not be found. Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Returning 404 to user: Instance d219bce9-a31b-43a2-949a-89f1ba959edd could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e27ca08d-041c-4e43-a979-bb0c0201e555 tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd" status: 404 len: 111 microversion: 2.1 time: 0.030460 Jul 24 02:03:23.168416 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3246/6594] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:23 2022] GET /compute/v2.1/servers/d219bce9-a31b-43a2-949a-89f1ba959edd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:03:23.175521 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9eb2dbeb-54e1-48b9-a45c-35728df974bf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '.version_select at 0x7f05e9e4b160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:23.194230 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9eb2dbeb-54e1-48b9-a45c-35728df974bf tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-94600061" status: 202 len: 0 microversion: 2.1 time: 0.022926 Jul 24 02:03:23.194805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3349/6595] 10.222.0.27 () {58 vars in 1214 bytes} [Sun Jul 24 02:03:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-94600061 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:03:23.800335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:23.800856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:23.807205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:23.807615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:23.808396 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:23.808851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:23.826773 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] HTTP exception thrown: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Request method failure captured: Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 HTTP/1.1 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KgB86oIaw87tq9BM8BRe3y7Vlfrpc-ZLwal3pWkp4iN32zWrrEfwHE5nSQXtwbjmUrjP5QUzyzMQ1Smf2EncApn2C77jNLeis9te_YbNvWfpRMC8nd4Qo2kARCqR11mYEcrIitmIfoNi2AiyiCamXGkSGgFzJ9IGS-uKsqPQAN4sc8 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 017ae15508e74480a8c6ced05bf424df Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_017ae15508e74480a8c6ced05bf424df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 017ae15508e74480a8c6ced05bf424df Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerDiskConfigTestJSON-1405572395-project Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 0c2a363c5ed84a84b2e4f00c8aa3b34f Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405572395-project Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '8752192f-7f03-4c01-947c-e20a62bc1a91'} Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:03:23.828499 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Returning 404 to user: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-26839d37-f52e-4b92-b31d-18b661be861d tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 404 len: 111 microversion: 2.1 time: 0.035120 Jul 24 02:03:23.832013 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3247/6596] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:03:23 2022] DELETE /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:03:23.838584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:23.839316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] [instance: 8752192f-7f03-4c01-947c-e20a62bc1a91] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:23.847479 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:23.847930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:23.848689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:23.849121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:23.862700 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] HTTP exception thrown: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Request method failure captured: Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 HTTP/1.1 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KgB86oIaw87tq9BM8BRe3y7Vlfrpc-ZLwal3pWkp4iN32zWrrEfwHE5nSQXtwbjmUrjP5QUzyzMQ1Smf2EncApn2C77jNLeis9te_YbNvWfpRMC8nd4Qo2kARCqR11mYEcrIitmIfoNi2AiyiCamXGkSGgFzJ9IGS-uKsqPQAN4sc8 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 017ae15508e74480a8c6ced05bf424df Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_017ae15508e74480a8c6ced05bf424df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/017ae15508e74480a8c6ced05bf424df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 017ae15508e74480a8c6ced05bf424df Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1405572395 Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerDiskConfigTestJSON-1405572395-project Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 0c2a363c5ed84a84b2e4f00c8aa3b34f Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerDiskConfigTestJSON-1405572395-project Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8752192f-7f03-4c01-947c-e20a62bc1a91'} Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:03:23.864560 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] Returning 404 to user: Instance 8752192f-7f03-4c01-947c-e20a62bc1a91 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc23c39f-b727-4e17-8d20-7706b38585fc tempest-ServerDiskConfigTestJSON-1405572395 tempest-ServerDiskConfigTestJSON-1405572395-project] 10.222.0.27 "GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91" status: 404 len: 111 microversion: 2.1 time: 0.031364 Jul 24 02:03:23.867816 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3350/6597] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:23 2022] GET /compute/v2.1/servers/8752192f-7f03-4c01-947c-e20a62bc1a91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:03:32.425130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9c92561-0b6e-4c93-aaec-58cf8b23e872 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'create', calling method: .version_select at 0x7f05ea21f9d0>, body: {"keypair": {"name": "tempest-keypair-620695224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmUzLlrD2Uy2JuRQnZB+e2dz+kZ6vMICezMiDsVNsPYH+oF1UVv3i/2Wxf4CB+Fk2NGbbiuKvxYe0qkDtsau40m9M5oHFBE+iLrYjrrwYVLCvGQ/jW5qR/y1d+MsOvTzg=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:32.429338 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=36 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:32.442777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c9c92561-0b6e-4c93-aaec-58cf8b23e872 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for project 65afddc02ce0461988f64f41f706be14. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:03:32.448144 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c9c92561-0b6e-4c93-aaec-58cf8b23e872 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for user 4ca622718e5c42dc9a71b80fca387e66 and project 65afddc02ce0461988f64f41f706be14. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:03:32.479367 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9c92561-0b6e-4c93-aaec-58cf8b23e872 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180290 Jul 24 02:03:32.479994 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3248/6598] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:03:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:03:33.829771 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-224532233", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "515f0778-c427-42dc-963a-6220ed8237d8"}], "security_groups": [{"name": "tempest-securitygroup--893383063"}], "key_name": "tempest-keypair-620695224", "user_data": "}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:33.837653 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:33.854918 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:33.947311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] validate_networks() for [('515f0778-c427-42dc-963a-6220ed8237d8', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:03:34.338412 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:03:34.338860 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:03:34.339363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:03:34.339770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:03:34.340181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:03:34.349913 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:34.350358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:34.351155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:34.351598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:34.368583 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:03:34.374411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for user 4ca622718e5c42dc9a71b80fca387e66 and project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:03:34.386737 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:03:34.389577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:03:34.436520 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f397d570-a919-4959-9dc4-800ada5e4778 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.610573 Jul 24 02:03:34.437718 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3351/6599] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:03:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:03:34.445101 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:34.450344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ce362f7-a624-47c7-b2a0-214bde569500 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:34.452073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ce362f7-a624-47c7-b2a0-214bde569500 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:34.516267 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ce362f7-a624-47c7-b2a0-214bde569500 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:34.524266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ce362f7-a624-47c7-b2a0-214bde569500 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1237 microversion: 2.1 time: 0.080692 Jul 24 02:03:34.524851 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3249/6600] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:34 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:35.540354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:35.541859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:35.552123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:35.553112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:35.554159 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:35.554817 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:35.635716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:35.646325 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e43b4ce4-6a4a-4098-84fc-e8ed3996dfcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1307 microversion: 2.1 time: 0.109791 Jul 24 02:03:35.647343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3352/6601] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:35 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:36.665711 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:36.667056 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:36.675140 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:36.675602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:36.676405 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:36.676858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:36.839071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:36.848313 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e05f96f5-7606-4409-a9a8-a518ebe76d8b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1362 microversion: 2.1 time: 0.187645 Jul 24 02:03:36.848911 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3250/6602] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:36 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:36.909634 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4256f94b-1efc-4dd6-b8e4-e67cd5840daf req-7c7ee16e-d928-4fef-9c3b-28a05548212e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960a02c8-7096-46ad-8709-604b29327e51", "tag": "71b9e955-de56-4a59-8259-38d511917661"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:36.943105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4256f94b-1efc-4dd6-b8e4-e67cd5840daf req-7c7ee16e-d928-4fef-9c3b-28a05548212e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:36.943735 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4256f94b-1efc-4dd6-b8e4-e67cd5840daf req-7c7ee16e-d928-4fef-9c3b-28a05548212e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:36.960736 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4256f94b-1efc-4dd6-b8e4-e67cd5840daf req-7c7ee16e-d928-4fef-9c3b-28a05548212e service nova] Creating event network-changed:71b9e955-de56-4a59-8259-38d511917661 for instance 960a02c8-7096-46ad-8709-604b29327e51 on n-h1-master-1 Jul 24 02:03:36.968598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4256f94b-1efc-4dd6-b8e4-e67cd5840daf req-7c7ee16e-d928-4fef-9c3b-28a05548212e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065477 Jul 24 02:03:36.970006 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3353/6603] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:03:37.866959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:37.867613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:37.874530 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:37.874994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:37.875771 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:37.876221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:38.007541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:38.015190 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-faa4682e-7c0d-4b6a-8442-6c71a7be40b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1362 microversion: 2.1 time: 0.152407 Jul 24 02:03:38.015756 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3251/6604] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:37 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:39.032890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:39.034259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:39.041396 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:39.041892 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:39.042705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:39.043127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:39.181330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:39.189032 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a2f21531-0144-49cf-8625-3cd19941e6d2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1362 microversion: 2.1 time: 0.161100 Jul 24 02:03:39.189622 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3354/6605] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:39 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:40.205663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:40.206314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:40.213082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:40.213547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:40.214352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:40.214803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:40.346732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:40.354191 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-172aa87e-9e9e-4ebb-91a1-1b65df0dc263 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1362 microversion: 2.1 time: 0.152481 Jul 24 02:03:40.354761 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3252/6606] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:40 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:40.778544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4ba6241a-5cc8-4e84-b00c-d9532c34ab18 req-22a1891d-ebe1-4fd8-bd65-d29e2fc0edfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960a02c8-7096-46ad-8709-604b29327e51", "name": "network-vif-plugged", "status": "completed", "tag": "71b9e955-de56-4a59-8259-38d511917661"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:40.789038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4ba6241a-5cc8-4e84-b00c-d9532c34ab18 req-22a1891d-ebe1-4fd8-bd65-d29e2fc0edfe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:40.789526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4ba6241a-5cc8-4e84-b00c-d9532c34ab18 req-22a1891d-ebe1-4fd8-bd65-d29e2fc0edfe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:40.801547 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4ba6241a-5cc8-4e84-b00c-d9532c34ab18 req-22a1891d-ebe1-4fd8-bd65-d29e2fc0edfe service nova] Creating event network-vif-plugged:71b9e955-de56-4a59-8259-38d511917661 for instance 960a02c8-7096-46ad-8709-604b29327e51 on n-h1-master-1 Jul 24 02:03:40.806371 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4ba6241a-5cc8-4e84-b00c-d9532c34ab18 req-22a1891d-ebe1-4fd8-bd65-d29e2fc0edfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031607 Jul 24 02:03:40.806982 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3355/6607] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:03:41.372107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:41.372763 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:41.379702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:41.380163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:41.380941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:41.381395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:41.515707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:41.523186 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-60cffe05-1841-4b5d-8a13-7dda8b0b5591 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1362 microversion: 2.1 time: 0.155074 Jul 24 02:03:41.523756 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3253/6608] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:41 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:42.541023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:42.541760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:42.548303 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:42.548754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:42.549520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:42.549989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:42.683175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:03:42.691409 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5eb44d92-325a-4e3a-89dc-14a1609024b2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1547 microversion: 2.1 time: 0.155470 Jul 24 02:03:42.692162 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3356/6609] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:03:42 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:03:42.708307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-039661b8-a4c2-453f-b845-89ac59f5dd56 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:03:42.708818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-039661b8-a4c2-453f-b845-89ac59f5dd56 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:03:42.715821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-039661b8-a4c2-453f-b845-89ac59f5dd56 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:42.716313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-039661b8-a4c2-453f-b845-89ac59f5dd56 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:42.717244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-039661b8-a4c2-453f-b845-89ac59f5dd56 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:42.717719 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-039661b8-a4c2-453f-b845-89ac59f5dd56 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:42.793878 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-039661b8-a4c2-453f-b845-89ac59f5dd56 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089438 Jul 24 02:03:42.794486 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3254/6610] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 02:03:42 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:03:43.731705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-313e7839-6951-4361-90a9-d79336a9e774 req-6d0d9ab7-70ee-44b9-a688-8dc9cfbc9c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960a02c8-7096-46ad-8709-604b29327e51", "tag": "71b9e955-de56-4a59-8259-38d511917661"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:03:43.741488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-313e7839-6951-4361-90a9-d79336a9e774 req-6d0d9ab7-70ee-44b9-a688-8dc9cfbc9c2f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:03:43.741970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-313e7839-6951-4361-90a9-d79336a9e774 req-6d0d9ab7-70ee-44b9-a688-8dc9cfbc9c2f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:03:43.754023 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-313e7839-6951-4361-90a9-d79336a9e774 req-6d0d9ab7-70ee-44b9-a688-8dc9cfbc9c2f service nova] Creating event network-changed:71b9e955-de56-4a59-8259-38d511917661 for instance 960a02c8-7096-46ad-8709-604b29327e51 on n-h1-master-1 Jul 24 02:03:43.758936 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-313e7839-6951-4361-90a9-d79336a9e774 req-6d0d9ab7-70ee-44b9-a688-8dc9cfbc9c2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030928 Jul 24 02:03:43.759593 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3357/6611] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:04:18.536565 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:18.537491 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:18.538507 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=28 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:18.543324 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:18.544035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:18.552102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:18.552568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:18.553350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:18.553826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:18.690330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:18.698038 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c720f709-8b08-4110-8413-6e5572de064b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1666 microversion: 2.1 time: 0.163322 Jul 24 02:04:18.698625 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3255/6612] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:18 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:18.714726 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:18.715506 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:18.717499 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:18.718305 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:18.720025 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:18.720586 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=26 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:18.727905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:18.728356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:18.729125 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:18.729557 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:18.863033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:18.870933 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3e5418e3-1ad2-4839-b139-f6fd068c9a24 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1666 microversion: 2.1 time: 0.160272 Jul 24 02:04:18.871516 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3358/6613] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:18 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:18.887563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:18.888303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:18.894358 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:18.894820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:18.895602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:18.896052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:19.027714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:19.035365 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fbedc809-0ee8-4070-8bf3-292764b446da tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1666 microversion: 2.1 time: 0.151716 Jul 24 02:04:19.035935 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3256/6614] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:18 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:19.051879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:19.052888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:19.059044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:19.060129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:19.060908 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:19.061350 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:19.089126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:19.095105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Old instance type m1.heat2, new instance type m1.heat {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:04:19.101343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:04:19.101796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:04:19.102282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:04:19.102698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:04:19.103118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:04:19.165345 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-666a4018-b6e6-4567-80c8-4d06367a4e13 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51/action" status: 202 len: 0 microversion: 2.1 time: 0.117396 Jul 24 02:04:19.169173 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3359/6615] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:04:19 2022] POST /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:04:19.174617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:19.175433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:19.181379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:19.182045 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:19.182827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:19.183273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:19.323371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:19.331529 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b310bc4a-1758-4eff-813e-5ffd3b2f4d5e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1675 microversion: 2.1 time: 0.160770 Jul 24 02:04:19.332320 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3257/6616] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:19 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:20.350612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:20.351306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:20.358281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:20.358738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:20.359510 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:20.359947 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:20.499672 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:20.507508 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43c93dff-4113-438f-9366-ae4d17da78b5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1675 microversion: 2.1 time: 0.161623 Jul 24 02:04:20.508091 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3360/6617] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:20 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:21.525523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:21.526191 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:21.533697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:21.534176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:21.534962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:21.535418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:21.672814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:21.680482 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa647255-f545-47f8-8673-d56aea0c2f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.158930 Jul 24 02:04:21.681067 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3258/6618] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:21 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:22.698649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:22.699289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:22.706988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:22.707467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:22.708234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:22.708672 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:22.842627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:22.850066 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2fd4c3b-f66a-4a13-a511-2e8283613978 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.155322 Jul 24 02:04:22.850655 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3361/6619] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:22 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:23.867706 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:23.868340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:23.875424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:23.875888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:23.876661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:23.877112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:24.005448 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:24.013941 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5c58bd53-20b1-456e-bb05-83dbfed3060a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.150279 Jul 24 02:04:24.014524 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3259/6620] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:23 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:25.030794 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:25.031405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:25.038328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:25.038777 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:25.039536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:25.039973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:25.173191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:25.180753 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fde7aca2-115b-4042-9174-a476b917e33f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.154054 Jul 24 02:04:25.181358 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3362/6621] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:25 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:26.198658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:26.199293 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:26.207229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:26.207699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:26.208504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:26.208955 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:26.338140 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:26.346682 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c84b55b-f6b0-4799-bcdd-d0b577a22715 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.152040 Jul 24 02:04:26.347264 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3260/6622] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:26 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:27.364010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:27.364880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:27.371830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:27.372527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:27.373283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:27.373741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:27.507402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:27.515091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cde52868-090b-4eb3-aa32-1f215315be5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.154979 Jul 24 02:04:27.515659 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3363/6623] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:27 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:28.532764 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:28.533403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:28.540397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:28.540862 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:28.541640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:28.542114 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:28.671607 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:28.679195 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f728503-5d14-454b-b80d-5fb0646024ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.150899 Jul 24 02:04:28.679769 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3261/6624] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:28 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:29.696680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:29.697210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:29.705057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:29.705551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:29.706368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:29.706808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:29.839900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:29.847445 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5cfd0f33-e77f-4851-a9fd-2f516be21b1d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.154756 Jul 24 02:04:29.848017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3364/6625] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:29 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:30.865718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:30.866364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:30.873896 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:30.874369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:30.875153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:30.875605 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:31.007233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:31.015675 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e9676d84-1f1c-4844-8768-72a5a376af3a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.154147 Jul 24 02:04:31.016255 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3262/6626] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:30 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:32.033316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:32.033891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:32.040818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:32.041271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:32.042067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:32.042511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:32.178188 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:32.186062 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-89954096-a0c5-4311-8c52-50dbc77025fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1680 microversion: 2.1 time: 0.156704 Jul 24 02:04:32.186636 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3365/6627] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:32 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:33.204619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:33.205209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:33.212549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:33.213019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:33.213857 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:33.214312 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:33.365712 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:33.373802 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2d19bce0-d69e-4ecc-833a-29d85111c509 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1679 microversion: 2.1 time: 0.173623 Jul 24 02:04:33.374396 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3263/6628] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:33 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:33.840138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1aed452d-dc24-4f0a-bca5-8ec5032735e5 req-e8798e1b-5c8f-483b-afe7-17931d2871fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960a02c8-7096-46ad-8709-604b29327e51", "name": "network-vif-unplugged", "status": "completed", "tag": "71b9e955-de56-4a59-8259-38d511917661"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:33.849864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1aed452d-dc24-4f0a-bca5-8ec5032735e5 req-e8798e1b-5c8f-483b-afe7-17931d2871fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:33.850593 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1aed452d-dc24-4f0a-bca5-8ec5032735e5 req-e8798e1b-5c8f-483b-afe7-17931d2871fa service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:33.863194 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1aed452d-dc24-4f0a-bca5-8ec5032735e5 req-e8798e1b-5c8f-483b-afe7-17931d2871fa service nova] Creating event network-vif-unplugged:71b9e955-de56-4a59-8259-38d511917661 for instance 960a02c8-7096-46ad-8709-604b29327e51 on n-h2-master-1 Jul 24 02:04:33.869904 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-1aed452d-dc24-4f0a-bca5-8ec5032735e5 req-e8798e1b-5c8f-483b-afe7-17931d2871fa service nova] Instance 960a02c8-7096-46ad-8709-604b29327e51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:04:33.883587 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1aed452d-dc24-4f0a-bca5-8ec5032735e5 req-e8798e1b-5c8f-483b-afe7-17931d2871fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120898 Jul 24 02:04:33.884630 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3366/6629] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:04:34.392126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:34.392890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:34.399824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:34.400289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:34.401076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:34.402153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:34.534697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:34.542466 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dbeacf30-2772-4e57-ae87-a6d4632fb77f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1679 microversion: 2.1 time: 0.154932 Jul 24 02:04:34.543042 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3264/6630] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:34 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:35.560033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:35.560729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:35.567456 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:35.567906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:35.568676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:35.569109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:35.709684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:35.717793 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-47642829-ad1c-466b-a892-a1109aa0d17c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1677 microversion: 2.1 time: 0.162238 Jul 24 02:04:35.718384 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3367/6631] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:35 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:35.898854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5ab66255-35b5-4d26-9674-76942fa164ac req-1315b925-8024-4617-9833-e05f5c279e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960a02c8-7096-46ad-8709-604b29327e51", "tag": "71b9e955-de56-4a59-8259-38d511917661"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:35.910162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5ab66255-35b5-4d26-9674-76942fa164ac req-1315b925-8024-4617-9833-e05f5c279e1a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:35.910624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5ab66255-35b5-4d26-9674-76942fa164ac req-1315b925-8024-4617-9833-e05f5c279e1a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:35.924737 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5ab66255-35b5-4d26-9674-76942fa164ac req-1315b925-8024-4617-9833-e05f5c279e1a service nova] Creating event network-changed:71b9e955-de56-4a59-8259-38d511917661 for instance 960a02c8-7096-46ad-8709-604b29327e51 on n-h2-master-1 Jul 24 02:04:35.929996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-5ab66255-35b5-4d26-9674-76942fa164ac req-1315b925-8024-4617-9833-e05f5c279e1a service nova] Instance 960a02c8-7096-46ad-8709-604b29327e51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:04:35.940974 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5ab66255-35b5-4d26-9674-76942fa164ac req-1315b925-8024-4617-9833-e05f5c279e1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045894 Jul 24 02:04:35.941565 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3265/6632] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:04:36.736922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:36.737464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:36.744650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:36.745110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:36.745924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:36.746367 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:36.875212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:36.882812 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-58d8c97c-cbe7-40f5-aa79-e0b558d5d958 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1677 microversion: 2.1 time: 0.149894 Jul 24 02:04:36.883389 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3368/6633] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:36 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:37.900690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:37.901451 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:37.908057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:37.908526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:37.909330 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:37.909814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:38.041289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:38.049138 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-55c69010-b494-4ed9-b673-f1ad5ff182cc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1674 microversion: 2.1 time: 0.153727 Jul 24 02:04:38.049734 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3266/6634] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:37 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:04:38.065935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f8bc54d-7d3a-4d3a-bf6f-0d61f28f5953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:38.066469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f8bc54d-7d3a-4d3a-bf6f-0d61f28f5953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:38.073324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc54d-7d3a-4d3a-bf6f-0d61f28f5953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:38.073840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc54d-7d3a-4d3a-bf6f-0d61f28f5953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:38.074604 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc54d-7d3a-4d3a-bf6f-0d61f28f5953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:38.075614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f8bc54d-7d3a-4d3a-bf6f-0d61f28f5953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:38.134223 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f8bc54d-7d3a-4d3a-bf6f-0d61f28f5953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51/action" status: 204 len: 0 microversion: 2.1 time: 0.072023 Jul 24 02:04:38.134885 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3369/6635] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:04:38 2022] POST /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:04:38.143336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:38.144099 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:38.150426 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:38.150755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:38.151547 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:38.152005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:38.290291 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:38.299550 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ba4d0c7a-208d-4336-a8fc-4ed4e9ff28a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1674 microversion: 2.1 time: 0.160082 Jul 24 02:04:38.300629 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3267/6636] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:38 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:39.318978 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:39.319677 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:39.330813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.331265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.332234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.332675 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.467558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:39.475304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-de366409-72b0-4423-af45-9a1f5f314ef3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1666 microversion: 2.1 time: 0.160585 Jul 24 02:04:39.475871 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3370/6637] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:39 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:39.491944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:39.492576 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:39.500168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.500631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.501408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.501899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.643992 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:39.651474 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0e6fdf72-9878-48ec-bf5c-048e45ad10f6 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1666 microversion: 2.1 time: 0.163690 Jul 24 02:04:39.652037 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3268/6638] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:39 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:39.667507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:39.668129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:39.675025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.675491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.676273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.676720 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.805713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:39.813816 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-988c8835-a8ce-4620-a341-109e316bc70b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1666 microversion: 2.1 time: 0.150177 Jul 24 02:04:39.814396 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3371/6639] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:39 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:39.829869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:39.830387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:39.836395 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.836858 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.837634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.838106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.865996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:04:39.940067 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a53c056-a096-4370-be0a-20b9b859ea6f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 204 len: 0 microversion: 2.1 time: 0.113923 Jul 24 02:04:39.940660 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3269/6640] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:04:39 2022] DELETE /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:04:39.949009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:39.949637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:39.955806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.956256 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.957014 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:39.957448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:39.972832 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:40.091687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:40.099382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-480c0214-6638-4db0-a0c0-571efd08df35 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1672 microversion: 2.1 time: 0.154391 Jul 24 02:04:40.099966 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3372/6641] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:39 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:04:41.117591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:41.118357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:41.126511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:41.126989 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:41.127851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:41.128243 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:41.132574 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:41.268272 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9234da94-c694-4e7f-bafe-ffa1c0df0e29 req-074627c6-ea3f-44e4-9abb-a5683c7758d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960a02c8-7096-46ad-8709-604b29327e51", "name": "network-vif-plugged", "status": "completed", "tag": "71b9e955-de56-4a59-8259-38d511917661"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:41.275603 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:41.278386 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9234da94-c694-4e7f-bafe-ffa1c0df0e29 req-074627c6-ea3f-44e4-9abb-a5683c7758d5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:41.279754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9234da94-c694-4e7f-bafe-ffa1c0df0e29 req-074627c6-ea3f-44e4-9abb-a5683c7758d5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:41.286032 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-512ae6b9-f1b3-4522-b83b-b6816537e0dc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1672 microversion: 2.1 time: 0.173175 Jul 24 02:04:41.286854 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3270/6642] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:41 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:41.292165 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9234da94-c694-4e7f-bafe-ffa1c0df0e29 req-074627c6-ea3f-44e4-9abb-a5683c7758d5 service nova] Creating event network-vif-plugged:71b9e955-de56-4a59-8259-38d511917661 for instance 960a02c8-7096-46ad-8709-604b29327e51 on n-h2-master-1 Jul 24 02:04:41.298558 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9234da94-c694-4e7f-bafe-ffa1c0df0e29 req-074627c6-ea3f-44e4-9abb-a5683c7758d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Jul 24 02:04:41.299196 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3373/6643] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:04:42.305964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:42.306599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:42.314315 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f08eab2e-81fe-4823-ba76-875538a9b60b req-218ea4a3-33bc-4b01-81bf-c5888dd9fad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960a02c8-7096-46ad-8709-604b29327e51", "name": "network-vif-deleted", "tag": "71b9e955-de56-4a59-8259-38d511917661"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:42.323462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:42.327864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f08eab2e-81fe-4823-ba76-875538a9b60b req-218ea4a3-33bc-4b01-81bf-c5888dd9fad4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:42.328663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:42.329434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:42.329911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:42.333010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f08eab2e-81fe-4823-ba76-875538a9b60b req-218ea4a3-33bc-4b01-81bf-c5888dd9fad4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:42.345126 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f08eab2e-81fe-4823-ba76-875538a9b60b req-218ea4a3-33bc-4b01-81bf-c5888dd9fad4 service nova] Creating event network-vif-deleted:71b9e955-de56-4a59-8259-38d511917661 for instance 960a02c8-7096-46ad-8709-604b29327e51 on n-h2-master-1 Jul 24 02:04:42.350310 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f08eab2e-81fe-4823-ba76-875538a9b60b req-218ea4a3-33bc-4b01-81bf-c5888dd9fad4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049115 Jul 24 02:04:42.351498 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3374/6644] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:04:42.399260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:42.408308 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-00756853-a86d-49e0-8294-99b7f9a05e8f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 200 len: 1322 microversion: 2.1 time: 0.106234 Jul 24 02:04:42.408890 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3271/6645] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:42 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 1322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:43.427519 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:43.428231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:43.434564 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:43.435023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:43.436506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:43.436953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:43.452448 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 HTTP/1.1 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '960a02c8-7096-46ad-8709-604b29327e51'} Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:04:43.454085 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0802830a-80b7-4b7f-83ac-f9a65acfd3db tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 404 len: 111 microversion: 2.1 time: 0.033057 Jul 24 02:04:43.457968 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3375/6646] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:43 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:04:43.470481 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:43.470972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:43.477337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:43.477845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:43.478641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:43.479097 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:43.493714 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 HTTP/1.1 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '960a02c8-7096-46ad-8709-604b29327e51'} Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:04:43.495316 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bb918b17-1e98-42c5-a0f4-03392fc1aaab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 404 len: 111 microversion: 2.1 time: 0.032150 Jul 24 02:04:43.499775 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3272/6647] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:43 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:04:43.545345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1548799356", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "515f0778-c427-42dc-963a-6220ed8237d8"}], "security_groups": [{"name": "tempest-securitygroup--893383063"}], "key_name": "tempest-keypair-620695224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:43.647863 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] validate_networks() for [('515f0778-c427-42dc-963a-6220ed8237d8', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:04:44.014631 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:04:44.015057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:04:44.015528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:04:44.015934 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:04:44.016343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:04:44.025184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:44.025626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:44.026443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:44.026873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:44.043769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:04:44.049607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for user 4ca622718e5c42dc9a71b80fca387e66 and project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:04:44.061859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:04:44.064092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:04:44.109536 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-92cc2e01-5a22-4307-9cb6-bb4a69f6f9b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.568549 Jul 24 02:04:44.110222 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3376/6648] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:04:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:04:44.120804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aa7239a2-cf8e-4620-b7b0-f587c7e320a2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:44.121411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-aa7239a2-cf8e-4620-b7b0-f587c7e320a2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:44.180569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-aa7239a2-cf8e-4620-b7b0-f587c7e320a2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:44.187632 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aa7239a2-cf8e-4620-b7b0-f587c7e320a2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1238 microversion: 2.1 time: 0.070668 Jul 24 02:04:44.188248 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3273/6649] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:44 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:45.205692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:45.206449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:45.213608 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:45.214173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:45.215027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:45.215472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:45.282314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:45.289728 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-68fbb8d3-dda1-4938-961a-5241f16a88a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1296 microversion: 2.1 time: 0.089146 Jul 24 02:04:45.290523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3377/6650] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:45 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:46.307705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:46.309006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:46.319168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:46.319645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:46.320456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:46.320908 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:46.458006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:46.466775 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f2249ddc-3b19-47f3-828a-e4c93b8f7050 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.162867 Jul 24 02:04:46.468181 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3274/6651] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:46 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:46.485944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8812064e-c5a2-448c-a19f-78e5e25b448a req-c2797e1f-3222-4bd6-9f9f-86c7acc2d97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b9bc10-150e-4e8d-8b54-95b1afe45e4c", "tag": "437a1801-9b3b-45dd-94ba-836779ef97bb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:46.507170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8812064e-c5a2-448c-a19f-78e5e25b448a req-c2797e1f-3222-4bd6-9f9f-86c7acc2d97d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:46.507624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8812064e-c5a2-448c-a19f-78e5e25b448a req-c2797e1f-3222-4bd6-9f9f-86c7acc2d97d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:46.519989 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8812064e-c5a2-448c-a19f-78e5e25b448a req-c2797e1f-3222-4bd6-9f9f-86c7acc2d97d service nova] Creating event network-changed:437a1801-9b3b-45dd-94ba-836779ef97bb for instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c on n-h2-master-1 Jul 24 02:04:46.525362 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8812064e-c5a2-448c-a19f-78e5e25b448a req-c2797e1f-3222-4bd6-9f9f-86c7acc2d97d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050990 Jul 24 02:04:46.526023 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3378/6652] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:04:47.484869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:47.485496 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:47.492743 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:47.493207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:47.494013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:47.494467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:47.627151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:47.634704 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dad8a551-e00a-48dd-bf9e-bdc3b6ef2bc3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.153916 Jul 24 02:04:47.635277 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3275/6653] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:47 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:48.656114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:48.656818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:48.663156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:48.663609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:48.664372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:48.664813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:48.795458 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:48.802977 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-75f7045b-f595-40ec-a27d-87f8da812965 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.152547 Jul 24 02:04:48.803559 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3379/6654] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:48 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:49.820468 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:49.821162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:49.824147 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:49.830014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:49.830486 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:49.831284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:49.831744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:49.965644 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:49.974164 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d2ac9b4b-2903-4551-ad1d-a6890cb97f69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.157707 Jul 24 02:04:49.974753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3276/6655] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:49 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:50.992666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:50.993284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:50.996164 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:51.002092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:51.002545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:51.003315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:51.003753 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:51.135612 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:51.143633 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3c70faba-f2cb-4b51-ad96-e5e43f54671a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.155153 Jul 24 02:04:51.144201 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3380/6656] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:50 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:52.160942 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:52.161574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:52.168564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:52.169029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:52.170593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:52.171041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:52.284833 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:04:52.285038 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c (ip 10.222.0.27) !!! Jul 24 02:04:52.305494 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:52.314087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-970fdacf-1fe6-489c-9f06-836776e7044b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.157037 Jul 24 02:04:52.314669 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3277/6657] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:52 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:53.315502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ad3bf3f4-de68-4351-9c42-721513ab7d3b req-2ceeab5e-849e-4389-b16b-e19f530f9761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b9bc10-150e-4e8d-8b54-95b1afe45e4c", "name": "network-vif-plugged", "status": "completed", "tag": "437a1801-9b3b-45dd-94ba-836779ef97bb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:53.324627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ad3bf3f4-de68-4351-9c42-721513ab7d3b req-2ceeab5e-849e-4389-b16b-e19f530f9761 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:53.325131 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ad3bf3f4-de68-4351-9c42-721513ab7d3b req-2ceeab5e-849e-4389-b16b-e19f530f9761 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:53.333592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:53.334357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:53.337941 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ad3bf3f4-de68-4351-9c42-721513ab7d3b req-2ceeab5e-849e-4389-b16b-e19f530f9761 service nova] Creating event network-vif-plugged:437a1801-9b3b-45dd-94ba-836779ef97bb for instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c on n-h2-master-1 Jul 24 02:04:53.341380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:53.341969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:53.342843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:53.343348 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ad3bf3f4-de68-4351-9c42-721513ab7d3b req-2ceeab5e-849e-4389-b16b-e19f530f9761 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031564 Jul 24 02:04:53.343461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:53.344222 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3381/6658] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:04:53.478994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:53.487512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-87d1be7e-ce80-436b-a947-ff63a77303be tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.159573 Jul 24 02:04:53.488089 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3278/6659] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:53 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:54.501660 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:54.502500 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:54.508082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:54.508943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:54.516822 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:54.517273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:54.518087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:54.518531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:54.645805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:54.653167 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69af8fd3-472d-4e64-b4c0-f7510145e1e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1363 microversion: 2.1 time: 0.152496 Jul 24 02:04:54.653784 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3382/6660] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:54 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:55.670956 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:55.671694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:55.673642 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:55.681015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:55.681481 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:55.682328 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:55.682878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:55.826579 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:04:55.835004 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f17765df-add0-462f-a679-37330a7af216 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1549 microversion: 2.1 time: 0.168301 Jul 24 02:04:55.835647 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3279/6661] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:04:55 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:04:55.852233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67ea176d-6bee-4598-a7f5-c0e8984c772e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:04:55.853331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67ea176d-6bee-4598-a7f5-c0e8984c772e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:04:55.860707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67ea176d-6bee-4598-a7f5-c0e8984c772e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:55.861164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67ea176d-6bee-4598-a7f5-c0e8984c772e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:55.861993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67ea176d-6bee-4598-a7f5-c0e8984c772e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:55.862432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67ea176d-6bee-4598-a7f5-c0e8984c772e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:55.944767 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67ea176d-6bee-4598-a7f5-c0e8984c772e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096573 Jul 24 02:04:55.945398 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3383/6662] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 02:04:55 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:04:57.222461 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-044bd770-8275-4005-9343-6a79a9d491e9 req-f4a57789-1ed5-4b9c-9679-7fe2994234f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b9bc10-150e-4e8d-8b54-95b1afe45e4c", "tag": "437a1801-9b3b-45dd-94ba-836779ef97bb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:04:57.231340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-044bd770-8275-4005-9343-6a79a9d491e9 req-f4a57789-1ed5-4b9c-9679-7fe2994234f3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:04:57.232434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-044bd770-8275-4005-9343-6a79a9d491e9 req-f4a57789-1ed5-4b9c-9679-7fe2994234f3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:04:57.243999 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-044bd770-8275-4005-9343-6a79a9d491e9 req-f4a57789-1ed5-4b9c-9679-7fe2994234f3 service nova] Creating event network-changed:437a1801-9b3b-45dd-94ba-836779ef97bb for instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c on n-h2-master-1 Jul 24 02:04:57.249608 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-044bd770-8275-4005-9343-6a79a9d491e9 req-f4a57789-1ed5-4b9c-9679-7fe2994234f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030844 Jul 24 02:04:57.250270 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3280/6663] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:05:58.901320 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=7 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:05:58.902122 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=43 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:05:58.906615 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bece200f-8b90-43b6-bce6-26d99d3c173d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:05:58.914066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bece200f-8b90-43b6-bce6-26d99d3c173d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:05:58.914514 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bece200f-8b90-43b6-bce6-26d99d3c173d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:05:58.935833 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bece200f-8b90-43b6-bce6-26d99d3c173d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Going to try to stop instance {{(pid=119561) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 02:05:58.978285 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bece200f-8b90-43b6-bce6-26d99d3c173d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action" status: 202 len: 0 microversion: 2.1 time: 0.079092 Jul 24 02:05:58.978906 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3384/6664] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:05:58 2022] POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 02:05:58.987040 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=9 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:05:58.987812 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=50 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:05:58.993136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:05:58.994055 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:05:59.002674 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:05:59.003149 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:05:59.003949 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:05:59.004408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:05:59.199049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:05:59.207272 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a6f4b83-6168-4895-990f-25fabf1922e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.223892 Jul 24 02:05:59.207840 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3281/6665] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:05:58 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:00.225652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:00.226368 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:00.232920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:00.233380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:00.234204 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:00.234650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:00.423957 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:00.431587 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-090c3f38-9bbb-4a43-95bd-7c9006e778e4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.211054 Jul 24 02:06:00.432160 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3385/6666] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:00 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:01.450380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:01.450937 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:01.458554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:01.459020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:01.459798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:01.460246 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:01.588583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:01.596987 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9e585d45-a585-4d12-bb6c-6e2f0ae79641 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.151194 Jul 24 02:06:01.597570 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3282/6667] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:01 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:02.614044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:02.614915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:02.621827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:02.622284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:02.623053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:02.623490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:02.753161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:02.760748 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8f738a5-700e-4ffc-9a8d-f42554e3b76d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.150645 Jul 24 02:06:02.761326 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3386/6668] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:02 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:03.778856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:03.779484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:03.786963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:03.787427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:03.788200 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:03.788652 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:03.925269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:03.932921 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5bc69f64-9112-4fc9-8bec-12d2855dfd1b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.158142 Jul 24 02:06:03.933505 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3283/6669] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:03 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:04.950035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:04.950666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:04.957481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:04.957957 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:04.958793 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:04.959230 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:05.089591 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:05.097546 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-44597edc-218a-460f-83ee-e7ae781d925b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.151440 Jul 24 02:06:05.098154 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3387/6670] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:04 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:06.116504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:06.118115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:06.127263 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:06.127731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:06.128541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:06.129065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:06.286891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:06.294671 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8c254437-fa89-4fe4-b7a4-a676b780893a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.183040 Jul 24 02:06:06.295259 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3284/6671] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:06 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:07.316374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:07.316998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:07.323955 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:07.324409 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:07.325179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:07.325619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:07.455424 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:07.462940 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e031a915-7e30-49e4-946f-e3ae58e66ea0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.150749 Jul 24 02:06:07.463532 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3388/6672] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:07 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:08.480257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:08.480804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:08.488346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:08.488812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:08.489879 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:08.490324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:08.621831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:08.630193 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-89cf3d24-d32d-4f08-9f37-c525db270491 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.154000 Jul 24 02:06:08.630776 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3285/6673] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:08 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:09.647999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:09.648619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:09.655770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:09.656223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:09.656989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:09.657625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:09.793361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:09.801832 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac913b72-c9d1-4436-a20d-23a374a68135 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1655 microversion: 2.1 time: 0.157637 Jul 24 02:06:09.802413 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3389/6674] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:09 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:09.818859 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:09.819833 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:09.826837 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:09.827303 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:09.828076 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:09.828526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:09.856664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:09.863158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119562) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:06:09.869531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:06:09.870003 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:06:09.870492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:06:09.870912 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:06:09.871335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:06:09.935033 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9ce24f6a-d509-4841-bd5a-8fd69bcb87e3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action" status: 202 len: 0 microversion: 2.1 time: 0.120894 Jul 24 02:06:09.935644 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3286/6675] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:06:09 2022] POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:06:09.944573 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:09.945194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:09.951191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:09.951709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:09.952535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:09.953037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:10.086780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:10.095578 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-84e460fb-0c20-47fd-ba8f-196df826ecd0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.154337 Jul 24 02:06:10.096367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3390/6676] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:09 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:06:11.114360 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:11.115295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:11.122262 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:11.122736 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:11.123541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:11.123998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:11.318716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:11.326541 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d793bb0-b4f0-4d9e-b7d9-8415f0404594 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1678 microversion: 2.1 time: 0.216944 Jul 24 02:06:11.327066 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3287/6677] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:11 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:12.344670 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:12.346049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:12.352858 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:12.353310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:12.354101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:12.354543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:12.522151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:12.529584 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-503500f8-56b7-4bdb-8d04-b29cde3c6c26 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1683 microversion: 2.1 time: 0.188811 Jul 24 02:06:12.530185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3391/6678] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:12 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:13.548424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:13.549002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:13.556016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:13.556489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:13.557280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:13.557762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:13.703323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:13.712893 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44812b72-9b99-45fc-a5f7-e31e0c45d02e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1683 microversion: 2.1 time: 0.168382 Jul 24 02:06:13.713816 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3288/6679] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:13 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:14.209895 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-5262018e-2020-4f53-bdcc-ccf94c2ccf2a req-9c85a988-b0c3-49ed-a472-87f04ab5d6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b9bc10-150e-4e8d-8b54-95b1afe45e4c", "name": "network-vif-unplugged", "status": "completed", "tag": "437a1801-9b3b-45dd-94ba-836779ef97bb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:14.219119 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5262018e-2020-4f53-bdcc-ccf94c2ccf2a req-9c85a988-b0c3-49ed-a472-87f04ab5d6b0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:14.219569 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-5262018e-2020-4f53-bdcc-ccf94c2ccf2a req-9c85a988-b0c3-49ed-a472-87f04ab5d6b0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:14.232618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-5262018e-2020-4f53-bdcc-ccf94c2ccf2a req-9c85a988-b0c3-49ed-a472-87f04ab5d6b0 service nova] Creating event network-vif-unplugged:437a1801-9b3b-45dd-94ba-836779ef97bb for instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c on n-h1-master-1 Jul 24 02:06:14.238850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-5262018e-2020-4f53-bdcc-ccf94c2ccf2a req-9c85a988-b0c3-49ed-a472-87f04ab5d6b0 service nova] Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:06:14.250916 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-5262018e-2020-4f53-bdcc-ccf94c2ccf2a req-9c85a988-b0c3-49ed-a472-87f04ab5d6b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044760 Jul 24 02:06:14.251620 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3392/6680] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:06:14.731694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:14.733002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:14.741291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:14.742114 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:14.743090 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:14.743694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:14.885880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:14.893364 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3efe5c06-6c3e-4e73-bfee-ee1a370aac5a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1682 microversion: 2.1 time: 0.166157 Jul 24 02:06:14.893975 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3289/6681] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:14 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:15.911911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:15.912610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:15.918906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:15.919356 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:15.920115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:15.920553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:16.054699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:16.062188 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a51aadc1-b64d-42c8-b4e2-fdf20a0505ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1680 microversion: 2.1 time: 0.155638 Jul 24 02:06:16.062762 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3393/6682] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:15 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:06:16.265321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-3c82a402-06b6-49af-a052-5a53a1117180 req-4bb5518e-ac9a-4201-bd8b-35ba395ecd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b9bc10-150e-4e8d-8b54-95b1afe45e4c", "tag": "437a1801-9b3b-45dd-94ba-836779ef97bb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:16.274423 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3c82a402-06b6-49af-a052-5a53a1117180 req-4bb5518e-ac9a-4201-bd8b-35ba395ecd73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:16.274890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-3c82a402-06b6-49af-a052-5a53a1117180 req-4bb5518e-ac9a-4201-bd8b-35ba395ecd73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:16.287045 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-3c82a402-06b6-49af-a052-5a53a1117180 req-4bb5518e-ac9a-4201-bd8b-35ba395ecd73 service nova] Creating event network-changed:437a1801-9b3b-45dd-94ba-836779ef97bb for instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c on n-h1-master-1 Jul 24 02:06:16.293008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-3c82a402-06b6-49af-a052-5a53a1117180 req-4bb5518e-ac9a-4201-bd8b-35ba395ecd73 service nova] Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:06:16.308865 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-3c82a402-06b6-49af-a052-5a53a1117180 req-4bb5518e-ac9a-4201-bd8b-35ba395ecd73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047237 Jul 24 02:06:16.309479 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3290/6683] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:06:17.081143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:17.081795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:17.088699 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:17.089149 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:17.089954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:17.090394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:17.236251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:17.244955 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0b53150b-22ec-4a34-b0da-132c9da347ed tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1676 microversion: 2.1 time: 0.168574 Jul 24 02:06:17.246007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3394/6684] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:17 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:17.263301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ab2a8e92-6c04-48e3-908f-a79661a25b6e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:17.263951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ab2a8e92-6c04-48e3-908f-a79661a25b6e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:17.272692 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab2a8e92-6c04-48e3-908f-a79661a25b6e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:17.273911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab2a8e92-6c04-48e3-908f-a79661a25b6e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:17.274730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab2a8e92-6c04-48e3-908f-a79661a25b6e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:17.275188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ab2a8e92-6c04-48e3-908f-a79661a25b6e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:17.338655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ab2a8e92-6c04-48e3-908f-a79661a25b6e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action" status: 204 len: 0 microversion: 2.1 time: 0.079313 Jul 24 02:06:17.339379 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3291/6685] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:06:17 2022] POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:06:17.349575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:17.351427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:17.362904 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:17.364101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:17.365575 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:17.366304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:17.605126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:17.613537 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab46dfa3-a8da-4562-9677-8e5178217ddc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1676 microversion: 2.1 time: 0.269599 Jul 24 02:06:17.614367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3395/6686] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:17 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:18.633034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:18.633797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:18.640321 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:18.640797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:18.641623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:18.642400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:18.861887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:18.869633 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2c252426-72de-45d2-a485-83d00460de62 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1655 microversion: 2.1 time: 0.241899 Jul 24 02:06:18.870172 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3292/6687] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:18 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1655 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:18.885899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:18.886513 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:18.893919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:18.894372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:18.895124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:18.895554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:19.109774 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:19.118125 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-da09c606-0e33-40d2-baed-b253f1eb373e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1655 microversion: 2.1 time: 0.236007 Jul 24 02:06:19.119057 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3396/6688] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:18 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1655 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:19.135125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7438280e-c6ab-42c5-9ef9-4498e750b36a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:19.141305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7438280e-c6ab-42c5-9ef9-4498e750b36a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:19.141847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7438280e-c6ab-42c5-9ef9-4498e750b36a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:19.163805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7438280e-c6ab-42c5-9ef9-4498e750b36a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Going to try to start instance {{(pid=119562) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 02:06:19.205953 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7438280e-c6ab-42c5-9ef9-4498e750b36a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action" status: 202 len: 0 microversion: 2.1 time: 0.074519 Jul 24 02:06:19.206557 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3293/6689] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:06:19 2022] POST /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:06:19.214732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:19.215446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:19.222609 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:19.223146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:19.223998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:19.224375 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:19.374302 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:19.384291 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cfc5a8c3-740e-45fb-bf7a-1aa6ef0f1fab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1664 microversion: 2.1 time: 0.173184 Jul 24 02:06:19.385539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3397/6690] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:19 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:19.507418 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5ff2e794-e2b5-43c5-81d0-594ff284ee64 req-0ef9d859-fc00-47ca-aa89-7ccc73095cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b9bc10-150e-4e8d-8b54-95b1afe45e4c", "name": "network-vif-plugged", "status": "completed", "tag": "437a1801-9b3b-45dd-94ba-836779ef97bb"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:19.517496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5ff2e794-e2b5-43c5-81d0-594ff284ee64 req-0ef9d859-fc00-47ca-aa89-7ccc73095cac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:19.517999 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5ff2e794-e2b5-43c5-81d0-594ff284ee64 req-0ef9d859-fc00-47ca-aa89-7ccc73095cac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:19.530258 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5ff2e794-e2b5-43c5-81d0-594ff284ee64 req-0ef9d859-fc00-47ca-aa89-7ccc73095cac service nova] Creating event network-vif-plugged:437a1801-9b3b-45dd-94ba-836779ef97bb for instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c on n-h1-master-1 Jul 24 02:06:19.536182 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5ff2e794-e2b5-43c5-81d0-594ff284ee64 req-0ef9d859-fc00-47ca-aa89-7ccc73095cac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102990 Jul 24 02:06:19.536807 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3294/6691] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:06:20.403164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:20.403720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:20.411621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:20.412071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:20.412837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:20.413262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:20.550747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:20.558515 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aa536b18-00fd-4c79-99cf-acec19077eda tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1668 microversion: 2.1 time: 0.159343 Jul 24 02:06:20.559086 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3398/6692] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:20 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:20.576571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:20.577201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:20.584442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:20.584906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:20.585713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:20.586174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:20.589040 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:20.619927 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:06:20.699740 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1603377-6d31-45e9-9bc2-02591db0c425 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 204 len: 0 microversion: 2.1 time: 0.127892 Jul 24 02:06:20.703551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3295/6693] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:06:20 2022] DELETE /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:06:20.712160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:20.712780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:20.718864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:20.719313 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:20.721035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:20.721487 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:20.854735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:20.858321 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:20.863324 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ecf6f3c-7e35-4005-9684-27a4b6e144fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1674 microversion: 2.1 time: 0.157227 Jul 24 02:06:20.863921 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3399/6694] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:20 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:06:21.881700 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:21.882474 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:21.889681 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:21.890163 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:21.890946 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:21.891431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:22.024594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:22.032478 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5e0722e3-33d2-4d10-aadf-66cd43b440cf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 200 len: 1674 microversion: 2.1 time: 0.155590 Jul 24 02:06:22.033121 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3296/6695] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:21 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:22.856710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-990adccb-1060-4b11-ab6e-65b9533a5be3 req-82761fbd-9edb-42da-a4b9-3376f2cc2617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b9bc10-150e-4e8d-8b54-95b1afe45e4c", "name": "network-vif-deleted", "tag": "437a1801-9b3b-45dd-94ba-836779ef97bb"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:22.869715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-990adccb-1060-4b11-ab6e-65b9533a5be3 req-82761fbd-9edb-42da-a4b9-3376f2cc2617 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:22.870173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-990adccb-1060-4b11-ab6e-65b9533a5be3 req-82761fbd-9edb-42da-a4b9-3376f2cc2617 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:22.885029 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-990adccb-1060-4b11-ab6e-65b9533a5be3 req-82761fbd-9edb-42da-a4b9-3376f2cc2617 service nova] Creating event network-vif-deleted:437a1801-9b3b-45dd-94ba-836779ef97bb for instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c on n-h1-master-1 Jul 24 02:06:22.890352 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-990adccb-1060-4b11-ab6e-65b9533a5be3 req-82761fbd-9edb-42da-a4b9-3376f2cc2617 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037695 Jul 24 02:06:22.891237 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3400/6696] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:06:23.050952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:23.051771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:23.060571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:23.061096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:23.061987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:23.062508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:23.079651 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c HTTP/1.1 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: exception: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'e5b9bc10-150e-4e8d-8b54-95b1afe45e4c'} Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:06:23.082335 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:06:23.085919 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d05750d0-3073-453d-af67-2003045d9e8d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 404 len: 111 microversion: 2.1 time: 0.037993 Jul 24 02:06:23.098304 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3297/6697] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:23 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:06:23.105173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:23.105926 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:23.112641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:23.113097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:23.113929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:23.114844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:23.130066 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c HTTP/1.1 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: exception: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e5b9bc10-150e-4e8d-8b54-95b1afe45e4c'} Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:06:23.131873 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:06:23.135820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:06:23.136326 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9fad077f-595b-4c01-91ed-5216f1f61fdd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 404 len: 111 microversion: 2.1 time: 0.034666 Jul 24 02:06:23.136982 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3401/6698] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:23 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:06:23.186096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-508366299", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "515f0778-c427-42dc-963a-6220ed8237d8"}], "security_groups": [{"name": "tempest-securitygroup--893383063"}], "key_name": "tempest-keypair-620695224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:23.291884 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] validate_networks() for [('515f0778-c427-42dc-963a-6220ed8237d8', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:06:23.730880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:06:23.731320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:06:23.731819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:06:23.732220 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:06:23.732674 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:06:23.743632 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:23.744093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:23.744909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:23.745353 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:23.762890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:06:23.768801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for user 4ca622718e5c42dc9a71b80fca387e66 and project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:06:23.781969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:06:23.784649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:06:23.833913 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-244ca5e5-e940-4e72-ba40-c22cc13ae961 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.651707 Jul 24 02:06:23.834754 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3298/6699] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:06:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:06:23.845295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-db1f5014-857e-47fe-a22d-05fd727bfdba tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:23.846153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-db1f5014-857e-47fe-a22d-05fd727bfdba tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:23.904889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-db1f5014-857e-47fe-a22d-05fd727bfdba tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:23.914184 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-db1f5014-857e-47fe-a22d-05fd727bfdba tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1237 microversion: 2.1 time: 0.073206 Jul 24 02:06:23.925017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3402/6700] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:23 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:24.933315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:24.934670 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:24.941645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:24.942144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:24.942940 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:24.943407 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:25.011823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:25.019936 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1603fbed-54bf-42be-b7fe-087c424c9f89 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1295 microversion: 2.1 time: 0.091482 Jul 24 02:06:25.020662 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3299/6701] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:24 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:26.037201 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:26.038000 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:26.045533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:26.046192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:26.047275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:26.047756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:26.240891 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:26.250025 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-96faf01c-abef-430e-b010-787a07dde6f3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.216712 Jul 24 02:06:26.251544 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3403/6702] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:26 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:26.371305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-68cb2967-4d83-4177-93cc-186c563fa9bc req-55315de8-d77f-4de7-b496-dbc61024a298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:26.380677 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-68cb2967-4d83-4177-93cc-186c563fa9bc req-55315de8-d77f-4de7-b496-dbc61024a298 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:26.381296 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-68cb2967-4d83-4177-93cc-186c563fa9bc req-55315de8-d77f-4de7-b496-dbc61024a298 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:26.394339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-68cb2967-4d83-4177-93cc-186c563fa9bc req-55315de8-d77f-4de7-b496-dbc61024a298 service nova] Creating event network-changed:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h2-master-1 Jul 24 02:06:26.399600 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-68cb2967-4d83-4177-93cc-186c563fa9bc req-55315de8-d77f-4de7-b496-dbc61024a298 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118460 Jul 24 02:06:26.400335 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3300/6703] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:06:27.268180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:27.268792 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:27.275716 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:27.276166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:27.276926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:27.277383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:27.405567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:27.413125 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-76112b36-15f4-46d3-81a0-94911aed4467 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.148970 Jul 24 02:06:27.413717 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3404/6704] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:27 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:28.432364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:28.432999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:28.439882 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:28.440366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:28.441143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:28.441594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:28.574434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:28.582550 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0cdd3d41-0692-4400-9f89-ca609bb260a1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.155465 Jul 24 02:06:28.583130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3301/6705] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:28 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:29.600576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:29.601194 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:29.603671 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:29.609501 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:29.610185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:29.610961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:29.611399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:29.749353 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:29.757345 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-73ded84c-ab4a-4de6-baab-30eed5e8b959 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.160951 Jul 24 02:06:29.757961 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3405/6706] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:29 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:06:30.775357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:30.775996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:30.778913 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:30.784831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:30.785299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:30.786114 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:30.786565 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:30.919098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:30.926847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6db3d38b-1918-4086-9261-f75003cd4850 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.155462 Jul 24 02:06:30.927437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3302/6707] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:30 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:31.944911 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:31.945530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:31.952538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:31.952986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:31.953847 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:31.954314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:32.085260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:32.092861 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-07bb1216-63aa-4c15-853c-2af420bf5593 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.151947 Jul 24 02:06:32.093437 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3406/6708] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:31 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:32.212801 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:06:32.213257 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:06:32.666404 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:06:32.666611 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:06:33.109565 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:33.110869 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:33.118442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:33.118916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:33.119721 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:33.120178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:33.248896 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:33.256706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f711959-4cb1-4d48-8ea0-cb099e7d7c45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.151086 Jul 24 02:06:33.257272 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3303/6709] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:33 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:33.839552 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-802ffde9-fb0e-4e90-b245-146bdc58a5a1 req-9fadd4ac-36cf-4209-9bc5-9f0e76f29a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "name": "network-vif-plugged", "status": "completed", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:33.848877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-802ffde9-fb0e-4e90-b245-146bdc58a5a1 req-9fadd4ac-36cf-4209-9bc5-9f0e76f29a71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:33.849331 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-802ffde9-fb0e-4e90-b245-146bdc58a5a1 req-9fadd4ac-36cf-4209-9bc5-9f0e76f29a71 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:33.861042 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-802ffde9-fb0e-4e90-b245-146bdc58a5a1 req-9fadd4ac-36cf-4209-9bc5-9f0e76f29a71 service nova] Creating event network-vif-plugged:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h2-master-1 Jul 24 02:06:33.866305 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-802ffde9-fb0e-4e90-b245-146bdc58a5a1 req-9fadd4ac-36cf-4209-9bc5-9f0e76f29a71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030574 Jul 24 02:06:33.866902 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3407/6710] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:06:34.274155 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:34.274823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:34.276700 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:34.277376 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:34.285319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:34.285816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:34.286607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:34.287060 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:34.417011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:34.425250 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7c5e40d0-11a3-4253-9ab7-374d5922cf11 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1362 microversion: 2.1 time: 0.155004 Jul 24 02:06:34.425850 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3304/6711] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:34 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:35.439661 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:35.446841 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:35.447277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:35.455208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:35.455897 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:35.456939 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:35.457482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:35.588387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:06:35.597372 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-83512287-0b9e-4af1-9c89-e487bdd5414f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1547 microversion: 2.1 time: 0.158758 Jul 24 02:06:35.597968 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3408/6712] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:06:35 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:06:35.614160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cba254f4-3908-4bd0-9b9c-625a3140e9bb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:06:35.615050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cba254f4-3908-4bd0-9b9c-625a3140e9bb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:06:35.621986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cba254f4-3908-4bd0-9b9c-625a3140e9bb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:35.622450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cba254f4-3908-4bd0-9b9c-625a3140e9bb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:35.623226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cba254f4-3908-4bd0-9b9c-625a3140e9bb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:35.623675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cba254f4-3908-4bd0-9b9c-625a3140e9bb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:35.703467 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cba254f4-3908-4bd0-9b9c-625a3140e9bb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093246 Jul 24 02:06:35.704087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3305/6713] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 02:06:35 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:06:37.076989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-c140d276-67e2-4451-831e-29be2c54bebe req-1f4704a4-288d-4405-a346-aa3e62ae1f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:06:37.085936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c140d276-67e2-4451-831e-29be2c54bebe req-1f4704a4-288d-4405-a346-aa3e62ae1f7a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:06:37.086388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-c140d276-67e2-4451-831e-29be2c54bebe req-1f4704a4-288d-4405-a346-aa3e62ae1f7a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:06:37.098228 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-c140d276-67e2-4451-831e-29be2c54bebe req-1f4704a4-288d-4405-a346-aa3e62ae1f7a service nova] Creating event network-changed:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h2-master-1 Jul 24 02:06:37.103003 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-c140d276-67e2-4451-831e-29be2c54bebe req-1f4704a4-288d-4405-a346-aa3e62ae1f7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078342 Jul 24 02:06:37.103591 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3409/6714] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:07:38.694915 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=7 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:38.695685 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:38.700096 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:07:38.701125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:38.712464 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:38.712926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:38.713728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:38.714178 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:38.745340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:38.751197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119562) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:07:38.758071 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:07:38.758504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:07:38.758988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:07:38.759407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:07:38.759826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:07:38.822052 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1e37657d-dccf-490e-b858-30cd0dc2452a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7/action" status: 202 len: 0 microversion: 2.1 time: 0.129659 Jul 24 02:07:38.822672 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3306/6715] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:07:38 2022] POST /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:07:38.829815 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=9 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:38.830560 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=38 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:38.836087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:38.836625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:38.846506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:38.847010 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:38.847789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:38.848333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:38.984503 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:38.993060 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e15967b3-9407-4fc2-bf01-9a9922520470 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1675 microversion: 2.1 time: 0.165976 Jul 24 02:07:38.993658 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3410/6716] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:38 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:07:40.010911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:40.011458 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:40.019107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:40.019579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:40.020367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:40.020824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:40.192398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:40.200547 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-260b0a5e-9c6a-4906-94d6-3070c4423394 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1675 microversion: 2.1 time: 0.194577 Jul 24 02:07:40.201125 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3307/6717] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:40 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:41.218616 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:41.219228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:41.226783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:41.227228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:41.227988 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:41.228423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:41.358505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:41.366423 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d41014bc-6767-4050-bf53-c4e88eef128f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.151771 Jul 24 02:07:41.366951 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3411/6718] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:41 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:42.383868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:42.384429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:42.391409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:42.391887 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:42.392713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:42.393173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:42.525124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:42.532746 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c56e973b-ed1d-4c92-ad7e-ca5209b936d8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.152917 Jul 24 02:07:42.533329 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3308/6719] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:42 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:43.551236 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:43.551851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:43.558805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:43.559285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:43.560054 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:43.560493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:43.698084 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:43.705548 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a272ad10-9b82-4302-8189-ea79e98c3c54 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.158810 Jul 24 02:07:43.706382 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3412/6720] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:43 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:44.722703 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:44.723339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:44.730359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:44.730829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:44.731618 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:44.732078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:44.865197 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:44.872834 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ce15c2b-8e69-4fa1-b313-4d9c993aaddb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.154055 Jul 24 02:07:44.873419 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3309/6721] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:44 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:45.890793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:45.891684 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:45.899505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:45.899951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:45.900708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:45.901138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:46.032579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:46.040295 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a6295ba-abd8-4e5f-b30d-8f5817e4d60b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.153459 Jul 24 02:07:46.040864 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3413/6722] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:45 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:47.057919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:47.058549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:47.066368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:47.066848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:47.067649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:47.068106 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:47.202089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:47.210485 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50fea140-2c75-45a3-9fad-4218b6f61d7c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.156598 Jul 24 02:07:47.211063 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3310/6723] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:47 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:48.227707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:48.228319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:48.235086 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:48.235533 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:48.236297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:48.236728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:48.365160 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:48.372780 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be4c3c6b-dc80-4783-982e-da90064b7278 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.148951 Jul 24 02:07:48.373288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3414/6724] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:48 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:49.390532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:49.391169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:49.398590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:49.399065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:49.399851 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:49.400309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:49.532799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:49.541529 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2e2cedaa-0ce5-4692-b0d4-44237718f22a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.154667 Jul 24 02:07:49.541998 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3311/6725] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:49 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:50.558789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:50.559411 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:50.567471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:50.567929 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:50.568702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:50.569146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:50.700788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:50.708612 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7448dafb-9d3d-4fa8-96c9-0814eabea953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.153743 Jul 24 02:07:50.709180 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3415/6726] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:50 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:51.725810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:51.726446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:51.733357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:51.733861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:51.734648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:51.735102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:51.870032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:51.878359 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c9ce3cd0-6314-438c-bb87-685f6152cdcd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1680 microversion: 2.1 time: 0.155981 Jul 24 02:07:51.879323 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3312/6727] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:51 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:52.895790 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:52.896409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:52.903550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:52.904012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:52.904799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:52.905236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:53.038856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:53.046455 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-232922b1-a9cb-4018-a0aa-855320f3a324 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1679 microversion: 2.1 time: 0.154661 Jul 24 02:07:53.047038 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3416/6728] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:52 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:53.368387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0764bc47-2a4a-411e-a38d-0b1c8afdabe4 req-2075283d-2339-4a80-9c8d-0971a4f35040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "name": "network-vif-unplugged", "status": "completed", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:07:53.378478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0764bc47-2a4a-411e-a38d-0b1c8afdabe4 req-2075283d-2339-4a80-9c8d-0971a4f35040 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:53.378957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0764bc47-2a4a-411e-a38d-0b1c8afdabe4 req-2075283d-2339-4a80-9c8d-0971a4f35040 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:53.391849 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0764bc47-2a4a-411e-a38d-0b1c8afdabe4 req-2075283d-2339-4a80-9c8d-0971a4f35040 service nova] Creating event network-vif-unplugged:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h1-master-1 Jul 24 02:07:53.400726 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-0764bc47-2a4a-411e-a38d-0b1c8afdabe4 req-2075283d-2339-4a80-9c8d-0971a4f35040 service nova] Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:07:53.413257 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0764bc47-2a4a-411e-a38d-0b1c8afdabe4 req-2075283d-2339-4a80-9c8d-0971a4f35040 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110350 Jul 24 02:07:53.414099 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3313/6729] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:07:54.064390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:54.065003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:54.072605 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:54.073050 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:54.073860 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:54.074296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:54.212334 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:54.220226 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bfa57bb4-4339-42ce-9a26-76c19327643c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1679 microversion: 2.1 time: 0.159701 Jul 24 02:07:54.220894 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3417/6730] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:54 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:55.241270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:55.242028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:55.248366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:55.248829 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:55.249604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:55.250083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:55.381751 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:55.389324 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15dac806-9f23-4854-afb3-9ad5932bc6b7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1677 microversion: 2.1 time: 0.154306 Jul 24 02:07:55.389950 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3314/6731] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:55 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:55.428099 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1c6a8f44-32df-4b97-a80a-f9b7072280e2 req-083308d6-7479-4300-bb07-255218d496f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:07:55.436971 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1c6a8f44-32df-4b97-a80a-f9b7072280e2 req-083308d6-7479-4300-bb07-255218d496f2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:55.437421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1c6a8f44-32df-4b97-a80a-f9b7072280e2 req-083308d6-7479-4300-bb07-255218d496f2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:55.448750 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1c6a8f44-32df-4b97-a80a-f9b7072280e2 req-083308d6-7479-4300-bb07-255218d496f2 service nova] Creating event network-changed:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h1-master-1 Jul 24 02:07:55.454035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-1c6a8f44-32df-4b97-a80a-f9b7072280e2 req-083308d6-7479-4300-bb07-255218d496f2 service nova] Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:07:55.465324 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1c6a8f44-32df-4b97-a80a-f9b7072280e2 req-083308d6-7479-4300-bb07-255218d496f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040965 Jul 24 02:07:55.465947 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3418/6732] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:07:56.407442 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:56.408076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:56.415784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.416483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.417268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.417734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.560641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:56.575489 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c5694788-0d40-45ef-a1b6-cc1bc81e7634 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1674 microversion: 2.1 time: 0.171994 Jul 24 02:07:56.576096 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3315/6733] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:56 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:56.594297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:07:56.594929 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:56.601594 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.602134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.602918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.603361 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.645836 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.646639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.647436 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.647874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.670644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for project 65afddc02ce0461988f64f41f706be14. Resources: {'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:07:56.675809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for user 4ca622718e5c42dc9a71b80fca387e66 and project 65afddc02ce0461988f64f41f706be14. Resources: {'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:07:56.775376 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6ae0812a-479d-4b35-905e-b1f210dc0714 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7/action" status: 202 len: 0 microversion: 2.1 time: 0.186117 Jul 24 02:07:56.776013 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3419/6734] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:07:56 2022] POST /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:07:56.784447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:56.785170 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:56.791601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.792065 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.793061 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:56.793499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:56.926647 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:56.934685 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-52d447ab-7285-4780-8903-285132836a8e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1673 microversion: 2.1 time: 0.154266 Jul 24 02:07:56.935417 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3316/6735] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:56 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:57.954102 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:57.955385 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:57.962653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:57.963101 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:57.963872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:57.964308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:58.102052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:58.110534 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-739defd5-061d-4789-80c7-5a54fe218b1a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1673 microversion: 2.1 time: 0.161826 Jul 24 02:07:58.121842 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3420/6736] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:57 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:58.162567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d59e3bbd-9299-4b6a-8218-e0332acab265 req-bdb99e49-dd46-4c07-994f-ea6a3a6931be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "name": "network-vif-plugged", "status": "completed", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:07:58.170668 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d59e3bbd-9299-4b6a-8218-e0332acab265 req-bdb99e49-dd46-4c07-994f-ea6a3a6931be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:58.171133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d59e3bbd-9299-4b6a-8218-e0332acab265 req-bdb99e49-dd46-4c07-994f-ea6a3a6931be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:58.183753 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d59e3bbd-9299-4b6a-8218-e0332acab265 req-bdb99e49-dd46-4c07-994f-ea6a3a6931be service nova] Creating event network-vif-plugged:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h1-master-1 Jul 24 02:07:58.189206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-d59e3bbd-9299-4b6a-8218-e0332acab265 req-bdb99e49-dd46-4c07-994f-ea6a3a6931be service nova] Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:07:58.200477 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d59e3bbd-9299-4b6a-8218-e0332acab265 req-bdb99e49-dd46-4c07-994f-ea6a3a6931be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101421 Jul 24 02:07:58.201093 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3317/6737] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:07:59.128483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:07:59.130637 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:07:59.145420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:59.146135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:59.147351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:59.147351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:59.298328 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:07:59.306955 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d847c823-0a4f-47a9-9c4c-5678bc227953 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1673 microversion: 2.1 time: 0.182449 Jul 24 02:07:59.307760 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3421/6738] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:07:59 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:07:59.806882 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b4be911d-115c-45d0-9668-13da4cd813a7 req-29c0360f-3b71-47ca-bb1a-e7ab915d6386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "name": "network-vif-unplugged", "status": "completed", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:07:59.816083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b4be911d-115c-45d0-9668-13da4cd813a7 req-29c0360f-3b71-47ca-bb1a-e7ab915d6386 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:07:59.816649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b4be911d-115c-45d0-9668-13da4cd813a7 req-29c0360f-3b71-47ca-bb1a-e7ab915d6386 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:07:59.829346 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b4be911d-115c-45d0-9668-13da4cd813a7 req-29c0360f-3b71-47ca-bb1a-e7ab915d6386 service nova] Creating event network-vif-unplugged:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h2-master-1 Jul 24 02:07:59.835460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-b4be911d-115c-45d0-9668-13da4cd813a7 req-29c0360f-3b71-47ca-bb1a-e7ab915d6386 service nova] Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:07:59.846052 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b4be911d-115c-45d0-9668-13da4cd813a7 req-29c0360f-3b71-47ca-bb1a-e7ab915d6386 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044748 Jul 24 02:07:59.846731 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3318/6739] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:08:00.324480 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:00.325096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:00.332756 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:00.333473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:00.334282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:00.334718 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:00.542668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:00.550419 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6938b354-5dc2-4b15-b7da-0c670d88318f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1673 microversion: 2.1 time: 0.229779 Jul 24 02:08:00.551304 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3422/6740] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:00 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:01.570130 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:01.570857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:01.577349 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:01.577864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:01.578657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:01.579116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:01.712910 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:01.720550 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cdbaa3c2-1290-4b56-81c7-54f2919a1ee2 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1673 microversion: 2.1 time: 0.156701 Jul 24 02:08:01.721130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3319/6741] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:01 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:01.870182 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-46803a70-7fd0-4a26-839c-c642e78de0c3 req-69147a6e-b711-4d5f-9a4e-1d7b0c67d63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:08:01.879218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-46803a70-7fd0-4a26-839c-c642e78de0c3 req-69147a6e-b711-4d5f-9a4e-1d7b0c67d63a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:01.879674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-46803a70-7fd0-4a26-839c-c642e78de0c3 req-69147a6e-b711-4d5f-9a4e-1d7b0c67d63a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:01.890942 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-46803a70-7fd0-4a26-839c-c642e78de0c3 req-69147a6e-b711-4d5f-9a4e-1d7b0c67d63a service nova] Creating event network-changed:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h2-master-1 Jul 24 02:08:01.896744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-46803a70-7fd0-4a26-839c-c642e78de0c3 req-69147a6e-b711-4d5f-9a4e-1d7b0c67d63a service nova] Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:08:01.907285 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-46803a70-7fd0-4a26-839c-c642e78de0c3 req-69147a6e-b711-4d5f-9a4e-1d7b0c67d63a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040777 Jul 24 02:08:01.907885 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3423/6742] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:08:02.739216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:02.739798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:02.746997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:02.747458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:02.748233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:02.748683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:02.878689 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:02.886914 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4187e15c-8852-4053-b34f-c5a4e25ca666 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1673 microversion: 2.1 time: 0.152577 Jul 24 02:08:02.887481 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3320/6743] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:02 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:03.905767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:03.906415 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:03.913327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:03.913811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:03.914586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:03.915027 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:03.919022 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:04.095758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:04.103627 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-382cf3ef-1d6e-4bae-ab86-e01913f59eae tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1673 microversion: 2.1 time: 0.202986 Jul 24 02:08:04.104216 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3424/6744] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:03 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:05.121219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:05.121915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:05.129105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.129686 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.130558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.131017 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.266777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:05.275091 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cc2e6c4d-d0b3-4532-9dd4-30469558144d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1666 microversion: 2.1 time: 0.158320 Jul 24 02:08:05.275665 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3321/6745] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:05 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:05.291769 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:05.292390 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:05.299102 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.299551 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.300312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.300962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.433323 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:05.440880 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c3ce1ead-da1f-4295-915c-3ce6f7fe8e48 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1666 microversion: 2.1 time: 0.153108 Jul 24 02:08:05.442165 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3425/6746] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:05 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:05.458005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:05.458652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:05.464666 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.465126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.465932 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.466381 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.470401 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:05.603597 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:05.611130 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3eb74e0d-60fb-448a-86b5-400a239753f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1666 microversion: 2.1 time: 0.157652 Jul 24 02:08:05.611703 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3322/6747] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:05 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:05.627317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:05.627805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:05.634693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.635088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.635841 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.636273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.661443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:08:05.735654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d4b12704-96d5-4c9e-9d4b-d116e473dc6c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 204 len: 0 microversion: 2.1 time: 0.111653 Jul 24 02:08:05.736444 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3426/6748] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:08:05 2022] DELETE /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:08:05.746403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:05.747035 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:05.753041 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.753500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.755049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:05.755499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:05.885399 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:05.893009 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42c3d6c1-6fc0-490d-971b-bbc0347a3a69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1672 microversion: 2.1 time: 0.150500 Jul 24 02:08:05.893923 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3323/6749] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:05 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:06.914216 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:06.915033 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:06.917879 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:06.923563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:06.924015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:06.925805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:06.927081 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:07.061289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:07.069891 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-47c3fb10-1714-449a-8d8f-48d9f794d47d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1672 microversion: 2.1 time: 0.161872 Jul 24 02:08:07.070457 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3427/6750] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:06 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:08.093125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:08.096556 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:08.105186 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:08.105704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:08.106589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:08.107035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:08.156970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-9329351e-4c88-45b2-91a9-6439b245da5e req-0836dd85-8019-4a38-99b4-18afb16a8574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36eb4660-e101-4a7b-9552-dd78da7e60f7", "name": "network-vif-deleted", "tag": "27d6e6fe-8a62-45a8-b379-c13d2f9778e3"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:08:08.168631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9329351e-4c88-45b2-91a9-6439b245da5e req-0836dd85-8019-4a38-99b4-18afb16a8574 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:08.169080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-9329351e-4c88-45b2-91a9-6439b245da5e req-0836dd85-8019-4a38-99b4-18afb16a8574 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:08.184138 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-9329351e-4c88-45b2-91a9-6439b245da5e req-0836dd85-8019-4a38-99b4-18afb16a8574 service nova] Creating event network-vif-deleted:27d6e6fe-8a62-45a8-b379-c13d2f9778e3 for instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 on n-h2-master-1 Jul 24 02:08:08.188452 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:08.192530 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-9329351e-4c88-45b2-91a9-6439b245da5e req-0836dd85-8019-4a38-99b4-18afb16a8574 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038849 Jul 24 02:08:08.194320 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3428/6751] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:08:08.202087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffa5b30b-2ff0-4ec1-90eb-18d0c113902f tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 200 len: 1605 microversion: 2.1 time: 0.118507 Jul 24 02:08:08.203125 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3324/6752] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:08 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 1605 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:09.220981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:09.221750 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:09.224652 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:09.229792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:09.230251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:09.231029 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:09.231472 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:09.247315 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 HTTP/1.1 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '36eb4660-e101-4a7b-9552-dd78da7e60f7'} Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:08:09.248995 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2d954312-2a12-4a08-b40a-679569338f9e tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 404 len: 111 microversion: 2.1 time: 0.033749 Jul 24 02:08:09.252780 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3429/6753] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:09 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:08:09.266414 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:09.267076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:09.270953 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=43 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:09.276309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:09.276784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:09.277616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:09.278199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:09.298293 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 HTTP/1.1 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '36eb4660-e101-4a7b-9552-dd78da7e60f7'} Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:08:09.299989 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81f91663-ef15-48c0-992d-f238724428ee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 404 len: 111 microversion: 2.1 time: 0.039089 Jul 24 02:08:09.304410 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3325/6754] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:09 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:08:09.349870 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-673811877", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "515f0778-c427-42dc-963a-6220ed8237d8"}], "security_groups": [{"name": "tempest-securitygroup--893383063"}], "key_name": "tempest-keypair-620695224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:08:09.453793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] validate_networks() for [('515f0778-c427-42dc-963a-6220ed8237d8', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:08:09.913282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:08:09.913731 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:08:09.914206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:08:09.914614 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:08:09.915023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:08:09.926960 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:09.927404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:09.928202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:09.928637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:09.945257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:08:09.950459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for user 4ca622718e5c42dc9a71b80fca387e66 and project 65afddc02ce0461988f64f41f706be14. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:08:09.963136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:08:09.965384 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:08:10.011104 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-333a198b-df80-4349-92d1-b4aa23344833 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.665280 Jul 24 02:08:10.011755 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3430/6755] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:08:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:08:10.022143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9be03e74-7cbf-46ac-a675-a225a7d09bb1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:10.022805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9be03e74-7cbf-46ac-a675-a225a7d09bb1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:10.077124 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9be03e74-7cbf-46ac-a675-a225a7d09bb1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:10.087064 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9be03e74-7cbf-46ac-a675-a225a7d09bb1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1237 microversion: 2.1 time: 0.069138 Jul 24 02:08:10.087627 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3326/6756] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:10 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:11.105380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:11.106310 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:11.114535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:11.115603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:11.116792 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:11.117462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:11.193528 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:11.201209 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a4ae43f8-5a9d-49fc-8b6a-a021a61d1aaf tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1307 microversion: 2.1 time: 0.100592 Jul 24 02:08:11.201805 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3431/6757] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:11 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:12.219310 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:12.221307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:12.230049 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:12.230521 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:12.231500 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:12.231968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:12.430531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:12.438169 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c3f1420-237c-4ce9-a4bf-31eb36549126 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1362 microversion: 2.1 time: 0.222829 Jul 24 02:08:12.438738 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3327/6758] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:12 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:12.496414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0acb637c-c89a-46c3-b26b-79ab042ad4fb req-79181edb-3d06-4469-8571-98161dfdcf3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8566a46-bc51-45e5-824f-26ae62468ffa", "tag": "62d696fe-20df-4b19-bd84-154e56a1bc13"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:08:12.511225 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0acb637c-c89a-46c3-b26b-79ab042ad4fb req-79181edb-3d06-4469-8571-98161dfdcf3c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:12.511674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0acb637c-c89a-46c3-b26b-79ab042ad4fb req-79181edb-3d06-4469-8571-98161dfdcf3c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:12.528904 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0acb637c-c89a-46c3-b26b-79ab042ad4fb req-79181edb-3d06-4469-8571-98161dfdcf3c service nova] Creating event network-changed:62d696fe-20df-4b19-bd84-154e56a1bc13 for instance c8566a46-bc51-45e5-824f-26ae62468ffa on n-h2-master-1 Jul 24 02:08:12.533661 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0acb637c-c89a-46c3-b26b-79ab042ad4fb req-79181edb-3d06-4469-8571-98161dfdcf3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040972 Jul 24 02:08:12.534400 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3432/6759] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:08:13.457059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:13.457809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:13.466947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:13.467418 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:13.468214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:13.468672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:13.595483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:13.603742 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-052962b8-55f8-46f1-ab9a-d0833f91b4b0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1362 microversion: 2.1 time: 0.150705 Jul 24 02:08:13.604342 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3328/6760] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:13 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:14.623357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:14.624064 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:14.632761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:14.633216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:14.634021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:14.634463 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:14.770559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:14.778605 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a90c2d67-80d2-407a-99b3-add39047a159 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1362 microversion: 2.1 time: 0.160443 Jul 24 02:08:14.780151 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3433/6761] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:14 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:15.797964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:15.798628 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:15.806672 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:15.807144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:15.807930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:15.808383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:15.945364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:15.952914 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f476a11-32e9-4728-beb9-8db61d8236f0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1362 microversion: 2.1 time: 0.159314 Jul 24 02:08:15.953463 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3329/6762] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:15 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:16.969994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:16.970626 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:16.977899 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:16.978366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:16.979146 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:16.979588 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:17.109526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:17.118047 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-005146a4-83c9-4e7b-ae6e-ebb63f35898c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1362 microversion: 2.1 time: 0.151900 Jul 24 02:08:17.118633 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3434/6763] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:16 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:18.135835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:18.136467 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:18.143398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:18.143863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:18.144639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:18.145786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:18.278321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:18.286109 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d5ffb158-f2ba-4203-ae93-9d1cc1d67e78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1362 microversion: 2.1 time: 0.154068 Jul 24 02:08:18.286691 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3330/6764] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:18 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:18.449491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7788d4bf-7388-49d1-b709-cfb0d19e3aaf req-387b7609-ab1e-4346-b245-b089d980b6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8566a46-bc51-45e5-824f-26ae62468ffa", "name": "network-vif-plugged", "status": "completed", "tag": "62d696fe-20df-4b19-bd84-154e56a1bc13"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:08:18.458434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7788d4bf-7388-49d1-b709-cfb0d19e3aaf req-387b7609-ab1e-4346-b245-b089d980b6b4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:18.458902 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7788d4bf-7388-49d1-b709-cfb0d19e3aaf req-387b7609-ab1e-4346-b245-b089d980b6b4 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:18.471599 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7788d4bf-7388-49d1-b709-cfb0d19e3aaf req-387b7609-ab1e-4346-b245-b089d980b6b4 service nova] Creating event network-vif-plugged:62d696fe-20df-4b19-bd84-154e56a1bc13 for instance c8566a46-bc51-45e5-824f-26ae62468ffa on n-h2-master-1 Jul 24 02:08:18.476789 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7788d4bf-7388-49d1-b709-cfb0d19e3aaf req-387b7609-ab1e-4346-b245-b089d980b6b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031052 Jul 24 02:08:18.477402 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3435/6765] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:08:19.303115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:19.303779 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:19.310747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:19.311215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:19.312021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:19.312477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:19.441160 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:19.449010 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cae5b3d6-6127-46aa-bb34-990c0a1416e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1362 microversion: 2.1 time: 0.149989 Jul 24 02:08:19.449589 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3331/6766] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:19 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:20.465164 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:20.466181 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:20.470623 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:20.471359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:20.479675 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:20.480134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:20.480933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:20.481380 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:20.623255 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:08:20.630919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bbc06917-01f1-4fb9-a04a-bf5aaafeb75d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1548 microversion: 2.1 time: 0.167532 Jul 24 02:08:20.631475 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3436/6767] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:08:20 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:08:20.648548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5a147c37-6b0e-4234-91e9-3c758c01f220 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:08:20.649067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a147c37-6b0e-4234-91e9-3c758c01f220 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:08:20.651063 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:20.657105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a147c37-6b0e-4234-91e9-3c758c01f220 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:20.657572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a147c37-6b0e-4234-91e9-3c758c01f220 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:20.658411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a147c37-6b0e-4234-91e9-3c758c01f220 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:20.658864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a147c37-6b0e-4234-91e9-3c758c01f220 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:20.736476 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5a147c37-6b0e-4234-91e9-3c758c01f220 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092520 Jul 24 02:08:20.737088 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3332/6768] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 02:08:20 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:08:22.019847 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8aeb5f65-2ecb-4e25-8e94-cd53bcdd3dfa req-48d4280a-273d-4f21-b939-687af22dff01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8566a46-bc51-45e5-824f-26ae62468ffa", "tag": "62d696fe-20df-4b19-bd84-154e56a1bc13"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:08:22.028973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8aeb5f65-2ecb-4e25-8e94-cd53bcdd3dfa req-48d4280a-273d-4f21-b939-687af22dff01 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:08:22.029502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8aeb5f65-2ecb-4e25-8e94-cd53bcdd3dfa req-48d4280a-273d-4f21-b939-687af22dff01 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:08:22.041199 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8aeb5f65-2ecb-4e25-8e94-cd53bcdd3dfa req-48d4280a-273d-4f21-b939-687af22dff01 service nova] Creating event network-changed:62d696fe-20df-4b19-bd84-154e56a1bc13 for instance c8566a46-bc51-45e5-824f-26ae62468ffa on n-h2-master-1 Jul 24 02:08:22.046401 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8aeb5f65-2ecb-4e25-8e94-cd53bcdd3dfa req-48d4280a-273d-4f21-b939-687af22dff01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030418 Jul 24 02:08:22.047322 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3437/6769] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:09:26.993314 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=17 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:26.994172 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=52 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:26.998421 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:26.999054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:27.005963 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:27.006357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:27.007144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:27.007596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:27.140432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:27.147937 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1228bd44-f55a-4dd4-92e0-2ef7885baaef tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1667 microversion: 2.1 time: 0.157073 Jul 24 02:09:27.148506 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3333/6770] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:26 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:27.162717 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:27.163552 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:27.168680 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d22e6326-2adf-4ad0-a21c-20b4e1fe3892 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2df07ac6-56bb-4982-acc3-689c36513b1b"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:09:27.169887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d22e6326-2adf-4ad0-a21c-20b4e1fe3892 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:27.178794 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d22e6326-2adf-4ad0-a21c-20b4e1fe3892 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:27.179243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d22e6326-2adf-4ad0-a21c-20b4e1fe3892 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:27.180525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d22e6326-2adf-4ad0-a21c-20b4e1fe3892 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:27.180958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d22e6326-2adf-4ad0-a21c-20b4e1fe3892 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:27.431153 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d22e6326-2adf-4ad0-a21c-20b4e1fe3892 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269134 Jul 24 02:09:27.431769 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3438/6771] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 02:09:27 2022] POST /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:09:38.080054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:09:38.081102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:38.083913 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:38.084592 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:38.090759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:38.091230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:38.092022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:38.092475 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:38.122916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:38.129311 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Old instance type m1.heat2, new instance type m1.heat {{(pid=119562) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:09:38.136369 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:09:38.136801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:09:38.137285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:09:38.137732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:09:38.138159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:09:38.200467 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44b71b52-b3d3-4d27-8f75-0eec28864eb7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.124285 Jul 24 02:09:38.201087 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3334/6772] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:09:38 2022] POST /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:09:38.207422 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:38.208226 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:38.213560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:38.214304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:38.222036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:38.222498 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:38.223287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:38.224318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:38.363503 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:38.373157 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-467cd643-2781-405e-a216-a3dac41c2417 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1722 microversion: 2.1 time: 0.167712 Jul 24 02:09:38.373755 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3439/6773] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:38 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:39.392998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:39.393552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:39.400664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:39.401134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:39.401948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:39.402404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:39.635390 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:39.643617 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c1b894e-450d-43e8-a803-0b91b75a8a78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1722 microversion: 2.1 time: 0.255530 Jul 24 02:09:39.644119 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3335/6774] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:39 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:40.661166 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:40.661854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:40.669745 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:40.670202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:40.670973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:40.671411 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:40.810291 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:40.818232 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f010afaa-e9f9-4b8c-bda0-07f5326a114c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.160973 Jul 24 02:09:40.818812 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3440/6775] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:40 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:41.835482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:41.836184 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:41.843539 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:41.844010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:41.844807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:41.845264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:41.975236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:41.983945 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ac8a585-c2d1-48c1-ba04-a55a8ca0d9d9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.152461 Jul 24 02:09:41.984568 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3336/6776] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:41 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:43.001422 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:43.002066 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:43.008889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:43.009920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:43.010689 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:43.011127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:43.147559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:43.156269 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed39fc7b-083d-42cf-a953-6db958107de8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.158720 Jul 24 02:09:43.156847 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3441/6777] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:42 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:44.173365 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:44.174028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:44.181156 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:44.181622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:44.182433 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:44.182906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:44.317446 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:44.325863 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f154bd5d-c855-471e-84d1-6f0f3ae40785 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.156315 Jul 24 02:09:44.326451 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3337/6778] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:44 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:45.342414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:45.343035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:45.349967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:45.350424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:45.351193 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:45.351634 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:45.487193 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:45.496059 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-261a82a3-207b-4ec2-b81e-ee97584045ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.157598 Jul 24 02:09:45.496637 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3442/6779] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:45 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:09:46.513233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:46.513900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:46.520836 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:46.521306 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:46.522126 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:46.522580 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:46.652985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:46.662400 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b5a31a7-b5d4-4ec9-ad6e-2dfc3be3a123 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.153031 Jul 24 02:09:46.663205 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3338/6780] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:46 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:47.681894 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:47.682451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:47.689365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:47.689865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:47.690643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:47.691084 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:47.818880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:47.827435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a884c4ab-2337-4fa4-9b4a-2efaa4418527 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.149767 Jul 24 02:09:47.828017 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3443/6781] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:47 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:48.844531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:48.845159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:48.852184 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:48.852649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:48.854198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:48.854649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:48.989610 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:48.998534 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3ee8734-1389-440e-8a6a-e007abf50ce9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.157970 Jul 24 02:09:48.999102 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3339/6782] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:48 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:50.015767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:50.016377 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:50.023361 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:50.023807 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:50.024576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:50.025008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:50.154238 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:50.162297 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aca7bba5-f3b8-4a0c-9208-cc9dd7ce1a06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.150440 Jul 24 02:09:50.162883 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3444/6783] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:50 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:51.179204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:51.180165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:51.187594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:51.188070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:51.188867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:51.189326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:51.324590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:51.332642 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2890d9aa-272e-484f-9b82-029820d9a79d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.157385 Jul 24 02:09:51.333225 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3340/6784] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:51 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:52.222260 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:09:52.222803 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:09:52.350474 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:52.351096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:52.358850 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:52.359311 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:52.360088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:52.360530 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:52.490710 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:52.499258 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-349d71f3-f5b9-4035-b3bd-a9d3a7e6541d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.152674 Jul 24 02:09:52.499837 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3445/6785] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:52 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:52.676936 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:09:52.677111 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:09:53.516558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:53.517123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:53.524046 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:53.524526 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:53.526072 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:53.526525 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:53.656476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:53.664515 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08c03758-d577-4f6e-9ea2-06a03f6683fa tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.151970 Jul 24 02:09:53.665122 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3341/6786] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:53 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:54.682018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:54.682641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:54.689814 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:54.690274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:54.691056 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:54.691499 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:54.828097 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:54.837003 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-786f8f45-6799-4cd8-9144-35c293bf3373 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.159206 Jul 24 02:09:54.837597 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3446/6787] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:54 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:55.854949 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:55.855551 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:55.862498 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:55.862971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:55.863760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:55.864218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:55.996970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:56.005148 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-403b9c8b-df37-4d6f-95b1-710c8ee2a0e8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.154412 Jul 24 02:09:56.005824 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3342/6788] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:55 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:57.023148 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:57.023793 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:57.031110 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:57.031566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:57.032332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:57.032769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:57.175549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:57.184242 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5015569c-5506-470e-b8c1-a53c62c8729a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.164983 Jul 24 02:09:57.184823 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3447/6789] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:57 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:58.201050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:58.201749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:58.208941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:58.209409 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:58.210252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:58.210709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:58.348990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:58.357721 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-797e58eb-007f-44b1-ac7b-4964ae99eee7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1727 microversion: 2.1 time: 0.161148 Jul 24 02:09:58.358311 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3343/6790] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:58 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:59.375917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:09:59.376461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:09:59.382976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:59.383434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:59.385020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:59.385457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:59.521939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:09:59.531072 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b96e076-af02-4638-b25d-8219973dff5d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1726 microversion: 2.1 time: 0.159356 Jul 24 02:09:59.531665 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3448/6791] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:09:59 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:09:59.746930 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-58ef7a21-93cc-4ce8-a453-dd6e8df28e23 req-a008151a-f5da-4020-900a-941814499946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8566a46-bc51-45e5-824f-26ae62468ffa", "name": "network-vif-unplugged", "status": "completed", "tag": "62d696fe-20df-4b19-bd84-154e56a1bc13"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:09:59.756708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-58ef7a21-93cc-4ce8-a453-dd6e8df28e23 req-a008151a-f5da-4020-900a-941814499946 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:09:59.757202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-58ef7a21-93cc-4ce8-a453-dd6e8df28e23 req-a008151a-f5da-4020-900a-941814499946 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:09:59.770900 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-58ef7a21-93cc-4ce8-a453-dd6e8df28e23 req-a008151a-f5da-4020-900a-941814499946 service nova] Creating event network-vif-unplugged:62d696fe-20df-4b19-bd84-154e56a1bc13 for instance c8566a46-bc51-45e5-824f-26ae62468ffa on n-h1-master-1 Jul 24 02:09:59.776664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-58ef7a21-93cc-4ce8-a453-dd6e8df28e23 req-a008151a-f5da-4020-900a-941814499946 service nova] Instance c8566a46-bc51-45e5-824f-26ae62468ffa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:09:59.787672 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-58ef7a21-93cc-4ce8-a453-dd6e8df28e23 req-a008151a-f5da-4020-900a-941814499946 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045570 Jul 24 02:09:59.788470 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3344/6792] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:10:00.548502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:00.549119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:00.556321 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:00.556728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:00.557502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:00.557965 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:00.795154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:00.803304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9c53c72-e80f-4e93-80cb-26a07758cf61 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1726 microversion: 2.1 time: 0.258877 Jul 24 02:10:00.803890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3449/6793] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:00 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1726 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:01.808668 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-155d4d4b-8b2f-4184-9ebc-f9afe1dab81d req-42297d17-2f7b-46a8-b408-ba076641d1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8566a46-bc51-45e5-824f-26ae62468ffa", "tag": "62d696fe-20df-4b19-bd84-154e56a1bc13"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:10:01.818326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-155d4d4b-8b2f-4184-9ebc-f9afe1dab81d req-42297d17-2f7b-46a8-b408-ba076641d1e8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:01.818785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-155d4d4b-8b2f-4184-9ebc-f9afe1dab81d req-42297d17-2f7b-46a8-b408-ba076641d1e8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:01.821175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:01.821918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:01.829358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:01.829993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:01.830859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:01.831378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:01.832379 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-155d4d4b-8b2f-4184-9ebc-f9afe1dab81d req-42297d17-2f7b-46a8-b408-ba076641d1e8 service nova] Creating event network-changed:62d696fe-20df-4b19-bd84-154e56a1bc13 for instance c8566a46-bc51-45e5-824f-26ae62468ffa on n-h1-master-1 Jul 24 02:10:01.838728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-155d4d4b-8b2f-4184-9ebc-f9afe1dab81d req-42297d17-2f7b-46a8-b408-ba076641d1e8 service nova] Instance c8566a46-bc51-45e5-824f-26ae62468ffa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:10:01.850567 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-155d4d4b-8b2f-4184-9ebc-f9afe1dab81d req-42297d17-2f7b-46a8-b408-ba076641d1e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047817 Jul 24 02:10:01.851183 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3345/6794] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:10:02.150558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:02.159818 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c27a22b-1101-45c3-ba22-8b05b4f5184b tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.343048 Jul 24 02:10:02.160638 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3450/6795] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:01 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:03.178878 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:03.180454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:03.188188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:03.188653 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:03.189638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:03.190115 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:03.324273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:03.335140 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2e63d817-2230-459c-86ef-2d1d886af183 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.161093 Jul 24 02:10:03.340784 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3346/6796] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:03 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:04.353649 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:04.354311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:04.361277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:04.361765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:04.362537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:04.362974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:04.498624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:04.506753 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-29886f82-873c-4919-992a-5480adb6ed06 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.157995 Jul 24 02:10:04.507324 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3451/6797] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:04 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:05.524076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:05.525419 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:05.532497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:05.532966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:05.533779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:05.534235 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:05.671839 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:05.680028 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-74bfd2b8-0b11-4577-9f05-35ffe3d694ce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.159920 Jul 24 02:10:05.680739 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3347/6798] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:05 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:06.697924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:06.698575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:06.705477 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:06.705990 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:06.706750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:06.707197 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:06.842127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:06.850164 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ee92257-e5a9-4448-b0b0-3ac679a66889 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.156389 Jul 24 02:10:06.850771 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3452/6799] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:06 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:07.869041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:07.869665 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:07.876571 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:07.877028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:07.877833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:07.878281 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:08.007111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:08.015961 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-15fcc761-f513-4691-8808-3aa4f925dd69 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.151667 Jul 24 02:10:08.016546 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3348/6800] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:07 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:09.033149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:09.033788 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:09.036435 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=29 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:09.042622 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:09.043080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:09.043855 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:09.044295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:09.047062 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=85 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:09.176158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:09.184790 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7ef1154c-8096-470c-8bf2-91f219beefab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.155541 Jul 24 02:10:09.185364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3453/6801] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:09 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:10.202139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:10.202777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:10.205390 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=35 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:10.210657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:10.211125 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:10.212084 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:10.212705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:10.215319 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:10.350089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:10.358286 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9668cc30-7a49-4963-b091-06a18ba2db4a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.160593 Jul 24 02:10:10.358871 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3349/6802] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:10 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:10:11.376371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:11.376897 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:11.384667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:11.385127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:11.385931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:11.386369 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:11.516857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:11.525033 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e673cbaa-4798-49fe-bd71-293295eccc78 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.152604 Jul 24 02:10:11.525604 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3454/6803] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:11 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:12.542104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:12.542738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:12.549703 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:12.550194 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:12.550983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:12.551434 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:12.687738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:12.695739 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-405e5cf4-b1a3-4a5e-a3a7-a2a71e1161f4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1724 microversion: 2.1 time: 0.158348 Jul 24 02:10:12.696401 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3350/6804] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:12 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:13.713873 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:13.714410 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:13.721305 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:13.721789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:13.722558 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:13.722995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:13.851840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:13.859833 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79eda4ea-6b73-412e-9fe3-75e770645795 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1721 microversion: 2.1 time: 0.150511 Jul 24 02:10:13.860405 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3455/6805] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:13 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:13.876359 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:10:13.876943 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:13.884292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:13.884751 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:13.885533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:13.886019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:13.923124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:13.923602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:13.924415 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:13.924865 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:13.948148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for project 65afddc02ce0461988f64f41f706be14. Resources: {'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:10:13.953347 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Getting quotas for user 4ca622718e5c42dc9a71b80fca387e66 and project 65afddc02ce0461988f64f41f706be14. Resources: {'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:10:14.053572 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9cdeea22-a43b-456d-8121-2670d7069c14 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "POST /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.180874 Jul 24 02:10:14.054245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3351/6806] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:10:13 2022] POST /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:10:14.063197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:14.063818 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:14.070257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:14.071384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:14.072308 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:14.072873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:14.281262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:14.289659 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d60db38e-9151-4972-b291-93d599171210 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.230960 Jul 24 02:10:14.290276 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3456/6807] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:14 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:15.308571 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:15.309294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:15.316640 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:15.317118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:15.317933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:15.318391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:15.448236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:15.456268 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4591c523-4699-4326-9076-3ececeeb14c8 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.152914 Jul 24 02:10:15.456850 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3352/6808] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:15 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:16.476042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:16.477386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:16.484262 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:16.484722 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:16.485838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:16.486072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:16.647309 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:16.656517 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a7f986bd-3c23-42ba-840f-c5ce0ebd0547 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.184671 Jul 24 02:10:16.662894 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3457/6809] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:16 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:17.673307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:17.673895 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:17.681664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:17.682151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:17.682941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:17.683399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:17.818023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:17.826880 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-82ed4039-d664-4fc6-9cef-dd4d08d4254a tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.157761 Jul 24 02:10:17.827459 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3353/6810] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:17 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:18.843973 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:18.844592 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:18.851469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:18.852572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:18.853349 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:18.853887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:19.099748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:19.108032 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-57fb912c-6034-492b-b4f9-e17ba97dfaee tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.267916 Jul 24 02:10:19.108614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3458/6811] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:18 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:19.674066 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-7379665c-a92d-4887-8197-03ae38d8c546 req-766fa062-efdb-4f30-a8e0-25b0865000be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8566a46-bc51-45e5-824f-26ae62468ffa", "tag": "62d696fe-20df-4b19-bd84-154e56a1bc13"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:10:19.685628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7379665c-a92d-4887-8197-03ae38d8c546 req-766fa062-efdb-4f30-a8e0-25b0865000be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:19.686488 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-7379665c-a92d-4887-8197-03ae38d8c546 req-766fa062-efdb-4f30-a8e0-25b0865000be service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:19.704565 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-7379665c-a92d-4887-8197-03ae38d8c546 req-766fa062-efdb-4f30-a8e0-25b0865000be service nova] Creating event network-changed:62d696fe-20df-4b19-bd84-154e56a1bc13 for instance c8566a46-bc51-45e5-824f-26ae62468ffa on n-h2-master-1 Jul 24 02:10:19.710989 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-7379665c-a92d-4887-8197-03ae38d8c546 req-766fa062-efdb-4f30-a8e0-25b0865000be service nova] Instance c8566a46-bc51-45e5-824f-26ae62468ffa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:10:19.724549 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-7379665c-a92d-4887-8197-03ae38d8c546 req-766fa062-efdb-4f30-a8e0-25b0865000be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054811 Jul 24 02:10:19.725420 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3354/6812] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:10:20.128558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:20.129444 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:20.137874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:20.138335 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:20.139139 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:20.139596 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:20.475038 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:20.484042 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c6921dfc-a80a-4568-ab34-edc25a37b2a0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.361211 Jul 24 02:10:20.484652 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3459/6813] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:20 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:21.503387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:21.504094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:21.511159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:21.511629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:21.512447 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:21.512901 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:21.650432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:21.658555 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0100b7cf-eef2-4e9e-91c0-0def99a89167 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.160598 Jul 24 02:10:21.659138 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3355/6814] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:21 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:22.676808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:22.677423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:22.685293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:22.685782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:22.686731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:22.687174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:22.824150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:22.832306 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6d8362e2-9135-478e-b6c7-79f5835ee15d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.159693 Jul 24 02:10:22.832876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3460/6815] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:22 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:23.850744 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:23.851374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:23.858663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:23.859129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:23.859914 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:23.860368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:23.939753 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:23.995994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:24.004285 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c4750806-ef14-47da-b012-1dda4ad962fc tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.157569 Jul 24 02:10:24.004965 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3356/6816] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:23 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:25.022619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:25.023297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:25.030956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:25.031417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:25.032223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:25.032667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:25.172440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:25.180971 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-84599104-50e1-44ab-97af-0b9d56874ed4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.162032 Jul 24 02:10:25.181740 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3461/6817] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:25 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:26.198982 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:26.199614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:26.206617 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:26.207085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:26.207867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:26.208318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:26.339844 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:26.347873 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5d851425-7d11-4aa8-858e-dd98738a3cab tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.153575 Jul 24 02:10:26.348448 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3357/6818] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:26 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:27.364942 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:27.365854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:27.373780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:27.374180 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:27.374948 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:27.375390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:27.503968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:27.512946 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-22130ae3-54a6-4881-bdee-e370e175aca7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.151913 Jul 24 02:10:27.513518 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3462/6819] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:27 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:28.531049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:28.531683 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:28.538446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:28.538916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:28.540826 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:28.541289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:28.673965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:28.682953 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-93ac2101-e047-4cdd-92aa-418f8f604dce tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.155853 Jul 24 02:10:28.683552 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3358/6820] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:28 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:29.700294 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:29.700814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:29.707570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:29.708028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:29.708799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:29.709244 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:29.841546 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:29.849862 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6aad5479-896d-4261-80bd-7cbc6a61933d tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.153547 Jul 24 02:10:29.850463 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3463/6821] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:29 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:30.869449 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:30.870106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:30.877018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:30.877486 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:30.878294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:30.878757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:31.012076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:31.020180 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-10424042-9834-439c-8acb-33df7bb15317 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.155585 Jul 24 02:10:31.020759 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3359/6822] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:30 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:10:32.038035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:32.038655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:32.046216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:32.046668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:32.047470 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:32.047912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:32.181821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:32.190001 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b95a48ed-4587-4cd4-aa26-ee38975e20fd tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.155877 Jul 24 02:10:32.190601 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3464/6823] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:32 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:33.207176 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:33.207807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:33.215003 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:33.215468 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:33.216250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:33.216700 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:33.349278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:33.358747 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-863f0b1e-6594-4f3f-86c1-78641672fa46 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1720 microversion: 2.1 time: 0.155421 Jul 24 02:10:33.359318 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3360/6824] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:33 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:34.377340 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:34.377907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:34.385195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.385641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.386422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.386854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.516770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:34.525300 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6c296e28-bcb9-4033-b5ec-6faae17cafb3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1713 microversion: 2.1 time: 0.151484 Jul 24 02:10:34.526003 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3465/6825] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:34 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:34.541999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:34.542637 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:34.549607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.550093 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.550883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.551340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.680029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:34.687915 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1266bb1-df5e-4152-bf76-b88a30ef3c5c tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1713 microversion: 2.1 time: 0.150434 Jul 24 02:10:34.688475 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3361/6826] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:34 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:34.704477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:34.705095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:34.711259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.711704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.713233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.713665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.846398 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:34.855063 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9a4bd42-acb8-49b4-93fd-68a7d77d14f1 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1713 microversion: 2.1 time: 0.154451 Jul 24 02:10:34.855637 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3466/6827] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:34 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:34.871845 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:34.872358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:34.878341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.878867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.879578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:34.880025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:34.907337 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:10:34.921860 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:34.982862 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b4c1362d-5372-415a-a74d-46258198a790 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 204 len: 0 microversion: 2.1 time: 0.115376 Jul 24 02:10:34.983928 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3362/6828] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:10:34 2022] DELETE /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:10:34.992588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:34.993812 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:34.999809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:35.000260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:35.001023 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:35.001457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:35.131126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:35.139153 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-82bfb903-2e71-4962-a810-a648cd6ec873 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1719 microversion: 2.1 time: 0.150716 Jul 24 02:10:35.139741 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3467/6829] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:34 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:36.156785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:36.157514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:36.164497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:36.165490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:36.166309 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:36.166762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:36.650586 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:36.658587 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-99b033ed-96a8-477b-8bf2-f9bfcb2d4b77 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1719 microversion: 2.1 time: 0.506211 Jul 24 02:10:36.659266 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3363/6830] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:36 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1719 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:37.676485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:37.677373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:37.690898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8c88e8cb-5a1f-468a-8cfa-5d8cfe06eaac req-99a3db5a-6f19-460d-9e3d-b1182e8203de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8566a46-bc51-45e5-824f-26ae62468ffa", "name": "network-vif-deleted", "tag": "62d696fe-20df-4b19-bd84-154e56a1bc13"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:10:37.693998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:37.694467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:37.695318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:37.695903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:37.708199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8c88e8cb-5a1f-468a-8cfa-5d8cfe06eaac req-99a3db5a-6f19-460d-9e3d-b1182e8203de service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:37.708824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8c88e8cb-5a1f-468a-8cfa-5d8cfe06eaac req-99a3db5a-6f19-460d-9e3d-b1182e8203de service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:37.725181 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8c88e8cb-5a1f-468a-8cfa-5d8cfe06eaac req-99a3db5a-6f19-460d-9e3d-b1182e8203de service nova] Creating event network-vif-deleted:62d696fe-20df-4b19-bd84-154e56a1bc13 for instance c8566a46-bc51-45e5-824f-26ae62468ffa on n-h2-master-1 Jul 24 02:10:37.731651 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8c88e8cb-5a1f-468a-8cfa-5d8cfe06eaac req-99a3db5a-6f19-460d-9e3d-b1182e8203de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044367 Jul 24 02:10:37.732407 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3364/6831] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:10:37.787922 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:37.797375 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e7587f0d-21e5-456a-a799-e4e36b9007a3 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1652 microversion: 2.1 time: 0.124941 Jul 24 02:10:37.798493 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3468/6832] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:37 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1652 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:38.816958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:38.817965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:38.825112 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:38.825737 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:38.826643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:38.827175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:38.894240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:38.902612 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-50b4d8d2-45bf-4eac-8b43-205eb2208ba7 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1368 microversion: 2.1 time: 0.090990 Jul 24 02:10:38.903901 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3365/6833] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:38 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:39.920128 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:39.920743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:39.923482 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=32 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:39.928819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:39.929274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:39.930066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:39.930537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:39.933384 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=96 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:39.996181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:40.004475 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ed08736f-daee-45b5-94db-a557ec3f6e32 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1368 microversion: 2.1 time: 0.088220 Jul 24 02:10:40.005057 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3469/6834] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:39 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:41.022632 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:41.023266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:41.027328 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:41.032519 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:41.032992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:41.033821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:41.034279 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:41.097824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca622718e5c42dc9a71b80fca387e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65afddc02ce0461988f64f41f706be14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:41.106569 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c1f35a75-6322-4f48-ae80-c4d590b2fbe9 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 200 len: 1368 microversion: 2.1 time: 0.087862 Jul 24 02:10:41.107151 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3366/6835] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:41 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:42.123890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:42.124511 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:42.131643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:42.132094 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:42.132874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:42.133317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:42.146776 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa HTTP/1.1 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: exception: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c8566a46-bc51-45e5-824f-26ae62468ffa'} Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:42.148446 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24e6f3e3-d54c-40d5-b7e6-d92fce5a3363 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 404 len: 111 microversion: 2.1 time: 0.030586 Jul 24 02:10:42.153278 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3470/6836] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:42 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:42.206183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:42.207167 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:42.215230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:42.215701 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:42.216483 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:42.216936 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:42.229544 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/os-volume_attachments HTTP/1.1 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': 'c8566a46-bc51-45e5-824f-26ae62468ffa'} Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:42.231246 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c0e19c82-a046-4694-a1c1-e8e73ec843a5 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030632 Jul 24 02:10:42.235290 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3367/6837] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:10:42 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.535234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.535736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.543506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.544038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.544884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.545388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.559926 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa HTTP/1.1 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: exception: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'c8566a46-bc51-45e5-824f-26ae62468ffa'} Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.561578 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5f40027d-acbb-4ef7-ae8f-7ad5d82bd353 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 404 len: 111 microversion: 2.1 time: 0.031846 Jul 24 02:10:45.565280 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3471/6838] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:10:45 2022] DELETE /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.572935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.573575 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: c8566a46-bc51-45e5-824f-26ae62468ffa] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.580930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.581403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.582277 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.582739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.596165 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa HTTP/1.1 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c8566a46-bc51-45e5-824f-26ae62468ffa'} Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.597741 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance c8566a46-bc51-45e5-824f-26ae62468ffa could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-25b89159-1978-45a3-8f62-58dc6adac774 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa" status: 404 len: 111 microversion: 2.1 time: 0.030983 Jul 24 02:10:45.601994 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3368/6839] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:45 2022] GET /compute/v2.1/servers/c8566a46-bc51-45e5-824f-26ae62468ffa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.608263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.608768 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.615170 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.616036 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.616884 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.617328 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.634050 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 HTTP/1.1 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '36eb4660-e101-4a7b-9552-dd78da7e60f7'} Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.635666 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5971d619-424f-460a-b277-9a6b46bd7180 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 404 len: 111 microversion: 2.1 time: 0.032611 Jul 24 02:10:45.639955 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3472/6840] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:10:45 2022] DELETE /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.645559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.646217 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 36eb4660-e101-4a7b-9552-dd78da7e60f7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.652698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.653171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.654023 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.654490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.669325 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 HTTP/1.1 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '36eb4660-e101-4a7b-9552-dd78da7e60f7'} Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.671095 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 36eb4660-e101-4a7b-9552-dd78da7e60f7 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c3a5ce0-17bb-4088-8d52-287dd6bd3e45 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7" status: 404 len: 111 microversion: 2.1 time: 0.030931 Jul 24 02:10:45.674664 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3369/6841] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:45 2022] GET /compute/v2.1/servers/36eb4660-e101-4a7b-9552-dd78da7e60f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.682017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.682613 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.689202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.689798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.690661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.691179 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.707165 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c HTTP/1.1 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: exception: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'e5b9bc10-150e-4e8d-8b54-95b1afe45e4c'} Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.708899 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ba917d1-14fe-47fe-9f16-4d150fd488e0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 404 len: 111 microversion: 2.1 time: 0.033046 Jul 24 02:10:45.712645 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3473/6842] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:10:45 2022] DELETE /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 02:10:45.719572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.720208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: e5b9bc10-150e-4e8d-8b54-95b1afe45e4c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.726440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.727404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.728145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.728253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.746169 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c HTTP/1.1 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: exception: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'e5b9bc10-150e-4e8d-8b54-95b1afe45e4c'} Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.747659 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance e5b9bc10-150e-4e8d-8b54-95b1afe45e4c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.751855 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-767246eb-cc24-4dc7-ba0d-20d65ff439b4 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c" status: 404 len: 111 microversion: 2.1 time: 0.033466 Jul 24 02:10:45.752791 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3370/6843] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:45 2022] GET /compute/v2.1/servers/e5b9bc10-150e-4e8d-8b54-95b1afe45e4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.758144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.759324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.766208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.766662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.767464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.767907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.781618 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 HTTP/1.1 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '960a02c8-7096-46ad-8709-604b29327e51'} Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.783197 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d03ab52-9611-4715-85d1-ae01d83cb8ea tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 404 len: 111 microversion: 2.1 time: 0.030416 Jul 24 02:10:45.787852 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3474/6844] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:10:45 2022] DELETE /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.793444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.794111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] [instance: 960a02c8-7096-46ad-8709-604b29327e51] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:45.800497 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.800972 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.801797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:45.802258 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:45.818247 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] HTTP exception thrown: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Request method failure captured: Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 HTTP/1.1 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Kh0qYD_us7SyZST5uuUVUx2GICKMQKseOD1DL0UyjfpCgLuT8ZYWuOHNPD2zgF5ts8_oXxlPKSAY-pYvPQ1JiIQXc3zKySdNnEJMeMCQmGfy5xxtYUKFKpmyZDc6wBXpvTzqAj7IJzeEEJbub6fOqkkCpWhqsrcing7glN4j2Sf4zA Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65afddc02ce0461988f64f41f706be14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65afddc02ce0461988f64f41f706be14", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65afddc02ce0461988f64f41f706be14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 65afddc02ce0461988f64f41f706be14 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1206111791 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 4ca622718e5c42dc9a71b80fca387e66 Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServerActionsTestJSON-1206111791-project Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '960a02c8-7096-46ad-8709-604b29327e51'} Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:10:45.819824 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Returning 404 to user: Instance 960a02c8-7096-46ad-8709-604b29327e51 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0f3eb63e-3df9-4d38-844a-000be26150fb tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51" status: 404 len: 111 microversion: 2.1 time: 0.032099 Jul 24 02:10:45.824122 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3371/6845] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:45 2022] GET /compute/v2.1/servers/960a02c8-7096-46ad-8709-604b29327e51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:10:45.830832 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9e6bca4c-9187-4b52-90d9-fea5c4b5a5d0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] Calling method '.version_select at 0x7f05eae5ca60>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:45.852784 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9e6bca4c-9187-4b52-90d9-fea5c4b5a5d0 tempest-ServerActionsTestJSON-1206111791 tempest-ServerActionsTestJSON-1206111791-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-620695224" status: 202 len: 0 microversion: 2.1 time: 0.025763 Jul 24 02:10:45.853890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3475/6846] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 02:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-620695224 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:10:55.082710 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-412145955", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "820b1e22-cf1c-4dd2-a5ea-57fac2a29e8a"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:10:55.138518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] validate_networks() for [('820b1e22-cf1c-4dd2-a5ea-57fac2a29e8a', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:10:55.640041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:10:55.640490 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:10:55.640988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:10:55.641422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:10:55.641899 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:10:55.651853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:55.652257 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:55.653087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:55.653537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:55.673924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Getting quotas for project 5aced8671cd34fd5bbc3f9e8a0e08a4a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:10:55.679655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Getting quotas for user b9da4dd8be354487bd7e6ea155c3aadb and project 5aced8671cd34fd5bbc3f9e8a0e08a4a. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:10:55.694050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:10:55.696343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:10:55.742231 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0d8c7a0e-f7f9-48a5-aba3-d071c5b97c55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815285 Jul 24 02:10:55.742895 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3372/6847] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:10:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:10:55.754865 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2edd66df-02b3-444c-8c7e-81f29576938d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:55.755689 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2edd66df-02b3-444c-8c7e-81f29576938d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:55.778995 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=15 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:55.817192 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2edd66df-02b3-444c-8c7e-81f29576938d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:55.824379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2edd66df-02b3-444c-8c7e-81f29576938d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1216 microversion: 2.1 time: 0.074479 Jul 24 02:10:55.824984 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3476/6848] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:55 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:56.843126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:56.844284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:56.852545 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:56.853685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:56.854691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:56.855146 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:56.965532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:56.973719 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44a82f2e-5532-437b-b088-d89bff09e411 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1274 microversion: 2.1 time: 0.135473 Jul 24 02:10:56.974820 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3373/6849] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:56 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:57.991470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:57.992212 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:58.000511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:58.001069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:58.001973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:58.002489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:58.263808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:58.273250 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-301653f0-6348-46ac-8462-29669d0692ef tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1316 microversion: 2.1 time: 0.286069 Jul 24 02:10:58.274117 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3477/6850] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:57 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:10:58.442940 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-410bdb7b-16d0-4d2d-a79f-db310fd51a96 req-57c17270-3097-4157-b6c6-ec114547ab4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a37eb031-caed-4188-88ea-814df2cec0a8", "tag": "9469fd0f-ede0-4103-8aaf-1f22e62d8e05"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:10:58.466667 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-410bdb7b-16d0-4d2d-a79f-db310fd51a96 req-57c17270-3097-4157-b6c6-ec114547ab4d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:58.467137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-410bdb7b-16d0-4d2d-a79f-db310fd51a96 req-57c17270-3097-4157-b6c6-ec114547ab4d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:58.488545 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-410bdb7b-16d0-4d2d-a79f-db310fd51a96 req-57c17270-3097-4157-b6c6-ec114547ab4d service nova] Creating event network-changed:9469fd0f-ede0-4103-8aaf-1f22e62d8e05 for instance a37eb031-caed-4188-88ea-814df2cec0a8 on n-h1-master-1 Jul 24 02:10:58.495478 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-410bdb7b-16d0-4d2d-a79f-db310fd51a96 req-57c17270-3097-4157-b6c6-ec114547ab4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061712 Jul 24 02:10:58.496110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3374/6851] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:10:59.291642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:10:59.292278 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:10:59.298977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:59.299438 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:59.300216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:10:59.300653 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:10:59.438607 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:10:59.446386 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c61f0b3-8cd2-48d8-880d-4520482f16bd tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1316 microversion: 2.1 time: 0.159480 Jul 24 02:10:59.446980 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3478/6852] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:10:59 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:11:00.465163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:00.465837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:00.472144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:00.472613 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:00.473427 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:00.473911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:00.607584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:00.615879 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7b35d449-4eb7-4594-926b-24e29210b2c0 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1316 microversion: 2.1 time: 0.155818 Jul 24 02:11:00.616489 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3375/6853] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:00 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:01.633574 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:01.634760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:01.641063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:01.641513 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:01.642301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:01.642738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:01.770985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:01.779378 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4df7204-18dc-4aa7-b63e-5e2090f9a22a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1316 microversion: 2.1 time: 0.149743 Jul 24 02:11:01.779957 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3479/6854] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:01 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:02.796018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:02.796892 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:02.804092 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:02.804598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:02.805522 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:02.806528 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:02.940687 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:02.949484 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a3c30fa2-0801-4922-bdda-7e3cf8154038 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1316 microversion: 2.1 time: 0.157681 Jul 24 02:11:02.950164 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3376/6855] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:02 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:03.967144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:03.967753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:03.974626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:03.975072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:03.975833 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:03.976269 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:04.106441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:04.113782 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-342b607f-9985-411d-aea9-ffd9bf00b042 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1316 microversion: 2.1 time: 0.150477 Jul 24 02:11:04.114350 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3480/6856] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:03 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:04.715802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8f2819a9-46e4-49f8-88a4-ecb12f28cff4 req-0a287c3e-b4ae-4b39-a73e-9da2fbf3de26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a37eb031-caed-4188-88ea-814df2cec0a8", "name": "network-vif-plugged", "status": "completed", "tag": "9469fd0f-ede0-4103-8aaf-1f22e62d8e05"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:04.725643 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8f2819a9-46e4-49f8-88a4-ecb12f28cff4 req-0a287c3e-b4ae-4b39-a73e-9da2fbf3de26 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:04.726127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8f2819a9-46e4-49f8-88a4-ecb12f28cff4 req-0a287c3e-b4ae-4b39-a73e-9da2fbf3de26 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:04.739599 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8f2819a9-46e4-49f8-88a4-ecb12f28cff4 req-0a287c3e-b4ae-4b39-a73e-9da2fbf3de26 service nova] Creating event network-vif-plugged:9469fd0f-ede0-4103-8aaf-1f22e62d8e05 for instance a37eb031-caed-4188-88ea-814df2cec0a8 on n-h1-master-1 Jul 24 02:11:04.745526 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8f2819a9-46e4-49f8-88a4-ecb12f28cff4 req-0a287c3e-b4ae-4b39-a73e-9da2fbf3de26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Jul 24 02:11:04.746395 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3377/6857] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:11:05.131762 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:05.132383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:05.138970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:05.139431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:05.140203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:05.140647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:05.273435 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:05.280967 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad926aa2-8a65-40e4-a19d-9725b9e4111d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1316 microversion: 2.1 time: 0.153337 Jul 24 02:11:05.281578 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3481/6858] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:05 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:06.298780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:06.299500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:06.302675 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:06.303501 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:06.310587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:06.311054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:06.311844 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:06.312291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:06.315141 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:06.447757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:06.455391 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-44f5f81f-1c96-4b54-a5df-d781867dd172 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1505 microversion: 2.1 time: 0.160877 Jul 24 02:11:06.456001 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3378/6859] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:06 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:06.509730 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1779645756", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "820b1e22-cf1c-4dd2-a5ea-57fac2a29e8a"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:06.516621 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:06.562823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] validate_networks() for [('820b1e22-cf1c-4dd2-a5ea-57fac2a29e8a', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:11:06.934316 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:11:06.934745 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:11:06.935222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:11:06.935629 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:11:06.936043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:11:06.944974 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:06.945523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:06.946414 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:06.946881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:06.963660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Getting quotas for project 5aced8671cd34fd5bbc3f9e8a0e08a4a. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:11:06.968781 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Getting quotas for user b9da4dd8be354487bd7e6ea155c3aadb and project 5aced8671cd34fd5bbc3f9e8a0e08a4a. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:11:06.981295 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:11:06.983602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:11:07.029116 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-21191c34-b0e2-452e-a46d-d46f85b86459 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523796 Jul 24 02:11:07.029841 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3482/6860] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:11:07.039642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d3864fc3-b7f9-430f-8f8a-8373501c8191 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:07.041004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d3864fc3-b7f9-430f-8f8a-8373501c8191 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:07.094538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d3864fc3-b7f9-430f-8f8a-8373501c8191 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:07.101430 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d3864fc3-b7f9-430f-8f8a-8373501c8191 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1217 microversion: 2.1 time: 0.065705 Jul 24 02:11:07.106309 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3379/6861] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:07 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:08.120491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:08.121452 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:08.128738 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:08.129195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:08.130041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:08.130421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:08.208314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:08.216042 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1578828b-4d1f-4340-9e19-b49209c63bf2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1275 microversion: 2.1 time: 0.100747 Jul 24 02:11:08.216622 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3483/6862] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:08 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:09.233617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:09.234289 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:09.242781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:09.243403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:09.244362 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:09.244816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:09.512295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:09.520403 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-747ccadf-dc64-462f-a71c-85f10fc269d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.290721 Jul 24 02:11:09.521008 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3380/6863] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:09 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:11:09.826249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0d0b7db6-7cd7-48f1-b5ea-29f50aa8adf2 req-f5dc0b6f-bae9-47bd-a5bc-d2ba998524dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647a83c5-6508-4e77-bcdd-9148becb6eb8", "tag": "3a9e1c3e-dbb5-4e18-be9c-ec82e1a60f82"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:09.837821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0d0b7db6-7cd7-48f1-b5ea-29f50aa8adf2 req-f5dc0b6f-bae9-47bd-a5bc-d2ba998524dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:09.838352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0d0b7db6-7cd7-48f1-b5ea-29f50aa8adf2 req-f5dc0b6f-bae9-47bd-a5bc-d2ba998524dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:09.853173 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0d0b7db6-7cd7-48f1-b5ea-29f50aa8adf2 req-f5dc0b6f-bae9-47bd-a5bc-d2ba998524dd service nova] Creating event network-changed:3a9e1c3e-dbb5-4e18-be9c-ec82e1a60f82 for instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 on n-h2-master-1 Jul 24 02:11:09.859880 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0d0b7db6-7cd7-48f1-b5ea-29f50aa8adf2 req-f5dc0b6f-bae9-47bd-a5bc-d2ba998524dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041690 Jul 24 02:11:09.860596 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3484/6864] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:11:10.537252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:10.537918 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:10.545739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:10.546214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:10.547035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:10.547491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:10.679727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:10.687607 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4fe1be0e-c97e-49bb-b454-a70e612844b9 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.154330 Jul 24 02:11:10.688183 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3381/6865] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:10 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:11.704924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:11.705886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:11.712118 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:11.717874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:11.718317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:11.719111 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:11.719544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:11.874225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:11.882098 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-36cfc28e-36cb-4f0d-bc80-b54f7c2770b7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.181426 Jul 24 02:11:11.882688 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3485/6866] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:11 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:12.899044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:12.900163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:12.902807 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:12.908294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:12.908776 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:12.909534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:12.910011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:13.040680 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:13.048037 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef684833-6389-4d84-be51-d02a24bfad55 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.153023 Jul 24 02:11:13.048613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3382/6867] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:12 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:14.065493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:14.066114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:14.073457 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:14.074009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:14.074806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:14.075299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:14.213319 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:14.220912 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d6b5ccc2-8617-4f34-bc4f-73f397571ade tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.159330 Jul 24 02:11:14.221557 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3486/6868] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:14 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:15.237454 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:15.238143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:15.245964 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:15.246437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:15.247253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:15.247710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:15.375901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:15.384090 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-885ffedc-3067-4ae9-96f9-07a4309b7e0f tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.149893 Jul 24 02:11:15.384679 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3383/6869] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:15 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:16.400624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:16.401251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:16.408197 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:16.408657 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:16.409440 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:16.409911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:16.537784 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:16.546205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d696bfeb-7a25-41c2-8acc-630cccb11cd6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.149759 Jul 24 02:11:16.546786 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3487/6870] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:16 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:17.564685 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e7045748-1360-480c-b121-9328ccf2642e req-92400b0f-e9b5-4dd6-927f-0233a60099cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647a83c5-6508-4e77-bcdd-9148becb6eb8", "name": "network-vif-plugged", "status": "completed", "tag": "3a9e1c3e-dbb5-4e18-be9c-ec82e1a60f82"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:17.568848 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:17.569537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:17.572261 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:17.572985 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:17.574658 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:17.580196 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:17.580537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e7045748-1360-480c-b121-9328ccf2642e req-92400b0f-e9b5-4dd6-927f-0233a60099cd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:17.580932 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:17.581037 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e7045748-1360-480c-b121-9328ccf2642e req-92400b0f-e9b5-4dd6-927f-0233a60099cd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:17.581754 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:17.582416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:17.593287 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e7045748-1360-480c-b121-9328ccf2642e req-92400b0f-e9b5-4dd6-927f-0233a60099cd service nova] Creating event network-vif-plugged:3a9e1c3e-dbb5-4e18-be9c-ec82e1a60f82 for instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 on n-h2-master-1 Jul 24 02:11:17.598438 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e7045748-1360-480c-b121-9328ccf2642e req-92400b0f-e9b5-4dd6-927f-0233a60099cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037507 Jul 24 02:11:17.599047 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3384/6871] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:11:17.760427 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:17.767998 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7333204d-81a2-4b19-a166-6c89826324c3 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.208152 Jul 24 02:11:17.768602 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3488/6872] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:17 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:18.786239 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:18.786951 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:18.793300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:18.793798 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:18.794570 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:18.795018 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:18.985642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:18.994556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e32df13d-65ab-45f1-8a7b-9cdd9c3ba2d5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1317 microversion: 2.1 time: 0.213344 Jul 24 02:11:18.995154 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3385/6873] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:18 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:20.011370 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:20.011999 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:20.019016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:20.019478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:20.020253 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:20.020697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:20.478303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:20.486161 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8fbad17-0334-43b5-8f13-98d26ab1cb50 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1507 microversion: 2.1 time: 0.478762 Jul 24 02:11:20.486941 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3489/6874] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:20 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:20.503636 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:20.504232 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:20.511641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:20.512261 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:20.513082 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:20.513602 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:20.543171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:11:20.619764 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5a3025ee-145b-4cf6-80c8-85f86b5a30ee tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 204 len: 0 microversion: 2.1 time: 0.119706 Jul 24 02:11:20.620848 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3386/6875] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:11:20 2022] DELETE /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:11:20.629073 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:20.629638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:20.636206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:20.636667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:20.637452 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:20.637920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:20.774786 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:20.782379 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ea8da87b-8f1f-4a59-964b-648f0587f7cc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1513 microversion: 2.1 time: 0.157455 Jul 24 02:11:20.782939 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3490/6876] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:20 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:11:21.800944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:21.801684 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:21.810071 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:21.810595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:21.811391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:21.811916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:21.946536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:21.954244 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b3560b6-901b-4a79-b68a-4cabd5b86ed6 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1513 microversion: 2.1 time: 0.157557 Jul 24 02:11:21.954823 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3387/6877] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:21 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:22.685136 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a246745f-e01d-4101-be30-85a0fff7ee19 req-fc5fad06-cd85-4449-b5b9-27f433d266df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647a83c5-6508-4e77-bcdd-9148becb6eb8", "name": "network-vif-deleted", "tag": "3a9e1c3e-dbb5-4e18-be9c-ec82e1a60f82"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:22.694726 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a246745f-e01d-4101-be30-85a0fff7ee19 req-fc5fad06-cd85-4449-b5b9-27f433d266df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:22.695062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a246745f-e01d-4101-be30-85a0fff7ee19 req-fc5fad06-cd85-4449-b5b9-27f433d266df service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:22.708344 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a246745f-e01d-4101-be30-85a0fff7ee19 req-fc5fad06-cd85-4449-b5b9-27f433d266df service nova] Creating event network-vif-deleted:3a9e1c3e-dbb5-4e18-be9c-ec82e1a60f82 for instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 on n-h2-master-1 Jul 24 02:11:22.716522 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a246745f-e01d-4101-be30-85a0fff7ee19 req-fc5fad06-cd85-4449-b5b9-27f433d266df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035302 Jul 24 02:11:22.718287 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3491/6878] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:11:22.972171 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:22.972715 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:22.980702 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:22.981173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:22.981992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:22.982448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:23.013195 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:23.013660 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:23.014226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lazy-loading 'fault' on Instance uuid 647a83c5-6508-4e77-bcdd-9148becb6eb8 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:11:23.055900 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:23.064478 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c25cdaed-391f-4481-8591-7a7878733cfc tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 200 len: 1307 microversion: 2.1 time: 0.096385 Jul 24 02:11:23.065044 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3388/6879] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:22 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:24.083545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:24.084239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.090573 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.091020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.091776 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.092208 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.105470 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] HTTP exception thrown: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Request method failure captured: Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 HTTP/1.1 Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KoukjWvXw3SAIkHXGfXlNm4099Tg8Hbyt87136dY85tCAf6LVBwwuBXWQlO24gtjO_Pqz3buAWv0_8wyURiZedTCi_dw18o_Hd0KopCjFyDmCDryCZSGoxLjY96b3ton5ABcU6fC2jtWIhgr13-grv51Smgf1J3nDV2oIMH8HTuF_g Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aced8671cd34fd5bbc3f9e8a0e08a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b9da4dd8be354487bd7e6ea155c3aadb Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '647a83c5-6508-4e77-bcdd-9148becb6eb8'} Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:24.107105 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Returning 404 to user: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f030858f-04fb-4e49-8f21-f0e929e85b8e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 404 len: 111 microversion: 2.1 time: 0.030086 Jul 24 02:11:24.111791 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3492/6880] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:24 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:11:24.118858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:24.119492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.126254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.126723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.127504 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.127951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.257939 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:24.265488 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-53bb5ad8-861f-43cd-8509-4d36657df9ce tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1505 microversion: 2.1 time: 0.151595 Jul 24 02:11:24.266115 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3389/6881] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:24 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:24.282185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4faae3dc-9bf4-4787-92c0-40a66f76ee54 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:24.283184 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4faae3dc-9bf4-4787-92c0-40a66f76ee54 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 08adf4ce-1446-4cc1-80e4-765ac7f630e7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.288906 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-4faae3dc-9bf4-4787-92c0-40a66f76ee54 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] HTTP exception thrown: Instance 08adf4ce-1446-4cc1-80e4-765ac7f630e7 could not be found. Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4faae3dc-9bf4-4787-92c0-40a66f76ee54 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Request method failure captured: Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/08adf4ce-1446-4cc1-80e4-765ac7f630e7/action HTTP/1.1 Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 32 Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KoukjWvXw3SAIkHXGfXlNm4099Tg8Hbyt87136dY85tCAf6LVBwwuBXWQlO24gtjO_Pqz3buAWv0_8wyURiZedTCi_dw18o_Hd0KopCjFyDmCDryCZSGoxLjY96b3ton5ABcU6fC2jtWIhgr13-grv51Smgf1J3nDV2oIMH8HTuF_g Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aced8671cd34fd5bbc3f9e8a0e08a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b9da4dd8be354487bd7e6ea155c3aadb Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: {"resize": {"flavorRef": "452"}} Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 08adf4ce-1446-4cc1-80e4-765ac7f630e7 could not be found. Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '08adf4ce-1446-4cc1-80e4-765ac7f630e7', 'body': {'resize': {'flavorRef': '452'}}} Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08adf4ce-1446-4cc1-80e4-765ac7f630e7 could not be found. Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:11:24.291203 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08adf4ce-1446-4cc1-80e4-765ac7f630e7 could not be found. Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08adf4ce-1446-4cc1-80e4-765ac7f630e7 could not be found. Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4faae3dc-9bf4-4787-92c0-40a66f76ee54 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Returning 404 to user: Instance 08adf4ce-1446-4cc1-80e4-765ac7f630e7 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4faae3dc-9bf4-4787-92c0-40a66f76ee54 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "POST /compute/v2.1/servers/08adf4ce-1446-4cc1-80e4-765ac7f630e7/action" status: 404 len: 111 microversion: 2.1 time: 0.014400 Jul 24 02:11:24.294990 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3493/6882] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:11:24 2022] POST /compute/v2.1/servers/08adf4ce-1446-4cc1-80e4-765ac7f630e7/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:11:24.301168 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:24.301858 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.308103 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.308579 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.309367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.309861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.441422 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:24.449233 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c5c49f8-38cc-4c35-91a0-cf876f1dca7c tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1505 microversion: 2.1 time: 0.151967 Jul 24 02:11:24.449849 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3390/6883] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:24 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:24.468120 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:24.468745 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.475532 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.475986 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.477433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.477997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.605355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:24.612836 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fef0fb4b-fdda-440e-b6fe-a6dc0d4383b8 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1505 microversion: 2.1 time: 0.149755 Jul 24 02:11:24.613401 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3494/6884] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:24 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:24.629367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9e50d78f-55c3-4695-8cf7-0415636acf01"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:24.630464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.637110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.637568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.638365 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.638812 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.681063 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:24.686548 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] HTTP exception thrown: Flavor 9e50d78f-55c3-4695-8cf7-0415636acf01 could not be found. Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Request method failure captured: Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: request: POST /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8/action HTTP/1.1 Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 65 Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KoukjWvXw3SAIkHXGfXlNm4099Tg8Hbyt87136dY85tCAf6LVBwwuBXWQlO24gtjO_Pqz3buAWv0_8wyURiZedTCi_dw18o_Hd0KopCjFyDmCDryCZSGoxLjY96b3ton5ABcU6fC2jtWIhgr13-grv51Smgf1J3nDV2oIMH8HTuF_g Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aced8671cd34fd5bbc3f9e8a0e08a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9da4dd8be354487bd7e6ea155c3aadb Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: {"resize": {"flavorRef": "9e50d78f-55c3-4695-8cf7-0415636acf01"}} Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: exception: Flavor 9e50d78f-55c3-4695-8cf7-0415636acf01 could not be found. Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'a37eb031-caed-4188-88ea-814df2cec0a8', 'body': {'resize': {'flavorRef': '9e50d78f-55c3-4695-8cf7-0415636acf01'}}} Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 24 02:11:24.688505 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9e50d78f-55c3-4695-8cf7-0415636acf01 could not be found. Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9e50d78f-55c3-4695-8cf7-0415636acf01 could not be found. Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9e50d78f-55c3-4695-8cf7-0415636acf01 could not be found. Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Returning 400 to user: Flavor 9e50d78f-55c3-4695-8cf7-0415636acf01 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c491c15-bc8e-46f9-b125-7f4ce238aa9e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "POST /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8/action" status: 400 len: 107 microversion: 2.1 time: 0.064559 Jul 24 02:11:24.692729 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3391/6885] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:11:24 2022] POST /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 02:11:24.699162 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:24.699787 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.705839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.706297 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.707065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.707505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.841633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:24.849163 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9370055-2266-4ac9-9ea9-ba15887d9ce2 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1505 microversion: 2.1 time: 0.154332 Jul 24 02:11:24.849741 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3495/6886] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:24 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:24.867107 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:24.868321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:24.874534 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.874994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:24.875856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:24.876394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.005570 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:25.013389 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a42ef419-802a-4d2e-9e1d-f9cb0a1882f5 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1505 microversion: 2.1 time: 0.150455 Jul 24 02:11:25.014000 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3392/6887] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:24 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:25.030738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-051ce232-64cc-4aad-b902-e1160b59ec33 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-051ce232-64cc-4aad-b902-e1160b59ec33 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Request method failure captured: Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: request: POST /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8/action HTTP/1.1 Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 29 Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KoukjWvXw3SAIkHXGfXlNm4099Tg8Hbyt87136dY85tCAf6LVBwwuBXWQlO24gtjO_Pqz3buAWv0_8wyURiZedTCi_dw18o_Hd0KopCjFyDmCDryCZSGoxLjY96b3ton5ABcU6fC2jtWIhgr13-grv51Smgf1J3nDV2oIMH8HTuF_g Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aced8671cd34fd5bbc3f9e8a0e08a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b9da4dd8be354487bd7e6ea155c3aadb Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: {"resize": {"flavorRef": ""}} Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a37eb031-caed-4188-88ea-814df2cec0a8', 'body': {'resize': {'flavorRef': ''}}} Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise error Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi '' Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.033043 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-051ce232-64cc-4aad-b902-e1160b59ec33 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-051ce232-64cc-4aad-b902-e1160b59ec33 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "POST /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8/action" status: 400 len: 113 microversion: 2.1 time: 0.007786 Jul 24 02:11:25.037095 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3496/6888] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:11:25 2022] POST /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 24 02:11:25.043525 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:25.044157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:25.050212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.050682 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.051473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.051954 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.181036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:25.188586 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28430aca-5bff-416a-97d6-f47643bf4d3e tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1505 microversion: 2.1 time: 0.149786 Jul 24 02:11:25.189155 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3393/6889] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:25 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:11:25.209531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:25.210146 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:25.218421 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.218876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.219643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.220078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.232781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] HTTP exception thrown: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Request method failure captured: Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 HTTP/1.1 Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KoukjWvXw3SAIkHXGfXlNm4099Tg8Hbyt87136dY85tCAf6LVBwwuBXWQlO24gtjO_Pqz3buAWv0_8wyURiZedTCi_dw18o_Hd0KopCjFyDmCDryCZSGoxLjY96b3ton5ABcU6fC2jtWIhgr13-grv51Smgf1J3nDV2oIMH8HTuF_g Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aced8671cd34fd5bbc3f9e8a0e08a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b9da4dd8be354487bd7e6ea155c3aadb Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '647a83c5-6508-4e77-bcdd-9148becb6eb8'} Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:11:25.234361 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Returning 404 to user: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f8e2894-1491-4370-975a-59cee5f7ffde tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 404 len: 111 microversion: 2.1 time: 0.030945 Jul 24 02:11:25.238375 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3497/6890] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:11:25 2022] DELETE /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:11:25.245165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:25.245831 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: 647a83c5-6508-4e77-bcdd-9148becb6eb8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:25.251924 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.252399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.253191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.253651 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.268007 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] HTTP exception thrown: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Request method failure captured: Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 HTTP/1.1 Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KoukjWvXw3SAIkHXGfXlNm4099Tg8Hbyt87136dY85tCAf6LVBwwuBXWQlO24gtjO_Pqz3buAWv0_8wyURiZedTCi_dw18o_Hd0KopCjFyDmCDryCZSGoxLjY96b3ton5ABcU6fC2jtWIhgr13-grv51Smgf1J3nDV2oIMH8HTuF_g Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aced8671cd34fd5bbc3f9e8a0e08a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: b9da4dd8be354487bd7e6ea155c3aadb Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '647a83c5-6508-4e77-bcdd-9148becb6eb8'} Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:25.269552 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Returning 404 to user: Instance 647a83c5-6508-4e77-bcdd-9148becb6eb8 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d330b663-5606-4c89-a9fd-5e9379646ad7 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8" status: 404 len: 111 microversion: 2.1 time: 0.030618 Jul 24 02:11:25.273731 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3394/6891] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:25 2022] GET /compute/v2.1/servers/647a83c5-6508-4e77-bcdd-9148becb6eb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 02:11:25.279665 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:25.280175 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:25.286245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.286705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.287503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.287950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.312834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:11:25.315630 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=100 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:25.390857 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6ba83ef-ecab-4826-bab3-8048dc44c30a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 204 len: 0 microversion: 2.1 time: 0.114595 Jul 24 02:11:25.391594 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3498/6892] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:11:25 2022] DELETE /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 02:11:25.400523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:25.401172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:25.407311 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.407783 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.408575 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:25.409031 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:25.424429 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:25.544429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:25.551880 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9703e69f-034d-4547-8881-143e6e3e5d36 tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1511 microversion: 2.1 time: 0.156062 Jul 24 02:11:25.552633 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3395/6893] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:25 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:26.572181 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:26.573117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:26.580093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:26.580545 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:26.581319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:26.581785 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:26.716076 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4dd8be354487bd7e6ea155c3aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:11:26.723705 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aac70a65-db80-4653-9359-e6900eae053d tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 200 len: 1511 microversion: 2.1 time: 0.157290 Jul 24 02:11:26.724265 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3499/6894] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:26 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:11:27.253595 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-aac9c29d-ecd3-43a8-b040-2c268678826b req-fd7bb327-c1ac-4d2b-924c-b56e92d8edb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a37eb031-caed-4188-88ea-814df2cec0a8", "name": "network-vif-deleted", "tag": "9469fd0f-ede0-4103-8aaf-1f22e62d8e05"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:11:27.262893 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aac9c29d-ecd3-43a8-b040-2c268678826b req-fd7bb327-c1ac-4d2b-924c-b56e92d8edb6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:27.263340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aac9c29d-ecd3-43a8-b040-2c268678826b req-fd7bb327-c1ac-4d2b-924c-b56e92d8edb6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:27.276126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-aac9c29d-ecd3-43a8-b040-2c268678826b req-fd7bb327-c1ac-4d2b-924c-b56e92d8edb6 service nova] Creating event network-vif-deleted:9469fd0f-ede0-4103-8aaf-1f22e62d8e05 for instance a37eb031-caed-4188-88ea-814df2cec0a8 on n-h1-master-1 Jul 24 02:11:27.281341 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-aac9c29d-ecd3-43a8-b040-2c268678826b req-fd7bb327-c1ac-4d2b-924c-b56e92d8edb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Jul 24 02:11:27.282001 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3396/6895] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:11:27.741267 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:11:27.741822 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] [instance: a37eb031-caed-4188-88ea-814df2cec0a8] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:11:27.748958 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:27.749422 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:27.750223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:11:27.750665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:11:27.764419 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] HTTP exception thrown: Instance a37eb031-caed-4188-88ea-814df2cec0a8 could not be found. Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Request method failure captured: Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 HTTP/1.1 Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KoukjWvXw3SAIkHXGfXlNm4099Tg8Hbyt87136dY85tCAf6LVBwwuBXWQlO24gtjO_Pqz3buAWv0_8wyURiZedTCi_dw18o_Hd0KopCjFyDmCDryCZSGoxLjY96b3ton5ABcU6fC2jtWIhgr13-grv51Smgf1J3nDV2oIMH8HTuF_g Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aced8671cd34fd5bbc3f9e8a0e08a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aced8671cd34fd5bbc3f9e8a0e08a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 5aced8671cd34fd5bbc3f9e8a0e08a4a Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695609756 Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: b9da4dd8be354487bd7e6ea155c3aadb Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-ServersNegativeTestJSON-1695609756-project Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: exception: Instance a37eb031-caed-4188-88ea-814df2cec0a8 could not be found. Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': 'a37eb031-caed-4188-88ea-814df2cec0a8'} Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a37eb031-caed-4188-88ea-814df2cec0a8 could not be found. Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a37eb031-caed-4188-88ea-814df2cec0a8 could not be found. Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:11:27.766082 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a37eb031-caed-4188-88ea-814df2cec0a8 could not be found. Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] Returning 404 to user: Instance a37eb031-caed-4188-88ea-814df2cec0a8 could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7cdf4d46-1468-4930-8bdf-a73bd54cb90a tempest-ServersNegativeTestJSON-1695609756 tempest-ServersNegativeTestJSON-1695609756-project] 10.222.0.27 "GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8" status: 404 len: 111 microversion: 2.1 time: 0.030628 Jul 24 02:11:27.770279 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3500/6896] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:11:27 2022] GET /compute/v2.1/servers/a37eb031-caed-4188-88ea-814df2cec0a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:12:01.311002 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:01.312538 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=5 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:01.484820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ed88c29-d408-4fd2-8534-4382e7272028 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Action: 'create', calling method: .version_select at 0x7f05eade89d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1817055322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMewzW+e5mtZZjgStmPNvOeGLZrU8sp1VoBtZZIKiqdgGGMNk92OVY2VXxAWxtHjOIaL0hJH9tXPtArGrRDFPKjLRdKRg4FdmgJFgvY8rvbfpJWxd6J4HmKOoL8TsYQG+g=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:01.501438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2ed88c29-d408-4fd2-8534-4382e7272028 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:12:01.507523 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2ed88c29-d408-4fd2-8534-4382e7272028 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for user 603b9d20e2a94b0c99f9820f8374d0fa and project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:12:01.538752 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ed88c29-d408-4fd2-8534-4382e7272028 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.235149 Jul 24 02:12:01.539509 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3397/6897] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:12:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:01.590129 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1471768703", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1817055322", "networks": [{"uuid": "a90512da-f00d-4b45-8ffd-ef53f31df41b"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:01.598951 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:01.599616 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:01.647261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] validate_networks() for [('a90512da-f00d-4b45-8ffd-ef53f31df41b', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:12:02.090531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:12:02.090967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:12:02.091448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:12:02.091994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:12:02.092347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:12:02.103878 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:02.104489 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:02.105352 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:02.105824 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:02.125087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:12:02.131057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for user 603b9d20e2a94b0c99f9820f8374d0fa and project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:12:02.145597 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:12:02.147744 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:12:02.198073 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e268cdbf-9476-413a-9490-6afe3daee38a tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612305 Jul 24 02:12:02.198811 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3501/6898] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:12:02.209036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63510a47-b6cc-47bf-9c5c-454e737ded23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:02.209909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63510a47-b6cc-47bf-9c5c-454e737ded23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:02.277988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63510a47-b6cc-47bf-9c5c-454e737ded23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:02.286391 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63510a47-b6cc-47bf-9c5c-454e737ded23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1263 microversion: 2.1 time: 0.081384 Jul 24 02:12:02.291110 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3398/6899] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:02 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:12:03.306780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:03.308406 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:03.316144 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:03.316607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:03.317705 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:03.318522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:03.426603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:03.440216 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9382665-7041-4089-bd65-5755fd7e0238 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1323 microversion: 2.1 time: 0.135789 Jul 24 02:12:03.441824 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3502/6900] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:03 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1323 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:04.458851 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:04.459395 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:04.475291 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:04.476057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:04.478761 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:04.479233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:04.712282 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:04.720485 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5ef07e62-3ef6-471f-9141-9fff0e22fce4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.265893 Jul 24 02:12:04.721175 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3399/6901] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:04 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:05.156067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-39b036b7-c58f-45ff-a0d0-b89ad025d358 req-0171a05c-4da2-46ba-91a4-353dafc061ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e601572f-de07-44ef-ae8c-bb586f86fa3c", "tag": "ff2c14f4-8e36-48ec-97a3-18d0461a05e0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:05.172702 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-39b036b7-c58f-45ff-a0d0-b89ad025d358 req-0171a05c-4da2-46ba-91a4-353dafc061ff service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:05.173148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-39b036b7-c58f-45ff-a0d0-b89ad025d358 req-0171a05c-4da2-46ba-91a4-353dafc061ff service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:05.185956 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-39b036b7-c58f-45ff-a0d0-b89ad025d358 req-0171a05c-4da2-46ba-91a4-353dafc061ff service nova] Creating event network-changed:ff2c14f4-8e36-48ec-97a3-18d0461a05e0 for instance e601572f-de07-44ef-ae8c-bb586f86fa3c on n-h2-master-1 Jul 24 02:12:05.194091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-39b036b7-c58f-45ff-a0d0-b89ad025d358 req-0171a05c-4da2-46ba-91a4-353dafc061ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153199 Jul 24 02:12:05.197530 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3503/6902] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:05.739305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:05.740023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:05.750273 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:05.750833 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:05.751709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:05.752248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:05.913284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:05.921821 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-33aa72ea-43da-426d-a8fb-39098c4a38c0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.187083 Jul 24 02:12:05.922425 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3400/6903] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:05 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:06.941126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:06.941791 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:06.948660 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:06.949112 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:06.950006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:06.950444 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:07.087994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:07.095807 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e82c1f8-335c-454c-9770-c237e4ae1861 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.159940 Jul 24 02:12:07.096377 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3504/6904] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:06 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:08.112514 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:08.113072 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:08.120402 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:08.120869 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:08.121658 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:08.122128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:08.689944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:08.698415 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ba1b58c-57d8-4f5d-b727-2f93fc9bdb16 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.589881 Jul 24 02:12:08.699030 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3401/6905] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:08 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:09.716210 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:09.716837 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:09.723787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:09.724250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:09.725073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:09.725525 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:09.862707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:09.871582 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ad4e3e48-89f3-4a34-a7e9-093fa5d37d3f tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.159047 Jul 24 02:12:09.872143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3505/6906] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:09 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:10.888824 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:10.889455 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:10.896166 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:10.896639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:10.897419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:10.897921 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:11.027492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:11.034979 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-77d895d4-914c-4a29-b2d7-52db1e600952 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.150342 Jul 24 02:12:11.035551 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3402/6907] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:10 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:11.848418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-aa03f6fe-909a-4717-9417-8f2ff400f1ab req-f85f1f10-b588-473a-9317-38c90e763337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e601572f-de07-44ef-ae8c-bb586f86fa3c", "name": "network-vif-plugged", "status": "completed", "tag": "ff2c14f4-8e36-48ec-97a3-18d0461a05e0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:11.860099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-aa03f6fe-909a-4717-9417-8f2ff400f1ab req-f85f1f10-b588-473a-9317-38c90e763337 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:11.860650 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-aa03f6fe-909a-4717-9417-8f2ff400f1ab req-f85f1f10-b588-473a-9317-38c90e763337 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:11.872934 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-aa03f6fe-909a-4717-9417-8f2ff400f1ab req-f85f1f10-b588-473a-9317-38c90e763337 service nova] Creating event network-vif-plugged:ff2c14f4-8e36-48ec-97a3-18d0461a05e0 for instance e601572f-de07-44ef-ae8c-bb586f86fa3c on n-h2-master-1 Jul 24 02:12:11.877960 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-aa03f6fe-909a-4717-9417-8f2ff400f1ab req-f85f1f10-b588-473a-9317-38c90e763337 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033889 Jul 24 02:12:11.878700 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3506/6908] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:12.051801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:12.052427 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:12.059656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:12.060122 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:12.060905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:12.061355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:12.192047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:12.200070 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04d8106f-6a29-43b8-9366-3206ba406d67 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.152193 Jul 24 02:12:12.200644 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3403/6909] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:12 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:13.214294 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:13.215249 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:13.220455 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:13.221719 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:13.230181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:13.230678 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:13.231471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:13.231916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:13.380962 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:13.390410 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bc16fbe0-f799-4fbe-8c9c-cdee5f8388de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1363 microversion: 2.1 time: 0.176987 Jul 24 02:12:13.391006 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3507/6910] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:13 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:14.410522 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:14.411380 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:14.413321 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:14.420996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:14.421391 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:14.422219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:14.422669 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:14.557240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:14.564704 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1be6e8c-7b1b-46d4-a484-8672354884f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1555 microversion: 2.1 time: 0.159176 Jul 24 02:12:14.565272 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3404/6911] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:14 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:14.581627 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:14.582274 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:14.589341 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:14.589827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:14.590598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:14.591032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:14.720393 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:14.727855 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b340b4e2-d739-4d4a-9380-381ca2a0214e tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1555 microversion: 2.1 time: 0.150058 Jul 24 02:12:14.728418 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3508/6912] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:14 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:16.330977 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6b91a874-9563-413e-9a78-df4b65488c01 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41924408-bd17-45da-8de3-419722c9bcfe"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:16.332054 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6b91a874-9563-413e-9a78-df4b65488c01 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:16.338922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b91a874-9563-413e-9a78-df4b65488c01 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:16.339387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b91a874-9563-413e-9a78-df4b65488c01 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:16.340162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b91a874-9563-413e-9a78-df4b65488c01 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:16.340609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b91a874-9563-413e-9a78-df4b65488c01 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:16.593655 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6b91a874-9563-413e-9a78-df4b65488c01 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "POST /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266135 Jul 24 02:12:16.594294 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3405/6913] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 02:12:16 2022] POST /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:27.254287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:27.254801 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:27.258271 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:27.258955 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=36 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:27.265206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:27.265744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:27.266523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:27.266962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:27.344605 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lazy-loading 'services' on Instance uuid e601572f-de07-44ef-ae8c-bb586f86fa3c {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:12:27.412643 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8bdeedd4-865e-4c69-aaf3-34cd275db25b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments/41924408-bd17-45da-8de3-419722c9bcfe" status: 202 len: 0 microversion: 2.1 time: 0.162547 Jul 24 02:12:27.413242 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3509/6914] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:12:27 2022] DELETE /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments/41924408-bd17-45da-8de3-419722c9bcfe => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:12:27.423275 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e583668e-b87e-43b9-87e0-ee5cb9b7a73c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:27.424416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e583668e-b87e-43b9-87e0-ee5cb9b7a73c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:27.427393 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:27.428135 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:27.436551 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e583668e-b87e-43b9-87e0-ee5cb9b7a73c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:27.437029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e583668e-b87e-43b9-87e0-ee5cb9b7a73c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:27.437881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e583668e-b87e-43b9-87e0-ee5cb9b7a73c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:27.438344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e583668e-b87e-43b9-87e0-ee5cb9b7a73c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:27.475966 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e583668e-b87e-43b9-87e0-ee5cb9b7a73c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057009 Jul 24 02:12:27.476703 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3406/6915] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:12:27 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:28.488589 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-43b91be1-31a9-4af0-a5cd-bf4bd4d668b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:28.489579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-43b91be1-31a9-4af0-a5cd-bf4bd4d668b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:28.497278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b91be1-31a9-4af0-a5cd-bf4bd4d668b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:28.497853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b91be1-31a9-4af0-a5cd-bf4bd4d668b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:28.498739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b91be1-31a9-4af0-a5cd-bf4bd4d668b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:28.499245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-43b91be1-31a9-4af0-a5cd-bf4bd4d668b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:28.532111 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-43b91be1-31a9-4af0-a5cd-bf4bd4d668b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048769 Jul 24 02:12:28.532789 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3510/6916] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:12:28 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:29.544278 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f7289f60-dbe1-439e-a2c3-470c4c4cbd15 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:29.545394 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f7289f60-dbe1-439e-a2c3-470c4c4cbd15 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:29.552943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7289f60-dbe1-439e-a2c3-470c4c4cbd15 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:29.553413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7289f60-dbe1-439e-a2c3-470c4c4cbd15 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:29.554958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7289f60-dbe1-439e-a2c3-470c4c4cbd15 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:29.555431 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f7289f60-dbe1-439e-a2c3-470c4c4cbd15 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:29.587993 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f7289f60-dbe1-439e-a2c3-470c4c4cbd15 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047705 Jul 24 02:12:29.588586 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3407/6917] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:12:29 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:30.599732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-312606e8-0a4f-435e-b52e-fcf8d86319c3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:30.600661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-312606e8-0a4f-435e-b52e-fcf8d86319c3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:30.607789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-312606e8-0a4f-435e-b52e-fcf8d86319c3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:30.608243 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-312606e8-0a4f-435e-b52e-fcf8d86319c3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:30.609017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-312606e8-0a4f-435e-b52e-fcf8d86319c3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:30.609462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-312606e8-0a4f-435e-b52e-fcf8d86319c3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:30.644552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-312606e8-0a4f-435e-b52e-fcf8d86319c3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048891 Jul 24 02:12:30.645028 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3511/6918] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:12:30 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:31.656713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c244c1d1-b898-4828-b5df-8b85c0f91c83 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:31.658223 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c244c1d1-b898-4828-b5df-8b85c0f91c83 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:31.667978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c244c1d1-b898-4828-b5df-8b85c0f91c83 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:31.668451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c244c1d1-b898-4828-b5df-8b85c0f91c83 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:31.669247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c244c1d1-b898-4828-b5df-8b85c0f91c83 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:31.669726 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c244c1d1-b898-4828-b5df-8b85c0f91c83 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:31.701176 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c244c1d1-b898-4828-b5df-8b85c0f91c83 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048407 Jul 24 02:12:31.702125 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3408/6919] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:12:31 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:32.713290 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5a1fb7a1-f5e0-4e6a-b8a8-870c0e0f1ac1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:32.714250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5a1fb7a1-f5e0-4e6a-b8a8-870c0e0f1ac1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:32.721134 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a1fb7a1-f5e0-4e6a-b8a8-870c0e0f1ac1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:32.721623 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a1fb7a1-f5e0-4e6a-b8a8-870c0e0f1ac1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:32.722448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a1fb7a1-f5e0-4e6a-b8a8-870c0e0f1ac1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:32.722888 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5a1fb7a1-f5e0-4e6a-b8a8-870c0e0f1ac1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:32.752746 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5a1fb7a1-f5e0-4e6a-b8a8-870c0e0f1ac1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043825 Jul 24 02:12:32.753324 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3512/6920] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:12:32 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 02:12:32.764252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:32.764761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:32.771876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:32.772374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:32.773723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:32.774185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:32.847604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] HTTP exception thrown: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c is not attached to volume 41924408-bd17-45da-8de3-419722c9bcfe Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Request method failure captured: Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments/41924408-bd17-45da-8de3-419722c9bcfe HTTP/1.1 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KpsCKn5mEwgAr3YThPDe2CtGtOSLt4BQwTgxLHSVZ2kxS4qxIPXtnkqubWkMdMtuKXVZ8nhhmqcNI6Rjz0wg5ezR3-mmTFxpauuTvSYpJOsoPoh9rRCYEuj12cicm94eoL4jaYlVkzT8QjGOrSLmfoXKsFJZr_D8q70jHCiCaJI_fA Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e7f43fc61f442d2b8c5e847099d7268", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 603b9d20e2a94b0c99f9820f8374d0fa Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: exception: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c is not attached to volume 41924408-bd17-45da-8de3-419722c9bcfe Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': 'e601572f-de07-44ef-ae8c-bb586f86fa3c', 'id': '41924408-bd17-45da-8de3-419722c9bcfe'} Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 41924408-bd17-45da-8de3-419722c9bcfe. Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c is not attached to volume 41924408-bd17-45da-8de3-419722c9bcfe Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:12:32.852997 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:12:32.856735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:12:32.856735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:12:32.856735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c is not attached to volume 41924408-bd17-45da-8de3-419722c9bcfe Jul 24 02:12:32.856735 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:32.856735 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Returning 404 to user: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c is not attached to volume 41924408-bd17-45da-8de3-419722c9bcfe {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:12:32.856735 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-34104a68-971b-4a00-923a-d5051b43f420 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments/41924408-bd17-45da-8de3-419722c9bcfe" status: 404 len: 154 microversion: 2.1 time: 0.094346 Jul 24 02:12:32.856735 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3409/6921] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:12:32 2022] DELETE /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c/os-volume_attachments/41924408-bd17-45da-8de3-419722c9bcfe => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:12:36.176005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:36.176514 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:36.184471 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:36.184931 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:36.185783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:36.186229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:36.215263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:12:36.297308 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7119cf29-7d3d-45ea-9b11-4ffb6168edb0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 204 len: 0 microversion: 2.1 time: 0.124829 Jul 24 02:12:36.298023 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3513/6922] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:12:36 2022] DELETE /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:12:36.308302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:36.309026 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:36.316619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:36.317109 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:36.318035 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:36.318558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:36.458469 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:36.466223 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0c60d64e-d4d9-49be-924f-d51bbb647a11 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1561 microversion: 2.1 time: 0.163479 Jul 24 02:12:36.466804 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3410/6923] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:36 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:37.484260 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:37.484980 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:37.492408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:37.492866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:37.493643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:37.494113 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:37.628666 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:37.637565 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be3a86d1-3444-418f-b01b-39acefe8b9dd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1561 microversion: 2.1 time: 0.157604 Jul 24 02:12:37.638217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3514/6924] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:37 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:38.514382 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-972ab5ff-903f-44da-b60d-79c284721929 req-3f5b7b76-d55b-4b70-a9fc-73d42aacede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e601572f-de07-44ef-ae8c-bb586f86fa3c", "name": "network-vif-deleted", "tag": "ff2c14f4-8e36-48ec-97a3-18d0461a05e0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:38.524769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-972ab5ff-903f-44da-b60d-79c284721929 req-3f5b7b76-d55b-4b70-a9fc-73d42aacede6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:38.525344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-972ab5ff-903f-44da-b60d-79c284721929 req-3f5b7b76-d55b-4b70-a9fc-73d42aacede6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:38.548409 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-972ab5ff-903f-44da-b60d-79c284721929 req-3f5b7b76-d55b-4b70-a9fc-73d42aacede6 service nova] Creating event network-vif-deleted:ff2c14f4-8e36-48ec-97a3-18d0461a05e0 for instance e601572f-de07-44ef-ae8c-bb586f86fa3c on n-h2-master-1 Jul 24 02:12:38.553533 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-972ab5ff-903f-44da-b60d-79c284721929 req-3f5b7b76-d55b-4b70-a9fc-73d42aacede6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042894 Jul 24 02:12:38.554296 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3411/6925] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:38.656270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:38.656831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:38.665863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:38.666536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:38.667325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:38.667769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:38.701692 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:38.702220 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:38.702920 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lazy-loading 'fault' on Instance uuid e601572f-de07-44ef-ae8c-bb586f86fa3c {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:12:38.746729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:38.754193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f81f8740-bc89-47a4-9753-18ae9585da28 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 200 len: 1353 microversion: 2.1 time: 0.102923 Jul 24 02:12:38.754756 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3515/6926] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:38 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:39.772344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:39.773105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: e601572f-de07-44ef-ae8c-bb586f86fa3c] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:39.779473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:39.779944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:39.780747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:39.781205 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:39.794843 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] HTTP exception thrown: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c could not be found. Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Request method failure captured: Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c HTTP/1.1 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KpsCKn5mEwgAr3YThPDe2CtGtOSLt4BQwTgxLHSVZ2kxS4qxIPXtnkqubWkMdMtuKXVZ8nhhmqcNI6Rjz0wg5ezR3-mmTFxpauuTvSYpJOsoPoh9rRCYEuj12cicm94eoL4jaYlVkzT8QjGOrSLmfoXKsFJZr_D8q70jHCiCaJI_fA Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e7f43fc61f442d2b8c5e847099d7268", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 603b9d20e2a94b0c99f9820f8374d0fa Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: exception: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c could not be found. Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'e601572f-de07-44ef-ae8c-bb586f86fa3c'} Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c could not be found. Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c could not be found. Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:12:39.796472 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c could not be found. Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Returning 404 to user: Instance e601572f-de07-44ef-ae8c-bb586f86fa3c could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d444fe08-adba-4bf8-936b-59cb6629a6b8 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c" status: 404 len: 111 microversion: 2.1 time: 0.030767 Jul 24 02:12:39.800720 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3412/6927] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:39 2022] GET /compute/v2.1/servers/e601572f-de07-44ef-ae8c-bb586f86fa3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:12:39.807683 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ac72a7a8-8086-4032-88bb-d5a475fe65c2 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '.version_select at 0x7f05eac49160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:39.826901 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ac72a7a8-8086-4032-88bb-d5a475fe65c2 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1817055322" status: 202 len: 0 microversion: 2.1 time: 0.023844 Jul 24 02:12:39.827485 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3516/6928] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 02:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1817055322 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:12:39.844990 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b52d4cf8-b349-4978-b80a-58c73685f557 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Action: 'create', calling method: .version_select at 0x7f05ea1bd430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-519619228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYpysZoVIz+ef6+KtMMjGVLWquQHaPZkhsbAZhR5KwTTzMNq740MIPQ7HQFHhMcQzV724T2xlgHQLUq4/UWRX5urJx3dj5z1XVmqHc/D2y8lSbgMKwz0pZfAejtbc0s+g=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:39.859531 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b52d4cf8-b349-4978-b80a-58c73685f557 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:12:39.865368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b52d4cf8-b349-4978-b80a-58c73685f557 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for user 603b9d20e2a94b0c99f9820f8374d0fa and project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:12:39.889023 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b52d4cf8-b349-4978-b80a-58c73685f557 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047973 Jul 24 02:12:39.889620 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3413/6929] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:12:39 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:39.937332 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2070264111", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-519619228", "networks": [{"uuid": "a90512da-f00d-4b45-8ffd-ef53f31df41b"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:39.990989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] validate_networks() for [('a90512da-f00d-4b45-8ffd-ef53f31df41b', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:12:40.377800 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:12:40.378233 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:12:40.378713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:12:40.379126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:12:40.379537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:12:40.394885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:40.395825 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:40.396647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:40.397088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:40.417764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:12:40.422853 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Getting quotas for user 603b9d20e2a94b0c99f9820f8374d0fa and project 8e7f43fc61f442d2b8c5e847099d7268. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:12:40.435306 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:12:40.437548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:12:40.484234 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ce7fb1f9-1af1-4508-b67c-f0a24c4844bc tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550834 Jul 24 02:12:40.484903 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3517/6930] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:12:40.495749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08603e15-d678-4a5c-9e36-a9ce3f1cdc95 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:40.496388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-08603e15-d678-4a5c-9e36-a9ce3f1cdc95 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:40.552040 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08603e15-d678-4a5c-9e36-a9ce3f1cdc95 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:40.560009 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08603e15-d678-4a5c-9e36-a9ce3f1cdc95 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1262 microversion: 2.1 time: 0.069172 Jul 24 02:12:40.560591 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3414/6931] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:40 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:41.577712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:41.578915 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:41.585083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:41.585536 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:41.586961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:41.587409 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:41.662304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:41.670571 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eeb16dfb-3c85-4fb2-94ad-a77608713d93 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1320 microversion: 2.1 time: 0.097601 Jul 24 02:12:41.671157 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3518/6932] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:41 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1320 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:42.688472 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:42.689105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:42.697131 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:42.697594 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:42.698422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:42.698872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:42.885347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-860fa260-ca5a-426e-a1d0-34cc9e3f3f2d req-3803ca3b-54af-47fe-8860-e3791dd5f3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1e714e-b24f-4462-8236-d831b7424f6f", "tag": "62f50362-c4b2-486c-afe1-17d3f5814164"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:42.896476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-860fa260-ca5a-426e-a1d0-34cc9e3f3f2d req-3803ca3b-54af-47fe-8860-e3791dd5f3fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:42.897310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-860fa260-ca5a-426e-a1d0-34cc9e3f3f2d req-3803ca3b-54af-47fe-8860-e3791dd5f3fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:42.910477 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-860fa260-ca5a-426e-a1d0-34cc9e3f3f2d req-3803ca3b-54af-47fe-8860-e3791dd5f3fb service nova] Creating event network-changed:62f50362-c4b2-486c-afe1-17d3f5814164 for instance 8b1e714e-b24f-4462-8236-d831b7424f6f on n-h2-master-1 Jul 24 02:12:42.916987 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-860fa260-ca5a-426e-a1d0-34cc9e3f3f2d req-3803ca3b-54af-47fe-8860-e3791dd5f3fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037655 Jul 24 02:12:42.917641 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3519/6933] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:42.929302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:42.937833 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b2bff57-c549-4ae2-97f7-609d93e71be9 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.253145 Jul 24 02:12:42.938443 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3415/6934] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:42 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:43.956405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:43.957113 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:43.964002 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:43.964460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:43.965232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:43.965704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:44.099857 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:44.108184 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-84fbacef-4785-486f-91ae-d3f3f203b5b5 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.156929 Jul 24 02:12:44.108900 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3520/6935] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:43 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:45.126019 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:45.126731 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:45.135587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:45.136101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:45.136925 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:45.137399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:45.284952 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:45.292772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1114326-9435-4653-be0f-f124cf8f2e64 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.171041 Jul 24 02:12:45.293348 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3416/6936] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:45 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:46.309055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:46.309687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:46.316601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:46.317052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:46.317856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:46.318293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:46.447333 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:46.454766 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be82d78a-8a7d-4809-ad47-3a84c357cfe0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.149634 Jul 24 02:12:46.455332 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3521/6937] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:46 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:47.472903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:47.473500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:47.481098 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:47.481572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:47.482388 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:47.482845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:47.614702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:47.623315 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5639c8fc-ecab-4f9a-8157-20b457fb85e3 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.154351 Jul 24 02:12:47.623901 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3417/6938] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:47 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:48.640512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:48.641142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:48.648141 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:48.649191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:48.650007 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:48.650461 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:48.779950 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:48.787398 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e6ad0b5-d712-4fb8-ab72-ea85db6686e4 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.150804 Jul 24 02:12:48.787977 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3522/6939] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:48 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:49.804487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:49.806011 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:49.813021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:49.813490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:49.814308 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:49.814764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:49.953873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:49.962038 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fe1e12ee-c2a1-472d-acf2-86a59ebf1f97 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.161435 Jul 24 02:12:49.962819 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3418/6940] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:49 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:50.037374 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8096a05e-a2d9-4139-9bd6-e3822f1add3a req-84faf42c-04c9-45b3-abec-254c6d071361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1e714e-b24f-4462-8236-d831b7424f6f", "name": "network-vif-plugged", "status": "completed", "tag": "62f50362-c4b2-486c-afe1-17d3f5814164"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:50.047251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8096a05e-a2d9-4139-9bd6-e3822f1add3a req-84faf42c-04c9-45b3-abec-254c6d071361 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:50.047708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8096a05e-a2d9-4139-9bd6-e3822f1add3a req-84faf42c-04c9-45b3-abec-254c6d071361 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:50.059882 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8096a05e-a2d9-4139-9bd6-e3822f1add3a req-84faf42c-04c9-45b3-abec-254c6d071361 service nova] Creating event network-vif-plugged:62f50362-c4b2-486c-afe1-17d3f5814164 for instance 8b1e714e-b24f-4462-8236-d831b7424f6f on n-h2-master-1 Jul 24 02:12:50.064777 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8096a05e-a2d9-4139-9bd6-e3822f1add3a req-84faf42c-04c9-45b3-abec-254c6d071361 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031204 Jul 24 02:12:50.065379 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3523/6941] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:12:50.979139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:50.979777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:50.981803 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:50.987998 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:50.988465 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:50.989252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:50.989731 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:51.117663 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:51.125364 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-90dd2c99-d92a-47a6-942b-cb32f0fed0fd tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1362 microversion: 2.1 time: 0.150301 Jul 24 02:12:51.125965 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3419/6942] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:50 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:52.140178 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:52.140961 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:52.146251 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:52.146959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:52.154211 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:52.154661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:52.155429 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:52.155865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:52.291486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:52.299419 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-062c7348-2943-40fb-9212-ca9b300cb735 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1554 microversion: 2.1 time: 0.160184 Jul 24 02:12:52.300007 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3524/6943] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:52 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:52.316371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:12:52.317006 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:52.324068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:52.324538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:52.325326 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:52.325807 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:52.454795 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:12:52.463413 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7108f268-10e3-4c08-a9fe-7838921a7816 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1554 microversion: 2.1 time: 0.150974 Jul 24 02:12:52.463995 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3420/6944] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:12:52 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:12:54.101885 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46abc93a-466f-4c17-88fe-dc5c8092f15c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc69ddb2-0a0b-44db-9db8-eb327e1681b3"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:12:54.102939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46abc93a-466f-4c17-88fe-dc5c8092f15c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:12:54.109712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46abc93a-466f-4c17-88fe-dc5c8092f15c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:54.110167 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46abc93a-466f-4c17-88fe-dc5c8092f15c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:54.110928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46abc93a-466f-4c17-88fe-dc5c8092f15c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:12:54.111363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46abc93a-466f-4c17-88fe-dc5c8092f15c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:12:54.186307 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:54.366734 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46abc93a-466f-4c17-88fe-dc5c8092f15c tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268666 Jul 24 02:12:54.367864 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3525/6945] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 02:12:54 2022] POST /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:05.008047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:05.008578 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:05.011131 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:05.011814 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=70 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:05.017746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:05.018222 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:05.019021 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:05.019477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:05.102367 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lazy-loading 'services' on Instance uuid 8b1e714e-b24f-4462-8236-d831b7424f6f {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:13:05.171277 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9c1bec99-dd26-413e-94a3-0cbd08431709 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments/dc69ddb2-0a0b-44db-9db8-eb327e1681b3" status: 202 len: 0 microversion: 2.1 time: 0.167930 Jul 24 02:13:05.171884 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3421/6946] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:13:05 2022] DELETE /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments/dc69ddb2-0a0b-44db-9db8-eb327e1681b3 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:13:05.178479 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:05.180016 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:05.184508 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7f2f7b21-aff7-4d76-a4f7-8e173cf82976 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:05.185652 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7f2f7b21-aff7-4d76-a4f7-8e173cf82976 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:05.194273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2f7b21-aff7-4d76-a4f7-8e173cf82976 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:05.194787 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2f7b21-aff7-4d76-a4f7-8e173cf82976 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:05.195853 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2f7b21-aff7-4d76-a4f7-8e173cf82976 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:05.196301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7f2f7b21-aff7-4d76-a4f7-8e173cf82976 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:05.229408 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7f2f7b21-aff7-4d76-a4f7-8e173cf82976 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052820 Jul 24 02:13:05.229925 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3526/6947] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:13:05 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:06.242749 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-85d48f33-1767-40bb-8122-d406507f89f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:06.243816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-85d48f33-1767-40bb-8122-d406507f89f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:06.250259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85d48f33-1767-40bb-8122-d406507f89f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:06.250722 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85d48f33-1767-40bb-8122-d406507f89f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:06.251499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85d48f33-1767-40bb-8122-d406507f89f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:06.251948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-85d48f33-1767-40bb-8122-d406507f89f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:06.281961 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-85d48f33-1767-40bb-8122-d406507f89f0 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Jul 24 02:13:06.282519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3422/6948] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:13:06 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:07.293531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d9d143e9-bed8-4ed1-bd3c-d1e9efd78f52 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:07.294440 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d9d143e9-bed8-4ed1-bd3c-d1e9efd78f52 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:07.301687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9d143e9-bed8-4ed1-bd3c-d1e9efd78f52 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:07.302188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9d143e9-bed8-4ed1-bd3c-d1e9efd78f52 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:07.302961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9d143e9-bed8-4ed1-bd3c-d1e9efd78f52 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:07.303399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d9d143e9-bed8-4ed1-bd3c-d1e9efd78f52 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:07.333880 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d9d143e9-bed8-4ed1-bd3c-d1e9efd78f52 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Jul 24 02:13:07.334470 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3527/6949] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:13:07 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:08.345945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-efb35e28-5e84-4edc-962f-561eda0fc2de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:08.346919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-efb35e28-5e84-4edc-962f-561eda0fc2de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:08.354540 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efb35e28-5e84-4edc-962f-561eda0fc2de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:08.355009 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efb35e28-5e84-4edc-962f-561eda0fc2de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:08.355790 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efb35e28-5e84-4edc-962f-561eda0fc2de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:08.356238 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efb35e28-5e84-4edc-962f-561eda0fc2de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:08.387312 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-efb35e28-5e84-4edc-962f-561eda0fc2de tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Jul 24 02:13:08.387804 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3423/6950] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:13:08 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:09.399767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4ad73e4d-b92a-443b-866c-9cd72f9f1d0b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:09.400716 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4ad73e4d-b92a-443b-866c-9cd72f9f1d0b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:09.407798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ad73e4d-b92a-443b-866c-9cd72f9f1d0b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:09.408277 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ad73e4d-b92a-443b-866c-9cd72f9f1d0b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:09.409168 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ad73e4d-b92a-443b-866c-9cd72f9f1d0b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:09.409627 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4ad73e4d-b92a-443b-866c-9cd72f9f1d0b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:09.440016 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4ad73e4d-b92a-443b-866c-9cd72f9f1d0b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Jul 24 02:13:09.440785 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3528/6951] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:13:09 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:10.452145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5851c147-e6d0-4a5f-b386-9f4ccfe0fd76 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:10.453018 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5851c147-e6d0-4a5f-b386-9f4ccfe0fd76 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:10.459775 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5851c147-e6d0-4a5f-b386-9f4ccfe0fd76 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:10.460884 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5851c147-e6d0-4a5f-b386-9f4ccfe0fd76 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:10.461804 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5851c147-e6d0-4a5f-b386-9f4ccfe0fd76 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:10.462266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5851c147-e6d0-4a5f-b386-9f4ccfe0fd76 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:10.491266 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5851c147-e6d0-4a5f-b386-9f4ccfe0fd76 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042963 Jul 24 02:13:10.492032 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3424/6952] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:13:10 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 02:13:10.501933 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:10.502529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:10.510614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:10.511069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:10.511842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:10.512296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:10.589237 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] HTTP exception thrown: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f is not attached to volume dc69ddb2-0a0b-44db-9db8-eb327e1681b3 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Request method failure captured: Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments/dc69ddb2-0a0b-44db-9db8-eb327e1681b3 HTTP/1.1 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KpsCKn5mEwgAr3YThPDe2CtGtOSLt4BQwTgxLHSVZ2kxS4qxIPXtnkqubWkMdMtuKXVZ8nhhmqcNI6Rjz0wg5ezR3-mmTFxpauuTvSYpJOsoPoh9rRCYEuj12cicm94eoL4jaYlVkzT8QjGOrSLmfoXKsFJZr_D8q70jHCiCaJI_fA Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e7f43fc61f442d2b8c5e847099d7268", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 603b9d20e2a94b0c99f9820f8374d0fa Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f is not attached to volume dc69ddb2-0a0b-44db-9db8-eb327e1681b3 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': '8b1e714e-b24f-4462-8236-d831b7424f6f', 'id': 'dc69ddb2-0a0b-44db-9db8-eb327e1681b3'} Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dc69ddb2-0a0b-44db-9db8-eb327e1681b3. Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f is not attached to volume dc69ddb2-0a0b-44db-9db8-eb327e1681b3 Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:13:10.591282 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:13:10.595382 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:13:10.595382 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:13:10.595382 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f is not attached to volume dc69ddb2-0a0b-44db-9db8-eb327e1681b3 Jul 24 02:13:10.595382 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:10.595382 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Returning 404 to user: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f is not attached to volume dc69ddb2-0a0b-44db-9db8-eb327e1681b3 {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:13:10.595382 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cdcf5b02-7da5-408e-9b3e-437fa0718ecf tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments/dc69ddb2-0a0b-44db-9db8-eb327e1681b3" status: 404 len: 154 microversion: 2.1 time: 0.094911 Jul 24 02:13:10.595382 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3529/6953] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:13:10 2022] DELETE /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f/os-volume_attachments/dc69ddb2-0a0b-44db-9db8-eb327e1681b3 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 02:13:13.940025 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:13.940549 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:13.947625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:13.948098 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:13.948881 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:13.949337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:13.974821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:13:14.056966 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6eb74960-3a54-4474-a05d-445071750698 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 204 len: 0 microversion: 2.1 time: 0.120504 Jul 24 02:13:14.061822 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3425/6954] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:13:13 2022] DELETE /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:13:14.066493 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:14.067130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:14.080117 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:14.082667 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:14.083509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:14.083970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:14.238173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:14.246765 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5ddf2dfc-b612-4319-9505-3f5e716be56b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1560 microversion: 2.1 time: 0.184389 Jul 24 02:13:14.247364 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3530/6955] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:14 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:15.264905 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:15.265624 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:15.272621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:15.273867 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:15.274650 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:15.275098 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:15.402209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:15.409619 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-25ab0d04-e328-4f66-87d2-a1ffe516805b tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1560 microversion: 2.1 time: 0.149033 Jul 24 02:13:15.410220 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3426/6956] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:15 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:16.266198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-84cf4dd1-a042-43ba-9fb7-7cf690f08bc9 req-6c06cbe8-48af-499f-a515-f240c4855163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1e714e-b24f-4462-8236-d831b7424f6f", "name": "network-vif-deleted", "tag": "62f50362-c4b2-486c-afe1-17d3f5814164"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:13:16.276131 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-84cf4dd1-a042-43ba-9fb7-7cf690f08bc9 req-6c06cbe8-48af-499f-a515-f240c4855163 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:16.276696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-84cf4dd1-a042-43ba-9fb7-7cf690f08bc9 req-6c06cbe8-48af-499f-a515-f240c4855163 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:16.296758 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-84cf4dd1-a042-43ba-9fb7-7cf690f08bc9 req-6c06cbe8-48af-499f-a515-f240c4855163 service nova] Creating event network-vif-deleted:62f50362-c4b2-486c-afe1-17d3f5814164 for instance 8b1e714e-b24f-4462-8236-d831b7424f6f on n-h2-master-1 Jul 24 02:13:16.302076 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-84cf4dd1-a042-43ba-9fb7-7cf690f08bc9 req-6c06cbe8-48af-499f-a515-f240c4855163 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039942 Jul 24 02:13:16.303053 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3531/6957] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:16.427374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:16.428325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:16.437987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:16.438450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:16.439251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:16.439697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:16.474241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:16.474599 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:16.475062 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lazy-loading 'fault' on Instance uuid 8b1e714e-b24f-4462-8236-d831b7424f6f {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:13:16.520201 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b9d20e2a94b0c99f9820f8374d0fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e7f43fc61f442d2b8c5e847099d7268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:16.529144 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04570801-99b0-4908-a341-2a8cca340378 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 200 len: 1352 microversion: 2.1 time: 0.105680 Jul 24 02:13:16.529735 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3427/6958] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:16 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:17.548673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:17.549296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] [instance: 8b1e714e-b24f-4462-8236-d831b7424f6f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:17.556285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:17.556728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:17.557493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:17.557983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:17.571008 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] HTTP exception thrown: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f could not be found. Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Request method failure captured: Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f HTTP/1.1 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KpsCKn5mEwgAr3YThPDe2CtGtOSLt4BQwTgxLHSVZ2kxS4qxIPXtnkqubWkMdMtuKXVZ8nhhmqcNI6Rjz0wg5ezR3-mmTFxpauuTvSYpJOsoPoh9rRCYEuj12cicm94eoL4jaYlVkzT8QjGOrSLmfoXKsFJZr_D8q70jHCiCaJI_fA Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e7f43fc61f442d2b8c5e847099d7268", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e7f43fc61f442d2b8c5e847099d7268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 8e7f43fc61f442d2b8c5e847099d7268 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1843209040 Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 603b9d20e2a94b0c99f9820f8374d0fa Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestEncryptedCinderVolumes-1843209040-project Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f could not be found. Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '8b1e714e-b24f-4462-8236-d831b7424f6f'} Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f could not be found. Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f could not be found. Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:13:17.572611 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f could not be found. Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Returning 404 to user: Instance 8b1e714e-b24f-4462-8236-d831b7424f6f could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f5295443-08de-470f-b5d2-071da8d74f23 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f" status: 404 len: 111 microversion: 2.1 time: 0.030483 Jul 24 02:13:17.576679 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3532/6959] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:17 2022] GET /compute/v2.1/servers/8b1e714e-b24f-4462-8236-d831b7424f6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:13:17.582694 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f83325a8-c681-4a76-b10d-a040ce68d5c1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] Calling method '.version_select at 0x7f05ea0163a0>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:17.600604 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f83325a8-c681-4a76-b10d-a040ce68d5c1 tempest-TestEncryptedCinderVolumes-1843209040 tempest-TestEncryptedCinderVolumes-1843209040-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-519619228" status: 202 len: 0 microversion: 2.1 time: 0.021774 Jul 24 02:13:17.601723 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3428/6960] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 02:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-519619228 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:13:45.055511 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-54fad554-86cb-4785-874c-91f37d94f4e1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'create', calling method: .version_select at 0x7f05ea915160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1028295947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKqqxGOqWBPTEyYrCaO0QQigvMYEOZraL7/OyQuiQF5glnUYVQxmXIhSLkwh6n4h9aoFZ04clfg8vN35l3Kv9d1bpeRk3UVHpn8IleAcobe5p0AATDzDVqttPSlTk10eg=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:13:45.059676 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:45.060444 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=34 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:45.072823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-54fad554-86cb-4785-874c-91f37d94f4e1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for project 3f362209460b447eafc746d78d91f589. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:13:45.077829 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-54fad554-86cb-4785-874c-91f37d94f4e1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for user 436ffbb8d49e46a9be0520b19ba223d5 and project 3f362209460b447eafc746d78d91f589. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:13:45.101575 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-54fad554-86cb-4785-874c-91f37d94f4e1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050999 Jul 24 02:13:45.102221 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3533/6961] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:13:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:45.150324 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:45.151267 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:45.156270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2034183077", "imageRef": "2677bb87-5b28-4dd7-b2b3-39b1d8daeab9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1028295947", "networks": [{"uuid": "6a4c28db-6fe3-49c0-a5b3-384e9f12d6ee"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:13:45.211518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] validate_networks() for [('6a4c28db-6fe3-49c0-a5b3-384e9f12d6ee', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:13:45.586314 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:13:45.587103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:13:45.587292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:13:45.587693 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:13:45.588128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:13:45.597158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:45.597629 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:45.598487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:45.598947 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:45.616484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for project 3f362209460b447eafc746d78d91f589. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:13:45.621810 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for user 436ffbb8d49e46a9be0520b19ba223d5 and project 3f362209460b447eafc746d78d91f589. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:13:45.635122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:13:45.637331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2677bb87-5b28-4dd7-b2b3-39b1d8daeab9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:13:45.682556 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e417ac69-6153-4688-9792-116948bc26fb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534135 Jul 24 02:13:45.683217 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3429/6962] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:13:45.693232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c83ff841-b07a-4225-8801-f89c9954a888 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:45.693961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c83ff841-b07a-4225-8801-f89c9954a888 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:45.753840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c83ff841-b07a-4225-8801-f89c9954a888 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:45.760810 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c83ff841-b07a-4225-8801-f89c9954a888 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1259 microversion: 2.1 time: 0.071629 Jul 24 02:13:45.761877 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3534/6963] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:45 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:46.779726 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:46.780443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:46.788294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:46.788760 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:46.789566 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:46.790152 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:46.890970 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:46.901066 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1880ad58-6786-4a2d-877b-c53ac5e27f87 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1319 microversion: 2.1 time: 0.126070 Jul 24 02:13:46.902166 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3430/6964] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:46 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1319 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:47.919152 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:47.919777 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:47.939521 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:47.940255 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:47.950856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:47.951511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:48.108443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:48.121954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9613f40d-03eb-467a-a7b5-5cdbb4bf4f1e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.206586 Jul 24 02:13:48.122898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3535/6965] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:47 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:49.141059 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:49.142017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:49.150637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:49.151781 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:49.153008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:49.153733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:49.314794 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:49.327867 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3e9ce4a2-a532-4e0f-8db2-42f3a593434c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.190943 Jul 24 02:13:49.328473 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3431/6966] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:49 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:50.345271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:50.346005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:50.353417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:50.353906 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:50.354703 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:50.355148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:50.497247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:50.505245 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-88f52f1c-a6a1-4338-81b9-24d7242a59d4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.164523 Jul 24 02:13:50.505857 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3536/6967] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:50 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:51.522799 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:51.523478 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:51.530614 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:51.531095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:51.531931 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:51.532370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:51.675820 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:51.683607 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-45c6d078-41aa-404e-bb90-153b4f560a30 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.164750 Jul 24 02:13:51.684197 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3432/6968] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:51 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:52.700886 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:52.701506 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:52.708417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:52.708872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:52.709770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:52.710281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:52.856537 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:52.864468 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aaeacb14-a936-473a-a74f-6c58e73f2784 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.167642 Jul 24 02:13:52.865110 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3537/6969] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:52 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:13:53.883257 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:53.884113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:53.891288 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:53.891824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:53.893058 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:53.893589 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:54.041216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:54.049159 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a80d95e1-ce1d-4bf5-86a1-43e2508f76fd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.170595 Jul 24 02:13:54.050100 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3433/6970] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:53 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:55.067437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:55.068061 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:55.076030 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:55.076492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:55.077272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:55.077749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:55.211712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:55.219306 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d7e25573-c4be-48a7-9984-6ce5749e5986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.156105 Jul 24 02:13:55.219881 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3538/6971] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:55 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:56.235555 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:56.236189 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:56.238891 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:56.239669 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:56.245490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:56.245987 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:56.246769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:56.247216 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:56.380227 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:56.388285 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b6764dab-99bf-4b29-b875-4bd76a324aa9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.156598 Jul 24 02:13:56.388866 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3434/6972] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:56 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:57.405843 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:57.406473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:57.408314 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:57.415075 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:57.415528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:57.416295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:57.416741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:57.547135 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:57.554717 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2b56e8f-d270-4c88-9e86-0bb25aafcdc3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.152792 Jul 24 02:13:57.555304 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3539/6973] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:57 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:13:58.573489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:58.574270 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:58.582432 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:58.583541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:58.584983 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:58.585585 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:58.692451 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e152f7b7-7b00-421c-b76d-53575b63abb3 req-6bde8049-e333-417f-9721-31cdf7259646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c31c41c-750b-4908-8e76-ffd4a6fc8bd2", "tag": "c452cf06-8756-4a22-90a8-a4996b5e6801"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:13:58.706446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e152f7b7-7b00-421c-b76d-53575b63abb3 req-6bde8049-e333-417f-9721-31cdf7259646 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:58.707236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e152f7b7-7b00-421c-b76d-53575b63abb3 req-6bde8049-e333-417f-9721-31cdf7259646 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:58.731224 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e152f7b7-7b00-421c-b76d-53575b63abb3 req-6bde8049-e333-417f-9721-31cdf7259646 service nova] Creating event network-changed:c452cf06-8756-4a22-90a8-a4996b5e6801 for instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 on n-h2-master-1 Jul 24 02:13:58.737627 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e152f7b7-7b00-421c-b76d-53575b63abb3 req-6bde8049-e333-417f-9721-31cdf7259646 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049476 Jul 24 02:13:58.738288 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3540/6974] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:13:58.821320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:13:58.829763 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d173c487-54f6-41c8-9128-8bc52dabf71d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.261651 Jul 24 02:13:58.830367 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3435/6975] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:58 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:13:59.848988 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:13:59.849756 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:13:59.856160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:59.856618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:59.857394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:13:59.857868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:13:59.993544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:00.001140 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e3e144e2-931a-4626-91cc-609fcfdf88e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.157301 Jul 24 02:14:00.001774 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3541/6976] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:13:59 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:01.018897 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:01.019532 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:01.027192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:01.027663 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:01.028458 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:01.028916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:01.155843 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:01.163590 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b75efb0-0479-4ca3-bdff-7f5c1bf7a31a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.148683 Jul 24 02:14:01.164177 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3436/6977] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:01 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:14:02.182357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:02.182906 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:02.189896 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:02.190351 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:02.191116 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:02.191554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:02.320765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:02.328253 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bf6ec6aa-8212-4d0a-a0a1-7d8ae60cc395 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.150277 Jul 24 02:14:02.328829 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3542/6978] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:02 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:03.345535 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:03.346207 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:03.353134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:03.353596 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:03.354403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:03.354856 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:03.488620 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:03.496783 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf353ea8-ac4c-45f3-a6ad-7ad0bbf2bda0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.155180 Jul 24 02:14:03.497361 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3437/6979] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:03 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:04.514491 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:04.515119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:04.528212 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:04.528710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:04.529563 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:04.530059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:04.651269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-790e3881-772e-49e4-ba3b-37bf44bd1db6 req-3d4ab59a-0167-4865-aa50-0176b30aa83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c31c41c-750b-4908-8e76-ffd4a6fc8bd2", "name": "network-vif-plugged", "status": "completed", "tag": "c452cf06-8756-4a22-90a8-a4996b5e6801"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:14:04.659490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-790e3881-772e-49e4-ba3b-37bf44bd1db6 req-3d4ab59a-0167-4865-aa50-0176b30aa83a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:04.659958 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-790e3881-772e-49e4-ba3b-37bf44bd1db6 req-3d4ab59a-0167-4865-aa50-0176b30aa83a service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:04.671526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:04.672111 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-790e3881-772e-49e4-ba3b-37bf44bd1db6 req-3d4ab59a-0167-4865-aa50-0176b30aa83a service nova] Creating event network-vif-plugged:c452cf06-8756-4a22-90a8-a4996b5e6801 for instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 on n-h2-master-1 Jul 24 02:14:04.677271 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-790e3881-772e-49e4-ba3b-37bf44bd1db6 req-3d4ab59a-0167-4865-aa50-0176b30aa83a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160291 Jul 24 02:14:04.679580 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3438/6980] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:14:04.680326 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e865d504-7a7d-4ae4-b09c-696556697aac tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.169740 Jul 24 02:14:04.680890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3543/6981] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:04 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:05.700219 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:05.700979 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:05.707355 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:05.707825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:05.708619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:05.709745 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:05.839014 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:05.846459 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fd65c964-3271-41ee-bcd6-533ae5f154dd tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1359 microversion: 2.1 time: 0.151548 Jul 24 02:14:05.847029 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3439/6982] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:05 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:06.863297 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:06.863949 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:06.872282 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:06.872758 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:06.873512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:06.874000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:07.006825 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:07.014304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-375cb3c1-f2fd-4fd9-86d8-40d461678b5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1549 microversion: 2.1 time: 0.154943 Jul 24 02:14:07.014876 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3544/6983] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:06 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:07.030364 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:07.030995 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:07.038788 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:07.039248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:07.040027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:07.040477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:07.168584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:07.175981 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-19f46fa9-3036-4dfe-b16d-8c3865cb832b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1549 microversion: 2.1 time: 0.149485 Jul 24 02:14:07.176550 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3440/6984] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:07 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:07.192015 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:07.195705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:07.196497 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Searching by: {'deleted': False, 'project_id': '3f362209460b447eafc746d78d91f589'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 02:14:07.201927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:07.202377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:07.203207 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:07.203643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:07.228884 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 02:14:07.255520 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bcf22ed7-ae3c-4922-a4f8-92a64aea3023 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067310 Jul 24 02:14:07.256127 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3545/6985] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 02:14:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:14:07.266464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:07.267105 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:07.274203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:07.274677 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:07.275469 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:07.275926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:07.403409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:07.410914 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6b451eb0-4ae1-4b45-beab-547638bb3d4b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1549 microversion: 2.1 time: 0.148376 Jul 24 02:14:07.411488 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3441/6986] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:07 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:08.934785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e6808571-29bc-45d3-9a1b-b2691b4d6d06 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f826214a-6d51-43e2-9350-1096864e832e"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:14:08.935849 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e6808571-29bc-45d3-9a1b-b2691b4d6d06 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:08.943548 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6808571-29bc-45d3-9a1b-b2691b4d6d06 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:08.944003 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6808571-29bc-45d3-9a1b-b2691b4d6d06 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:08.944770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6808571-29bc-45d3-9a1b-b2691b4d6d06 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:08.945206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e6808571-29bc-45d3-9a1b-b2691b4d6d06 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:09.243992 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e6808571-29bc-45d3-9a1b-b2691b4d6d06 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312934 Jul 24 02:14:09.244568 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3546/6987] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 02:14:08 2022] POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:14:22.211295 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:22.211925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:22.214953 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:22.215836 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=70 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:22.221698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:22.222182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:22.222966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:22.223414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:22.361284 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:22.370783 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f53e084-dfb0-421b-ac4f-5986820973e4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1595 microversion: 2.1 time: 0.163969 Jul 24 02:14:22.371366 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3442/6988] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:22 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1595 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:24.058699 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:24.059613 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:24.060213 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:24.064905 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0983b8de-a66f-4b99-9e68-f4e572bf47ee req-1896523c-d25a-4acd-bd95-d93b51dd8927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c31c41c-750b-4908-8e76-ffd4a6fc8bd2", "tag": "c452cf06-8756-4a22-90a8-a4996b5e6801"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:14:24.073952 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0983b8de-a66f-4b99-9e68-f4e572bf47ee req-1896523c-d25a-4acd-bd95-d93b51dd8927 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:24.074406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0983b8de-a66f-4b99-9e68-f4e572bf47ee req-1896523c-d25a-4acd-bd95-d93b51dd8927 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:24.086781 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0983b8de-a66f-4b99-9e68-f4e572bf47ee req-1896523c-d25a-4acd-bd95-d93b51dd8927 service nova] Creating event network-changed:c452cf06-8756-4a22-90a8-a4996b5e6801 for instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 on n-h2-master-1 Jul 24 02:14:24.093091 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0983b8de-a66f-4b99-9e68-f4e572bf47ee req-1896523c-d25a-4acd-bd95-d93b51dd8927 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036031 Jul 24 02:14:24.094036 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3547/6989] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:14:25.071891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1011701770"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:14:25.072443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:25.079408 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:25.079878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:25.080675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:25.081135 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:25.217409 n-d-master-1 devstack@n-api.service[119562]: INFO nova.network.security_group_api [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Adding security group 2a9ea00e-a5db-4761-b98d-fde1f17eee5a to port c452cf06-8756-4a22-90a8-a4996b5e6801 Jul 24 02:14:25.568831 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-971b664b-8007-43f7-a112-29e9649f2f09 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.501811 Jul 24 02:14:25.570461 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3443/6990] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:14:25 2022] POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:14:25.580620 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:14:25.581992 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:14:25.590945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:25.591661 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:25.592448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:25.593109 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:25.759875 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:14:25.768484 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2fdc56e4-4a17-4372-a84a-9628dd50c2b0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1761 microversion: 2.1 time: 0.192893 Jul 24 02:14:25.769980 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3548/6991] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:14:25 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1761 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:14:26.108206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-925d43a0-ea9c-4383-92a6-2b4cfdadd72f req-bdc2efaf-a806-4656-a241-8f17cc22a14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c31c41c-750b-4908-8e76-ffd4a6fc8bd2", "tag": "c452cf06-8756-4a22-90a8-a4996b5e6801"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:14:26.117379 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-925d43a0-ea9c-4383-92a6-2b4cfdadd72f req-bdc2efaf-a806-4656-a241-8f17cc22a14f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:14:26.117950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-925d43a0-ea9c-4383-92a6-2b4cfdadd72f req-bdc2efaf-a806-4656-a241-8f17cc22a14f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:14:26.130048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-925d43a0-ea9c-4383-92a6-2b4cfdadd72f req-bdc2efaf-a806-4656-a241-8f17cc22a14f service nova] Creating event network-changed:c452cf06-8756-4a22-90a8-a4996b5e6801 for instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 on n-h2-master-1 Jul 24 02:14:26.136587 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-925d43a0-ea9c-4383-92a6-2b4cfdadd72f req-bdc2efaf-a806-4656-a241-8f17cc22a14f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033152 Jul 24 02:14:26.137299 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3444/6992] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:16:32.234681 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:16:32.235349 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:16:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:16:32.306584 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:16:32.306727 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:16:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:16:32.689082 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:16:32.689645 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:16:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:16:37.793789 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 24 02:16:37.794750 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:16:37.795493 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:16:37.799545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-21c31931-b6ef-442b-96a0-5dbe19068f5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:16:37.800568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-21c31931-b6ef-442b-96a0-5dbe19068f5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:16:37.808004 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21c31931-b6ef-442b-96a0-5dbe19068f5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:37.808455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21c31931-b6ef-442b-96a0-5dbe19068f5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:37.809213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21c31931-b6ef-442b-96a0-5dbe19068f5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:37.809647 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-21c31931-b6ef-442b-96a0-5dbe19068f5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:37.879859 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-21c31931-b6ef-442b-96a0-5dbe19068f5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.087708 Jul 24 02:16:37.880520 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3549/6993] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:16:37 2022] POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:16:37.887015 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:16:37.887851 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:16:37.888440 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:16:37.889390 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:16:37.893903 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:16:37.894631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:16:37.903478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:37.903953 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:37.904754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:37.905210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:38.180890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:16:38.189153 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8feef457-6952-41ea-b0d2-d7b5902bf0fc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1763 microversion: 2.1 time: 0.304003 Jul 24 02:16:38.189751 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3445/6994] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:16:37 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1763 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:16:39.209608 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:16:39.210359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:16:39.217293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:39.217779 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:39.218556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:39.219006 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:39.225927 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36200. Jul 24 02:16:39.420490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:16:39.428937 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2c0df2f9-4666-4a04-801a-f45730774377 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1768 microversion: 2.1 time: 0.225180 Jul 24 02:16:39.429507 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3550/6995] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:16:39 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1768 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:16:40.446872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:16:40.447434 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:16:40.455922 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:40.456398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:40.457188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:40.457645 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:40.476207 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36208. Jul 24 02:16:40.476935 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36206. Jul 24 02:16:40.604114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:16:40.612108 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf3940cd-0aed-4b65-9616-8e7b3eb0cf31 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1768 microversion: 2.1 time: 0.169518 Jul 24 02:16:40.612677 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3446/6996] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:16:40 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1768 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:16:41.629068 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:16:41.629708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:16:41.637296 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:41.637783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:41.638553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:41.638995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:41.783862 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:16:41.791996 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5c26f62c-e8d9-42e1-81bb-5c201ec5520e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1768 microversion: 2.1 time: 0.167002 Jul 24 02:16:41.792584 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3551/6997] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:16:41 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1768 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:16:42.808403 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:16:42.809041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:16:42.816094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:42.816568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:42.817359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:42.817847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:42.965732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:16:42.973788 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2eaa4b91-4e2d-4428-b16e-8a8a490286f5 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1768 microversion: 2.1 time: 0.169304 Jul 24 02:16:42.974369 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3447/6998] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:16:42 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1768 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:16:43.991478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:16:43.992103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:16:43.999195 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:43.999649 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:44.000433 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:16:44.000870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:16:44.148899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:16:44.156956 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-367c0dce-3b4e-4c33-9172-71487e5c1c86 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1761 microversion: 2.1 time: 0.169904 Jul 24 02:16:44.157524 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3552/6999] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:16:43 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:16:52.774065 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:16:52.774632 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:16:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:18:12.726912 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:18:12.727510 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:18:13.391886 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:13.392652 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=18 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:13.397538 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1011701770"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:13.398116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:13.404847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:13.405307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:13.406111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:13.406564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:13.540397 n-d-master-1 devstack@n-api.service[119562]: INFO nova.network.security_group_api [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Removing security group 2a9ea00e-a5db-4761-b98d-fde1f17eee5a from port c452cf06-8756-4a22-90a8-a4996b5e6801 Jul 24 02:18:13.887328 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3b8ff4fa-445d-4a8c-a8a3-082306025acc tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.497239 Jul 24 02:18:13.895358 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3448/7000] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:18:13 2022] POST /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:18:13.903593 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=8 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:13.904158 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:14.068039 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-ac5aed98-c728-4790-9a16-66df9b3d0694 req-97d755eb-6de5-4968-ad34-96b0d8e3cb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c31c41c-750b-4908-8e76-ffd4a6fc8bd2", "tag": "c452cf06-8756-4a22-90a8-a4996b5e6801"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:14.090553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ac5aed98-c728-4790-9a16-66df9b3d0694 req-97d755eb-6de5-4968-ad34-96b0d8e3cb52 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:14.091534 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-ac5aed98-c728-4790-9a16-66df9b3d0694 req-97d755eb-6de5-4968-ad34-96b0d8e3cb52 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:14.132125 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-ac5aed98-c728-4790-9a16-66df9b3d0694 req-97d755eb-6de5-4968-ad34-96b0d8e3cb52 service nova] Creating event network-changed:c452cf06-8756-4a22-90a8-a4996b5e6801 for instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 on n-h2-master-1 Jul 24 02:18:14.144598 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-ac5aed98-c728-4790-9a16-66df9b3d0694 req-97d755eb-6de5-4968-ad34-96b0d8e3cb52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247674 Jul 24 02:18:14.145458 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3553/7001] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:18:15.338211 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:15.338737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:15.346567 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:15.347033 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:15.347823 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:15.348275 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:15.432716 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lazy-loading 'services' on Instance uuid 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:18:15.508719 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8f300069-4ad7-467a-9499-04ac51f4f121 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments/f826214a-6d51-43e2-9350-1096864e832e" status: 202 len: 0 microversion: 2.1 time: 0.174925 Jul 24 02:18:15.509515 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3449/7002] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:18:15 2022] DELETE /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments/f826214a-6d51-43e2-9350-1096864e832e => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:18:15.519017 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-606d7fc6-13c2-495a-afd7-278fa6f7076f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:15.520049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-606d7fc6-13c2-495a-afd7-278fa6f7076f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:15.528805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606d7fc6-13c2-495a-afd7-278fa6f7076f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:15.529187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606d7fc6-13c2-495a-afd7-278fa6f7076f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:15.529992 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606d7fc6-13c2-495a-afd7-278fa6f7076f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:15.530615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-606d7fc6-13c2-495a-afd7-278fa6f7076f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:15.562262 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-606d7fc6-13c2-495a-afd7-278fa6f7076f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048118 Jul 24 02:18:15.562850 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3554/7003] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:18:15 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:16.184371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-513bb40b-4411-4675-92c5-deaef1a40644 req-c32436fd-db4b-4f4f-9ce7-d88d0bb04d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c31c41c-750b-4908-8e76-ffd4a6fc8bd2", "tag": "c452cf06-8756-4a22-90a8-a4996b5e6801"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:16.196573 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-513bb40b-4411-4675-92c5-deaef1a40644 req-c32436fd-db4b-4f4f-9ce7-d88d0bb04d1b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:16.197128 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-513bb40b-4411-4675-92c5-deaef1a40644 req-c32436fd-db4b-4f4f-9ce7-d88d0bb04d1b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:16.217324 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-513bb40b-4411-4675-92c5-deaef1a40644 req-c32436fd-db4b-4f4f-9ce7-d88d0bb04d1b service nova] Creating event network-changed:c452cf06-8756-4a22-90a8-a4996b5e6801 for instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 on n-h2-master-1 Jul 24 02:18:16.222818 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-513bb40b-4411-4675-92c5-deaef1a40644 req-c32436fd-db4b-4f4f-9ce7-d88d0bb04d1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042652 Jul 24 02:18:16.224124 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3450/7004] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:16.576343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-71e8f9c5-4ecc-48a4-a7d9-9075d75ffdc1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:16.577952 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-71e8f9c5-4ecc-48a4-a7d9-9075d75ffdc1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:16.586047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e8f9c5-4ecc-48a4-a7d9-9075d75ffdc1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:16.586505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e8f9c5-4ecc-48a4-a7d9-9075d75ffdc1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:16.587301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e8f9c5-4ecc-48a4-a7d9-9075d75ffdc1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:16.587736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-71e8f9c5-4ecc-48a4-a7d9-9075d75ffdc1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:16.619551 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-71e8f9c5-4ecc-48a4-a7d9-9075d75ffdc1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047887 Jul 24 02:18:16.620278 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3555/7005] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:18:16 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:17.632742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-76cb0ce5-f5fc-4354-988f-04ba01ab0c14 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:17.633802 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-76cb0ce5-f5fc-4354-988f-04ba01ab0c14 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:17.640387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76cb0ce5-f5fc-4354-988f-04ba01ab0c14 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:17.640850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76cb0ce5-f5fc-4354-988f-04ba01ab0c14 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:17.641633 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76cb0ce5-f5fc-4354-988f-04ba01ab0c14 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:17.642117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-76cb0ce5-f5fc-4354-988f-04ba01ab0c14 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:17.672615 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-76cb0ce5-f5fc-4354-988f-04ba01ab0c14 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Jul 24 02:18:17.673190 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3451/7006] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:18:17 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:18.685046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dd36c7ad-4e35-429d-a8ef-cf7a64b35259 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:18.686011 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dd36c7ad-4e35-429d-a8ef-cf7a64b35259 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:18.693037 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd36c7ad-4e35-429d-a8ef-cf7a64b35259 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:18.693535 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd36c7ad-4e35-429d-a8ef-cf7a64b35259 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:18.694357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd36c7ad-4e35-429d-a8ef-cf7a64b35259 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:18.694805 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd36c7ad-4e35-429d-a8ef-cf7a64b35259 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:18.723656 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dd36c7ad-4e35-429d-a8ef-cf7a64b35259 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jul 24 02:18:18.724234 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3556/7007] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:18:18 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:19.736292 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8c952171-f517-4a13-8b4a-737eb3447ad9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:19.737111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8c952171-f517-4a13-8b4a-737eb3447ad9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:19.744962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c952171-f517-4a13-8b4a-737eb3447ad9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:19.745442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c952171-f517-4a13-8b4a-737eb3447ad9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:19.746301 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c952171-f517-4a13-8b4a-737eb3447ad9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:19.746755 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8c952171-f517-4a13-8b4a-737eb3447ad9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:19.776805 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8c952171-f517-4a13-8b4a-737eb3447ad9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Jul 24 02:18:19.777383 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3452/7008] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:18:19 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:20.789331 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7b9e132b-ccd0-4181-b896-8968cef8ded3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:20.790301 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7b9e132b-ccd0-4181-b896-8968cef8ded3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:20.797393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b9e132b-ccd0-4181-b896-8968cef8ded3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:20.797903 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b9e132b-ccd0-4181-b896-8968cef8ded3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:20.798681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b9e132b-ccd0-4181-b896-8968cef8ded3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:20.799123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7b9e132b-ccd0-4181-b896-8968cef8ded3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:20.828092 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7b9e132b-ccd0-4181-b896-8968cef8ded3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043466 Jul 24 02:18:20.828933 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3557/7009] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:18:20 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 02:18:20.839111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:20.839814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:20.846779 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:20.847315 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:20.848161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:20.848678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:20.924596 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] HTTP exception thrown: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 is not attached to volume f826214a-6d51-43e2-9350-1096864e832e Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Request method failure captured: Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: request: DELETE /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments/f826214a-6d51-43e2-9350-1096864e832e HTTP/1.1 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KrKRv1qUHDOmZzBqypV2GmI5LfVOqnOpu04yYqtFtFyeyhoZF9YqgvKajXO3X4BNSexefUK1bxsl75Rco5NAoBqPTToBNW6F5I8bxoNmrhdccNcaHuGd0IB_jJYYR8dn0G9rRSU1mi5qPViUF-njSRv6J9rzs9ppb06vwn1N9JjmWE Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f362209460b447eafc746d78d91f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f362209460b447eafc746d78d91f589", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 436ffbb8d49e46a9be0520b19ba223d5 Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 is not attached to volume f826214a-6d51-43e2-9350-1096864e832e Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: action_args: {'server_id': '4c31c41c-750b-4908-8e76-ffd4a6fc8bd2', 'id': 'f826214a-6d51-43e2-9350-1096864e832e'} Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f826214a-6d51-43e2-9350-1096864e832e. Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 is not attached to volume f826214a-6d51-43e2-9350-1096864e832e Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:18:20.926254 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:18:20.930617 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:18:20.930617 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:18:20.930617 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 is not attached to volume f826214a-6d51-43e2-9350-1096864e832e Jul 24 02:18:20.930617 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:20.930617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Returning 404 to user: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 is not attached to volume f826214a-6d51-43e2-9350-1096864e832e {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:18:20.930617 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5020857c-105f-48a1-8300-73827ea8a986 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments/f826214a-6d51-43e2-9350-1096864e832e" status: 404 len: 154 microversion: 2.1 time: 0.092716 Jul 24 02:18:20.930617 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3453/7010] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:18:20 2022] DELETE /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2/os-volume_attachments/f826214a-6d51-43e2-9350-1096864e832e => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:18:24.171170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:24.171673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:24.178708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:24.179157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:24.179927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:24.180360 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:24.206027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:18:24.288245 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2a9ad20c-4d2b-4f19-a180-b5f625bfd271 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 204 len: 0 microversion: 2.1 time: 0.119885 Jul 24 02:18:24.289101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3558/7011] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:18:24 2022] DELETE /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:18:24.298098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:24.299303 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:24.307943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:24.308324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:24.309121 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:24.309568 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:24.444028 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:24.451848 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9234b355-5f79-4164-8690-3c2807797f01 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1555 microversion: 2.1 time: 0.157813 Jul 24 02:18:24.452517 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3454/7012] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:24 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:18:25.470445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:25.471153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:25.482043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:25.482491 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:25.483260 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:25.483695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:25.617365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:25.624929 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f776fe2b-ae45-4284-97c9-545b9a45ff48 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1555 microversion: 2.1 time: 0.158840 Jul 24 02:18:25.625515 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3559/7013] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:25 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:26.581617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-b477c861-2cc3-4907-bdf2-4c39c2396512 req-52fe0fef-9f36-47d2-aebf-326e91ab24d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c31c41c-750b-4908-8e76-ffd4a6fc8bd2", "name": "network-vif-deleted", "tag": "c452cf06-8756-4a22-90a8-a4996b5e6801"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:26.591532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b477c861-2cc3-4907-bdf2-4c39c2396512 req-52fe0fef-9f36-47d2-aebf-326e91ab24d5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:26.592001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-b477c861-2cc3-4907-bdf2-4c39c2396512 req-52fe0fef-9f36-47d2-aebf-326e91ab24d5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:26.603795 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-b477c861-2cc3-4907-bdf2-4c39c2396512 req-52fe0fef-9f36-47d2-aebf-326e91ab24d5 service nova] Creating event network-vif-deleted:c452cf06-8756-4a22-90a8-a4996b5e6801 for instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 on n-h2-master-1 Jul 24 02:18:26.609463 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-b477c861-2cc3-4907-bdf2-4c39c2396512 req-52fe0fef-9f36-47d2-aebf-326e91ab24d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031421 Jul 24 02:18:26.610238 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3455/7014] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:26.642019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:26.642765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:26.650590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:26.651121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:26.651962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:26.652467 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:26.718779 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:26.727096 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6e883c95-9242-4ec2-a5db-58431dbf1202 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 200 len: 1344 microversion: 2.1 time: 0.088972 Jul 24 02:18:26.727685 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3560/7015] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:26 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:27.745605 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:27.746305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:27.753421 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:27.754331 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:27.755117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:27.756108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:27.769256 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] HTTP exception thrown: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 could not be found. Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Request method failure captured: Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 HTTP/1.1 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3KrKRv1qUHDOmZzBqypV2GmI5LfVOqnOpu04yYqtFtFyeyhoZF9YqgvKajXO3X4BNSexefUK1bxsl75Rco5NAoBqPTToBNW6F5I8bxoNmrhdccNcaHuGd0IB_jJYYR8dn0G9rRSU1mi5qPViUF-njSRv6J9rzs9ppb06vwn1N9JjmWE Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f362209460b447eafc746d78d91f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f362209460b447eafc746d78d91f589", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 436ffbb8d49e46a9be0520b19ba223d5 Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 could not be found. Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '4c31c41c-750b-4908-8e76-ffd4a6fc8bd2'} Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 could not be found. Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 could not be found. Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:18:27.770944 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 could not be found. Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Returning 404 to user: Instance 4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f6d8ebdb-52bf-4a61-89fb-5d10f818b305 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2" status: 404 len: 111 microversion: 2.1 time: 0.033419 Jul 24 02:18:27.776800 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3456/7016] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:27 2022] GET /compute/v2.1/servers/4c31c41c-750b-4908-8e76-ffd4a6fc8bd2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:18:27.782359 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-24e7d3cc-aeb4-44c9-a846-d3581305248e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '.version_select at 0x7f05e9e69ee0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:27.803738 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-24e7d3cc-aeb4-44c9-a846-d3581305248e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1028295947" status: 202 len: 0 microversion: 2.1 time: 0.025272 Jul 24 02:18:27.804313 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3561/7017] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 02:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1028295947 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 02:18:36.566932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ab62863f-b37f-45e8-8200-ed78cabffea0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'create', calling method: .version_select at 0x7f05ea27a4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1501028228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzzdBLFOZhBbIGmm2wBcydZBxhy9BqF82nTlbtPoCFY4k+jmHfxFKBK0fFiBgJHUz1OplbQIvVtyXXgy2Oka8gbeGW0ceye9W2/1w6SENggYktKsSo4HgcgEWjfz/E1qA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:36.581925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ab62863f-b37f-45e8-8200-ed78cabffea0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for project 3f362209460b447eafc746d78d91f589. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:18:36.587429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-ab62863f-b37f-45e8-8200-ed78cabffea0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for user 436ffbb8d49e46a9be0520b19ba223d5 and project 3f362209460b447eafc746d78d91f589. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:18:36.613800 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ab62863f-b37f-45e8-8200-ed78cabffea0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.097579 Jul 24 02:18:36.614389 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3457/7018] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:18:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:36.663165 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2073298690", "imageRef": "03e5c2a1-ecf2-402d-98de-524db3af92a8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1501028228", "networks": [{"uuid": "6a4c28db-6fe3-49c0-a5b3-384e9f12d6ee"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:36.714100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] validate_networks() for [('6a4c28db-6fe3-49c0-a5b3-384e9f12d6ee', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:18:36.722910 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:37.142304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:18:37.142732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:18:37.143208 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:18:37.143618 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:18:37.144032 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:18:37.153764 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:37.154216 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:37.155014 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:37.155449 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:37.171763 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for project 3f362209460b447eafc746d78d91f589. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:18:37.176984 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Getting quotas for user 436ffbb8d49e46a9be0520b19ba223d5 and project 3f362209460b447eafc746d78d91f589. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:18:37.189270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:18:37.191397 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03e5c2a1-ecf2-402d-98de-524db3af92a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:18:37.238436 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-95fe507f-088e-4b53-a59c-621fc037503d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580836 Jul 24 02:18:37.239104 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3562/7019] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:18:37.249553 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e735d78-71e5-4ef1-a04b-6b0e478e2c7d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:37.250432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e735d78-71e5-4ef1-a04b-6b0e478e2c7d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:37.309874 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7e735d78-71e5-4ef1-a04b-6b0e478e2c7d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:37.316573 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e735d78-71e5-4ef1-a04b-6b0e478e2c7d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1259 microversion: 2.1 time: 0.070921 Jul 24 02:18:37.317142 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3458/7020] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:37 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:38.338668 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:38.340641 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:38.347796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:38.348374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:38.350157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:38.350615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:38.422898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:38.431513 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f023623a-2fb2-4512-8141-c5e31171bc9a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1329 microversion: 2.1 time: 0.100800 Jul 24 02:18:38.432101 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3563/7021] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:38 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:39.449010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:39.449837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:39.453475 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:39.472015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:39.472484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:39.473283 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:39.473757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:39.610958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:39.618662 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-48d4d52a-5282-4e21-bb01-483bf9c03a5f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.173664 Jul 24 02:18:39.619231 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3459/7022] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:39 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:40.636961 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:40.637655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:40.644818 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:40.645272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:40.646592 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:40.647042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:40.789785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:40.797573 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05d50148-3dd3-4c79-9de2-f35d91bdcdb9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.164527 Jul 24 02:18:40.803023 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3564/7023] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:40 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:41.815510 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:41.816143 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:41.824252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:41.825025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:41.827189 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:41.828271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:41.981313 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:41.992537 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6eaa27c3-ac1f-4d00-8393-de046f090514 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.180743 Jul 24 02:18:42.002330 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3460/7024] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:41 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:43.010079 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:43.010896 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:43.020087 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:43.020540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:43.022423 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:43.023154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:43.194464 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:43.202498 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e59b0126-332a-4b53-873e-bdcc3c8b2e4f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.197597 Jul 24 02:18:43.214594 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3565/7025] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:43 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:44.222564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:44.223195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:44.226585 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:44.231678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:44.232154 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:44.232941 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:44.233397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:44.378528 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:44.386997 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63ee8be0-f269-4834-be0c-190e1909c111 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.168347 Jul 24 02:18:44.387834 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3461/7026] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:44 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:45.405184 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:45.405752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:45.408428 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:45.413945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:45.414420 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:45.415218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:45.415682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:45.997749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:46.006283 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0a1d1820-cd94-4611-bb6c-d0e9a71ec79b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.604237 Jul 24 02:18:46.006890 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3566/7027] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:45 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:47.024852 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:47.026260 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:47.033773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:47.034324 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:47.035299 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:47.035825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:47.184953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:47.193489 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f745af04-b74c-425c-a8f6-02474bf1956c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.173932 Jul 24 02:18:47.194140 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3462/7028] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:47 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:18:48.211691 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:48.212303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:48.214972 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:48.215625 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:48.222079 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:48.222528 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:48.223291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:48.224365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:48.354365 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:48.361742 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3b5fee7d-9f59-4055-8484-85d63189edd9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.154631 Jul 24 02:18:48.362317 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3567/7029] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:48 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:49.378876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:49.379503 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:49.381549 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:49.387595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:49.388057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:49.388832 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:49.389282 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:49.514128 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:49.522024 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b2562ed-a28e-43fe-a8a7-4e284b823946 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.147090 Jul 24 02:18:49.522610 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3463/7030] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:49 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:18:50.539371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:50.539975 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:50.547041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:50.547493 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:50.548280 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:50.548714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:50.675831 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:50.683260 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c874d4a1-03d2-4fdc-bd71-a8d7239875be tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.148343 Jul 24 02:18:50.683846 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3568/7031] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:50 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:51.689125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-297a3d41-43d7-4283-982d-8528a7dcc8b0 req-e342f5a1-07e0-4f7e-88ff-22cf22c7a3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df6869c-d587-4975-a9ea-96fd5c4c5a5f", "tag": "af1d9658-4bcd-4aaf-963c-2e813f8e687b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:51.699876 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-297a3d41-43d7-4283-982d-8528a7dcc8b0 req-e342f5a1-07e0-4f7e-88ff-22cf22c7a3cb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:51.700506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-297a3d41-43d7-4283-982d-8528a7dcc8b0 req-e342f5a1-07e0-4f7e-88ff-22cf22c7a3cb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:51.702141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:51.711087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:51.715882 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-297a3d41-43d7-4283-982d-8528a7dcc8b0 req-e342f5a1-07e0-4f7e-88ff-22cf22c7a3cb service nova] Creating event network-changed:af1d9658-4bcd-4aaf-963c-2e813f8e687b for instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f on n-h2-master-1 Jul 24 02:18:51.719057 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:51.719464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:51.720258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:51.720707 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:51.721797 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-297a3d41-43d7-4283-982d-8528a7dcc8b0 req-e342f5a1-07e0-4f7e-88ff-22cf22c7a3cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037832 Jul 24 02:18:51.722715 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3464/7032] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:51.956851 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:51.965985 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-45df6914-936f-4931-87a2-4f556d6cbe12 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.269201 Jul 24 02:18:51.966590 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3569/7033] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:51 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:52.984447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:52.985172 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:52.993287 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:52.993794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:52.994587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:52.995043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:53.126250 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:53.133806 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-efc4dc47-78b8-4e34-a15f-1b013b23ccdb tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.153721 Jul 24 02:18:53.134387 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3465/7034] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:52 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:54.151049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:54.151669 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:54.158727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:54.159183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:54.159956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:54.160397 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:54.291349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:54.299071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87cd885a-0c03-4cc8-8c0e-df74b5b38424 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.151944 Jul 24 02:18:54.299650 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3570/7035] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:54 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:55.316036 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:55.316677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:55.324207 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:55.324679 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:55.325472 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:55.325957 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:55.458023 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:55.465558 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0443249-00b0-455f-a618-c1f7e5ec940b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.153471 Jul 24 02:18:55.466164 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3466/7036] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:55 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:56.482644 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:56.483180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:56.491554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:56.492016 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:56.492820 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:56.493263 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:56.627443 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:56.635017 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3d84685f-8b9b-48a0-bf0f-8a31484595a1 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.156400 Jul 24 02:18:56.635611 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3571/7037] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:56 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:57.651932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:57.652562 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:57.659659 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:57.660129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:57.660912 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:57.661368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:57.794908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:57.802919 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d769f419-9eb4-4b59-a8a9-ba8678864687 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.154913 Jul 24 02:18:57.803510 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3467/7038] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:57 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:58.139572 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-2ceb5212-83f4-47a2-82e0-179c64db0cee req-fc04f859-1116-4f4f-99e4-8fd123846334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df6869c-d587-4975-a9ea-96fd5c4c5a5f", "name": "network-vif-plugged", "status": "completed", "tag": "af1d9658-4bcd-4aaf-963c-2e813f8e687b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:18:58.148800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2ceb5212-83f4-47a2-82e0-179c64db0cee req-fc04f859-1116-4f4f-99e4-8fd123846334 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:58.149251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-2ceb5212-83f4-47a2-82e0-179c64db0cee req-fc04f859-1116-4f4f-99e4-8fd123846334 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:58.160762 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-2ceb5212-83f4-47a2-82e0-179c64db0cee req-fc04f859-1116-4f4f-99e4-8fd123846334 service nova] Creating event network-vif-plugged:af1d9658-4bcd-4aaf-963c-2e813f8e687b for instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f on n-h2-master-1 Jul 24 02:18:58.166354 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-2ceb5212-83f4-47a2-82e0-179c64db0cee req-fc04f859-1116-4f4f-99e4-8fd123846334 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 Jul 24 02:18:58.166960 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3572/7039] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:18:58.820338 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:58.820971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:58.827993 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:58.828459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:58.829233 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:58.829705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:58.958530 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:18:58.966019 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-99fc0af5-e5ed-43ae-960c-1026dabaa91b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1359 microversion: 2.1 time: 0.150057 Jul 24 02:18:58.966599 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3468/7040] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:58 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:18:59.984809 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:18:59.985507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:18:59.992285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:59.992731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:18:59.993488 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:18:59.993949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:00.131496 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:19:00.139185 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f7d91d40-235c-46c2-9735-2fff9317e24d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1548 microversion: 2.1 time: 0.159669 Jul 24 02:19:00.139778 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3573/7041] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:18:59 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:19:00.156932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:19:00.157599 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:19:00.165371 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:00.165888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:00.166714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:00.167197 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:00.296224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:19:00.303735 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8a10ebb3-4d84-4fa8-bc31-7781a991afc2 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1548 microversion: 2.1 time: 0.150711 Jul 24 02:19:00.304307 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3469/7042] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:19:00 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:19:00.319935 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:19:00.323270 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:19:00.324042 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Searching by: {'deleted': False, 'project_id': '3f362209460b447eafc746d78d91f589'} {{(pid=119561) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 24 02:19:00.329500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:00.329991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:00.330795 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:00.331237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:00.354738 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.multi_cell_list [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119561) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 24 02:19:00.381450 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e48840b6-65ee-4a4b-b814-b77072ae930d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.065861 Jul 24 02:19:00.382057 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3574/7043] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 02:19:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:19:00.392357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:19:00.393024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:19:00.399777 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:00.400252 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:00.401047 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:00.401505 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:00.532674 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:19:00.540317 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f72afa20-a70d-4d1e-80ba-3820b1bd2d8e tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1548 microversion: 2.1 time: 0.151868 Jul 24 02:19:00.540899 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3470/7044] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:19:00 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:19:02.018006 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-70659c25-ddcc-443d-bb58-9bb77d97768d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c31977c6-cf8b-4070-b7b9-03a93881dbe9"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:19:02.019091 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-70659c25-ddcc-443d-bb58-9bb77d97768d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:19:02.026432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70659c25-ddcc-443d-bb58-9bb77d97768d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:02.026891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70659c25-ddcc-443d-bb58-9bb77d97768d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:02.027665 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70659c25-ddcc-443d-bb58-9bb77d97768d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:02.028104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-70659c25-ddcc-443d-bb58-9bb77d97768d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:02.278392 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-70659c25-ddcc-443d-bb58-9bb77d97768d tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263879 Jul 24 02:19:02.279014 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3575/7045] 10.222.0.27 () {60 vars in 1322 bytes} [Sun Jul 24 02:19:02 2022] POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:19:12.970044 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:19:12.970679 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:19:12.973007 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=19 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:19:12.973857 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=68 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:19:12.979734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:12.980210 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:12.981002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:12.981460 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:13.110987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:19:13.120048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bf8cba6c-d664-402a-953f-2686ca8d2a37 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1594 microversion: 2.1 time: 0.154018 Jul 24 02:19:13.120691 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3471/7046] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:19:12 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:19:14.748043 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:19:14.749395 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=19 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:19:14.750736 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:19:14.819982 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8462958e-0cc9-4cbd-9a85-be990c2cd03d req-2c4ec720-0879-49bd-a093-2847c360cdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df6869c-d587-4975-a9ea-96fd5c4c5a5f", "tag": "af1d9658-4bcd-4aaf-963c-2e813f8e687b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:19:14.829696 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8462958e-0cc9-4cbd-9a85-be990c2cd03d req-2c4ec720-0879-49bd-a093-2847c360cdc2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:14.830065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8462958e-0cc9-4cbd-9a85-be990c2cd03d req-2c4ec720-0879-49bd-a093-2847c360cdc2 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:14.842807 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8462958e-0cc9-4cbd-9a85-be990c2cd03d req-2c4ec720-0879-49bd-a093-2847c360cdc2 service nova] Creating event network-changed:af1d9658-4bcd-4aaf-963c-2e813f8e687b for instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f on n-h2-master-1 Jul 24 02:19:14.848747 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8462958e-0cc9-4cbd-9a85-be990c2cd03d req-2c4ec720-0879-49bd-a093-2847c360cdc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112376 Jul 24 02:19:14.852272 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3576/7047] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:19:15.820368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-680689898"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:19:15.820932 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:19:15.828151 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:15.828621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:15.829607 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:15.830107 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:16.069327 n-d-master-1 devstack@n-api.service[119562]: INFO nova.network.security_group_api [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Adding security group 6d2fcf88-f974-4066-aca4-10b43f2c3257 to port af1d9658-4bcd-4aaf-963c-2e813f8e687b Jul 24 02:19:16.773108 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-674919c2-6f12-40e2-aac3-95d4349c535c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.955679 Jul 24 02:19:16.774838 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3472/7048] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:19:15 2022] POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/action => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:19:16.786531 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-58622221-1cab-409d-84ff-83b0a9d16fba req-080929c3-18f5-4091-a788-fa1e54e496fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df6869c-d587-4975-a9ea-96fd5c4c5a5f", "tag": "af1d9658-4bcd-4aaf-963c-2e813f8e687b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:19:16.788919 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:19:16.793061 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:19:16.800017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-58622221-1cab-409d-84ff-83b0a9d16fba req-080929c3-18f5-4091-a788-fa1e54e496fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:16.804185 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-58622221-1cab-409d-84ff-83b0a9d16fba req-080929c3-18f5-4091-a788-fa1e54e496fc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:16.810974 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:16.811649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:16.812897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:19:16.813352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:19:16.837454 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-58622221-1cab-409d-84ff-83b0a9d16fba req-080929c3-18f5-4091-a788-fa1e54e496fc service nova] Creating event network-changed:af1d9658-4bcd-4aaf-963c-2e813f8e687b for instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f on n-h2-master-1 Jul 24 02:19:16.845954 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-58622221-1cab-409d-84ff-83b0a9d16fba req-080929c3-18f5-4091-a788-fa1e54e496fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066461 Jul 24 02:19:16.850431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3577/7049] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:19:17.107760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:19:17.124631 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-32b8c8e9-4172-49a6-b33b-517cef37663f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1759 microversion: 2.1 time: 0.343570 Jul 24 02:19:17.131026 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3473/7050] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:19:16 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1759 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:19:52.315295 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:19:52.315969 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:19:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:20:14.552719 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:20:14.553477 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:20:14.557693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b0a85bd5-c6fc-42ef-858e-1564f74a5d9b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:20:14.558743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b0a85bd5-c6fc-42ef-858e-1564f74a5d9b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:14.565727 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0a85bd5-c6fc-42ef-858e-1564f74a5d9b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:14.566180 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0a85bd5-c6fc-42ef-858e-1564f74a5d9b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:14.566949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0a85bd5-c6fc-42ef-858e-1564f74a5d9b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:14.567895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0a85bd5-c6fc-42ef-858e-1564f74a5d9b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:14.638700 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b0a85bd5-c6fc-42ef-858e-1564f74a5d9b tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.087855 Jul 24 02:20:14.640045 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3578/7051] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:20:14 2022] POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:20:14.648516 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:14.649725 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:14.651969 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:20:14.652720 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=16 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:20:14.658374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:14.658840 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:14.659634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:14.660096 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:14.896205 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:14.904213 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-42651257-db44-476a-8313-f325116210fa tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1751 microversion: 2.1 time: 0.260635 Jul 24 02:20:14.904870 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3474/7052] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:14 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:15.923317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:15.924018 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:15.931340 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:15.931789 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:15.932560 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:15.932998 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:16.508907 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:16.516957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6724a4ae-9c26-47a9-b5be-169142f1cc43 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.598753 Jul 24 02:20:16.517536 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3579/7053] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:15 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:17.534625 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:17.535290 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:17.543813 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:17.544334 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:17.545354 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:17.545849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:17.702734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:17.711025 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-63f8a3e9-af21-46fd-a8b4-77ddc8ea959f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.180235 Jul 24 02:20:17.711613 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3475/7054] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:17 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:18.728486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:18.729089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:18.735978 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:18.736448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:18.737232 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:18.737694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:18.880638 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:18.888555 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f192ad83-5543-4b17-9389-3b55f0c165f7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.164104 Jul 24 02:20:18.889125 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3580/7055] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:18 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:20:19.905857 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:19.906495 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:19.914057 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:19.914533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:19.915340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:19.915799 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:20.060797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:20.069427 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0540a1e7-4c85-42c2-b1cf-61866a1fea60 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.167532 Jul 24 02:20:20.070039 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3476/7056] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:19 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:21.088687 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:21.089367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:21.096970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:21.097425 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:21.098273 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:21.098741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:21.246380 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:21.254599 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4e1e926-4e6f-4a9d-bbd4-ea5347aa0bf7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.171959 Jul 24 02:20:21.255137 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3581/7057] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:21 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:22.272319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:22.272955 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:22.280600 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:22.281073 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:22.281892 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:22.282344 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:22.427319 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:22.435446 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47362644-ae11-4c54-8697-4d8cf75f1d36 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.167375 Jul 24 02:20:22.436021 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3477/7058] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:22 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:23.453013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:23.453548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:23.461336 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:23.461827 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:23.462631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:23.463073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:23.607695 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:23.615718 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-87b095fd-5d0a-433e-88f1-5742c1a36596 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.166740 Jul 24 02:20:23.616289 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3582/7059] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:23 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:24.633017 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:24.633648 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:24.640514 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:24.640976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:24.641793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:24.642241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:24.783131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:24.791756 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-60ae724a-ed3d-403f-99d6-331fa85cc200 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.162697 Jul 24 02:20:24.792328 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3478/7060] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:24 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:25.809043 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:25.809658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:25.817324 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:25.817749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:25.818500 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:25.819223 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:25.968653 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:25.977640 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-94734958-f8ca-4b9f-b3ec-b49c39ad5782 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1756 microversion: 2.1 time: 0.172548 Jul 24 02:20:25.978245 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3583/7061] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:25 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:20:26.995159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:20:26.995793 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:20:27.002748 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:27.003221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:27.004007 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:20:27.004511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:20:27.149564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:20:27.157541 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-74bf1081-5581-480b-886f-8a4d39c60ee3 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1759 microversion: 2.1 time: 0.166560 Jul 24 02:20:27.158144 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3479/7062] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:20:26 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:22.814672 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-680689898"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:21:22.815286 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:22.817742 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:22.818398 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:22.824542 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:22.824989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:22.825778 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:22.826214 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:22.959361 n-d-master-1 devstack@n-api.service[119561]: INFO nova.network.security_group_api [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Removing security group 6d2fcf88-f974-4066-aca4-10b43f2c3257 from port af1d9658-4bcd-4aaf-963c-2e813f8e687b Jul 24 02:21:23.300687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8d84b545-3920-4e03-b9a2-3ca19f18db0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.489906 Jul 24 02:21:23.301308 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3584/7063] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:21:22 2022] POST /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 02:21:23.313821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ea129eb7-b6c4-4d65-b75c-1867beca2f6e req-7fa591c0-5f25-4c58-9ef8-94ad642093fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df6869c-d587-4975-a9ea-96fd5c4c5a5f", "tag": "af1d9658-4bcd-4aaf-963c-2e813f8e687b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:21:23.325109 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:23.326654 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=36 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:23.330323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ea129eb7-b6c4-4d65-b75c-1867beca2f6e req-7fa591c0-5f25-4c58-9ef8-94ad642093fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:23.332724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ea129eb7-b6c4-4d65-b75c-1867beca2f6e req-7fa591c0-5f25-4c58-9ef8-94ad642093fe service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:23.356217 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ea129eb7-b6c4-4d65-b75c-1867beca2f6e req-7fa591c0-5f25-4c58-9ef8-94ad642093fe service nova] Creating event network-changed:af1d9658-4bcd-4aaf-963c-2e813f8e687b for instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f on n-h2-master-1 Jul 24 02:21:23.360842 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [req-ea129eb7-b6c4-4d65-b75c-1867beca2f6e req-7fa591c0-5f25-4c58-9ef8-94ad642093fe service nova] [3f3b8e7e-bb2f-47ba-b337-b95f00af3bc9] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:21:24.345855 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:24.346345 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:24.352916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:24.353372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:24.354177 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:24.354619 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:24.368593 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [req-ea129eb7-b6c4-4d65-b75c-1867beca2f6e req-7fa591c0-5f25-4c58-9ef8-94ad642093fe service nova] [3f3b8e7e-bb2f-47ba-b337-b95f00af3bc9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36700. Jul 24 02:21:24.373007 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ea129eb7-b6c4-4d65-b75c-1867beca2f6e req-7fa591c0-5f25-4c58-9ef8-94ad642093fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.064471 Jul 24 02:21:24.374381 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3480/7064] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:24.450191 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lazy-loading 'services' on Instance uuid 1df6869c-d587-4975-a9ea-96fd5c4c5a5f {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:21:24.538204 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2e0a481e-8128-4002-a71b-426e482b25bf tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments/c31977c6-cf8b-4070-b7b9-03a93881dbe9" status: 202 len: 0 microversion: 2.1 time: 0.197693 Jul 24 02:21:24.539210 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3585/7065] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:21:24 2022] DELETE /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments/c31977c6-cf8b-4070-b7b9-03a93881dbe9 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:21:24.548801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ad93ad3-927d-4660-82b9-bde53d18e2d8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:24.550123 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ad93ad3-927d-4660-82b9-bde53d18e2d8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:24.560116 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ad93ad3-927d-4660-82b9-bde53d18e2d8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:24.561634 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ad93ad3-927d-4660-82b9-bde53d18e2d8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:24.562742 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ad93ad3-927d-4660-82b9-bde53d18e2d8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:24.563768 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6ad93ad3-927d-4660-82b9-bde53d18e2d8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:24.600935 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ad93ad3-927d-4660-82b9-bde53d18e2d8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056622 Jul 24 02:21:24.601898 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3481/7066] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:21:24 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:25.613159 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6617b753-5195-40b4-9563-e336c3fb090f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:25.614263 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6617b753-5195-40b4-9563-e336c3fb090f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:25.622412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6617b753-5195-40b4-9563-e336c3fb090f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:25.622868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6617b753-5195-40b4-9563-e336c3fb090f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:25.623639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6617b753-5195-40b4-9563-e336c3fb090f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:25.624080 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6617b753-5195-40b4-9563-e336c3fb090f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:25.654856 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6617b753-5195-40b4-9563-e336c3fb090f tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Jul 24 02:21:25.655438 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3586/7067] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:21:25 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:26.388484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-9372e284-604e-492a-a8f9-38ac478abd66 req-21979b65-bba2-403e-ad67-99cb2562bfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df6869c-d587-4975-a9ea-96fd5c4c5a5f", "tag": "af1d9658-4bcd-4aaf-963c-2e813f8e687b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:21:26.398678 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9372e284-604e-492a-a8f9-38ac478abd66 req-21979b65-bba2-403e-ad67-99cb2562bfd5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:26.399144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-9372e284-604e-492a-a8f9-38ac478abd66 req-21979b65-bba2-403e-ad67-99cb2562bfd5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:26.410470 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-9372e284-604e-492a-a8f9-38ac478abd66 req-21979b65-bba2-403e-ad67-99cb2562bfd5 service nova] Creating event network-changed:af1d9658-4bcd-4aaf-963c-2e813f8e687b for instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f on n-h2-master-1 Jul 24 02:21:26.416211 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-9372e284-604e-492a-a8f9-38ac478abd66 req-21979b65-bba2-403e-ad67-99cb2562bfd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031420 Jul 24 02:21:26.416881 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3482/7068] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:26.667122 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f3a68048-6228-42a0-85ad-8d74c282e79a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:26.668092 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f3a68048-6228-42a0-85ad-8d74c282e79a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:26.675603 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a68048-6228-42a0-85ad-8d74c282e79a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:26.676064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a68048-6228-42a0-85ad-8d74c282e79a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:26.676859 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a68048-6228-42a0-85ad-8d74c282e79a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:26.677301 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f3a68048-6228-42a0-85ad-8d74c282e79a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:26.716566 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f3a68048-6228-42a0-85ad-8d74c282e79a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053747 Jul 24 02:21:26.717541 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3587/7069] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:21:26 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:27.730076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8f8f3208-1350-4032-829d-6a0eb811a6e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:27.731110 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8f8f3208-1350-4032-829d-6a0eb811a6e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:27.737496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8f3208-1350-4032-829d-6a0eb811a6e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:27.738006 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8f3208-1350-4032-829d-6a0eb811a6e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:27.738797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8f3208-1350-4032-829d-6a0eb811a6e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:27.739253 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8f8f3208-1350-4032-829d-6a0eb811a6e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:27.770016 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8f8f3208-1350-4032-829d-6a0eb811a6e7 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Jul 24 02:21:27.770466 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3483/7070] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:21:27 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:28.782177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b92445ed-d5e9-4e65-91ab-2fcf2289aba0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:28.783137 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b92445ed-d5e9-4e65-91ab-2fcf2289aba0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:28.791342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b92445ed-d5e9-4e65-91ab-2fcf2289aba0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:28.791813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b92445ed-d5e9-4e65-91ab-2fcf2289aba0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:28.792643 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b92445ed-d5e9-4e65-91ab-2fcf2289aba0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:28.793093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b92445ed-d5e9-4e65-91ab-2fcf2289aba0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:28.824012 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b92445ed-d5e9-4e65-91ab-2fcf2289aba0 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045827 Jul 24 02:21:28.824594 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3588/7071] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:21:28 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:29.835800 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f4bcd90-3b43-4f0e-8a37-f8e3ce9216df tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:29.836654 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f4bcd90-3b43-4f0e-8a37-f8e3ce9216df tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:29.843487 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f4bcd90-3b43-4f0e-8a37-f8e3ce9216df tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:29.843944 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f4bcd90-3b43-4f0e-8a37-f8e3ce9216df tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:29.844712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f4bcd90-3b43-4f0e-8a37-f8e3ce9216df tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:29.845158 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f4bcd90-3b43-4f0e-8a37-f8e3ce9216df tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:29.873256 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f4bcd90-3b43-4f0e-8a37-f8e3ce9216df tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041909 Jul 24 02:21:29.873838 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3484/7072] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 02:21:29 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 24 02:21:29.884599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:29.885103 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:29.892009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:29.892464 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:29.893229 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:29.893687 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:29.968000 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] HTTP exception thrown: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f is not attached to volume c31977c6-cf8b-4070-b7b9-03a93881dbe9 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Request method failure captured: Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: request: DELETE /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments/c31977c6-cf8b-4070-b7b9-03a93881dbe9 HTTP/1.1 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KrKRv1qUHDOmZzBqypV2GmI5LfVOqnOpu04yYqtFtFyeyhoZF9YqgvKajXO3X4BNSexefUK1bxsl75Rco5NAoBqPTToBNW6F5I8bxoNmrhdccNcaHuGd0IB_jJYYR8dn0G9rRSU1mi5qPViUF-njSRv6J9rzs9ppb06vwn1N9JjmWE Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f362209460b447eafc746d78d91f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f362209460b447eafc746d78d91f589", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 436ffbb8d49e46a9be0520b19ba223d5 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f is not attached to volume c31977c6-cf8b-4070-b7b9-03a93881dbe9 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: action_args: {'server_id': '1df6869c-d587-4975-a9ea-96fd5c4c5a5f', 'id': 'c31977c6-cf8b-4070-b7b9-03a93881dbe9'} Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c31977c6-cf8b-4070-b7b9-03a93881dbe9. Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f is not attached to volume c31977c6-cf8b-4070-b7b9-03a93881dbe9 Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:21:29.969593 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:21:29.973617 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:21:29.973617 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:21:29.973617 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f is not attached to volume c31977c6-cf8b-4070-b7b9-03a93881dbe9 Jul 24 02:21:29.973617 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:29.973617 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Returning 404 to user: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f is not attached to volume c31977c6-cf8b-4070-b7b9-03a93881dbe9 {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:21:29.973617 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-791668f5-a9f5-4c2c-ada3-1f98e5419ac8 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments/c31977c6-cf8b-4070-b7b9-03a93881dbe9" status: 404 len: 154 microversion: 2.1 time: 0.091532 Jul 24 02:21:29.973617 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3589/7073] 10.222.0.27 () {58 vars in 1415 bytes} [Sun Jul 24 02:21:29 2022] DELETE /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f/os-volume_attachments/c31977c6-cf8b-4070-b7b9-03a93881dbe9 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:21:32.245869 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:21:32.246397 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:21:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:21:32.699494 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:21:32.700013 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:21:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:21:32.734572 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:21:32.734796 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:21:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:21:33.205727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:33.206240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:33.213118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:33.213580 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:33.214383 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:33.214831 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:33.239346 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:21:33.320212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c916877-0f17-4640-b82d-898b56b37d8a tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 204 len: 0 microversion: 2.1 time: 0.117920 Jul 24 02:21:33.321008 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3485/7074] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:21:33 2022] DELETE /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 24 02:21:33.329392 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:33.330044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:33.338275 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:33.338741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:33.339540 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:33.339987 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:33.480660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:33.488562 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ce8f8399-e48f-4d91-ab54-a751c90a2a82 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1554 microversion: 2.1 time: 0.163205 Jul 24 02:21:33.489129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3590/7075] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:33 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:21:34.507353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:34.508102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:34.515757 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:34.516219 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:34.516995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:34.517443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:34.651812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:34.659282 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3dde3a24-4ac9-4188-85dc-f200e9f1d1b4 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1554 microversion: 2.1 time: 0.156320 Jul 24 02:21:34.659848 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3486/7076] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:34 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:35.627892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-680de1cd-319a-4d35-bd18-702b56d33ba4 req-78f9ea73-64c3-4060-b580-7f9613e1112c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df6869c-d587-4975-a9ea-96fd5c4c5a5f", "name": "network-vif-deleted", "tag": "af1d9658-4bcd-4aaf-963c-2e813f8e687b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:21:35.637174 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-680de1cd-319a-4d35-bd18-702b56d33ba4 req-78f9ea73-64c3-4060-b580-7f9613e1112c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:35.637625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-680de1cd-319a-4d35-bd18-702b56d33ba4 req-78f9ea73-64c3-4060-b580-7f9613e1112c service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:35.649019 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-680de1cd-319a-4d35-bd18-702b56d33ba4 req-78f9ea73-64c3-4060-b580-7f9613e1112c service nova] Creating event network-vif-deleted:af1d9658-4bcd-4aaf-963c-2e813f8e687b for instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f on n-h2-master-1 Jul 24 02:21:35.654423 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-680de1cd-319a-4d35-bd18-702b56d33ba4 req-78f9ea73-64c3-4060-b580-7f9613e1112c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030122 Jul 24 02:21:35.655117 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3591/7077] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:35.676541 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:35.677286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:35.685266 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:35.685796 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:35.686591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:35.687132 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:35.750286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436ffbb8d49e46a9be0520b19ba223d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f362209460b447eafc746d78d91f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:35.757736 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3033487f-c739-402d-83f7-016edf7ffd0c tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 200 len: 1344 microversion: 2.1 time: 0.085302 Jul 24 02:21:35.758305 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3487/7078] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:35 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 1344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:36.776802 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:36.777569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] [instance: 1df6869c-d587-4975-a9ea-96fd5c4c5a5f] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:36.783873 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:36.784325 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:36.785089 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:36.785522 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:36.800552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] HTTP exception thrown: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f could not be found. Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Request method failure captured: Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f HTTP/1.1 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3KrKRv1qUHDOmZzBqypV2GmI5LfVOqnOpu04yYqtFtFyeyhoZF9YqgvKajXO3X4BNSexefUK1bxsl75Rco5NAoBqPTToBNW6F5I8bxoNmrhdccNcaHuGd0IB_jJYYR8dn0G9rRSU1mi5qPViUF-njSRv6J9rzs9ppb06vwn1N9JjmWE Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f362209460b447eafc746d78d91f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f362209460b447eafc746d78d91f589", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f362209460b447eafc746d78d91f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 3f362209460b447eafc746d78d91f589 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestMinimumBasicScenario-249719618 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: 436ffbb8d49e46a9be0520b19ba223d5 Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestMinimumBasicScenario-249719618-project Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f could not be found. Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '1df6869c-d587-4975-a9ea-96fd5c4c5a5f'} Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f could not be found. Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f could not be found. Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:21:36.802225 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f could not be found. Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Returning 404 to user: Instance 1df6869c-d587-4975-a9ea-96fd5c4c5a5f could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-449cf2be-45ec-4a26-8a87-c3ac6d506185 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f" status: 404 len: 111 microversion: 2.1 time: 0.032818 Jul 24 02:21:36.807548 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3592/7079] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:36 2022] GET /compute/v2.1/servers/1df6869c-d587-4975-a9ea-96fd5c4c5a5f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:21:36.812574 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-22510d38-0074-4de1-beb2-1ee7c646b4c9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] Calling method '.version_select at 0x7f05eafa3b80>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:36.834069 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-22510d38-0074-4de1-beb2-1ee7c646b4c9 tempest-TestMinimumBasicScenario-249719618 tempest-TestMinimumBasicScenario-249719618-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501028228" status: 202 len: 0 microversion: 2.1 time: 0.025225 Jul 24 02:21:36.835367 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3488/7080] 10.222.0.27 () {58 vars in 1271 bytes} [Sun Jul 24 02:21:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501028228 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:21:46.163499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c83cb775-9411-43f4-943e-57e990268d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: .version_select at 0x7f05eacb6c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-189096060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQw5P03ewgKkvMQqw9oKfPym6tmkP1LAVOQ5LhTphRo6smiYQSnvvs9fIW2E7vYCdl5fliEQJEeQZYS++TqST23J6WbTGE2SP80ukyRUk85am4qaqLXOvvqsstY6OI+bA=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:21:46.178476 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c83cb775-9411-43f4-943e-57e990268d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:21:46.184698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c83cb775-9411-43f4-943e-57e990268d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:21:46.212241 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c83cb775-9411-43f4-943e-57e990268d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.233454 Jul 24 02:21:46.212844 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3593/7081] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:21:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:21:51.869411 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:51.870221 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:51.874183 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1670659699", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "0d3becf9-c598-4656-ae1a-fe9e555e4f5d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-189096060", "security_groups": [{"name": "tempest-secgroup-smoke-877438163"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:21:52.107988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] validate_networks() for [('0d3becf9-c598-4656-ae1a-fe9e555e4f5d', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:21:52.656504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:21:52.657236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:21:52.657759 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:21:52.658192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:21:52.658798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:21:52.668980 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:52.669457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:52.670343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:52.671068 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:52.699486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:21:52.706058 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:21:52.727569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:21:52.731868 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:21:52.796223 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a286d19b-bc5a-4788-ab9d-0436cfe8b849 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.928620 Jul 24 02:21:52.797451 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3489/7082] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:21:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:21:52.804914 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:52.810979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fc0da126-5425-4162-a971-dbc5f63cda7f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:52.811602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fc0da126-5425-4162-a971-dbc5f63cda7f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:52.975944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fc0da126-5425-4162-a971-dbc5f63cda7f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:52.982750 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fc0da126-5425-4162-a971-dbc5f63cda7f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1266 microversion: 2.1 time: 0.178847 Jul 24 02:21:52.983335 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3594/7083] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:52 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:54.001496 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:54.002398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:54.011014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:54.011484 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:54.012442 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:54.013064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:54.083021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:54.091829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0ec10d5c-29bc-4432-94e6-392946d0627a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1270 microversion: 2.1 time: 0.095183 Jul 24 02:21:54.092424 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3490/7084] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:53 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:55.109704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:55.110669 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:55.114311 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:55.121202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:55.122251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:55.122578 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:55.123061 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:55.195376 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:55.202950 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-72edf267-308a-40ea-8153-85be7f85efd9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1324 microversion: 2.1 time: 0.097377 Jul 24 02:21:55.203534 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3595/7085] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:55 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1324 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:56.225340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:56.226022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:56.234919 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:56.235478 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:56.236229 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:56.236694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:56.441165 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:56.448824 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4b051347-84ac-492d-8abc-26130a6de3fa tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1391 microversion: 2.1 time: 0.232103 Jul 24 02:21:56.449400 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3491/7086] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:56 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:56.523547 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-66ab70e3-cee3-40a9-be40-56be4f0454b9 req-56a43215-a7f6-48c8-b32e-aa1a5e32fa7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91828a0a-87c7-4ff9-9a31-f8fa22d0f98d", "tag": "54eecba7-18ce-489e-a79e-df78f1148a7b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:21:56.535866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-66ab70e3-cee3-40a9-be40-56be4f0454b9 req-56a43215-a7f6-48c8-b32e-aa1a5e32fa7d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:56.536320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-66ab70e3-cee3-40a9-be40-56be4f0454b9 req-56a43215-a7f6-48c8-b32e-aa1a5e32fa7d service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:56.550430 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-66ab70e3-cee3-40a9-be40-56be4f0454b9 req-56a43215-a7f6-48c8-b32e-aa1a5e32fa7d service nova] Creating event network-changed:54eecba7-18ce-489e-a79e-df78f1148a7b for instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d on n-h1-master-1 Jul 24 02:21:56.556566 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-66ab70e3-cee3-40a9-be40-56be4f0454b9 req-56a43215-a7f6-48c8-b32e-aa1a5e32fa7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037045 Jul 24 02:21:56.557431 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3596/7087] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:21:57.466106 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:57.466666 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:57.473929 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:57.474444 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:57.475220 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:57.475688 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:57.613450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:57.621724 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8305ded6-98aa-4b3b-955a-a27369e083f3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1391 microversion: 2.1 time: 0.159700 Jul 24 02:21:57.622290 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3492/7088] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:57 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:58.640868 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:58.641601 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:58.649045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:58.649502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:58.650307 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:58.650750 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:58.783796 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:58.791552 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7bfb9827-550e-42c3-9ce7-7237b8fbb2c4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1391 microversion: 2.1 time: 0.155856 Jul 24 02:21:58.792129 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3597/7089] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:58 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:21:59.809770 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:21:59.810512 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:21:59.817533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:59.818734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:59.819537 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:21:59.819994 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:21:59.953559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:21:59.961630 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f1a950a8-923e-46e6-a795-b4ce98e9cc4c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1391 microversion: 2.1 time: 0.156642 Jul 24 02:21:59.962245 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3493/7090] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:21:59 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:00.978764 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:00.979379 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:00.986316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:00.986771 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:00.987534 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:00.987967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:01.125028 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:01.133468 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-30218e4c-797b-40b5-9ecf-193dafb44f42 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1391 microversion: 2.1 time: 0.158597 Jul 24 02:22:01.134164 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3598/7091] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:00 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:01.654891 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ce4a2c6f-483b-4510-bcdd-9a79a0528aac req-5d56fd94-7120-49e3-9529-bf7726640ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91828a0a-87c7-4ff9-9a31-f8fa22d0f98d", "name": "network-vif-plugged", "status": "completed", "tag": "54eecba7-18ce-489e-a79e-df78f1148a7b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:01.663641 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ce4a2c6f-483b-4510-bcdd-9a79a0528aac req-5d56fd94-7120-49e3-9529-bf7726640ed0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:01.664169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ce4a2c6f-483b-4510-bcdd-9a79a0528aac req-5d56fd94-7120-49e3-9529-bf7726640ed0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:01.675193 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ce4a2c6f-483b-4510-bcdd-9a79a0528aac req-5d56fd94-7120-49e3-9529-bf7726640ed0 service nova] Creating event network-vif-plugged:54eecba7-18ce-489e-a79e-df78f1148a7b for instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d on n-h1-master-1 Jul 24 02:22:01.680719 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ce4a2c6f-483b-4510-bcdd-9a79a0528aac req-5d56fd94-7120-49e3-9529-bf7726640ed0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091218 Jul 24 02:22:01.681303 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3494/7092] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:22:02.151197 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:02.151820 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:02.158783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:02.159240 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:02.160005 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:02.160443 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:02.295821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:02.303207 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b0f32483-3dad-4985-880f-f1e9d87b8efd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1391 microversion: 2.1 time: 0.155961 Jul 24 02:22:02.303775 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3599/7093] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:02 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:03.318347 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:03.319212 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:03.323508 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:03.324204 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:03.331307 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:03.331769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:03.332550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:03.332997 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:03.466104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:03.473596 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8bcde11b-0341-4015-a515-26d3975372ec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1562 microversion: 2.1 time: 0.157464 Jul 24 02:22:03.474780 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3495/7094] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:03 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:03.490928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:03.491795 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:03.493787 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:03.499930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:03.500384 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:03.501157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:03.501595 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:03.636111 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:03.643773 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-956bc00e-49a3-4bce-9e3b-b3842612e4ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1562 microversion: 2.1 time: 0.157406 Jul 24 02:22:03.644354 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3600/7095] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:03 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:05.557152 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:05.557935 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:05.559554 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-0030d101-93ed-4458-ac6b-4bd8f88d8852 req-647c98b5-9b37-4aeb-a099-996ee60bca16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91828a0a-87c7-4ff9-9a31-f8fa22d0f98d", "tag": "54eecba7-18ce-489e-a79e-df78f1148a7b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:05.565204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:05.565794 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:05.566606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:05.567066 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:05.569108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0030d101-93ed-4458-ac6b-4bd8f88d8852 req-647c98b5-9b37-4aeb-a099-996ee60bca16 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:05.570008 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-0030d101-93ed-4458-ac6b-4bd8f88d8852 req-647c98b5-9b37-4aeb-a099-996ee60bca16 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:05.581917 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-0030d101-93ed-4458-ac6b-4bd8f88d8852 req-647c98b5-9b37-4aeb-a099-996ee60bca16 service nova] Creating event network-changed:54eecba7-18ce-489e-a79e-df78f1148a7b for instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d on n-h1-master-1 Jul 24 02:22:05.591516 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-0030d101-93ed-4458-ac6b-4bd8f88d8852 req-647c98b5-9b37-4aeb-a099-996ee60bca16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035870 Jul 24 02:22:05.592672 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3601/7096] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:22:05.805007 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:05.813530 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e4434e42-ce7e-4972-a516-d79b7e4df2c8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1562 microversion: 2.1 time: 0.260266 Jul 24 02:22:05.814521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3496/7097] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:05 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:27.100143 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c768e8a-ee8a-4304-abc1-1d6355af8fb7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:27.101180 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0c768e8a-ee8a-4304-abc1-1d6355af8fb7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:27.104224 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=13 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:27.104883 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=34 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:27.111923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c768e8a-ee8a-4304-abc1-1d6355af8fb7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:27.112374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c768e8a-ee8a-4304-abc1-1d6355af8fb7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:27.113147 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c768e8a-ee8a-4304-abc1-1d6355af8fb7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:27.114150 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c768e8a-ee8a-4304-abc1-1d6355af8fb7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:27.170266 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c768e8a-ee8a-4304-abc1-1d6355af8fb7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action" status: 200 len: 24574 microversion: 2.1 time: 0.074419 Jul 24 02:22:27.170954 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3602/7098] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:22:27 2022] POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action => generated 24574 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:22:38.271814 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4f3602b5-38a1-4053-a4ea-c55e8802e723 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:38.272969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4f3602b5-38a1-4053-a4ea-c55e8802e723 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:38.275427 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:38.276101 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=40 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:38.282916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f3602b5-38a1-4053-a4ea-c55e8802e723 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:38.283380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f3602b5-38a1-4053-a4ea-c55e8802e723 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:38.284168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f3602b5-38a1-4053-a4ea-c55e8802e723 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:38.284623 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4f3602b5-38a1-4053-a4ea-c55e8802e723 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:38.350420 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4f3602b5-38a1-4053-a4ea-c55e8802e723 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action" status: 202 len: 0 microversion: 2.1 time: 0.082551 Jul 24 02:22:38.351200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3497/7099] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:22:38 2022] POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:22:38.360367 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:38.361325 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:38.364448 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:38.365129 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:38.371590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:38.371972 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:38.372761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:38.373234 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:38.511289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:38.519000 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f209af94-f487-4928-82da-f44e331cf305 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1685 microversion: 2.1 time: 0.162918 Jul 24 02:22:38.519578 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3603/7100] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:38 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:39.539581 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:39.540339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:39.546647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:39.547119 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:39.547904 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:39.548356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:39.685864 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:39.693524 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ba365226-2583-4066-968a-e5bd0c198bf4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1665 microversion: 2.1 time: 0.159828 Jul 24 02:22:39.694130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3498/7101] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:39 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:40.782448 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-16330df4-ea76-4d84-8b7f-4f46685159b7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:40.783387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-16330df4-ea76-4d84-8b7f-4f46685159b7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:40.790228 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16330df4-ea76-4d84-8b7f-4f46685159b7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:40.790697 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16330df4-ea76-4d84-8b7f-4f46685159b7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:40.791480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16330df4-ea76-4d84-8b7f-4f46685159b7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:40.791928 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-16330df4-ea76-4d84-8b7f-4f46685159b7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:40.848341 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-16330df4-ea76-4d84-8b7f-4f46685159b7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action" status: 200 len: 32646 microversion: 2.1 time: 0.069869 Jul 24 02:22:40.849008 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3604/7102] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:22:40 2022] POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:22:40.860804 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7182e2ae-bbe0-4031-9ae9-0f4a076e11c3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:40.861387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7182e2ae-bbe0-4031-9ae9-0f4a076e11c3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:40.868624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7182e2ae-bbe0-4031-9ae9-0f4a076e11c3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:40.869089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7182e2ae-bbe0-4031-9ae9-0f4a076e11c3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:40.869915 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7182e2ae-bbe0-4031-9ae9-0f4a076e11c3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:40.870370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7182e2ae-bbe0-4031-9ae9-0f4a076e11c3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:40.935614 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7182e2ae-bbe0-4031-9ae9-0f4a076e11c3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action" status: 202 len: 0 microversion: 2.1 time: 0.078920 Jul 24 02:22:40.936254 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3499/7103] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:22:40 2022] POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:22:40.945151 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:40.945890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:40.953059 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:40.953520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:40.954326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:40.954769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:41.093903 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:41.102005 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8538e458-a359-4aea-8f35-7cbda8466d85 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1672 microversion: 2.1 time: 0.161142 Jul 24 02:22:41.102573 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3605/7104] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:40 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:42.121452 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:42.121880 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:42.128100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:42.128572 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:42.129374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:42.129861 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:42.260796 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:42.268400 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cac50477-5284-4240-a4a6-04d85798f2e3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1672 microversion: 2.1 time: 0.152856 Jul 24 02:22:42.268969 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3500/7105] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:42 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:43.286483 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:43.287112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:43.294332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:43.294797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:43.295587 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:43.296035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:43.432706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:43.440268 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5d8a3c2-02b6-473e-8358-ca739b64e88e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1672 microversion: 2.1 time: 0.157737 Jul 24 02:22:43.440847 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3606/7106] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:43 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:44.457492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:44.458122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:44.464985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:44.465448 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:44.466247 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:44.466698 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:44.597008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:44.605256 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b144b383-1db8-4e97-ac8f-4b07c5b8d26e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1672 microversion: 2.1 time: 0.151763 Jul 24 02:22:44.605853 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3501/7107] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:44 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:45.623253 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:45.623798 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:45.630824 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:45.631911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:45.632691 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:45.633143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:45.768008 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:45.775844 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6b7baace-cafd-4fa0-99b5-b9446ceda9b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1672 microversion: 2.1 time: 0.156614 Jul 24 02:22:45.776434 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3607/7108] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:45 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:46.794286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:46.794925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:46.801842 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:46.802319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:46.803111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:46.803582 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:46.942012 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:46.950158 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-08b3d54a-8d0a-4423-bbea-4b088b4a198f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1680 microversion: 2.1 time: 0.159834 Jul 24 02:22:46.950734 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3502/7109] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:46 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:47.045456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be1ef351-0afa-482a-80f1-cc73b8032110 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:47.046426 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be1ef351-0afa-482a-80f1-cc73b8032110 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:47.053553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be1ef351-0afa-482a-80f1-cc73b8032110 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:47.054067 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be1ef351-0afa-482a-80f1-cc73b8032110 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:47.054845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be1ef351-0afa-482a-80f1-cc73b8032110 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:47.055284 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be1ef351-0afa-482a-80f1-cc73b8032110 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:47.108516 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be1ef351-0afa-482a-80f1-cc73b8032110 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action" status: 200 len: 38619 microversion: 2.1 time: 0.066792 Jul 24 02:22:47.109174 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3608/7110] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:22:47 2022] POST /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d/action => generated 38619 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:22:48.077994 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:48.078493 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:48.081053 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-e6d376d9-8f13-4b35-a91b-ae3ba956d3f3 req-d2ddd6fa-6c16-4bec-8041-796e8306b2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91828a0a-87c7-4ff9-9a31-f8fa22d0f98d", "tag": "54eecba7-18ce-489e-a79e-df78f1148a7b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:48.085793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:48.086332 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:48.087193 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:48.087718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:48.090942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e6d376d9-8f13-4b35-a91b-ae3ba956d3f3 req-d2ddd6fa-6c16-4bec-8041-796e8306b2bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:48.091393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-e6d376d9-8f13-4b35-a91b-ae3ba956d3f3 req-d2ddd6fa-6c16-4bec-8041-796e8306b2bc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:48.104079 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-e6d376d9-8f13-4b35-a91b-ae3ba956d3f3 req-d2ddd6fa-6c16-4bec-8041-796e8306b2bc service nova] Creating event network-changed:54eecba7-18ce-489e-a79e-df78f1148a7b for instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d on n-h1-master-1 Jul 24 02:22:48.109148 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-e6d376d9-8f13-4b35-a91b-ae3ba956d3f3 req-d2ddd6fa-6c16-4bec-8041-796e8306b2bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032419 Jul 24 02:22:48.109807 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3609/7111] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:22:48.118327 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:22:48.210124 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-87f0b598-87b2-41c5-8a59-4dbed9ad7a36 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 204 len: 0 microversion: 2.1 time: 0.135858 Jul 24 02:22:48.215369 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3503/7112] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:22:48 2022] DELETE /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:22:48.222106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:48.223063 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:48.230413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:48.231095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:48.232063 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:48.232673 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:48.389517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:48.398375 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e07faea1-e2cb-46cd-8c2a-2bdb8e0c2d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1686 microversion: 2.1 time: 0.182363 Jul 24 02:22:48.398987 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3610/7113] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:48 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:22:49.417539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:49.418208 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:49.425100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:49.425564 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:49.427352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:49.427849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:49.630398 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:22:49.639517 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-77e8e8bd-46eb-4b28-8c7a-8758365a8222 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 200 len: 1686 microversion: 2.1 time: 0.226954 Jul 24 02:22:49.640384 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3504/7114] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:49 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 1686 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:22:50.179428 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-f6313fcf-7dfc-4bc1-ac0e-bcc874b66dba req-0b81b40b-8058-457b-b3e0-1b8a812d4f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91828a0a-87c7-4ff9-9a31-f8fa22d0f98d", "name": "network-vif-deleted", "tag": "54eecba7-18ce-489e-a79e-df78f1148a7b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:50.189062 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f6313fcf-7dfc-4bc1-ac0e-bcc874b66dba req-0b81b40b-8058-457b-b3e0-1b8a812d4f93 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:50.189567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-f6313fcf-7dfc-4bc1-ac0e-bcc874b66dba req-0b81b40b-8058-457b-b3e0-1b8a812d4f93 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:50.201837 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-f6313fcf-7dfc-4bc1-ac0e-bcc874b66dba req-0b81b40b-8058-457b-b3e0-1b8a812d4f93 service nova] Creating event network-vif-deleted:54eecba7-18ce-489e-a79e-df78f1148a7b for instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d on n-h1-master-1 Jul 24 02:22:50.206825 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-f6313fcf-7dfc-4bc1-ac0e-bcc874b66dba req-0b81b40b-8058-457b-b3e0-1b8a812d4f93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Jul 24 02:22:50.207430 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3611/7115] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:22:50.657718 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:50.658355 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:22:50.665361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:50.665882 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:50.666675 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:22:50.667129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:22:50.681112 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] HTTP exception thrown: Instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d could not be found. Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Request method failure captured: Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d HTTP/1.1 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Ky5XfbVkZL6Jgtdp0Oto6Gr3xwXrf1Bzc8iOBIF3BzzW-2SBqiNHwqJHvDxoFIJrLw9uJ9ilkJK4CZhyxoNryqy1lDA8KMdYvXtKR2hZjA0aSnyM9P4eqpgBEnina0XBcESEFTtlETDsib8WrHBRSF3YENs6MWf6AWZR_vxtDdFJX4 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577aa474166845ffbc0ddc0c23b5a6cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a8ddac1d257f460e9115ab3f02942692 Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d could not be found. Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '91828a0a-87c7-4ff9-9a31-f8fa22d0f98d'} Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d could not be found. Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d could not be found. Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:22:50.682792 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d could not be found. Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Returning 404 to user: Instance 91828a0a-87c7-4ff9-9a31-f8fa22d0f98d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-66fe9309-4b1e-4d16-be83-86abec236876 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d" status: 404 len: 111 microversion: 2.1 time: 0.030471 Jul 24 02:22:50.687757 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3505/7116] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:22:50 2022] GET /compute/v2.1/servers/91828a0a-87c7-4ff9-9a31-f8fa22d0f98d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:22:53.996150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f622a460-1a86-44d8-b12c-d2ac181063b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '.version_select at 0x7f05eacbf670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:22:54.016308 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f622a460-1a86-44d8-b12c-d2ac181063b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-189096060" status: 202 len: 0 microversion: 2.1 time: 0.026186 Jul 24 02:22:54.016931 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3612/7117] 10.222.0.27 () {58 vars in 1280 bytes} [Sun Jul 24 02:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-189096060 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:22:54.046619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c14098f4-5360-4b54-8af6-d4e461da3f21 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: .version_select at 0x7f05ea33b820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-499407194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg5Hvn7MMUGo3Ds/t8DgTjIKMstJvv8YsDVJ7x7/JZQcJJc0xoYiw3YvyKoj2X0fslNur04Q3brtmiVIg1m4qLD6Uc7WaYw0+j+2GV3pnkT+4Pn6nIR/kDFSzAaS8eWzw=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:54.061913 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c14098f4-5360-4b54-8af6-d4e461da3f21 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:22:54.069151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-c14098f4-5360-4b54-8af6-d4e461da3f21 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:22:54.093142 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c14098f4-5360-4b54-8af6-d4e461da3f21 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050365 Jul 24 02:22:54.093773 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3506/7118] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:22:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:22:59.525619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1747326320", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "71220a79-0e1d-4665-b2c1-fe40f25d480a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-499407194", "security_groups": [{"name": "tempest-secgroup-smoke-2074384374"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:22:59.672859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] validate_networks() for [('71220a79-0e1d-4665-b2c1-fe40f25d480a', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:23:00.136646 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:23:00.137077 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:23:00.138005 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:23:00.138423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:23:00.139022 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:23:00.149285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:00.149773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:00.150798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:00.151611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:00.169990 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:23:00.175505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:23:00.188262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:23:00.190705 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:23:00.240221 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-05bf5f4e-0eb8-40f0-ba2e-7ccd4dacaacf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719057 Jul 24 02:23:00.246090 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3613/7119] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:22:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:23:00.265940 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09331cb5-d69e-43a2-b271-7b1460e7e2d6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:00.266783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09331cb5-d69e-43a2-b271-7b1460e7e2d6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:00.332938 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09331cb5-d69e-43a2-b271-7b1460e7e2d6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:00.340863 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09331cb5-d69e-43a2-b271-7b1460e7e2d6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1266 microversion: 2.1 time: 0.092819 Jul 24 02:23:00.341450 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3507/7120] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:00 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:01.358624 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:01.359139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:01.368413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:01.369227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:01.370327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:01.370991 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:01.545723 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:01.554035 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-510a2452-aa04-45cc-8f83-3606f11c93e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1326 microversion: 2.1 time: 0.200562 Jul 24 02:23:01.554625 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3614/7121] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:01 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1326 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:02.571872 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:02.573090 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:02.575551 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:02.582621 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:02.583083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:02.584560 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:02.585203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:02.836339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:02.843992 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-18d16197-a46a-46bc-8472-6a1fd9771f0f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.276783 Jul 24 02:23:02.844960 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3508/7122] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:02 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:03.183699 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-a40ffdcb-6ff1-4f12-8a1f-1db48692560f req-c31409a1-9296-42a2-8297-bb28245fc800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66929a7-eb69-4a78-8293-1ff25c6ca68b", "tag": "c69bcc38-0786-4922-97a4-997b4361843b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:23:03.204633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a40ffdcb-6ff1-4f12-8a1f-1db48692560f req-c31409a1-9296-42a2-8297-bb28245fc800 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:03.205424 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-a40ffdcb-6ff1-4f12-8a1f-1db48692560f req-c31409a1-9296-42a2-8297-bb28245fc800 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:03.218524 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-a40ffdcb-6ff1-4f12-8a1f-1db48692560f req-c31409a1-9296-42a2-8297-bb28245fc800 service nova] Creating event network-changed:c69bcc38-0786-4922-97a4-997b4361843b for instance b66929a7-eb69-4a78-8293-1ff25c6ca68b on n-h2-master-1 Jul 24 02:23:03.223824 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-a40ffdcb-6ff1-4f12-8a1f-1db48692560f req-c31409a1-9296-42a2-8297-bb28245fc800 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061992 Jul 24 02:23:03.225613 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3615/7123] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:23:03.861104 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:03.861765 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:03.869536 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:03.870029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:03.870805 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:03.871260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:04.008196 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:04.015593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8e547151-211c-45f6-853f-872187cf9182 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.158454 Jul 24 02:23:04.016177 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3509/7124] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:03 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:05.033009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:05.033736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:05.042015 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:05.042473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:05.043249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:05.043688 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:05.181055 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:05.188867 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f280888a-05f7-46ce-8bf6-10fbb14a4f5f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.160135 Jul 24 02:23:05.189449 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3616/7125] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:05 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:06.207286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:06.207822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:06.214240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:06.214705 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:06.215495 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:06.215950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:06.351192 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:06.358611 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd9acdfc-6216-4d89-996c-6156daedf939 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.156833 Jul 24 02:23:06.359179 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3510/7126] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:06 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:07.376417 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:07.377004 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:07.384576 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:07.385041 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:07.385872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:07.386312 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:07.521008 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:07.528550 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0fe75428-b406-4430-a906-8883be977e99 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.156133 Jul 24 02:23:07.529149 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3617/7127] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:07 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:08.546093 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:08.546728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:08.549406 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:08.555319 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:08.555784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:08.556562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:08.557015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:08.688761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:08.697212 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9b5f5137-c0ee-4380-9b59-49c32c788e80 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.155061 Jul 24 02:23:08.697817 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3511/7128] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:08 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:09.354956 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fa591eba-77eb-4db0-9fa3-f01feb1e113e req-c613d070-9f8a-4769-83de-de2e5ff2fd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66929a7-eb69-4a78-8293-1ff25c6ca68b", "name": "network-vif-plugged", "status": "completed", "tag": "c69bcc38-0786-4922-97a4-997b4361843b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:23:09.360301 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:09.366962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fa591eba-77eb-4db0-9fa3-f01feb1e113e req-c613d070-9f8a-4769-83de-de2e5ff2fd42 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:09.367544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fa591eba-77eb-4db0-9fa3-f01feb1e113e req-c613d070-9f8a-4769-83de-de2e5ff2fd42 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:09.371833 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=65 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:09.380876 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fa591eba-77eb-4db0-9fa3-f01feb1e113e req-c613d070-9f8a-4769-83de-de2e5ff2fd42 service nova] Creating event network-vif-plugged:c69bcc38-0786-4922-97a4-997b4361843b for instance b66929a7-eb69-4a78-8293-1ff25c6ca68b on n-h2-master-1 Jul 24 02:23:09.386168 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fa591eba-77eb-4db0-9fa3-f01feb1e113e req-c613d070-9f8a-4769-83de-de2e5ff2fd42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035675 Jul 24 02:23:09.386785 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3618/7129] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:23:09.715015 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:09.715643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:09.722554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:09.723022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:09.723803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:09.724254 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:09.853987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:09.861279 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7675da01-23ca-43d4-908f-f96df4f7e78b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.150328 Jul 24 02:23:09.861878 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3512/7130] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:09 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:10.875405 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:10.876137 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:10.881477 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:10.883109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:10.890160 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:10.890620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:10.891406 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:10.891844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:11.389349 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:11.397056 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-daaaf356-3b14-4ea0-8084-170fd677d2d2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1392 microversion: 2.1 time: 0.522787 Jul 24 02:23:11.397637 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3619/7131] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:10 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1392 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:12.414158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:12.414813 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:12.417042 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:12.422785 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:12.423245 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:12.424044 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:12.424489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:12.558050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:12.565651 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-09b39828-2b96-4214-811e-dbfeec5a14a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1565 microversion: 2.1 time: 0.155499 Jul 24 02:23:12.566210 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3513/7132] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:12 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:12.582389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:12.583010 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:12.590073 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:12.590529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:12.591316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:12.591748 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:12.724273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:12.732368 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-db69a908-3142-4d0b-8b5f-034fa0559017 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1565 microversion: 2.1 time: 0.153851 Jul 24 02:23:12.732952 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3620/7133] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:12 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:14.316754 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:23:14.318041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:14.325509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:14.326025 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:14.326835 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:14.327300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:14.380395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7188d825-39e1-4a21-9c11-d199cb404f14 req-8deeb72a-fc43-4879-871b-bf4d2866007b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66929a7-eb69-4a78-8293-1ff25c6ca68b", "tag": "c69bcc38-0786-4922-97a4-997b4361843b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:23:14.389218 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7188d825-39e1-4a21-9c11-d199cb404f14 req-8deeb72a-fc43-4879-871b-bf4d2866007b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:14.389918 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7188d825-39e1-4a21-9c11-d199cb404f14 req-8deeb72a-fc43-4879-871b-bf4d2866007b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:14.402123 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7188d825-39e1-4a21-9c11-d199cb404f14 req-8deeb72a-fc43-4879-871b-bf4d2866007b service nova] Creating event network-changed:c69bcc38-0786-4922-97a4-997b4361843b for instance b66929a7-eb69-4a78-8293-1ff25c6ca68b on n-h2-master-1 Jul 24 02:23:14.407484 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7188d825-39e1-4a21-9c11-d199cb404f14 req-8deeb72a-fc43-4879-871b-bf4d2866007b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092257 Jul 24 02:23:14.408596 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3621/7134] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:23:14.495887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:23:14.504591 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5b0649cd-99e8-4748-9766-1e8ceceafe52 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1565 microversion: 2.1 time: 0.191896 Jul 24 02:23:14.505401 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3514/7135] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:23:14 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:23:47.827984 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=7 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:47.828736 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=15 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:47.832959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aef5fad8-ace6-47f2-95a6-dc537f7a2d1e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:23:47.834009 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aef5fad8-ace6-47f2-95a6-dc537f7a2d1e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:23:47.841926 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aef5fad8-ace6-47f2-95a6-dc537f7a2d1e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:47.842381 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aef5fad8-ace6-47f2-95a6-dc537f7a2d1e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:47.843156 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aef5fad8-ace6-47f2-95a6-dc537f7a2d1e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:23:47.843598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aef5fad8-ace6-47f2-95a6-dc537f7a2d1e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:23:47.905124 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aef5fad8-ace6-47f2-95a6-dc537f7a2d1e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b/action" status: 200 len: 24537 microversion: 2.1 time: 0.079203 Jul 24 02:23:47.905793 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3622/7136] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:23:47 2022] POST /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b/action => generated 24537 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:24:18.311378 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=7 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:24:18.312146 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=42 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:24:18.316658 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3e4436d-af9d-4e4d-ac42-8b025341cc5d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:24:18.317630 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3e4436d-af9d-4e4d-ac42-8b025341cc5d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:18.325310 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3e4436d-af9d-4e4d-ac42-8b025341cc5d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:18.325808 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3e4436d-af9d-4e4d-ac42-8b025341cc5d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:18.326601 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3e4436d-af9d-4e4d-ac42-8b025341cc5d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:18.327055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3e4436d-af9d-4e4d-ac42-8b025341cc5d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:18.402397 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3e4436d-af9d-4e4d-ac42-8b025341cc5d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b/action" status: 202 len: 0 microversion: 2.1 time: 0.092560 Jul 24 02:24:18.402989 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3515/7137] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:24:18 2022] POST /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:24:18.411838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:18.412555 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:18.415554 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:24:18.416353 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:24:18.423996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:18.424492 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:18.425278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:18.425751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:18.650740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:18.658267 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20e56d11-d58c-4705-9743-c117e97df321 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1676 microversion: 2.1 time: 0.250651 Jul 24 02:24:18.659345 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3623/7138] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:18 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:19.677761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:19.678840 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:19.685451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:19.685971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:19.686872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:19.687221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:20.231471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:20.239339 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3dd90269-d3fb-4ada-91de-e256ee78b99f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.566907 Jul 24 02:24:20.239917 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3516/7139] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:19 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:21.256594 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:21.257215 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:21.267879 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:21.268343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:21.269127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:21.269572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:21.399409 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:21.410855 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-731834ed-f7ff-4947-926e-c333496030d0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.157854 Jul 24 02:24:21.411968 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3624/7140] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:21 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:24:22.429210 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:22.429798 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:22.437286 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:22.437787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:22.438576 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:22.439027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:22.574485 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:22.582984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c65ac918-3433-492b-839f-27ad94a8d9a8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.157759 Jul 24 02:24:22.583553 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3517/7141] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:22 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:23.601247 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:23.601898 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:23.608731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:23.609183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:23.609977 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:23.610416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:23.743087 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:23.751641 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6bcfa8af-6b4e-44e7-b9c1-3a0c24a2d6b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.154346 Jul 24 02:24:23.752219 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3625/7142] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:23 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:24.769281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:24.769954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:24.776898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:24.777370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:24.778825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:24.779293 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:24.922925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:24.930354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a25566f-bea9-4ce5-880f-7ae1503580d4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.165048 Jul 24 02:24:24.930918 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3518/7143] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:24 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:25.946748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:25.947285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:25.954839 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:25.955295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:25.956065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:25.956504 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:26.100195 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:26.108291 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4783baeb-e7ad-4baa-a97d-28ae6f1d4bf9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.165582 Jul 24 02:24:26.108874 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3626/7144] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:25 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:27.125973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:27.126598 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:27.133456 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:27.133976 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:27.134758 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:27.135206 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:27.267968 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:27.275617 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f0dc8347-8e70-4b94-ba0d-716bb8a40077 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.153705 Jul 24 02:24:27.276191 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3519/7145] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:27 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:28.292487 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:28.293130 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:28.300916 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:28.301383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:28.302191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:28.302640 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:28.435418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:28.442948 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a98214a4-67e7-4e15-be82-cdbd37142bcf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.154514 Jul 24 02:24:28.443525 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3627/7146] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:28 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:29.460332 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:29.460968 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:29.468792 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:29.469255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:29.470078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:29.470532 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:29.600823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:29.608682 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1b9cd5cf-82f2-4096-baf7-4528cc857c60 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1681 microversion: 2.1 time: 0.152250 Jul 24 02:24:29.609250 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3520/7147] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:29 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:30.626256 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:24:30.626876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:24:30.633889 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:30.634343 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:30.635105 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:24:30.635547 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:24:30.771584 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:24:30.779298 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-39e87586-7f44-4f7e-99ac-466f2fc9539b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1684 microversion: 2.1 time: 0.156935 Jul 24 02:24:30.779858 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3628/7148] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:24:30 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:24:52.326585 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 24 02:24:52.327232 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:24:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:25:02.994487 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6f354974-1748-40fe-ac2a-b1694880da98 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:02.995438 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6f354974-1748-40fe-ac2a-b1694880da98 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:02.998822 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:02.999499 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:03.008763 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f354974-1748-40fe-ac2a-b1694880da98 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:03.009232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f354974-1748-40fe-ac2a-b1694880da98 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:03.010051 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f354974-1748-40fe-ac2a-b1694880da98 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:03.010511 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6f354974-1748-40fe-ac2a-b1694880da98 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:03.075462 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6f354974-1748-40fe-ac2a-b1694880da98 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b/action" status: 200 len: 68965 microversion: 2.1 time: 0.085150 Jul 24 02:25:03.076521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3521/7149] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:25:02 2022] POST /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b/action => generated 68965 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:25:26.945734 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:26.946231 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:26.948448 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:26.949345 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=36 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:26.950894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-791471a7-aca8-4eb0-8e07-32d76e5df678 req-481123bc-9232-4dfd-85a1-2546fb19aec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66929a7-eb69-4a78-8293-1ff25c6ca68b", "tag": "c69bcc38-0786-4922-97a4-997b4361843b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:26.955511 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:26.955967 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:26.956554 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:26.956980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:26.957552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:26.957702 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:26.965770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-791471a7-aca8-4eb0-8e07-32d76e5df678 req-481123bc-9232-4dfd-85a1-2546fb19aec9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:26.966241 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-791471a7-aca8-4eb0-8e07-32d76e5df678 req-481123bc-9232-4dfd-85a1-2546fb19aec9 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:26.978087 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-791471a7-aca8-4eb0-8e07-32d76e5df678 req-481123bc-9232-4dfd-85a1-2546fb19aec9 service nova] Creating event network-changed:c69bcc38-0786-4922-97a4-997b4361843b for instance b66929a7-eb69-4a78-8293-1ff25c6ca68b on n-h2-master-1 Jul 24 02:25:26.984057 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-791471a7-aca8-4eb0-8e07-32d76e5df678 req-481123bc-9232-4dfd-85a1-2546fb19aec9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038416 Jul 24 02:25:26.984843 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3522/7150] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:25:26.987539 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:25:27.080428 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-85c071fe-7f00-405e-aedb-77db78272d16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 204 len: 0 microversion: 2.1 time: 0.138037 Jul 24 02:25:27.081197 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3629/7151] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:25:26 2022] DELETE /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:25:27.091344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:27.092252 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:27.100039 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:27.100909 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:27.102070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:27.103138 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:27.304748 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:27.313441 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-985b3420-039d-4946-8383-e145de9b140c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1690 microversion: 2.1 time: 0.227482 Jul 24 02:25:27.314048 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3523/7152] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:27 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:28.335485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:28.336190 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:28.344192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:28.344648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:28.345417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:28.345900 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:28.541658 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:28.549298 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-97d05a34-3f30-44b9-a54d-2b0096aa72be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1690 microversion: 2.1 time: 0.218096 Jul 24 02:25:28.549915 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3630/7153] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:28 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:29.414125 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0faafffa-10f0-46ae-be79-19f94fa46ec2 req-981626e4-7c88-4c38-95e3-62a1aee13dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66929a7-eb69-4a78-8293-1ff25c6ca68b", "name": "network-vif-deleted", "tag": "c69bcc38-0786-4922-97a4-997b4361843b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:29.424366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0faafffa-10f0-46ae-be79-19f94fa46ec2 req-981626e4-7c88-4c38-95e3-62a1aee13dac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:29.424824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0faafffa-10f0-46ae-be79-19f94fa46ec2 req-981626e4-7c88-4c38-95e3-62a1aee13dac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:29.436010 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0faafffa-10f0-46ae-be79-19f94fa46ec2 req-981626e4-7c88-4c38-95e3-62a1aee13dac service nova] Creating event network-vif-deleted:c69bcc38-0786-4922-97a4-997b4361843b for instance b66929a7-eb69-4a78-8293-1ff25c6ca68b on n-h2-master-1 Jul 24 02:25:29.441592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0faafffa-10f0-46ae-be79-19f94fa46ec2 req-981626e4-7c88-4c38-95e3-62a1aee13dac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 Jul 24 02:25:29.442272 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3524/7154] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:25:29.566177 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:29.566724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:29.573875 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:29.575507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:29.576302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:29.576751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:29.608368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:29.608819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:29.609275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lazy-loading 'fault' on Instance uuid b66929a7-eb69-4a78-8293-1ff25c6ca68b {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:25:29.651062 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:29.659693 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4430d1c2-d8cf-45d6-b6cc-f246677b9586 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 200 len: 1356 microversion: 2.1 time: 0.097475 Jul 24 02:25:29.660269 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3631/7155] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:29 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:30.679320 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:30.680041 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: b66929a7-eb69-4a78-8293-1ff25c6ca68b] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:30.687507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:30.687979 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:30.688773 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:30.689227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:30.703419 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] HTTP exception thrown: Instance b66929a7-eb69-4a78-8293-1ff25c6ca68b could not be found. Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Request method failure captured: Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b HTTP/1.1 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Ky5XfbVkZL6Jgtdp0Oto6Gr3xwXrf1Bzc8iOBIF3BzzW-2SBqiNHwqJHvDxoFIJrLw9uJ9ilkJK4CZhyxoNryqy1lDA8KMdYvXtKR2hZjA0aSnyM9P4eqpgBEnina0XBcESEFTtlETDsib8WrHBRSF3YENs6MWf6AWZR_vxtDdFJX4 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577aa474166845ffbc0ddc0c23b5a6cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a8ddac1d257f460e9115ab3f02942692 Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: exception: Instance b66929a7-eb69-4a78-8293-1ff25c6ca68b could not be found. Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'b66929a7-eb69-4a78-8293-1ff25c6ca68b'} Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66929a7-eb69-4a78-8293-1ff25c6ca68b could not be found. Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66929a7-eb69-4a78-8293-1ff25c6ca68b could not be found. Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:25:30.705067 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66929a7-eb69-4a78-8293-1ff25c6ca68b could not be found. Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Returning 404 to user: Instance b66929a7-eb69-4a78-8293-1ff25c6ca68b could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-59b32572-59cb-4ca2-aa25-61867e4a95b5 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b" status: 404 len: 111 microversion: 2.1 time: 0.032314 Jul 24 02:25:30.709371 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3525/7156] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:30 2022] GET /compute/v2.1/servers/b66929a7-eb69-4a78-8293-1ff25c6ca68b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:25:33.682930 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9f6ca310-fe7c-4001-96a5-90083569ddd6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '.version_select at 0x7f05eacbf670>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:33.708156 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9f6ca310-fe7c-4001-96a5-90083569ddd6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-499407194" status: 202 len: 0 microversion: 2.1 time: 0.029314 Jul 24 02:25:33.708783 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3632/7157] 10.222.0.27 () {58 vars in 1280 bytes} [Sun Jul 24 02:25:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-499407194 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:25:33.737501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4d310c63-45ea-4a07-9a71-4ed646522dd2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: .version_select at 0x7f05ea2ff550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-87039892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0gvmSbmhJAurtXJI+nRQo3IlirGWv8YkCE5L9p81sHj4JVvnN8d4Ln3xwfe8NFM09kC/R8w5OayhlAr3yHywfwu1W22vJvs4u5tfrfsJMDnJCnbd47qIn8Q0QnAWT4Ig=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:33.753161 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4d310c63-45ea-4a07-9a71-4ed646522dd2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:25:33.758378 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-4d310c63-45ea-4a07-9a71-4ed646522dd2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:25:33.781886 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4d310c63-45ea-4a07-9a71-4ed646522dd2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048198 Jul 24 02:25:33.782516 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3526/7158] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:25:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:25:39.292343 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1707817876", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "fcba8856-c1bc-46d3-afaf-c85a7c810eef"}], "key_name": "tempest-TestNetworkAdvancedServerOps-87039892", "security_groups": [{"name": "tempest-secgroup-smoke-1380835029"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:39.414974 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] validate_networks() for [('fcba8856-c1bc-46d3-afaf-c85a7c810eef', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:25:39.656378 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:39.883298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:25:39.883747 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:25:39.884250 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:25:39.884651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:25:39.885107 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:25:39.896809 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:39.897581 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:39.898614 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:39.899286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:39.921749 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:25:39.928928 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:25:39.944842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:25:39.947396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:25:40.010353 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bbe901db-e51a-492e-aa85-fbbf71c3ffaf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721590 Jul 24 02:25:40.016879 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3633/7159] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:25:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:25:40.022816 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-31c74573-38b3-4521-87bd-ce6388e24531 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:40.024959 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-31c74573-38b3-4521-87bd-ce6388e24531 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:40.111789 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-31c74573-38b3-4521-87bd-ce6388e24531 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:40.125259 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-31c74573-38b3-4521-87bd-ce6388e24531 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1265 microversion: 2.1 time: 0.104876 Jul 24 02:25:40.133889 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3527/7160] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:40 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:41.141773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:41.142471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:41.156567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:41.157191 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:41.158271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:41.159099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:41.282751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:41.295344 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-369490b0-29fe-4c79-a47c-bbf22f5588b9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1325 microversion: 2.1 time: 0.159436 Jul 24 02:25:41.295966 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3634/7161] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:41 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:42.310637 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:42.315240 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:42.315881 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:42.323269 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:42.323740 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:42.324533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:42.325962 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:42.405340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:42.413491 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b3bdbea6-b0eb-48d8-9fbb-358546d4a2be tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1323 microversion: 2.1 time: 0.104123 Jul 24 02:25:42.414886 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3528/7162] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:42 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1323 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:43.217761 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3836032c-8e03-42aa-a4a5-680ba47fd9a0 req-78459523-0f81-4d8c-83e8-dd06f4ebf593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:43.228137 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3836032c-8e03-42aa-a4a5-680ba47fd9a0 req-78459523-0f81-4d8c-83e8-dd06f4ebf593 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:43.233251 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3836032c-8e03-42aa-a4a5-680ba47fd9a0 req-78459523-0f81-4d8c-83e8-dd06f4ebf593 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:43.248653 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3836032c-8e03-42aa-a4a5-680ba47fd9a0 req-78459523-0f81-4d8c-83e8-dd06f4ebf593 service nova] Creating event network-changed:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h2-master-1 Jul 24 02:25:43.253936 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3836032c-8e03-42aa-a4a5-680ba47fd9a0 req-78459523-0f81-4d8c-83e8-dd06f4ebf593 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Jul 24 02:25:43.254800 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3635/7163] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:25:43.431465 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:43.432093 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:43.439695 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:43.440134 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:43.440918 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:43.441368 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:43.658340 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:43.665772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-907901ad-92d4-4cab-91b2-9e901ba2dd56 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1391 microversion: 2.1 time: 0.238281 Jul 24 02:25:43.666348 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3529/7164] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:43 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:44.683499 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:44.684887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:44.692106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:44.692768 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:44.693562 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:44.694035 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:44.835243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:44.843256 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1798c592-6be2-4dc9-bca0-27c76710f362 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1391 microversion: 2.1 time: 0.164039 Jul 24 02:25:44.843835 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3636/7165] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:44 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:45.860262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:45.860890 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:45.868027 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:45.868489 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:45.869533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:45.870012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:46.110627 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:46.119678 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cf8a0cf9-8e6e-4e29-9848-b900b827040a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1391 microversion: 2.1 time: 0.262864 Jul 24 02:25:46.129500 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3530/7166] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:45 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:47.136994 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:47.138512 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:47.145597 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:47.146085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:47.146862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:47.147304 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:47.289088 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:47.297289 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-541ec86f-e9d6-4159-802f-2db477a4f9ab tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1391 microversion: 2.1 time: 0.164213 Jul 24 02:25:47.297895 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3637/7167] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:47 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:48.143704 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e306caf0-0c6d-43d7-9e3f-dc64ed669e24 req-d9d5fca2-b090-4e08-846a-27eedfdac2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "name": "network-vif-plugged", "status": "completed", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:48.153290 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e306caf0-0c6d-43d7-9e3f-dc64ed669e24 req-d9d5fca2-b090-4e08-846a-27eedfdac2b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:48.154064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e306caf0-0c6d-43d7-9e3f-dc64ed669e24 req-d9d5fca2-b090-4e08-846a-27eedfdac2b8 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:48.166319 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e306caf0-0c6d-43d7-9e3f-dc64ed669e24 req-d9d5fca2-b090-4e08-846a-27eedfdac2b8 service nova] Creating event network-vif-plugged:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h2-master-1 Jul 24 02:25:48.172119 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e306caf0-0c6d-43d7-9e3f-dc64ed669e24 req-d9d5fca2-b090-4e08-846a-27eedfdac2b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032053 Jul 24 02:25:48.172778 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3531/7168] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:25:48.313880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:48.314502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:48.321549 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:48.322042 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:48.322831 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:48.323279 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:48.455161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:48.462699 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-39f7c19a-7725-408b-befc-db4ee9355cf6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1391 microversion: 2.1 time: 0.152874 Jul 24 02:25:48.463316 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3638/7169] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:48 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:49.481834 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:49.482584 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:49.489933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:49.490786 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:49.492240 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:49.493064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:49.634489 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:49.642649 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af594d9f-d410-4a3c-8f91-2d3755603b3d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1391 microversion: 2.1 time: 0.166587 Jul 24 02:25:49.643239 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3532/7170] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:49 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:50.659998 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:50.660610 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:50.663446 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:50.664300 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:50.671200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:50.671712 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:50.672638 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:50.673173 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:50.808383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:50.816054 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-720ea399-b88c-4a60-91c1-3f6a0070b73a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1564 microversion: 2.1 time: 0.159980 Jul 24 02:25:50.816628 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3639/7171] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:50 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:50.832758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:50.833391 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:50.835487 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:50.842363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:50.842827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:50.843604 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:50.844050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:50.978838 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:50.986365 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e2621f14-4d6d-45e5-ae3c-dbd30fc9d1e1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1564 microversion: 2.1 time: 0.157389 Jul 24 02:25:50.986951 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3533/7172] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:50 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:25:52.581281 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:25:52.581948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:25:52.583269 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-8242141a-756c-43ac-8c3c-c502c2ed7e47 req-f150c2e3-783d-437f-8d92-3fab8883a0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:25:52.589020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:52.589482 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:52.590866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:52.591586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:52.594055 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8242141a-756c-43ac-8c3c-c502c2ed7e47 req-f150c2e3-783d-437f-8d92-3fab8883a0a5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:25:52.594793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-8242141a-756c-43ac-8c3c-c502c2ed7e47 req-f150c2e3-783d-437f-8d92-3fab8883a0a5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:25:52.606955 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-8242141a-756c-43ac-8c3c-c502c2ed7e47 req-f150c2e3-783d-437f-8d92-3fab8883a0a5 service nova] Creating event network-changed:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h2-master-1 Jul 24 02:25:52.612427 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-8242141a-756c-43ac-8c3c-c502c2ed7e47 req-f150c2e3-783d-437f-8d92-3fab8883a0a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033228 Jul 24 02:25:52.613364 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3534/7173] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:25:52.818965 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:25:52.826767 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d7f98a3-856d-444c-83a8-9a497822387e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1564 microversion: 2.1 time: 0.250137 Jul 24 02:25:52.827697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3640/7174] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:25:52 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1564 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:26:26.098863 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:26:26.099634 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=34 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:26:26.103894 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3caff00d-3917-4b59-b4e9-7c056cae3dae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:26:26.104915 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3caff00d-3917-4b59-b4e9-7c056cae3dae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:26:26.113016 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3caff00d-3917-4b59-b4e9-7c056cae3dae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:26:26.113492 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3caff00d-3917-4b59-b4e9-7c056cae3dae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:26:26.114316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3caff00d-3917-4b59-b4e9-7c056cae3dae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:26:26.114774 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3caff00d-3917-4b59-b4e9-7c056cae3dae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:26:26.178639 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3caff00d-3917-4b59-b4e9-7c056cae3dae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action" status: 200 len: 24563 microversion: 2.1 time: 0.081672 Jul 24 02:26:26.179267 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3535/7175] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:26:26 2022] POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action => generated 24563 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:27:05.205146 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:05.205929 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=40 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:05.257234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:05.258284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:05.265070 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:05.265523 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:05.266327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:05.266773 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:05.305944 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:05.312767 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119561) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 24 02:27:05.319056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:27:05.319482 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:27:05.319991 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:27:05.320407 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:27:05.320826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:27:05.383033 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6076d3b-ddab-44e2-9e6d-986f913fea50 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action" status: 202 len: 0 microversion: 2.1 time: 0.179919 Jul 24 02:27:05.383585 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3641/7176] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:27:05 2022] POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 24 02:27:05.393821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:05.394563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:05.397237 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:05.397865 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:05.404960 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:05.405430 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:05.406366 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:05.406849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:05.620162 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:05.627912 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-02ae8769-bd96-4e09-9cd4-c1bd13f5aad7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1692 microversion: 2.1 time: 0.239809 Jul 24 02:27:05.628491 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3536/7177] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:05 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1692 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:06.647284 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:06.647923 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:06.656320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:06.656780 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:06.657550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:06.658025 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:06.874936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:06.882701 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-9615fa8d-3d80-41fb-89f1-5ccc4fe9d934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1692 microversion: 2.1 time: 0.240383 Jul 24 02:27:06.883277 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3642/7178] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:06 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1692 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:07.900236 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:07.900873 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:07.912120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:07.912595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:07.913398 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:07.913894 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:08.048261 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:08.055862 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6327c290-f72f-4962-be5a-943cb617338b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.159623 Jul 24 02:27:08.056453 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3537/7179] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:07 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:09.074046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:09.074661 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:09.081663 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:09.082145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:09.082909 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:09.083347 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:09.219338 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:09.226957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4c6c1db4-fe52-4c4a-9f83-ab2392a5b8fd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.156915 Jul 24 02:27:09.227539 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3643/7180] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:09 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:10.244010 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:10.244635 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:10.251847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:10.252304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:10.253083 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:10.253527 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:10.391022 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:10.398468 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-db9e1535-cacf-4448-aa9c-4a008e9ca694 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.158360 Jul 24 02:27:10.399043 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3538/7181] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:10 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:11.415235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:11.415838 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:11.423389 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:11.423849 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:11.424631 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:11.425074 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:11.560285 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:11.568132 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8ef5600a-7356-4459-877e-21310d4204d9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.156874 Jul 24 02:27:11.568707 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3644/7182] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:11 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:12.586039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:12.586675 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:12.593710 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:12.594185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:12.594970 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:12.595428 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:12.728846 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:12.737089 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-432125d1-fc9f-4c95-a6d6-a5b6700ad417 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.155146 Jul 24 02:27:12.737692 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3539/7183] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:12 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:13.754674 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:13.755288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:13.762266 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:13.762722 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:13.763490 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:13.763924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:13.895845 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:13.903423 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cf51cf64-1d51-4b98-8512-b27732981a3b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.152644 Jul 24 02:27:13.904076 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3645/7184] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:13 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:14.920188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:14.920822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:14.927733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:14.928203 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:14.928985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:14.929437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:15.058238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:15.065795 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-629873cf-a8ee-40e7-ae3f-0d37bf0e8567 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.150087 Jul 24 02:27:15.066377 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3540/7185] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:14 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:16.082492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:16.083114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:16.090129 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:16.090585 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:16.092374 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:16.092915 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:16.229712 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:16.237288 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e144e561-e9cd-405a-8035-abae703ecf81 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.158736 Jul 24 02:27:16.237898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3646/7186] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:16 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:17.255262 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:17.255888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:17.263628 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:17.264111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:17.264888 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:17.265336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:17.399471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:17.406982 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ba5b2a7-c05b-4c75-a659-c2485857f8b2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.155596 Jul 24 02:27:17.407561 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3541/7187] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:17 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:18.424722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:18.425259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:18.432222 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:18.432682 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:18.433454 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:18.433924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:18.570164 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:18.578687 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-76118788-c229-4570-9975-9aedc46ee139 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1697 microversion: 2.1 time: 0.157897 Jul 24 02:27:18.579275 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3647/7188] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:18 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:27:19.597821 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:19.598388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:19.605387 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:19.605906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:19.607341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:19.607806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:19.744409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:19.753540 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-979c19ee-2655-44fa-a704-380282442873 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1696 microversion: 2.1 time: 0.159642 Jul 24 02:27:19.754169 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3542/7189] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:19 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:20.052945 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-7af1f658-a491-49c1-adc0-21eb07162c3c req-e9e67996-0bc3-4bf1-82e4-e028242eb652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "name": "network-vif-unplugged", "status": "completed", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:20.085032 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7af1f658-a491-49c1-adc0-21eb07162c3c req-e9e67996-0bc3-4bf1-82e4-e028242eb652 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:20.086580 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-7af1f658-a491-49c1-adc0-21eb07162c3c req-e9e67996-0bc3-4bf1-82e4-e028242eb652 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:20.107821 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-7af1f658-a491-49c1-adc0-21eb07162c3c req-e9e67996-0bc3-4bf1-82e4-e028242eb652 service nova] Creating event network-vif-unplugged:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h1-master-1 Jul 24 02:27:20.116854 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [req-7af1f658-a491-49c1-adc0-21eb07162c3c req-e9e67996-0bc3-4bf1-82e4-e028242eb652 service nova] Instance 19099252-4566-4f53-9bed-f566bb7d711a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119561) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:27:20.141649 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-7af1f658-a491-49c1-adc0-21eb07162c3c req-e9e67996-0bc3-4bf1-82e4-e028242eb652 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.192148 Jul 24 02:27:20.144242 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3648/7190] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:27:20.772482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:20.773281 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:20.782394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:20.782978 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:20.783878 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:20.784437 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:21.005978 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:21.014816 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4d251ba6-c3fb-4c6f-9614-676fee3f559e tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1696 microversion: 2.1 time: 0.246446 Jul 24 02:27:21.021251 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3543/7191] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:20 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1696 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:22.034203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:22.034954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:22.041315 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:22.041813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:22.042598 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:22.043043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:22.158137 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-4c98233b-e906-4767-90f9-4c1043ded0b1 req-63f5c192-84c3-4348-8a74-0b2a9e2a684f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:22.166969 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4c98233b-e906-4767-90f9-4c1043ded0b1 req-63f5c192-84c3-4348-8a74-0b2a9e2a684f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:22.167503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-4c98233b-e906-4767-90f9-4c1043ded0b1 req-63f5c192-84c3-4348-8a74-0b2a9e2a684f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:22.179129 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-4c98233b-e906-4767-90f9-4c1043ded0b1 req-63f5c192-84c3-4348-8a74-0b2a9e2a684f service nova] Creating event network-changed:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h1-master-1 Jul 24 02:27:22.180441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:22.184656 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [req-4c98233b-e906-4767-90f9-4c1043ded0b1 req-63f5c192-84c3-4348-8a74-0b2a9e2a684f service nova] Instance 19099252-4566-4f53-9bed-f566bb7d711a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 24 02:27:22.188360 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7e757ff5-8944-49ba-8f36-a61fd1287e31 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1694 microversion: 2.1 time: 0.160098 Jul 24 02:27:22.189128 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3649/7192] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:22 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:22.195487 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-4c98233b-e906-4767-90f9-4c1043ded0b1 req-63f5c192-84c3-4348-8a74-0b2a9e2a684f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041805 Jul 24 02:27:22.196076 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3544/7193] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:27:23.207686 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:23.208311 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:23.215348 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.216743 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.217543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.218017 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.360225 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:23.368203 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ffac48f2-a02f-4147-bc23-3525c5c7bbc1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1691 microversion: 2.1 time: 0.164418 Jul 24 02:27:23.368788 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3650/7194] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:23 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:23.386504 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cd222428-3913-4e1b-9a95-0fa15ac872ca tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:23.387135 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cd222428-3913-4e1b-9a95-0fa15ac872ca tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:23.394165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd222428-3913-4e1b-9a95-0fa15ac872ca tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.394627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd222428-3913-4e1b-9a95-0fa15ac872ca tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.395414 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd222428-3913-4e1b-9a95-0fa15ac872ca tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.395859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cd222428-3913-4e1b-9a95-0fa15ac872ca tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.455124 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cd222428-3913-4e1b-9a95-0fa15ac872ca tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action" status: 204 len: 0 microversion: 2.1 time: 0.073626 Jul 24 02:27:23.455842 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3545/7195] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:27:23 2022] POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:27:23.464127 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:23.464785 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:23.471995 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.472442 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.473317 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.474066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.701220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:23.708900 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-fced93a3-b007-42fd-9772-4df5803a2fa8 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1691 microversion: 2.1 time: 0.248797 Jul 24 02:27:23.709490 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3651/7196] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:23 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:23.726424 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:23.727148 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:23.733533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.734028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.734814 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:23.735265 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:23.872664 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:23.880384 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8d806305-b3f0-43bc-9037-4199a9f2fd2a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1691 microversion: 2.1 time: 0.158135 Jul 24 02:27:23.880968 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3546/7197] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:23 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:24.897909 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:24.898568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:24.906043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:24.906505 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:24.907285 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:24.907732 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:25.058698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:25.066499 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2db2e393-cded-4043-a4a6-fe4b81585e75 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1683 microversion: 2.1 time: 0.172461 Jul 24 02:27:25.067084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3652/7198] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:24 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:25.177001 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-70d30ec7-9635-4a33-b838-fbd3b150f83c req-7934ed1f-7c02-4a47-b869-67e8f7e9ae36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "name": "network-vif-plugged", "status": "completed", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:25.185248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-70d30ec7-9635-4a33-b838-fbd3b150f83c req-7934ed1f-7c02-4a47-b869-67e8f7e9ae36 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:25.185708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-70d30ec7-9635-4a33-b838-fbd3b150f83c req-7934ed1f-7c02-4a47-b869-67e8f7e9ae36 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:25.197174 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-70d30ec7-9635-4a33-b838-fbd3b150f83c req-7934ed1f-7c02-4a47-b869-67e8f7e9ae36 service nova] Creating event network-vif-plugged:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h1-master-1 Jul 24 02:27:25.203199 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-70d30ec7-9635-4a33-b838-fbd3b150f83c req-7934ed1f-7c02-4a47-b869-67e8f7e9ae36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088237 Jul 24 02:27:25.203810 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3547/7199] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:27:47.254741 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5e683839-6319-4d85-9311-59fd108ecff7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:47.255704 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5e683839-6319-4d85-9311-59fd108ecff7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:47.257869 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=28 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:47.258538 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:47.264610 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e683839-6319-4d85-9311-59fd108ecff7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:47.265065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e683839-6319-4d85-9311-59fd108ecff7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:47.265944 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e683839-6319-4d85-9311-59fd108ecff7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:47.266388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5e683839-6319-4d85-9311-59fd108ecff7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:47.321785 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5e683839-6319-4d85-9311-59fd108ecff7 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action" status: 200 len: 24572 microversion: 2.1 time: 0.071004 Jul 24 02:27:47.322366 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3653/7200] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:27:47 2022] POST /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a/action => generated 24572 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:27:54.628892 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8d1fc7ad-27dc-48ec-b432-eefbf1df5f8e req-5f5cd8d2-20fe-486a-8e6a-ada2f1238ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:54.632122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:54.632739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:54.641372 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=24 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:54.642391 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:54.642531 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8d1fc7ad-27dc-48ec-b432-eefbf1df5f8e req-5f5cd8d2-20fe-486a-8e6a-ada2f1238ed0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:54.642979 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8d1fc7ad-27dc-48ec-b432-eefbf1df5f8e req-5f5cd8d2-20fe-486a-8e6a-ada2f1238ed0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:54.646476 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:54.646943 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:54.647724 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:54.648923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:54.656616 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8d1fc7ad-27dc-48ec-b432-eefbf1df5f8e req-5f5cd8d2-20fe-486a-8e6a-ada2f1238ed0 service nova] Creating event network-changed:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h1-master-1 Jul 24 02:27:54.661803 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8d1fc7ad-27dc-48ec-b432-eefbf1df5f8e req-5f5cd8d2-20fe-486a-8e6a-ada2f1238ed0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037080 Jul 24 02:27:54.662624 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3654/7201] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:27:54.677384 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:27:54.761260 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7ee7fcd4-e0c7-429e-8e70-2686d063e2f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 204 len: 0 microversion: 2.1 time: 0.140144 Jul 24 02:27:54.762619 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3548/7202] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:27:54 2022] DELETE /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:27:54.772139 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:54.772856 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:54.779927 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:54.780388 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:54.781172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:54.781615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:54.928116 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:54.936470 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a9e12d57-6175-463a-ab4e-7a7f8e5d3a16 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1689 microversion: 2.1 time: 0.169030 Jul 24 02:27:54.937052 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3655/7203] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:54 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:27:55.956127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:55.956854 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:55.963843 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:55.964314 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:55.965110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:55.965567 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:56.201407 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:27:56.209734 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9dbe2932-bf50-4436-8b5e-8ce7a7f2f147 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 200 len: 1689 microversion: 2.1 time: 0.257862 Jul 24 02:27:56.219501 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3549/7204] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:55 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:27:56.680789 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-dd3ae83a-9bfd-4842-b1cf-e67c4d5cedb9 req-bfaedcd1-c750-49d7-919f-d967af8aa3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19099252-4566-4f53-9bed-f566bb7d711a", "name": "network-vif-deleted", "tag": "c5703838-090d-4d71-ba18-a3de21f155b2"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:27:56.690842 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dd3ae83a-9bfd-4842-b1cf-e67c4d5cedb9 req-bfaedcd1-c750-49d7-919f-d967af8aa3de service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:56.691292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dd3ae83a-9bfd-4842-b1cf-e67c4d5cedb9 req-bfaedcd1-c750-49d7-919f-d967af8aa3de service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:56.703094 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-dd3ae83a-9bfd-4842-b1cf-e67c4d5cedb9 req-bfaedcd1-c750-49d7-919f-d967af8aa3de service nova] Creating event network-vif-deleted:c5703838-090d-4d71-ba18-a3de21f155b2 for instance 19099252-4566-4f53-9bed-f566bb7d711a on n-h1-master-1 Jul 24 02:27:56.707799 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-dd3ae83a-9bfd-4842-b1cf-e67c4d5cedb9 req-bfaedcd1-c750-49d7-919f-d967af8aa3de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034541 Jul 24 02:27:56.708394 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3656/7205] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:27:57.226127 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:27:57.226760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 19099252-4566-4f53-9bed-f566bb7d711a] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:27:57.234226 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:57.234694 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:57.235473 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:27:57.235923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:27:57.249908 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] HTTP exception thrown: Instance 19099252-4566-4f53-9bed-f566bb7d711a could not be found. Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Request method failure captured: Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a HTTP/1.1 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Ky5XfbVkZL6Jgtdp0Oto6Gr3xwXrf1Bzc8iOBIF3BzzW-2SBqiNHwqJHvDxoFIJrLw9uJ9ilkJK4CZhyxoNryqy1lDA8KMdYvXtKR2hZjA0aSnyM9P4eqpgBEnina0XBcESEFTtlETDsib8WrHBRSF3YENs6MWf6AWZR_vxtDdFJX4 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577aa474166845ffbc0ddc0c23b5a6cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a8ddac1d257f460e9115ab3f02942692 Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 19099252-4566-4f53-9bed-f566bb7d711a could not be found. Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '19099252-4566-4f53-9bed-f566bb7d711a'} Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19099252-4566-4f53-9bed-f566bb7d711a could not be found. Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19099252-4566-4f53-9bed-f566bb7d711a could not be found. Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:27:57.251536 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19099252-4566-4f53-9bed-f566bb7d711a could not be found. Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Returning 404 to user: Instance 19099252-4566-4f53-9bed-f566bb7d711a could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-92ea0644-163d-4cd9-9592-6479d893a9b3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a" status: 404 len: 111 microversion: 2.1 time: 0.030680 Jul 24 02:27:57.256169 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3550/7206] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:27:57 2022] GET /compute/v2.1/servers/19099252-4566-4f53-9bed-f566bb7d711a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:28:00.633645 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ccace11e-bd85-437a-b14f-374093b8ad1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '.version_select at 0x7f05eac165e0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:00.660435 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ccace11e-bd85-437a-b14f-374093b8ad1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-87039892" status: 202 len: 0 microversion: 2.1 time: 0.031870 Jul 24 02:28:00.661280 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3657/7207] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 02:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-87039892 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:28:00.688259 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-637fcecf-3ce1-4311-a9f0-d9db764b6d87 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: .version_select at 0x7f05e872d8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-74334525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiqR9pBtbECJhADXZc/ryunijq6rr00eK3Dkg+f38+p91o/SbaOJfLLUrQhgGS5Rq7A7vF5QYRUWGcICdgqeGqLbJBWchr6xJTn+d29F9APpggZ4nD3Bm/mr8hpa6Vg1g=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:28:00.704750 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-637fcecf-3ce1-4311-a9f0-d9db764b6d87 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:28:00.710887 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-637fcecf-3ce1-4311-a9f0-d9db764b6d87 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:28:00.738474 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-637fcecf-3ce1-4311-a9f0-d9db764b6d87 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055406 Jul 24 02:28:00.739077 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3551/7208] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:28:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:28:06.396755 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-657683178", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "e340e50f-cb27-44a4-8526-29094c9bd66f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-74334525", "security_groups": [{"name": "tempest-secgroup-smoke-1290966536"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:28:06.520253 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] validate_networks() for [('e340e50f-cb27-44a4-8526-29094c9bd66f', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:28:06.696401 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:06.915815 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:28:06.916245 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:28:06.916725 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:28:06.917140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:28:06.917552 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:28:06.933641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:06.934123 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:06.935834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:06.936287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:06.954027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:28:06.963240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:28:06.976441 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:28:06.978941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:28:07.026274 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb5a9035-da61-4810-85c1-61d4e5ffa84d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.634294 Jul 24 02:28:07.032564 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3658/7209] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:28:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:28:07.040068 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2412bafb-211a-4f19-8a19-5f1914137d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:07.040954 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2412bafb-211a-4f19-8a19-5f1914137d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:07.105728 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2412bafb-211a-4f19-8a19-5f1914137d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:07.114101 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2412bafb-211a-4f19-8a19-5f1914137d93 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1264 microversion: 2.1 time: 0.080151 Jul 24 02:28:07.114929 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3552/7210] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:07 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1264 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:08.133261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:08.134002 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:08.141920 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:08.142322 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:08.143045 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:08.143524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:08.222114 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:08.230071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b9972e7b-d52b-4632-beeb-13c30db2d314 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1268 microversion: 2.1 time: 0.101487 Jul 24 02:28:08.230654 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3659/7211] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:08 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1268 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:09.248913 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:09.249633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:09.252609 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:09.258816 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:09.259292 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:09.260089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:09.260541 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:09.334103 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:09.342003 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0a42c31f-6d9c-4604-a4e8-ea1dc1a1f59a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1322 microversion: 2.1 time: 0.098292 Jul 24 02:28:09.342585 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3553/7212] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:09 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:10.362996 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:10.363633 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:10.371236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:10.372478 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:10.373378 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:10.373854 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:10.572701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:10.584252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1efa2bf3-a7ab-4318-b21a-fcb769b8e0a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1390 microversion: 2.1 time: 0.228723 Jul 24 02:28:10.584840 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3660/7213] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:10 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:10.657721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-aed52877-6266-4d90-9c57-893ec78f8362 req-abcf0f6d-b5fc-459b-b1f8-605923ef2b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b504d9c-7d65-4132-bdcd-f5450e7423da", "tag": "dc94bcb8-3e4c-4d14-81c7-d329a2383bc5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:28:10.673503 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aed52877-6266-4d90-9c57-893ec78f8362 req-abcf0f6d-b5fc-459b-b1f8-605923ef2b36 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:10.674101 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-aed52877-6266-4d90-9c57-893ec78f8362 req-abcf0f6d-b5fc-459b-b1f8-605923ef2b36 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:10.686265 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-aed52877-6266-4d90-9c57-893ec78f8362 req-abcf0f6d-b5fc-459b-b1f8-605923ef2b36 service nova] Creating event network-changed:dc94bcb8-3e4c-4d14-81c7-d329a2383bc5 for instance 9b504d9c-7d65-4132-bdcd-f5450e7423da on n-h2-master-1 Jul 24 02:28:10.691726 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-aed52877-6266-4d90-9c57-893ec78f8362 req-abcf0f6d-b5fc-459b-b1f8-605923ef2b36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039258 Jul 24 02:28:10.692334 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3554/7214] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:28:11.604056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:11.604671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:11.611955 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:11.612408 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:11.613175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:11.613611 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:11.750031 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:11.757619 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-90393f76-519c-4ec5-a977-8d23a6a3b74f tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1390 microversion: 2.1 time: 0.157457 Jul 24 02:28:11.758200 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3661/7215] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:11 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:12.334432 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:28:12.334988 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:28:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:28:12.777441 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:12.778676 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:12.785022 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:12.785490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:12.786305 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:12.786764 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:12.915849 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:12.924326 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-996fe18c-6bec-4994-b1f0-ab6b8e8c0c7b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1390 microversion: 2.1 time: 0.152131 Jul 24 02:28:12.924891 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3555/7216] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:12 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:13.941651 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:13.942219 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:13.949064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:13.949518 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:13.950887 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:13.951319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:14.088243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:14.095909 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3edca593-dd4e-4aa8-b805-a8558848fa38 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1390 microversion: 2.1 time: 0.158373 Jul 24 02:28:14.096484 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3662/7217] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:13 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:15.113812 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:15.114331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:15.121139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:15.121973 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:15.122848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:15.123370 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:15.258187 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:15.266396 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e5e50ea6-e5d6-4e2b-93c3-49d854db5e91 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1390 microversion: 2.1 time: 0.157192 Jul 24 02:28:15.266969 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3556/7218] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:15 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:16.283362 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:16.283981 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:16.290882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:16.291337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:16.292100 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:16.292572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:16.425057 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:16.432457 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ff48426e-15c6-4077-8a86-42550d8734ae tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1390 microversion: 2.1 time: 0.153062 Jul 24 02:28:16.433030 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3663/7219] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:16 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:16.934934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-5e05b5bd-873c-482e-9014-d237abebe62f req-c5016f4d-54dc-45ec-88ee-c168c4c4b5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b504d9c-7d65-4132-bdcd-f5450e7423da", "name": "network-vif-plugged", "status": "completed", "tag": "dc94bcb8-3e4c-4d14-81c7-d329a2383bc5"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:28:16.944890 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5e05b5bd-873c-482e-9014-d237abebe62f req-c5016f4d-54dc-45ec-88ee-c168c4c4b5ac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:16.945351 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-5e05b5bd-873c-482e-9014-d237abebe62f req-c5016f4d-54dc-45ec-88ee-c168c4c4b5ac service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:16.957243 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-5e05b5bd-873c-482e-9014-d237abebe62f req-c5016f4d-54dc-45ec-88ee-c168c4c4b5ac service nova] Creating event network-vif-plugged:dc94bcb8-3e4c-4d14-81c7-d329a2383bc5 for instance 9b504d9c-7d65-4132-bdcd-f5450e7423da on n-h2-master-1 Jul 24 02:28:16.962593 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-5e05b5bd-873c-482e-9014-d237abebe62f req-c5016f4d-54dc-45ec-88ee-c168c4c4b5ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031328 Jul 24 02:28:16.963287 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3557/7220] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:28:17.449503 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:17.450141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:17.452616 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:17.453342 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:17.454908 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:17.461372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:17.461852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:17.462624 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:17.463128 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:17.596673 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:17.604254 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3cb68b16-5ab9-4049-b0c4-3d9f4c51c5cf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1390 microversion: 2.1 time: 0.158753 Jul 24 02:28:17.604848 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3664/7221] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:17 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:18.619154 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:18.624548 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:18.625331 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:18.631986 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:18.632477 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:18.633248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:18.633730 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:18.773032 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:18.781521 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3ee56861-478f-49a0-bd82-0fa77dc97fe4 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1561 microversion: 2.1 time: 0.163405 Jul 24 02:28:18.782142 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3558/7222] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:18 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:18.797569 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:18.798223 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:18.805183 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:18.805644 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:18.806455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:18.806905 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:18.935948 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:18.943523 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ca88277a-826b-4c7e-83d1-f982fbb037f2 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1561 microversion: 2.1 time: 0.149835 Jul 24 02:28:18.944104 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3665/7223] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:18 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:20.548325 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:28:20.549095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:20.549619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-90058214-fef7-4941-9321-a6e77773cc50 req-ded25d74-e3bb-4b58-a9d8-8007203d8332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b504d9c-7d65-4132-bdcd-f5450e7423da", "tag": "dc94bcb8-3e4c-4d14-81c7-d329a2383bc5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:28:20.557612 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:20.558202 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:20.559022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-90058214-fef7-4941-9321-a6e77773cc50 req-ded25d74-e3bb-4b58-a9d8-8007203d8332 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:20.559129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:20.559483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-90058214-fef7-4941-9321-a6e77773cc50 req-ded25d74-e3bb-4b58-a9d8-8007203d8332 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:20.559713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:20.573315 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-90058214-fef7-4941-9321-a6e77773cc50 req-ded25d74-e3bb-4b58-a9d8-8007203d8332 service nova] Creating event network-changed:dc94bcb8-3e4c-4d14-81c7-d329a2383bc5 for instance 9b504d9c-7d65-4132-bdcd-f5450e7423da on n-h2-master-1 Jul 24 02:28:20.580053 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-90058214-fef7-4941-9321-a6e77773cc50 req-ded25d74-e3bb-4b58-a9d8-8007203d8332 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 Jul 24 02:28:20.581914 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3666/7224] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:28:20.823924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:28:20.833558 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c41437e-46c8-4124-9852-d11233dbe1b0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1561 microversion: 2.1 time: 0.292323 Jul 24 02:28:20.834747 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3559/7225] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:28:20 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1561 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:28:54.137138 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=5 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:54.137910 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=46 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:54.142823 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-da03a40f-eecf-4db5-be6c-0e1e30ee3fa0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:28:54.143858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-da03a40f-eecf-4db5-be6c-0e1e30ee3fa0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:28:54.151953 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da03a40f-eecf-4db5-be6c-0e1e30ee3fa0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:54.152405 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da03a40f-eecf-4db5-be6c-0e1e30ee3fa0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:54.153175 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da03a40f-eecf-4db5-be6c-0e1e30ee3fa0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:28:54.153615 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-da03a40f-eecf-4db5-be6c-0e1e30ee3fa0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:28:54.214575 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-da03a40f-eecf-4db5-be6c-0e1e30ee3fa0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action" status: 200 len: 24566 microversion: 2.1 time: 0.079290 Jul 24 02:28:54.215257 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3667/7226] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:28:54 2022] POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action => generated 24566 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:29:33.177500 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-780a4112-1644-4b3a-b3ac-81b7c64c3ad3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:29:33.180042 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:29:33.180826 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=34 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:29:33.189317 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-780a4112-1644-4b3a-b3ac-81b7c64c3ad3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:33.189817 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-780a4112-1644-4b3a-b3ac-81b7c64c3ad3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:33.214420 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-780a4112-1644-4b3a-b3ac-81b7c64c3ad3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Going to try to stop instance {{(pid=119562) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 24 02:29:33.259913 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-780a4112-1644-4b3a-b3ac-81b7c64c3ad3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action" status: 202 len: 0 microversion: 2.1 time: 0.086710 Jul 24 02:29:33.260863 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3560/7227] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:29:33 2022] POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:29:33.272588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:33.273341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:33.276107 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:29:33.276780 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:29:33.282866 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:33.283332 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:33.284143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:33.284586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:33.432449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:33.440225 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-02d9fdf3-48f2-4184-a1df-4ab8d2ca4d63 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.172100 Jul 24 02:29:33.440808 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3668/7228] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:33 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:34.458674 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:34.459388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:34.467609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:34.468087 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:34.468934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:34.469392 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:34.604206 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:34.612016 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7a8af99b-fada-4d6f-bde8-e395a72d6f97 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.157600 Jul 24 02:29:34.612593 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3561/7229] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:34 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:35.629729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:35.630352 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:35.637257 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:35.637739 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:35.638509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:35.638989 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:35.770735 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:35.778241 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-96963005-138a-440d-9f83-9b54ac144f0a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.152620 Jul 24 02:29:35.778801 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3669/7230] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:35 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:36.795214 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:36.796005 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:36.803015 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:36.803490 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:36.804284 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:36.804770 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:36.940776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:36.948311 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-603d2d70-93ce-4415-b73c-d8acf7ec655b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.156978 Jul 24 02:29:36.948908 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3562/7231] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:36 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:37.966012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:37.966625 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:37.974708 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:37.975164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:37.975962 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:37.976400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:38.106418 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:38.114392 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8aface6c-282c-499a-b8ef-724ddc3286bd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.152331 Jul 24 02:29:38.114975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3670/7232] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:37 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:39.132349 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:39.132975 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:39.140550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:39.141011 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:39.141821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:39.142271 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:39.273470 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:39.281934 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9a124504-5e30-4d94-a41f-88adf2ea1c74 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.153437 Jul 24 02:29:39.282508 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3563/7233] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:39 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:40.300765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:40.301383 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:40.308099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:40.308555 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:40.309358 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:40.309843 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:40.447067 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:40.454957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5bff12fa-8ae0-426a-ad34-c8f1de7bfd43 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.159757 Jul 24 02:29:40.455556 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3671/7234] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:40 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:41.472297 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:41.472837 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:41.479192 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:41.479655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:41.480429 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:41.480880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:41.613660 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:41.621210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ba5a1627-d80a-4051-a5db-df56177e94ff tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.152872 Jul 24 02:29:41.621798 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3564/7235] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:41 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:42.639502 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:42.640125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:42.647022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:42.647483 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:42.648252 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:42.648698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:42.784249 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:42.792094 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-588cd005-bf01-4b17-b5c8-8311c6917705 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1689 microversion: 2.1 time: 0.156665 Jul 24 02:29:42.792691 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3672/7236] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:42 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:43.810344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:43.811134 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:43.818345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:43.818855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:43.819704 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:43.820161 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:43.950151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:43.958190 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b679be7f-57fe-4ac4-a7ae-6d89dac8505c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1666 microversion: 2.1 time: 0.151666 Jul 24 02:29:43.958749 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3565/7237] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:43 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:45.048642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-351643b0-f095-485a-b218-479d09328aa1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:29:45.049580 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-351643b0-f095-485a-b218-479d09328aa1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:45.056601 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351643b0-f095-485a-b218-479d09328aa1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:45.057053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351643b0-f095-485a-b218-479d09328aa1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:45.057864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351643b0-f095-485a-b218-479d09328aa1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:45.058302 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-351643b0-f095-485a-b218-479d09328aa1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:45.114128 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-351643b0-f095-485a-b218-479d09328aa1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action" status: 200 len: 38366 microversion: 2.1 time: 0.069314 Jul 24 02:29:45.114818 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3673/7238] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:29:45 2022] POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action => generated 38366 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:29:45.126960 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d0f57d0-34d6-47c3-9ee8-0dfc5f551b09 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:29:45.134000 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d0f57d0-34d6-47c3-9ee8-0dfc5f551b09 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:45.134462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d0f57d0-34d6-47c3-9ee8-0dfc5f551b09 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:45.157564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d0f57d0-34d6-47c3-9ee8-0dfc5f551b09 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Going to try to start instance {{(pid=119562) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 24 02:29:45.199128 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d0f57d0-34d6-47c3-9ee8-0dfc5f551b09 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action" status: 202 len: 0 microversion: 2.1 time: 0.076821 Jul 24 02:29:45.199729 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3566/7239] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:29:45 2022] POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:29:45.209706 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:45.210421 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:45.217725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:45.218178 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:45.218961 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:45.219400 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:45.416701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:45.425099 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f345995c-4a35-4c70-8b8e-80b6bb1a7baf tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1675 microversion: 2.1 time: 0.220354 Jul 24 02:29:45.425680 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3674/7240] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:45 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:29:46.444413 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:29:46.445131 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:29:46.451394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:46.452162 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:46.452951 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:29:46.453424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:29:46.588075 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:29:46.596418 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-47f77ffd-a76a-46e2-8ed6-6afe40394872 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1679 microversion: 2.1 time: 0.157135 Jul 24 02:29:46.596989 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3567/7241] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:29:46 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:30:18.820170 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a0a8d39e-5b8f-4b09-9c30-a6a0fa506825 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:30:18.821115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a0a8d39e-5b8f-4b09-9c30-a6a0fa506825 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:18.823720 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=14 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:18.824386 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=40 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:18.832044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39e-5b8f-4b09-9c30-a6a0fa506825 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:18.832502 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39e-5b8f-4b09-9c30-a6a0fa506825 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:18.833287 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39e-5b8f-4b09-9c30-a6a0fa506825 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:18.833755 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39e-5b8f-4b09-9c30-a6a0fa506825 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:18.897117 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a0a8d39e-5b8f-4b09-9c30-a6a0fa506825 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action" status: 200 len: 62923 microversion: 2.1 time: 0.080939 Jul 24 02:30:18.897811 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3675/7242] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:30:18 2022] POST /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da/action => generated 62923 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:30:42.445771 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:42.446307 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:42.448232 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-4fd46ae2-1256-4b82-ba71-5f062d2d0de0 req-8e088fc6-fc27-4028-b110-357572b6a413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b504d9c-7d65-4132-bdcd-f5450e7423da", "tag": "dc94bcb8-3e4c-4d14-81c7-d329a2383bc5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:30:42.450112 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=16 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:42.450935 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:42.456450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:42.456916 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:42.457594 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:42.457793 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:42.458461 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=4 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:42.458664 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:42.461728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4fd46ae2-1256-4b82-ba71-5f062d2d0de0 req-8e088fc6-fc27-4028-b110-357572b6a413 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:42.462206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-4fd46ae2-1256-4b82-ba71-5f062d2d0de0 req-8e088fc6-fc27-4028-b110-357572b6a413 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:42.476833 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-4fd46ae2-1256-4b82-ba71-5f062d2d0de0 req-8e088fc6-fc27-4028-b110-357572b6a413 service nova] Creating event network-changed:dc94bcb8-3e4c-4d14-81c7-d329a2383bc5 for instance 9b504d9c-7d65-4132-bdcd-f5450e7423da on n-h2-master-1 Jul 24 02:30:42.482316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-4fd46ae2-1256-4b82-ba71-5f062d2d0de0 req-8e088fc6-fc27-4028-b110-357572b6a413 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037823 Jul 24 02:30:42.483598 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3676/7243] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:30:42.488904 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:30:42.572918 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c559ca73-3e58-4c87-98bc-6dc03f0b8f12 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 204 len: 0 microversion: 2.1 time: 0.130984 Jul 24 02:30:42.574228 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3568/7244] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:30:42 2022] DELETE /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:30:42.583222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:42.583939 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:42.592108 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:42.593237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:42.593945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:42.594393 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:42.732459 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:30:42.740892 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-091d58fb-4a1b-474a-a6b2-7e07700fbf49 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1685 microversion: 2.1 time: 0.161917 Jul 24 02:30:42.741609 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3677/7245] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:42 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:30:43.760053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:43.760768 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:43.768965 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:43.769424 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:43.770230 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:43.770679 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:44.004898 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:30:44.012391 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6969e2fe-3f25-4eaf-8e96-710abd2178ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1685 microversion: 2.1 time: 0.256576 Jul 24 02:30:44.012955 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3569/7246] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:43 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1685 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:30:44.790344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6b1e7dee-5a84-496f-ba40-840c7368ed1b req-54d44233-83fb-4242-b304-8e6251817c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b504d9c-7d65-4132-bdcd-f5450e7423da", "name": "network-vif-deleted", "tag": "dc94bcb8-3e4c-4d14-81c7-d329a2383bc5"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:30:44.800363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6b1e7dee-5a84-496f-ba40-840c7368ed1b req-54d44233-83fb-4242-b304-8e6251817c3e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:44.800821 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6b1e7dee-5a84-496f-ba40-840c7368ed1b req-54d44233-83fb-4242-b304-8e6251817c3e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:44.815953 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6b1e7dee-5a84-496f-ba40-840c7368ed1b req-54d44233-83fb-4242-b304-8e6251817c3e service nova] Creating event network-vif-deleted:dc94bcb8-3e4c-4d14-81c7-d329a2383bc5 for instance 9b504d9c-7d65-4132-bdcd-f5450e7423da on n-h2-master-1 Jul 24 02:30:44.821888 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6b1e7dee-5a84-496f-ba40-840c7368ed1b req-54d44233-83fb-4242-b304-8e6251817c3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035202 Jul 24 02:30:44.822499 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3678/7247] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:30:45.030888 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:45.031702 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:45.038598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:45.039064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:45.039838 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:45.040285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:45.075711 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:45.076165 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:45.076633 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lazy-loading 'fault' on Instance uuid 9b504d9c-7d65-4132-bdcd-f5450e7423da {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:30:45.121626 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:30:45.131075 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ff271758-5cb9-468e-b40a-1ca8c778babd tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 200 len: 1354 microversion: 2.1 time: 0.104664 Jul 24 02:30:45.131975 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3570/7248] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:45 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 1354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:30:46.150014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:46.150724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9b504d9c-7d65-4132-bdcd-f5450e7423da] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:46.157192 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:46.157654 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:46.158445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:46.158891 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:46.172762 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.wsgi [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] HTTP exception thrown: Instance 9b504d9c-7d65-4132-bdcd-f5450e7423da could not be found. Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Request method failure captured: Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: request: GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da HTTP/1.1 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: Accept: application/json Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: Accept-Encoding: identity Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: Connection: close Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: Content-Length: 0 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: Content-Type: application/json Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: Host: 10.222.0.27 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: Openstack-System-Scope: None Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: User-Agent: python-urllib3/1.26.9 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Auth-Token: gAAAAABi3Ky5XfbVkZL6Jgtdp0Oto6Gr3xwXrf1Bzc8iOBIF3BzzW-2SBqiNHwqJHvDxoFIJrLw9uJ9ilkJK4CZhyxoNryqy1lDA8KMdYvXtKR2hZjA0aSnyM9P4eqpgBEnina0XBcESEFTtlETDsib8WrHBRSF3YENs6MWf6AWZR_vxtDdFJX4 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Id: None Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Domain-Name: None Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Identity-Status: Confirmed Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Is-Admin-Project: True Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Id: default Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Project-Domain-Name: Default Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Project-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Role: reader,member Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Roles: reader,member Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577aa474166845ffbc0ddc0c23b5a6cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-User: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Id: default Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-User-Domain-Name: Default Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-User-Id: a8ddac1d257f460e9115ab3f02942692 Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: method: > Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: exception: Instance 9b504d9c-7d65-4132-bdcd-f5450e7423da could not be found. Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: action_args: {'id': '9b504d9c-7d65-4132-bdcd-f5450e7423da'} Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b504d9c-7d65-4132-bdcd-f5450e7423da could not be found. Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b504d9c-7d65-4132-bdcd-f5450e7423da could not be found. Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:30:46.174430 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b504d9c-7d65-4132-bdcd-f5450e7423da could not be found. Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: ERROR nova.api.openstack.wsgi Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Returning 404 to user: Instance 9b504d9c-7d65-4132-bdcd-f5450e7423da could not be found. {{(pid=119561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7a9cf1fc-b3e4-49e7-8641-997880b9e4c6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da" status: 404 len: 111 microversion: 2.1 time: 0.031113 Jul 24 02:30:46.182275 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3679/7249] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:46 2022] GET /compute/v2.1/servers/9b504d9c-7d65-4132-bdcd-f5450e7423da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:30:49.486908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e1ee4f0d-b634-4ac5-bbd3-9751e0d468f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '.version_select at 0x7f05e86cc550>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:49.527058 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e1ee4f0d-b634-4ac5-bbd3-9751e0d468f9 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-74334525" status: 202 len: 0 microversion: 2.1 time: 0.044080 Jul 24 02:30:49.527655 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3571/7250] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 02:30:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-74334525 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:30:49.560758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f9296be8-822d-47bc-9321-b528005e2934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: .version_select at 0x7f05eac6e160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-817661485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm3gUUi0EqEeX855/6/QiRNAe8qKwpBtFm6KKPrRCbjgeHGj8t0Z67ysXCFxFg70XQKZu77rgC8hzb6h3ovRyGr9lbk60YVNAW8FGb4k9rgpZjx02Nd+gN2onUdaWcX3g=="}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:30:49.576403 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f9296be8-822d-47bc-9321-b528005e2934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:30:49.582780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-f9296be8-822d-47bc-9321-b528005e2934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'key_pairs'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:30:49.606277 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f9296be8-822d-47bc-9321-b528005e2934 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049480 Jul 24 02:30:49.606896 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3680/7251] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:30:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:30:55.093619 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-770447715", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "networks": [{"uuid": "a7c0bf48-52cc-48c0-bf63-935c7c7ec5f2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-817661485", "security_groups": [{"name": "tempest-secgroup-smoke-1470096272"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:30:55.126674 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:55.214564 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] validate_networks() for [('a7c0bf48-52cc-48c0-bf63-935c7c7ec5f2', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:30:55.674822 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:30:55.675241 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:30:55.675780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:30:55.676266 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:30:55.676699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:30:55.687345 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:55.687665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:55.688496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:55.689155 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:55.709554 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:30:55.715756 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Getting quotas for user a8ddac1d257f460e9115ab3f02942692 and project 577aa474166845ffbc0ddc0c23b5a6cc. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:30:55.738443 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:30:55.740785 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:30:55.792622 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2ba0ffbf-1582-481e-9b17-1a1b244b067b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703786 Jul 24 02:30:55.793290 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3572/7252] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:30:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:30:55.805445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f4e78cbc-30fb-4242-8fbe-2feb4c1b3212 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:55.806718 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f4e78cbc-30fb-4242-8fbe-2feb4c1b3212 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:55.908560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f4e78cbc-30fb-4242-8fbe-2feb4c1b3212 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:30:55.917979 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f4e78cbc-30fb-4242-8fbe-2feb4c1b3212 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1265 microversion: 2.1 time: 0.117308 Jul 24 02:30:55.919131 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3681/7253] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:55 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:30:56.943151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:56.946089 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:56.954665 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:56.955508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:56.956533 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:56.957300 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:57.041591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:30:57.054066 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-40e58f98-c25d-4ffc-9925-c8d106897ded tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1335 microversion: 2.1 time: 0.122267 Jul 24 02:30:57.054647 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3573/7254] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:56 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1335 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:30:58.072834 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:58.073363 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:58.080727 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=12 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:58.088921 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:58.089648 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:58.090485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:58.091094 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:58.271106 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:30:58.280577 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0d4dfefa-84a3-4b0f-bcf3-0a83b51401ad tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1391 microversion: 2.1 time: 0.210914 Jul 24 02:30:58.281317 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3682/7255] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:58 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:30:58.537339 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-bb0421ab-9173-445b-b551-a7233b83673a req-9eb10ae7-5ca6-4dbe-9cf6-7097cbcd8bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd", "tag": "0b240c3e-6926-4524-980b-50631942fd44"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:30:58.574661 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bb0421ab-9173-445b-b551-a7233b83673a req-9eb10ae7-5ca6-4dbe-9cf6-7097cbcd8bd0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:58.575144 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bb0421ab-9173-445b-b551-a7233b83673a req-9eb10ae7-5ca6-4dbe-9cf6-7097cbcd8bd0 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:58.593469 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-bb0421ab-9173-445b-b551-a7233b83673a req-9eb10ae7-5ca6-4dbe-9cf6-7097cbcd8bd0 service nova] Creating event network-changed:0b240c3e-6926-4524-980b-50631942fd44 for instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd on n-h1-master-1 Jul 24 02:30:58.601125 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-bb0421ab-9173-445b-b551-a7233b83673a req-9eb10ae7-5ca6-4dbe-9cf6-7097cbcd8bd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068134 Jul 24 02:30:58.602650 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3574/7256] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:30:59.298432 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:30:59.299050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:30:59.306013 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:59.306469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:59.307237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:30:59.307676 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:30:59.439979 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:30:59.447451 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-98624cb6-940b-406c-9129-416929a20ad6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1391 microversion: 2.1 time: 0.152992 Jul 24 02:30:59.448024 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3683/7257] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:30:59 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:00.465697 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:00.466408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:00.472718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:00.473182 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:00.474013 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:00.474450 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:00.610177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:00.617860 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0b5e2a1d-7c0d-46b2-951b-f359a8e54370 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1391 microversion: 2.1 time: 0.157202 Jul 24 02:31:00.618436 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3575/7258] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:00 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:01.635619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:01.636243 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:01.643299 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:01.643761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:01.644543 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:01.645000 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:01.777899 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:01.786337 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-986637ef-0698-4ee3-baeb-d91a91656cec tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1391 microversion: 2.1 time: 0.154721 Jul 24 02:31:01.786921 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3684/7259] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:01 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:02.803159 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:02.803815 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:02.811461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:02.811930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:02.812723 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:02.813175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:02.944757 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:02.953031 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f497cf50-f695-4dd7-9d22-ddef98e569ee tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1391 microversion: 2.1 time: 0.153576 Jul 24 02:31:02.953617 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3576/7260] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:02 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:03.969943 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:03.970566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:03.977512 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:03.977996 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:03.978765 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:03.979206 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:04.121913 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:04.125273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-ef771282-6414-4b48-b8f5-ef837b7c7fdd req-aa94d494-e0da-4e8b-818a-227c3006b64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd", "name": "network-vif-plugged", "status": "completed", "tag": "0b240c3e-6926-4524-980b-50631942fd44"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:04.132122 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-23b4be8d-529c-47e5-b06d-eb62261cdf7c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1391 microversion: 2.1 time: 0.166065 Jul 24 02:31:04.138595 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3685/7261] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:03 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:04.139316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ef771282-6414-4b48-b8f5-ef837b7c7fdd req-aa94d494-e0da-4e8b-818a-227c3006b64e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:04.139316 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-ef771282-6414-4b48-b8f5-ef837b7c7fdd req-aa94d494-e0da-4e8b-818a-227c3006b64e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:04.147548 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-ef771282-6414-4b48-b8f5-ef837b7c7fdd req-aa94d494-e0da-4e8b-818a-227c3006b64e service nova] Creating event network-vif-plugged:0b240c3e-6926-4524-980b-50631942fd44 for instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd on n-h1-master-1 Jul 24 02:31:04.154030 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-ef771282-6414-4b48-b8f5-ef837b7c7fdd req-aa94d494-e0da-4e8b-818a-227c3006b64e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032711 Jul 24 02:31:04.154714 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3577/7262] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:31:05.150692 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:05.151314 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:05.158274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:05.158749 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:05.159529 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:05.159976 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:05.316280 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:05.324493 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-63eaa4fd-7abb-45c3-b7c7-ac03f757b248 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1391 microversion: 2.1 time: 0.177855 Jul 24 02:31:05.325016 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3686/7263] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:05 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:06.339699 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:06.340512 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:06.345807 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:06.346518 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:06.353637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:06.354105 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:06.354880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:06.355322 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:06.494707 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:06.502452 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-73c7bf1f-dafc-4ffb-94ec-d6b35b04cd1a tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1563 microversion: 2.1 time: 0.164526 Jul 24 02:31:06.503035 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3578/7264] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:06 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:06.519918 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:06.520575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:06.522540 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:06.528936 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:06.529561 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:06.531188 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:06.531641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:06.664167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:06.672567 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b86ad570-8c50-4a8d-9210-baeef6ee71a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1563 microversion: 2.1 time: 0.156608 Jul 24 02:31:06.673143 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3687/7265] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:06 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:08.601178 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:08.601835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:08.610215 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:08.610906 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:08.611897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:08.612342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:08.662524 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1431183e-927e-458f-aeb8-df135a9ee6b5 req-c8305220-168e-45e4-aa64-bcf245d70e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd", "tag": "0b240c3e-6926-4524-980b-50631942fd44"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:08.671668 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1431183e-927e-458f-aeb8-df135a9ee6b5 req-c8305220-168e-45e4-aa64-bcf245d70e54 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:08.672320 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1431183e-927e-458f-aeb8-df135a9ee6b5 req-c8305220-168e-45e4-aa64-bcf245d70e54 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:08.683868 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1431183e-927e-458f-aeb8-df135a9ee6b5 req-c8305220-168e-45e4-aa64-bcf245d70e54 service nova] Creating event network-changed:0b240c3e-6926-4524-980b-50631942fd44 for instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd on n-h1-master-1 Jul 24 02:31:08.689647 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1431183e-927e-458f-aeb8-df135a9ee6b5 req-c8305220-168e-45e4-aa64-bcf245d70e54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089940 Jul 24 02:31:08.690316 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3688/7266] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:31:08.764368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:08.772240 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-806aedd8-3d5a-4fb9-8909-f82e371ba012 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1563 microversion: 2.1 time: 0.174931 Jul 24 02:31:08.784555 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3579/7267] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:08 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:30.012136 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:30.012890 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=38 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:30.017917 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-67aeaa52-a361-41ad-b82c-73dd5490ed8c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:30.018924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-67aeaa52-a361-41ad-b82c-73dd5490ed8c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:30.026291 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67aeaa52-a361-41ad-b82c-73dd5490ed8c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:30.026751 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67aeaa52-a361-41ad-b82c-73dd5490ed8c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:30.027526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67aeaa52-a361-41ad-b82c-73dd5490ed8c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:30.027973 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-67aeaa52-a361-41ad-b82c-73dd5490ed8c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:30.077608 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-67aeaa52-a361-41ad-b82c-73dd5490ed8c tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action" status: 200 len: 24573 microversion: 2.1 time: 0.066776 Jul 24 02:31:30.078793 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3689/7268] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:31:30 2022] POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action => generated 24573 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:31:36.460713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:36.461323 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:36.463780 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:36.464448 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=36 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:36.470825 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:36.471327 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:36.472214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:36.472742 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:36.497202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lazy-loading 'flavor' on Instance uuid 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:31:36.562816 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-d76e94cd-7a6f-47f2-a079-653c940d146d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action" status: 202 len: 0 microversion: 2.1 time: 0.106034 Jul 24 02:31:36.563475 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3580/7269] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:31:36 2022] POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:31:36.572805 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:36.573520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:36.583404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:36.583863 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:36.584651 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:36.585092 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:36.720074 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:36.727920 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-185b258b-a91b-4240-9709-07989459b07b tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1688 microversion: 2.1 time: 0.159997 Jul 24 02:31:36.728505 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3690/7270] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:36 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:37.747616 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:37.748920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:37.755747 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:37.756212 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:37.756992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:37.757443 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:37.896358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:37.903960 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-fa52bf9c-cd45-4c96-8195-e78785849081 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1671 microversion: 2.1 time: 0.161438 Jul 24 02:31:37.904527 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3581/7271] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:37 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:38.992039 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e3472b43-4d89-4465-ab9b-17f8df2b80a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:38.993013 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e3472b43-4d89-4465-ab9b-17f8df2b80a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:39.001636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3472b43-4d89-4465-ab9b-17f8df2b80a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:39.002136 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3472b43-4d89-4465-ab9b-17f8df2b80a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:39.002917 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3472b43-4d89-4465-ab9b-17f8df2b80a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:39.003363 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e3472b43-4d89-4465-ab9b-17f8df2b80a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:39.053232 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e3472b43-4d89-4465-ab9b-17f8df2b80a6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action" status: 200 len: 35005 microversion: 2.1 time: 0.065026 Jul 24 02:31:39.053934 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3691/7272] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:31:38 2022] POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action => generated 35005 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:31:39.064922 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b9eb5954-c448-4e6b-ad1d-d5b376bde350 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:39.065501 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b9eb5954-c448-4e6b-ad1d-d5b376bde350 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:39.072510 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9eb5954-c448-4e6b-ad1d-d5b376bde350 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:39.072971 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9eb5954-c448-4e6b-ad1d-d5b376bde350 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:39.073784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9eb5954-c448-4e6b-ad1d-d5b376bde350 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:39.074231 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b9eb5954-c448-4e6b-ad1d-d5b376bde350 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:39.141772 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b9eb5954-c448-4e6b-ad1d-d5b376bde350 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action" status: 202 len: 0 microversion: 2.1 time: 0.080570 Jul 24 02:31:39.142812 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3582/7273] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:31:39 2022] POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:31:39.151603 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:39.152324 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:39.160115 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:39.160574 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:39.161357 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:39.161823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:39.301296 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:39.309479 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1f0e793d-1f55-4d50-83b7-ff1f03c1f198 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1677 microversion: 2.1 time: 0.162220 Jul 24 02:31:39.310084 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3692/7274] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:39 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:40.327344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:40.328115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:40.335133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:40.335592 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:40.336374 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:40.336818 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:40.474216 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:40.482085 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-433e895f-d7cc-4275-ae47-ff49ce06c6b6 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1677 microversion: 2.1 time: 0.159554 Jul 24 02:31:40.482991 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3583/7275] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:40 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:41.499840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:41.500371 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:41.508202 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:41.508659 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:41.509431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:41.509907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:41.652964 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:41.661107 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5b08efe3-cc90-4f8f-8e73-c444b607165d tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1680 microversion: 2.1 time: 0.165586 Jul 24 02:31:41.661712 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3693/7276] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:41 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:41.750053 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a2682197-6978-4dcf-8079-49b49b686304 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:41.750950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a2682197-6978-4dcf-8079-49b49b686304 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:41.757461 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2682197-6978-4dcf-8079-49b49b686304 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:41.757967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2682197-6978-4dcf-8079-49b49b686304 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:41.758766 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2682197-6978-4dcf-8079-49b49b686304 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:41.759225 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a2682197-6978-4dcf-8079-49b49b686304 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:41.800706 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a2682197-6978-4dcf-8079-49b49b686304 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action" status: 200 len: 35005 microversion: 2.1 time: 0.054894 Jul 24 02:31:41.801716 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3584/7277] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:31:41 2022] POST /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd/action => generated 35005 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 24 02:31:42.794480 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:42.795014 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:42.798634 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-eae42ff7-0086-4fe8-9b6d-7bb223bbe736 req-fd7f54af-9b97-43b2-b09e-bead35e115f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd", "tag": "0b240c3e-6926-4524-980b-50631942fd44"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:42.802599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:42.803055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:42.803830 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:42.804265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:42.810095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eae42ff7-0086-4fe8-9b6d-7bb223bbe736 req-fd7f54af-9b97-43b2-b09e-bead35e115f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:42.810631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-eae42ff7-0086-4fe8-9b6d-7bb223bbe736 req-fd7f54af-9b97-43b2-b09e-bead35e115f1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:42.825823 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-eae42ff7-0086-4fe8-9b6d-7bb223bbe736 req-fd7f54af-9b97-43b2-b09e-bead35e115f1 service nova] Creating event network-changed:0b240c3e-6926-4524-980b-50631942fd44 for instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd on n-h1-master-1 Jul 24 02:31:42.831198 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-eae42ff7-0086-4fe8-9b6d-7bb223bbe736 req-fd7f54af-9b97-43b2-b09e-bead35e115f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037721 Jul 24 02:31:42.832102 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3585/7278] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:31:42.832773 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:31:42.919334 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a16a0e75-0f0a-4031-947a-5040131a2548 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 204 len: 0 microversion: 2.1 time: 0.128354 Jul 24 02:31:42.921760 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3694/7279] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:31:42 2022] DELETE /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:31:42.929652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:42.931996 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:42.939118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:42.939883 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:42.941070 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:42.941741 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:43.086273 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:43.094847 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd9acdee-373d-4605-b538-3ddef90179f0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1686 microversion: 2.1 time: 0.169804 Jul 24 02:31:43.095421 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3586/7280] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:42 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:44.113126 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:44.113859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:44.120949 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:44.121485 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:44.122288 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:44.122730 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:44.263423 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:44.272246 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-afdb3ae1-c04b-4b4e-9947-0c72e5a5c2e0 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1686 microversion: 2.1 time: 0.163386 Jul 24 02:31:44.283124 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3695/7281] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:44 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:45.002677 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-de9233b7-1cc9-493e-b680-5e54943c2429 req-1c71c951-4dc6-4312-b66e-d1a5d25a5a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd", "name": "network-vif-deleted", "tag": "0b240c3e-6926-4524-980b-50631942fd44"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:31:45.013502 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-de9233b7-1cc9-493e-b680-5e54943c2429 req-1c71c951-4dc6-4312-b66e-d1a5d25a5a03 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:45.014129 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-de9233b7-1cc9-493e-b680-5e54943c2429 req-1c71c951-4dc6-4312-b66e-d1a5d25a5a03 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:45.025354 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-de9233b7-1cc9-493e-b680-5e54943c2429 req-1c71c951-4dc6-4312-b66e-d1a5d25a5a03 service nova] Creating event network-vif-deleted:0b240c3e-6926-4524-980b-50631942fd44 for instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd on n-h1-master-1 Jul 24 02:31:45.030641 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-de9233b7-1cc9-493e-b680-5e54943c2429 req-1c71c951-4dc6-4312-b66e-d1a5d25a5a03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032239 Jul 24 02:31:45.031220 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3587/7282] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:31:45.290803 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:45.291414 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:45.299271 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:45.299865 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:45.300840 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:45.301417 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:45.335096 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:45.335621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:45.336112 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lazy-loading 'fault' on Instance uuid 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:31:45.384567 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ddac1d257f460e9115ab3f02942692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577aa474166845ffbc0ddc0c23b5a6cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:31:45.394295 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c36fca07-5063-473f-8ec6-2c6e0de22808 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 200 len: 1355 microversion: 2.1 time: 0.107492 Jul 24 02:31:45.405697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3696/7283] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:45 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:31:46.416008 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:46.416721 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] [instance: 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:31:46.423227 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:46.423684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:46.424457 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:31:46.424902 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:31:46.438264 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] HTTP exception thrown: Instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd could not be found. Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Request method failure captured: Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd HTTP/1.1 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3Ky5XfbVkZL6Jgtdp0Oto6Gr3xwXrf1Bzc8iOBIF3BzzW-2SBqiNHwqJHvDxoFIJrLw9uJ9ilkJK4CZhyxoNryqy1lDA8KMdYvXtKR2hZjA0aSnyM9P4eqpgBEnina0XBcESEFTtlETDsib8WrHBRSF3YENs6MWf6AWZR_vxtDdFJX4 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577aa474166845ffbc0ddc0c23b5a6cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577aa474166845ffbc0ddc0c23b5a6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 577aa474166845ffbc0ddc0c23b5a6cc Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1949778591 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: a8ddac1d257f460e9115ab3f02942692 Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1949778591-project Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd could not be found. Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd'} Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd could not be found. Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd could not be found. Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:31:46.439865 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd could not be found. Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Returning 404 to user: Instance 9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8fcba855-a3f1-4117-869a-f9b47618b0c1 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd" status: 404 len: 111 microversion: 2.1 time: 0.030431 Jul 24 02:31:46.444559 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3588/7284] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:31:46 2022] GET /compute/v2.1/servers/9cabe973-1e6b-43bc-8c9f-a4cbd82f72dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:31:49.766054 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f683ab2b-5261-48a3-8ef9-27dc3acf5eb3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] Calling method '.version_select at 0x7f05e9d1a040>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:31:49.789884 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f683ab2b-5261-48a3-8ef9-27dc3acf5eb3 tempest-TestNetworkAdvancedServerOps-1949778591 tempest-TestNetworkAdvancedServerOps-1949778591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-817661485" status: 202 len: 0 microversion: 2.1 time: 0.027833 Jul 24 02:31:49.790580 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3697/7285] 10.222.0.27 () {58 vars in 1280 bytes} [Sun Jul 24 02:31:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-817661485 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:32:01.024880 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=18 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:01.026177 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:01.261145 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-559f52e8-934f-427e-9db9-7ccd32a4c95f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'create', calling method: .version_select at 0x7f05e868ea60>, body: {"keypair": {"name": "tempest-TestShelveInstance-866122181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHnizEiN7Vs4E73OmSjtxSdGqKswfZLNaBjhqB7XwJK/U0Y+JMXP1xejGJWtjrA9uNMcvVpmgkLK/IxBK7Ed9LzCXRIAgGQHRiIRYAiOxsYP6hm+BR+L7EAt5EnJ6ItJA=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:32:01.276301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-559f52e8-934f-427e-9db9-7ccd32a4c95f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:32:01.282769 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-559f52e8-934f-427e-9db9-7ccd32a4c95f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for user c73ce3dd61734afe9f5b876975b6bcc9 and project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:32:01.309512 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-559f52e8-934f-427e-9db9-7ccd32a4c95f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.290293 Jul 24 02:32:01.310949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3589/7286] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:32:01 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:32:02.312995 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-434193615", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-866122181", "security_groups": [{"name": "tempest-secgroup-smoke-1295905054"}], "networks": [{"uuid": "39d51e27-c780-44e6-819a-6f2c15321081"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:32:02.323434 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:02.324111 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:02.432326 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] validate_networks() for [('39d51e27-c780-44e6-819a-6f2c15321081', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:32:02.953037 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:32:02.953471 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:32:02.953984 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:32:02.954404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:32:02.954827 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:32:02.963966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:02.964418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:02.965233 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:02.965698 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:02.983698 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:32:02.989046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for user c73ce3dd61734afe9f5b876975b6bcc9 and project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:32:03.001955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:32:03.004300 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:32:03.050220 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1aab0f1e-fc03-4bb6-8a92-5b3a475ee1a1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741448 Jul 24 02:32:03.055822 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3698/7287] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:32:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:32:03.061928 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6ba43a50-3972-48d1-a75b-d7fbf462e4c8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:03.062717 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6ba43a50-3972-48d1-a75b-d7fbf462e4c8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:03.133460 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6ba43a50-3972-48d1-a75b-d7fbf462e4c8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:03.140682 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6ba43a50-3972-48d1-a75b-d7fbf462e4c8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1245 microversion: 2.1 time: 0.083697 Jul 24 02:32:03.142028 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3590/7288] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:03 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:32:04.159254 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:04.160355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:04.168835 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:04.170314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:04.171327 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:04.171981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:04.257413 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:04.273648 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-243becae-6246-424e-9848-8c483393627c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1305 microversion: 2.1 time: 0.118308 Jul 24 02:32:04.274367 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3699/7289] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:04 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:05.291876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:05.293238 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:05.301699 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:05.302191 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:05.302996 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:05.303452 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:05.449727 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:05.458465 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-027230d3-be69-403f-9e43-5c99e7287185 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.170519 Jul 24 02:32:05.459054 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3591/7290] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:05 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:05.645877 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-dfb90d0a-155b-46c1-a3f8-908dcec642c2 req-95440437-7037-4de6-abc3-54ed2058f7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:32:05.659556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dfb90d0a-155b-46c1-a3f8-908dcec642c2 req-95440437-7037-4de6-abc3-54ed2058f7c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:05.660744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-dfb90d0a-155b-46c1-a3f8-908dcec642c2 req-95440437-7037-4de6-abc3-54ed2058f7c6 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:05.688457 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-dfb90d0a-155b-46c1-a3f8-908dcec642c2 req-95440437-7037-4de6-abc3-54ed2058f7c6 service nova] Creating event network-changed:5c731377-b38d-4d85-9294-d19e560d399b for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d on n-h2-master-1 Jul 24 02:32:05.694101 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-dfb90d0a-155b-46c1-a3f8-908dcec642c2 req-95440437-7037-4de6-abc3-54ed2058f7c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055326 Jul 24 02:32:05.694960 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3700/7291] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:32:06.475388 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:06.476047 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:06.483386 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:06.483850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:06.484648 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:06.485099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:06.677409 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:06.684984 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-49403c6a-00ac-4789-9398-3b7f79732e2c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.213493 Jul 24 02:32:06.686184 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3592/7292] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:06 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:07.704526 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:07.705161 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:07.711526 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:07.711987 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:07.712766 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:07.713213 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:07.904842 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:07.912461 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-7950d612-1701-4b55-839b-e4508532d850 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.213716 Jul 24 02:32:07.913046 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3701/7293] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:07 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:08.929285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:08.929945 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:08.937098 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:08.937559 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:08.938359 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:08.938806 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:09.071732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:09.079086 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-938179aa-e2ff-43bb-b73a-06cf385da693 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.153723 Jul 24 02:32:09.079655 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3593/7294] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:08 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:10.096711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:10.097339 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:10.103983 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:10.104445 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:10.105227 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:10.105695 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:10.249966 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:10.258051 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b6e7f963-9803-4201-85a1-020bdab42b37 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.166734 Jul 24 02:32:10.258624 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3702/7295] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:10 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:11.275614 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:11.276249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:11.283420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:11.283897 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:11.284683 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:11.285139 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:11.418777 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:11.426806 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-480d6eb8-7616-4a5d-8665-3d90b42adeb0 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.155332 Jul 24 02:32:11.427392 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3594/7296] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:11 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:12.163121 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-83baa82a-492a-4cd5-abd6-a017d5189e62 req-1412b601-8b84-4d6e-ac51-c899fe76a710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "name": "network-vif-plugged", "status": "completed", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:32:12.172681 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-83baa82a-492a-4cd5-abd6-a017d5189e62 req-1412b601-8b84-4d6e-ac51-c899fe76a710 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:12.173044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-83baa82a-492a-4cd5-abd6-a017d5189e62 req-1412b601-8b84-4d6e-ac51-c899fe76a710 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:12.184831 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-83baa82a-492a-4cd5-abd6-a017d5189e62 req-1412b601-8b84-4d6e-ac51-c899fe76a710 service nova] Creating event network-vif-plugged:5c731377-b38d-4d85-9294-d19e560d399b for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d on n-h2-master-1 Jul 24 02:32:12.190738 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-83baa82a-492a-4cd5-abd6-a017d5189e62 req-1412b601-8b84-4d6e-ac51-c899fe76a710 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Jul 24 02:32:12.191349 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3703/7297] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:32:12.444274 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:12.444908 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:12.452346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:12.452809 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:12.453595 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:12.454078 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:12.583294 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:12.590787 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-89b29bb7-1c91-441e-b336-10eac89e15ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.150440 Jul 24 02:32:12.591486 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3595/7298] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:12 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:13.605118 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:13.605923 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:13.610970 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:13.611700 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:13.618798 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:13.619246 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:13.620009 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:13.620448 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:13.759724 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:13.767697 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c275b2c1-3bfa-4094-a41a-56c013f81cfb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1371 microversion: 2.1 time: 0.163479 Jul 24 02:32:13.768673 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3704/7299] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:13 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:14.785074 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:14.785739 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:14.787640 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:14.793926 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:14.794400 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:14.795196 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:14.795649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:14.929617 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:14.937744 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1c1e69dd-3d9c-4f24-85d4-8612efc3b92b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1554 microversion: 2.1 time: 0.156620 Jul 24 02:32:14.938312 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3596/7300] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:14 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:14.954023 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:32:14.954639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:32:14.961460 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:14.961942 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:14.962715 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:14.963153 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:15.097056 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:32:15.104623 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1c087519-9c32-4cbc-8d8e-971339ade187 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1554 microversion: 2.1 time: 0.154911 Jul 24 02:32:15.105196 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3705/7301] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:32:14 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:32:17.047972 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-0498c987-4c05-4451-bf6d-3227b50fe033 req-5e5261cb-adb6-4080-b2b0-35b3f81f424e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:32:17.057043 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0498c987-4c05-4451-bf6d-3227b50fe033 req-5e5261cb-adb6-4080-b2b0-35b3f81f424e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:32:17.057520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-0498c987-4c05-4451-bf6d-3227b50fe033 req-5e5261cb-adb6-4080-b2b0-35b3f81f424e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:32:17.069402 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-0498c987-4c05-4451-bf6d-3227b50fe033 req-5e5261cb-adb6-4080-b2b0-35b3f81f424e service nova] Creating event network-changed:5c731377-b38d-4d85-9294-d19e560d399b for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d on n-h2-master-1 Jul 24 02:32:17.074280 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-0498c987-4c05-4451-bf6d-3227b50fe033 req-5e5261cb-adb6-4080-b2b0-35b3f81f424e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030111 Jul 24 02:32:17.074876 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3597/7302] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:33:12.344758 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:33:12.345471 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:34:43.172550 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 24 02:34:43.173502 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3f81d4f-5c47-4b48-92a8-e4559415656f] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 24 02:34:43.174315 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:34:43.175088 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=36 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:34:43.179132 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:34:43.179671 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:43.187416 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:43.187868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:43.188641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:43.189083 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:43.213178 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lazy-loading 'flavor' on Instance uuid c0201630-c1cb-4611-8bd7-3fa3e08ce66d {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:34:43.471858 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4f273fad-b562-4aa8-9762-b6cbad790003 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d/action" status: 202 len: 0 microversion: 2.1 time: 0.300913 Jul 24 02:34:43.472646 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3706/7303] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:34:43 2022] POST /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:34:43.479122 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:34:43.480608 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:34:43.481251 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:34:43.482183 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=38 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:34:43.487043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:43.487758 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:43.496619 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:43.497095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:43.497939 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:43.498406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:43.633929 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:43.641371 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5555011d-9081-490d-b8ba-c7db3eb905e8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.164071 Jul 24 02:34:43.641961 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3598/7304] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:43 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:44.664715 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:44.665422 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:44.676819 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:44.677283 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:44.678085 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:44.678524 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:44.684550 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3f81d4f-5c47-4b48-92a8-e4559415656f] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38168. Jul 24 02:34:44.685250 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38166. Jul 24 02:34:44.820566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:44.828654 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be2376fd-feb3-4861-998a-5cc8dfdfce18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.173007 Jul 24 02:34:44.829237 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3707/7305] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:44 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:45.846139 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:45.846805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:45.858750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:45.859223 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:45.860019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:45.860507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:45.878642 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38172. Jul 24 02:34:45.879470 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38174. Jul 24 02:34:45.993615 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:46.001829 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d61cec5-071a-41ee-a6f3-b59c55bd848d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.159674 Jul 24 02:34:46.002401 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3599/7306] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:45 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:47.019453 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:47.020070 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:47.028095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:47.028788 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:47.029582 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:47.030162 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:47.167535 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:47.175293 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0c175ec8-11d9-408a-a50a-30aaa3c65fd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.159909 Jul 24 02:34:47.175869 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3708/7307] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:47 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:48.192969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:48.193592 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:48.201294 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:48.201778 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:48.202558 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:48.203008 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:48.337368 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:48.345238 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5de34bc6-903c-4013-a965-1fb6bc5e1d05 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.156200 Jul 24 02:34:48.345849 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3600/7308] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:48 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:49.363029 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:49.363650 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:49.371412 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:49.371808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:49.372607 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:49.373047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:49.503176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:49.511361 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-42753e79-a730-4bb9-863b-6c67527727fc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.152272 Jul 24 02:34:49.511938 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3709/7309] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:49 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:50.528916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:50.529552 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:50.536567 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:50.537036 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:50.537882 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:50.538341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:50.673521 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:50.681083 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be5a3a56-362f-442a-a598-1e15483004b7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.156573 Jul 24 02:34:50.681646 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3601/7310] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:50 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:51.699986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:51.700606 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:51.707570 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:51.708031 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:51.708815 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:51.709259 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:51.842144 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:51.849716 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-468c39cd-3f58-4576-b746-a1ed0a17dfe2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.154724 Jul 24 02:34:51.850236 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3710/7311] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:51 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:34:52.264714 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:34:52.265322 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:34:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:34:52.719215 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:34:52.719748 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:34:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:34:52.753065 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:34:52.753257 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:34:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:34:52.867358 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:52.867976 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:52.874923 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:52.875380 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:52.876420 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:52.876863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:53.009111 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:53.017194 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8b149296-3cd2-4702-aa0c-05a23db9cd88 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.153720 Jul 24 02:34:53.017774 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3602/7312] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:52 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:54.034927 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:54.035542 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:54.044069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:54.044515 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:54.045278 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:54.045741 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:54.180138 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:54.187919 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a92faa45-33f6-4409-a181-d4b4482fbadf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.156960 Jul 24 02:34:54.188493 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3711/7313] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:54 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:55.204714 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:55.205353 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:55.213204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:55.213739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:55.214516 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:55.214966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:55.344805 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:55.352184 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-82ec0fd6-dea1-4f6d-bf9e-81232a482d11 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1699 microversion: 2.1 time: 0.151318 Jul 24 02:34:55.352750 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3603/7314] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:55 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:56.371035 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:56.371660 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:56.378876 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:56.379330 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:56.380097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:56.380537 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:56.514405 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:56.522046 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-50c82d79-5108-4a0d-b6cd-0108c1269705 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1699 microversion: 2.1 time: 0.155707 Jul 24 02:34:56.522615 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3712/7315] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:56 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:57.539200 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:57.539953 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:57.547441 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:57.547905 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:57.548690 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:57.549143 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:57.679946 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:57.687367 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ffbd0ddf-1b78-4281-a19c-9cfe8fccc93a tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1699 microversion: 2.1 time: 0.152058 Jul 24 02:34:57.687931 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3604/7316] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:57 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:58.704357 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:58.705000 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:58.711845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:58.712293 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:58.713058 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:58.714203 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:58.848520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:34:58.857656 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-aad1ea00-e427-41c7-8538-d2b66514c9bc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1699 microversion: 2.1 time: 0.156814 Jul 24 02:34:58.857939 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3713/7317] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:58 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:34:59.083862 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-2616f13b-1dae-473a-b739-a04427233d99 req-0ff10d9e-e6aa-4a22-b967-626acf80fb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "name": "network-vif-plugged", "status": "completed", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:34:59.092649 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2616f13b-1dae-473a-b739-a04427233d99 req-0ff10d9e-e6aa-4a22-b967-626acf80fb7f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:59.093118 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-2616f13b-1dae-473a-b739-a04427233d99 req-0ff10d9e-e6aa-4a22-b967-626acf80fb7f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:59.104577 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-2616f13b-1dae-473a-b739-a04427233d99 req-0ff10d9e-e6aa-4a22-b967-626acf80fb7f service nova] Creating event network-vif-plugged:5c731377-b38d-4d85-9294-d19e560d399b for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d on n-h2-master-1 Jul 24 02:34:59.108025 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [req-2616f13b-1dae-473a-b739-a04427233d99 req-0ff10d9e-e6aa-4a22-b967-626acf80fb7f service nova] [3f3b8e7e-bb2f-47ba-b337-b95f00af3bc9] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:34:59.874566 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:34:59.875271 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:34:59.882704 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:59.883200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:34:59.884106 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:34:59.884544 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:00.021693 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:00.031237 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c56d119d-1d29-4bf2-8e48-42db03f6e88b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.160564 Jul 24 02:35:00.032215 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3714/7318] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:34:59 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:35:00.127113 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [req-2616f13b-1dae-473a-b739-a04427233d99 req-0ff10d9e-e6aa-4a22-b967-626acf80fb7f service nova] [3f3b8e7e-bb2f-47ba-b337-b95f00af3bc9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38236. Jul 24 02:35:00.132188 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-2616f13b-1dae-473a-b739-a04427233d99 req-0ff10d9e-e6aa-4a22-b967-626acf80fb7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.115109 Jul 24 02:35:00.137056 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3605/7319] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:35:01.049986 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:01.050604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:01.061714 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:01.062426 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:01.063462 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:01.063912 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:01.215052 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:01.224776 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64d655f4-bed0-4e0a-903a-d287939b1c2f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.178271 Jul 24 02:35:01.225389 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3715/7320] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:01 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:02.245433 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:02.246343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:02.253849 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:02.254255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:02.255050 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:02.255507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:02.409115 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:02.417064 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7f8e91cd-2793-4027-b152-5a5bb0b234a9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.177578 Jul 24 02:35:02.418109 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3606/7321] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:02 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:03.434461 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:03.435012 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:03.447088 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:03.447590 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:03.448783 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:03.449249 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:03.608348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:03.623248 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-410e90b1-5611-4b3a-8e5d-46eb9f0fa927 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.192693 Jul 24 02:35:03.624162 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3716/7322] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:03 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:04.641351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:04.642631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:04.651419 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:04.652260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:04.653293 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:04.653995 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:04.820142 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:04.828717 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-cab51528-aefb-487f-b38f-db33c5c3a810 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.191444 Jul 24 02:35:04.829298 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3607/7323] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:04 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:05.846888 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:05.847534 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:05.855701 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:05.856254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:05.857124 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:05.857641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:06.010770 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:06.020569 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3defcba2-21d2-4831-9b94-91aa64817831 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.175783 Jul 24 02:35:06.029371 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3717/7324] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:05 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:07.037315 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:07.038050 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:07.048507 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:07.048991 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:07.050111 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:07.050772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:07.208049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:07.217386 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f53258f0-66da-461e-9d4a-fec3ac748df9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.184149 Jul 24 02:35:07.227686 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3608/7325] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:07 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:08.236027 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:08.238599 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:08.246919 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:08.248001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:08.248808 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:08.249250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:08.386019 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:08.394286 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b72b7f55-db0f-4892-aac1-559d829e6e99 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1694 microversion: 2.1 time: 0.162584 Jul 24 02:35:08.395048 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3718/7326] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:08 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:09.412116 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:09.412691 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:09.420064 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:09.420657 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:09.421524 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:09.422019 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:09.557856 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:09.565405 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-72f6b049-4b5c-480f-a9f8-88e433968d50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1676 microversion: 2.1 time: 0.157301 Jul 24 02:35:09.565994 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3609/7327] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:09 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:10.583342 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:10.583989 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:10.591508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:10.591966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:10.592740 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:10.593184 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:10.729552 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:10.737100 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4685be75-6d3c-4598-b897-649ffdb83976 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1676 microversion: 2.1 time: 0.157695 Jul 24 02:35:10.737697 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3719/7328] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:10 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:11.755343 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:11.756038 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:11.764268 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:11.764728 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:11.765508 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:11.765992 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:11.904591 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:11.912792 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f43f3a14-b17b-4359-9792-93462adfe181 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1679 microversion: 2.1 time: 0.161826 Jul 24 02:35:11.913367 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3610/7329] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:11 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:11.929089 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-db80811d-bb3d-4e1a-80bb-49464ff12958 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:35:11.929707 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-db80811d-bb3d-4e1a-80bb-49464ff12958 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:11.936772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db80811d-bb3d-4e1a-80bb-49464ff12958 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:11.937239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db80811d-bb3d-4e1a-80bb-49464ff12958 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:11.938043 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db80811d-bb3d-4e1a-80bb-49464ff12958 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:11.938518 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-db80811d-bb3d-4e1a-80bb-49464ff12958 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:11.955219 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:12.030822 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-db80811d-bb3d-4e1a-80bb-49464ff12958 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d/action" status: 202 len: 0 microversion: 2.1 time: 0.105686 Jul 24 02:35:12.034574 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3720/7330] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:35:11 2022] POST /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:35:12.039459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:12.040085 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:12.046803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:12.047280 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:12.048063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:12.048578 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:12.538746 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:12.547135 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-16aa4e8c-10c5-4c6c-ac38-0e94f16586c9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1627 microversion: 2.1 time: 0.511390 Jul 24 02:35:12.547590 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3611/7331] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:12 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1627 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:35:13.027142 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-d988219a-ccd0-4132-9e78-0df96f317da5 req-dc0b8db2-faa0-4b80-91cd-22227def2e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "name": "network-vif-unplugged", "status": "completed", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:35:13.037834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d988219a-ccd0-4132-9e78-0df96f317da5 req-dc0b8db2-faa0-4b80-91cd-22227def2e02 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:13.038797 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-d988219a-ccd0-4132-9e78-0df96f317da5 req-dc0b8db2-faa0-4b80-91cd-22227def2e02 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:13.056189 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.compute.server_external_events [req-d988219a-ccd0-4132-9e78-0df96f317da5 req-dc0b8db2-faa0-4b80-91cd-22227def2e02 service nova] Unable to find a host for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d. Dropping event network-vif-unplugged {{(pid=119561) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 24 02:35:13.057230 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-d988219a-ccd0-4132-9e78-0df96f317da5 req-dc0b8db2-faa0-4b80-91cd-22227def2e02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035767 Jul 24 02:35:13.058261 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3721/7332] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 24 02:35:13.564988 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:13.565652 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:13.568506 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=29 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:13.574496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:13.574961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:13.575746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:13.576198 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:13.579370 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=81 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:13.714669 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:13.722543 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-dd106a9d-b40e-4383-ae56-2495faddc083 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.161503 Jul 24 02:35:13.723113 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3612/7333] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:13 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:14.748395 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:14.751890 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:14.767028 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=35 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:14.769453 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:14.770169 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:14.773618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:14.774432 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:14.941938 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:14.952945 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-543a3b24-aa53-436e-b8f0-4d9edb424b24 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.214802 Jul 24 02:35:14.964614 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3722/7334] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:14 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:15.972043 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:15.973268 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:15.981102 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:15.981950 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:15.982967 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:15.983655 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:16.137787 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:16.151624 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7e36c0b8-b4aa-49a7-848f-35212f122487 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.183643 Jul 24 02:35:16.152228 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3613/7335] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:15 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:17.169954 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:17.170605 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:17.178047 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:17.178508 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:17.179553 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:17.180784 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:17.331109 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:17.343738 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ff75ce4-ac09-4061-8920-ef2302eea86d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.178282 Jul 24 02:35:17.345796 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3723/7336] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:17 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:18.364426 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:18.365076 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:18.374086 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:18.374562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:18.375367 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:18.375821 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:18.518801 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:18.526646 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1f62e0ad-8985-4553-b7c1-389e7600dbbc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.166844 Jul 24 02:35:18.527236 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3614/7337] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:18 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:19.544125 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:19.544951 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:19.552066 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:19.552527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:19.553309 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:19.553779 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:19.710360 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:19.718297 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a1a1e53-0913-4e3c-9f5b-a5520a4acca2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.178230 Jul 24 02:35:19.719079 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3724/7338] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:19 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:20.736569 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:20.737209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:20.745553 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:20.758052 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:20.762624 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:20.763089 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:20.938235 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:20.946289 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5e4ee91-2f7a-4b58-bf83-d99396889253 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.213646 Jul 24 02:35:20.954596 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3615/7339] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:20 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:21.963953 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:21.964595 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:21.972572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:21.973021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:21.974020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:21.974455 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:22.124639 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:22.133210 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-86e29127-b8bd-4bab-9d37-a4743272f0af tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.173677 Jul 24 02:35:22.133806 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3725/7340] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:21 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:23.150601 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:23.151094 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:23.158117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:23.158591 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:23.159369 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:23.159819 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:23.295885 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:23.303366 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c67b36d7-0f3e-4fe9-be5d-dfb972fbfeb2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.156849 Jul 24 02:35:23.303949 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3616/7341] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:23 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:24.321101 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:24.321743 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:24.329145 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:24.329600 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:24.330399 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:24.330838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:24.464386 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:24.471924 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ab7eb7aa-13ce-4603-8ffe-279f520f6b89 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.154853 Jul 24 02:35:24.472509 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3726/7342] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:24 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:25.490225 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:25.490776 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:25.498422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:25.498887 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:25.499669 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:25.500120 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:25.636326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:25.643765 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3bf38a36-3cb3-4619-9d1c-4a92a59bff0b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.157508 Jul 24 02:35:25.644334 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3617/7343] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:25 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:26.662003 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:26.662602 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:26.670425 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:26.670874 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:26.671637 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:26.672072 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:26.802985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:26.810539 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2c2c350-cf0b-41a0-8dee-dc98c5e0d6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.152546 Jul 24 02:35:26.811110 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3727/7344] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:26 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:27.828330 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:27.828957 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:27.835880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:27.836343 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:27.837110 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:27.837562 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:27.973374 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:27.981048 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-89e270b5-0ee1-4d07-aa6b-9346b721364f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.156690 Jul 24 02:35:27.981623 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3618/7345] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:27 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:35:28.999198 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:28.999753 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:29.007616 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:29.008069 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:29.008845 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:29.009286 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:29.146049 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:29.154252 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f7392d7-6e9a-433d-91d7-38054f5dbed2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.159095 Jul 24 02:35:29.154857 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3728/7346] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:28 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:30.172224 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:30.172879 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:30.179911 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:30.180375 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:30.181153 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:30.182183 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:30.319742 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:30.328792 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b268cdcb-22b9-4eea-84fe-ef38363ce212 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.160446 Jul 24 02:35:30.329356 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3619/7347] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:30 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:31.346900 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:31.347520 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:31.355154 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:31.355602 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:31.356372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:31.356806 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:31.493330 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:31.500892 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5be3e9e2-3803-4608-886f-5d9bfc02fac2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.157886 Jul 24 02:35:31.501753 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3729/7348] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:31 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:32.518823 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:32.519447 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:32.526422 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:32.526875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:32.527644 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:32.528094 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:32.913113 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:32.920886 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04728565-99e8-4f49-85f3-04f20b5d6df7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.406009 Jul 24 02:35:32.921450 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3620/7349] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:32 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:35:33.139559 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-fa72c6e4-0ac1-4f71-908f-8acd7c4441a5 req-d27a5b99-f6fc-4002-98d4-3205314716ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "name": "network-vif-plugged", "status": "completed", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:35:33.148980 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fa72c6e4-0ac1-4f71-908f-8acd7c4441a5 req-d27a5b99-f6fc-4002-98d4-3205314716ae service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:33.149431 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-fa72c6e4-0ac1-4f71-908f-8acd7c4441a5 req-d27a5b99-f6fc-4002-98d4-3205314716ae service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:33.160722 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-fa72c6e4-0ac1-4f71-908f-8acd7c4441a5 req-d27a5b99-f6fc-4002-98d4-3205314716ae service nova] Creating event network-vif-plugged:5c731377-b38d-4d85-9294-d19e560d399b for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d on n-h2-master-1 Jul 24 02:35:33.165761 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-fa72c6e4-0ac1-4f71-908f-8acd7c4441a5 req-d27a5b99-f6fc-4002-98d4-3205314716ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 Jul 24 02:35:33.166713 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3730/7350] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:35:33.941386 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:33.942483 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:33.950496 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:33.950966 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:33.951754 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:33.952208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:34.092285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:34.099698 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-3c3adda1-7fd3-4d36-a31a-892074d9921e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.165660 Jul 24 02:35:34.100255 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3621/7351] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:33 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:35.118154 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:35.119568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:35.126882 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:35.127418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:35.128272 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:35.128711 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:35.266941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:35.274611 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-ace6c382-9121-450b-bb49-e98a8c6cff18 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1685 microversion: 2.1 time: 0.161952 Jul 24 02:35:35.275803 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3731/7352] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:35 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:35:36.292999 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:35:36.293563 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:35:36.300520 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:36.301014 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:36.301841 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:35:36.302295 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:35:36.437231 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:35:36.444726 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-8959cb1d-c355-4961-b64c-1a58ee0e304c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1672 microversion: 2.1 time: 0.156291 Jul 24 02:35:36.445297 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3622/7353] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:35:36 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:36:32.353131 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:36:32.353815 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:37:13.002963 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=19 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:13.003750 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:13.007826 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:13.008341 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:13.012681 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=21 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:13.014193 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=65 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:13.024237 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:13.024693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:13.025480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:13.025951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:13.056478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:37:13.078964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e159ef39-8f31-4b09-bb0e-810024e5b471 req-cf85dcd2-942b-4584-a1ba-cf4e2b03f2eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:37:13.087378 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e159ef39-8f31-4b09-bb0e-810024e5b471 req-cf85dcd2-942b-4584-a1ba-cf4e2b03f2eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:13.087845 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e159ef39-8f31-4b09-bb0e-810024e5b471 req-cf85dcd2-942b-4584-a1ba-cf4e2b03f2eb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:13.101134 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e159ef39-8f31-4b09-bb0e-810024e5b471 req-cf85dcd2-942b-4584-a1ba-cf4e2b03f2eb service nova] Creating event network-changed:5c731377-b38d-4d85-9294-d19e560d399b for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d on n-h2-master-1 Jul 24 02:37:13.107508 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e159ef39-8f31-4b09-bb0e-810024e5b471 req-cf85dcd2-942b-4584-a1ba-cf4e2b03f2eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109399 Jul 24 02:37:13.108123 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3623/7354] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:37:13.145974 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-054479f1-24e8-4ff2-b1d4-75b1f56a7d33 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 204 len: 0 microversion: 2.1 time: 0.151829 Jul 24 02:37:13.148321 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3732/7355] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:37:12 2022] DELETE /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:37:13.157806 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:13.158539 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:13.166769 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:13.167255 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:13.168063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:13.168512 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:13.350081 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:13.357790 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6837a188-1734-47a9-8de1-f25f8fed3c50 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.204351 Jul 24 02:37:13.358361 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3624/7356] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:13 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:14.376492 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:14.377469 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:14.384554 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:14.385028 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:14.385828 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:14.387359 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:14.576020 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:14.583639 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a269fc44-a1bc-4b59-acaa-e3d4505dac5d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1678 microversion: 2.1 time: 0.211480 Jul 24 02:37:14.584217 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3733/7357] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:14 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:15.268609 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-22e565ea-1b12-44e6-ad48-f7f5e3904b3b req-24f0b55f-e2db-4b80-ad5a-98d7279242dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0201630-c1cb-4611-8bd7-3fa3e08ce66d", "name": "network-vif-deleted", "tag": "5c731377-b38d-4d85-9294-d19e560d399b"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:37:15.280350 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-22e565ea-1b12-44e6-ad48-f7f5e3904b3b req-24f0b55f-e2db-4b80-ad5a-98d7279242dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:15.280746 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-22e565ea-1b12-44e6-ad48-f7f5e3904b3b req-24f0b55f-e2db-4b80-ad5a-98d7279242dd service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:15.292264 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-22e565ea-1b12-44e6-ad48-f7f5e3904b3b req-24f0b55f-e2db-4b80-ad5a-98d7279242dd service nova] Creating event network-vif-deleted:5c731377-b38d-4d85-9294-d19e560d399b for instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d on n-h2-master-1 Jul 24 02:37:15.297959 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-22e565ea-1b12-44e6-ad48-f7f5e3904b3b req-24f0b55f-e2db-4b80-ad5a-98d7279242dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033052 Jul 24 02:37:15.298745 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3625/7358] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:37:15.601821 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:15.602549 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:15.609474 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:15.610053 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:15.610872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:15.611318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:15.659021 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:15.659571 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:15.660298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lazy-loading 'fault' on Instance uuid c0201630-c1cb-4611-8bd7-3fa3e08ce66d {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:37:15.710173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:15.717972 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-69837b5d-494f-4b96-8d76-7f48c7cd8856 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 200 len: 1335 microversion: 2.1 time: 0.120311 Jul 24 02:37:15.718772 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3734/7359] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:15 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:16.737029 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:16.737783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: c0201630-c1cb-4611-8bd7-3fa3e08ce66d] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:16.744063 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:16.744538 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:16.745342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:16.746028 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:16.759492 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] HTTP exception thrown: Instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d could not be found. Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Request method failure captured: Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d HTTP/1.1 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3K8blt9AzEYY9-DdTfIzRC-WvoQFh5i6KqjME3FfLkXTpVcd224A8UYxOkd-Yh4ex459N9Ag5oWBcjeMC6biPUUlxy0ZMeKa1PE3S77O6RpdbuvjXIYphjDgfqD3CkbEWh6n6KAYGd76-KRSvR97XqLTDBZKBTvisoWxjX0gdRFFiQw Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 645e564a038c4ecfb26eac5a0cceb11b Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestShelveInstance-1319108673 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/645e564a038c4ecfb26eac5a0cceb11b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645e564a038c4ecfb26eac5a0cceb11b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_645e564a038c4ecfb26eac5a0cceb11b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645e564a038c4ecfb26eac5a0cceb11b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestShelveInstance-1319108673 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 645e564a038c4ecfb26eac5a0cceb11b Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestShelveInstance-1319108673 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestShelveInstance-1319108673-project Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: c73ce3dd61734afe9f5b876975b6bcc9 Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestShelveInstance-1319108673-project Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: exception: Instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d could not be found. Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'c0201630-c1cb-4611-8bd7-3fa3e08ce66d'} Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d could not be found. Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d could not be found. Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:37:16.762101 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d could not be found. Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Returning 404 to user: Instance c0201630-c1cb-4611-8bd7-3fa3e08ce66d could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-17df2ca2-638c-4be4-8876-c841ed54cc0d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d" status: 404 len: 111 microversion: 2.1 time: 0.032080 Jul 24 02:37:16.767971 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3626/7360] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:16 2022] GET /compute/v2.1/servers/c0201630-c1cb-4611-8bd7-3fa3e08ce66d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:37:16.930141 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-657d86f6-b4ab-4e74-803f-a5c3f231288b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '.version_select at 0x7f05e9cfc1f0>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:16.955073 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-657d86f6-b4ab-4e74-803f-a5c3f231288b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-866122181" status: 202 len: 0 microversion: 2.1 time: 0.028847 Jul 24 02:37:16.955813 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3735/7361] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 02:37:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-866122181 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:37:16.981507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9eb6ee06-cc55-4d86-8b7b-4ccdef2fc6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'create', calling method: .version_select at 0x7f05ebede700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1894884669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL94wf6DrZEI4q4MZ1IZio18TH0+LsEHbbRiDA81Oh3g7jmOvhG9tg0IM/JwjYbDvoYTKJ4Oojm7QgOwXBpNIgxkBfwy2vXED3Jj0mYZZwI8PyqhJcPdoZLbpYzwwMEwsg=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:37:16.996154 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9eb6ee06-cc55-4d86-8b7b-4ccdef2fc6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:37:17.005021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-9eb6ee06-cc55-4d86-8b7b-4ccdef2fc6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for user c73ce3dd61734afe9f5b876975b6bcc9 and project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:37:17.033061 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9eb6ee06-cc55-4d86-8b7b-4ccdef2fc6ed tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.055535 Jul 24 02:37:17.033856 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3627/7362] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:37:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:37:33.082146 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:33.083005 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:33.087354 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-383009132", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1894884669", "security_groups": [{"name": "tempest-secgroup-smoke-1191027423"}], "networks": [{"uuid": "39d51e27-c780-44e6-819a-6f2c15321081"}], "block_device_mapping_v2": [{"uuid": "20f44bf3-def4-4e74-98ee-58e33f4b80c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:37:33.203570 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] validate_networks() for [('39d51e27-c780-44e6-819a-6f2c15321081', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:37:33.614814 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:37:33.615253 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:37:33.615740 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:37:33.616157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:37:33.616579 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:37:33.625458 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:33.625950 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:33.626761 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:33.627476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:33.644220 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:37:33.649486 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Getting quotas for user c73ce3dd61734afe9f5b876975b6bcc9 and project 645e564a038c4ecfb26eac5a0cceb11b. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:37:33.706748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:37:33.708876 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20f44bf3-def4-4e74-98ee-58e33f4b80c9',volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:37:33.832913 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4808ee6b-6d76-4878-bfc8-df8d4c65c4ae tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752493 Jul 24 02:37:33.833558 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3736/7363] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:37:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:37:33.842337 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=12 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:33.843323 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=4 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:33.844157 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:33.848383 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0a0ca5d9-fc0b-42ec-9832-c0bd943b0041 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:33.849020 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0a0ca5d9-fc0b-42ec-9832-c0bd943b0041 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:33.907962 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0a0ca5d9-fc0b-42ec-9832-c0bd943b0041 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:33.914831 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0a0ca5d9-fc0b-42ec-9832-c0bd943b0041 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1088 microversion: 2.1 time: 0.074317 Jul 24 02:37:33.915407 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3628/7364] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:33 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:34.935736 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:34.936968 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:34.943389 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:34.943844 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:34.944626 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:34.945068 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:35.011185 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:35.019271 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5d5866c-cbed-4a38-8646-370f69ce39cd tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1204 microversion: 2.1 time: 0.090763 Jul 24 02:37:35.019853 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3737/7365] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:34 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:36.044288 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:36.044936 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:36.060012 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:36.060784 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:36.061930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:36.062542 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:36.252496 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:36.263890 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-778e0a49-09cd-4549-b55e-46d99bca76bb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1272 microversion: 2.1 time: 0.224386 Jul 24 02:37:36.264898 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3629/7366] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:36 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:36.294993 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-04de7cb7-940f-4a6a-84f7-733c413038ab req-1ef27673-0470-4877-94c8-5af461c58afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:37:36.304956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-04de7cb7-940f-4a6a-84f7-733c413038ab req-1ef27673-0470-4877-94c8-5af461c58afc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:36.305772 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-04de7cb7-940f-4a6a-84f7-733c413038ab req-1ef27673-0470-4877-94c8-5af461c58afc service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:36.318627 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-04de7cb7-940f-4a6a-84f7-733c413038ab req-1ef27673-0470-4877-94c8-5af461c58afc service nova] Creating event network-changed:3d5a2218-c8ef-4850-9149-0cf895b392d6 for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 on n-h2-master-1 Jul 24 02:37:36.330700 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-04de7cb7-940f-4a6a-84f7-733c413038ab req-1ef27673-0470-4877-94c8-5af461c58afc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040365 Jul 24 02:37:36.331548 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3738/7367] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:37:37.281544 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:37.282558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:37.289927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:37.290403 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:37.291199 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:37.292667 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:37.443318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:37.452431 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-28baa8ad-73f2-4446-8ac9-cdcf7a2d5619 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1272 microversion: 2.1 time: 0.175183 Jul 24 02:37:37.453047 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3630/7368] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:37 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:38.471240 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:38.471879 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:38.478326 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:38.478790 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:38.479717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:38.480165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:38.621182 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:38.629085 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-003bf117-df51-42d3-bc58-8b158619c9b8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1272 microversion: 2.1 time: 0.163087 Jul 24 02:37:38.629662 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3739/7369] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:38 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:39.646117 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:39.646780 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:39.654930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:39.655394 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:39.656185 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:39.656631 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:39.798363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:39.806392 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-87086dee-216a-46e5-8900-0c80261a0fc7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1272 microversion: 2.1 time: 0.164062 Jul 24 02:37:39.806990 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3631/7370] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:39 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:40.824149 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:40.824765 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:40.831700 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:40.832152 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:40.832954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:40.833390 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:40.969701 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:40.977203 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2ca8f776-0c29-477d-897a-612b583befd3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.157559 Jul 24 02:37:40.977797 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3740/7371] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:40 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:41.995370 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:41.996000 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:42.003622 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:42.004095 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:42.004885 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:42.005340 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:42.140322 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:42.148433 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-be291769-d538-4a8e-8d36-0242671120fe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.157534 Jul 24 02:37:42.149001 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3632/7372] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:41 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:43.165596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:43.166288 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:43.173418 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:43.173907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:43.174671 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:43.175104 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:43.308568 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:43.316049 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-636b7181-8d59-46ed-ac5d-67b7f4ed0720 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.154384 Jul 24 02:37:43.316619 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3741/7373] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:43 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:44.336432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:44.337073 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:44.340841 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:44.346712 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:44.347188 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:44.348335 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:44.348797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:44.483969 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:44.491444 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-04101ddf-d714-4904-8346-c75c0664df9b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.158998 Jul 24 02:37:44.492017 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3633/7374] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:44 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:45.508936 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:45.509485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:45.512063 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:45.512736 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:45.518476 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:45.518951 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:45.519717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:45.520157 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:45.651257 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:45.658976 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-dd6c485b-e44f-4481-874d-1f127c32ae92 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.154247 Jul 24 02:37:45.659557 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3742/7375] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:45 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:46.676479 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:46.677136 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:46.683875 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:46.684342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:46.685124 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:46.685577 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:46.816774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:46.824563 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-81067206-9742-489b-9763-07eec49a0967 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.152234 Jul 24 02:37:46.825146 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3634/7376] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:46 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:47.840655 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:47.841273 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:47.848355 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:47.848813 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:47.849583 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:47.850049 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:47.992485 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:48.000812 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-be2bada8-72f6-4313-924e-29fa48ddd520 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.164115 Jul 24 02:37:48.001390 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3743/7377] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:47 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:49.018286 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:49.018911 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:49.026446 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:49.026930 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:49.027697 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:49.028142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:49.160283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:49.168073 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5c748baf-524a-40ca-b4fc-51e0efaf1448 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.153699 Jul 24 02:37:49.168650 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3635/7378] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:49 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:50.184869 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:50.185481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:50.192469 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:50.192941 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:50.193729 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:50.194164 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:50.332156 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:50.340812 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-0dbf3cb1-34e5-4d87-a89a-71b5b0053347 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.160241 Jul 24 02:37:50.341401 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3744/7379] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:50 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:51.356947 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:51.357567 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:51.364439 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:51.364900 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:51.365691 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:51.366145 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:51.496354 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:51.504097 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b253b40c-0156-4288-9ee3-fba4030a8102 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.151130 Jul 24 02:37:51.504667 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3636/7380] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:51 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:51.663222 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-b02a5125-4d3f-4488-9fc7-d559a412798b req-ad93fdb7-ef1b-418a-b094-e356e3725452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "name": "network-vif-plugged", "status": "completed", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:37:51.673450 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b02a5125-4d3f-4488-9fc7-d559a412798b req-ad93fdb7-ef1b-418a-b094-e356e3725452 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:51.673933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-b02a5125-4d3f-4488-9fc7-d559a412798b req-ad93fdb7-ef1b-418a-b094-e356e3725452 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:51.686007 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-b02a5125-4d3f-4488-9fc7-d559a412798b req-ad93fdb7-ef1b-418a-b094-e356e3725452 service nova] Creating event network-vif-plugged:3d5a2218-c8ef-4850-9149-0cf895b392d6 for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 on n-h2-master-1 Jul 24 02:37:51.691068 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-b02a5125-4d3f-4488-9fc7-d559a412798b req-ad93fdb7-ef1b-418a-b094-e356e3725452 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Jul 24 02:37:51.691745 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3745/7381] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:37:52.521745 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:52.522285 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:52.529336 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:52.529848 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:52.530639 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:52.531099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:52.664195 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:52.672210 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1d904358-5610-44a8-9a3b-15492e3ef184 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1260 microversion: 2.1 time: 0.154483 Jul 24 02:37:52.672787 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3637/7382] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:52 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:53.690941 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:53.691647 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:53.698641 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:53.699095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:53.699872 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:53.700310 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:53.835096 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:53.843027 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bd12d915-878a-4b62-9308-d318394bc726 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1443 microversion: 2.1 time: 0.157257 Jul 24 02:37:53.843608 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3746/7383] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:53 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:53.859097 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:37:53.859732 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:37:53.866609 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:53.867079 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:53.867859 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:53.868318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:54.000202 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:37:54.007948 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f61e22a6-f740-47f8-95e9-84de5507dbf3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1443 microversion: 2.1 time: 0.152724 Jul 24 02:37:54.008521 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3638/7384] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:37:53 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:37:55.709642 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-74f37ccc-fbb7-40d5-9c46-b596457b84b6 req-9780d23d-4cb3-412a-b4d3-56a85a542f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:37:55.718099 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-74f37ccc-fbb7-40d5-9c46-b596457b84b6 req-9780d23d-4cb3-412a-b4d3-56a85a542f47 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:37:55.718620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-74f37ccc-fbb7-40d5-9c46-b596457b84b6 req-9780d23d-4cb3-412a-b4d3-56a85a542f47 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:37:55.730050 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-74f37ccc-fbb7-40d5-9c46-b596457b84b6 req-9780d23d-4cb3-412a-b4d3-56a85a542f47 service nova] Creating event network-changed:3d5a2218-c8ef-4850-9149-0cf895b392d6 for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 on n-h2-master-1 Jul 24 02:37:55.735474 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-74f37ccc-fbb7-40d5-9c46-b596457b84b6 req-9780d23d-4cb3-412a-b4d3-56a85a542f47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089280 Jul 24 02:37:55.736185 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3747/7385] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:39:51.287750 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 24 02:39:51.288681 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 24 02:39:51.289264 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=24 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:39:51.290053 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=60 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:39:51.295326 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:39:51.295931 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:51.303557 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:51.304029 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:51.304824 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:51.305285 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:51.327406 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.objects.instance [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lazy-loading 'flavor' on Instance uuid 1f5e6115-4880-47c2-9a6f-1cafb429f179 {{(pid=119562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:39:51.397965 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-106a37c5-33a0-4db6-97e6-60ae096462de tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179/action" status: 202 len: 0 microversion: 2.1 time: 0.112820 Jul 24 02:39:51.398473 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3639/7386] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:39:51 2022] POST /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:39:51.405590 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3f81d4f-5c47-4b48-92a8-e4559415656f] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:39:51.406423 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:39:51.407009 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:39:51.407952 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=56 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:39:51.413050 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:51.413819 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:51.421295 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:51.421769 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:51.422538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:51.422970 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:51.559720 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:51.568071 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-cc5da3d6-45cd-4ca4-a858-ddfe581340d2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.164313 Jul 24 02:39:51.568650 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3748/7387] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:51 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:39:52.274807 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 24 02:39:52.275052 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:39:52.361942 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:39:52.363105 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:39:52.588249 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:52.588963 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:52.598250 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:52.598720 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:52.599506 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:52.599961 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:52.606065 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38752. Jul 24 02:39:52.606777 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38750. Jul 24 02:39:52.729575 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:39:52.730130 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:39:52.742944 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:52.750437 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af93b29b-0218-4e0d-8746-3c1893289fff tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.167923 Jul 24 02:39:52.751001 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3640/7388] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:52 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:39:52.761579 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:39:52.761754 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:39:53.767729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:53.768389 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:53.782507 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:53.782966 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:53.783736 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:53.784172 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:53.791490 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38762. Jul 24 02:39:53.794062 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3f81d4f-5c47-4b48-92a8-e4559415656f] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38760. Jul 24 02:39:53.920261 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:53.928668 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-222dd8fd-5c35-407e-907d-9283ee5d551b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.164838 Jul 24 02:39:53.929240 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3749/7389] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:53 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:39:54.945355 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:54.946004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:54.952864 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:54.953357 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:54.954169 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:54.954638 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:55.086729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:55.094376 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-97b3542c-558b-48fd-a491-d3c1387723ee tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.152949 Jul 24 02:39:55.094946 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3641/7390] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:54 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:39:56.111277 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:56.111889 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:56.120022 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:56.120924 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:56.121239 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:56.121694 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:56.254840 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:56.262798 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-64e6dcc3-106e-48a7-a4cf-dc4063d50be6 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.155450 Jul 24 02:39:56.263385 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3750/7391] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:56 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:39:57.280385 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:57.281024 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:57.288002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:57.288466 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:57.289244 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:57.289714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:57.419783 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:57.427375 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a83d0507-48f4-47b5-b58d-8c7ae098c7c1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.150900 Jul 24 02:39:57.427944 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3642/7392] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:57 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:39:58.444912 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:58.445560 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:58.452506 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:58.452956 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:58.453744 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:58.454186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:58.588722 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:58.596174 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e4ccdc5b-22d5-4004-a297-56969e629263 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.155558 Jul 24 02:39:58.596743 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3751/7393] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:58 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:39:59.614321 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:39:59.614958 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:39:59.621985 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:59.622451 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:59.624259 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:39:59.624709 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:39:59.757226 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:39:59.765020 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5322532a-431a-4f72-bdad-1e13ac2994b1 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.155244 Jul 24 02:39:59.765588 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3643/7394] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:39:59 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:00.783861 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:00.784543 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:00.792166 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:00.792636 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:00.793383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:00.793837 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:00.931456 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:00.938933 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d225e761-3589-4b8d-aeb4-24b2ca27debf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.159013 Jul 24 02:40:00.939499 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3752/7395] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:00 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:01.957482 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:01.958841 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:01.965733 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:01.966213 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:01.967010 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:01.967467 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:02.100491 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:02.108074 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-51053be5-8fe8-452a-ae19-cbf2e2dc511b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.155589 Jul 24 02:40:02.108642 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3644/7396] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:01 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:03.125752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:03.126463 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:03.134365 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:03.134811 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:03.135568 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:03.136001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:03.268235 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:03.276508 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d305c9a3-501f-4fa0-a19c-05c8ef5bcb8f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.154716 Jul 24 02:40:03.277088 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3753/7397] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:03 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:04.293659 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:04.294351 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:04.301085 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:04.301550 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:04.302363 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:04.302815 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:04.438734 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:04.446579 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1997d589-963f-4689-853e-35a34d31290f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.156702 Jul 24 02:40:04.447151 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3645/7398] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:04 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:05.463437 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:05.464117 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:05.471342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:05.471800 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:05.473097 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:05.473538 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:05.610465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:05.619065 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-99f6b097-7bcd-46d0-a4d2-766b8f7df8e5 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.159640 Jul 24 02:40:05.619654 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3754/7399] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:05 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:06.637818 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:06.638457 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:06.646397 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:06.646868 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:06.647656 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:06.648114 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:06.793151 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:06.801047 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4c75a665-3950-4371-9068-8dd55bb67bf8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1509 microversion: 2.1 time: 0.166797 Jul 24 02:40:06.801544 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3646/7400] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:06 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:06.817481 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-4b3e22fc-9af5-4def-ac02-43d0c7f15eb7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:40:06.818118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-4b3e22fc-9af5-4def-ac02-43d0c7f15eb7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:06.824993 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b3e22fc-9af5-4def-ac02-43d0c7f15eb7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:06.825446 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b3e22fc-9af5-4def-ac02-43d0c7f15eb7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:06.826248 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b3e22fc-9af5-4def-ac02-43d0c7f15eb7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:06.826686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-4b3e22fc-9af5-4def-ac02-43d0c7f15eb7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:06.901760 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-4b3e22fc-9af5-4def-ac02-43d0c7f15eb7 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "POST /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179/action" status: 202 len: 0 microversion: 2.1 time: 0.088508 Jul 24 02:40:06.902368 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3755/7401] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:40:06 2022] POST /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:40:06.910557 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:06.911158 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:06.917325 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:06.918100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:06.918898 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:06.919356 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:07.113690 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:07.128061 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-382495a9-b23a-46bf-8aa6-cd840e0de2f2 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1517 microversion: 2.1 time: 0.221374 Jul 24 02:40:07.129036 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3647/7402] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:06 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:08.147304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:08.148176 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:08.154731 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:08.155274 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:08.156127 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:08.156566 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:08.294387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:08.302917 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46a0dcc5-b9ea-48eb-85ca-fdef1a9c4565 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1519 microversion: 2.1 time: 0.160777 Jul 24 02:40:08.303843 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3756/7403] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:08 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:08.432401 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-bde97051-b789-4551-931f-07d4ebdf1d8e req-796f549d-371a-47d9-aed8-33eeccbc20e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "name": "network-vif-unplugged", "status": "completed", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:40:08.442590 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bde97051-b789-4551-931f-07d4ebdf1d8e req-796f549d-371a-47d9-aed8-33eeccbc20e1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:08.443342 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-bde97051-b789-4551-931f-07d4ebdf1d8e req-796f549d-371a-47d9-aed8-33eeccbc20e1 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:08.455876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.compute.server_external_events [req-bde97051-b789-4551-931f-07d4ebdf1d8e req-796f549d-371a-47d9-aed8-33eeccbc20e1 service nova] Unable to find a host for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179. Dropping event network-vif-unplugged {{(pid=119562) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 24 02:40:08.457753 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-bde97051-b789-4551-931f-07d4ebdf1d8e req-796f549d-371a-47d9-aed8-33eeccbc20e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.088684 Jul 24 02:40:08.458464 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3648/7404] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 24 02:40:09.320760 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:09.321387 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:09.328394 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:09.328852 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:09.329628 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:09.330093 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:09.469044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:09.477457 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b4a8f323-8a3a-4d23-a639-621b4392a508 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1519 microversion: 2.1 time: 0.160663 Jul 24 02:40:09.478074 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3757/7405] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:09 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:10.495228 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:10.495782 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:10.503171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:10.504552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:10.505352 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:10.505852 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:10.639305 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:10.647269 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7b3c53d2-3597-4d14-b663-9aa3424bc422 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1519 microversion: 2.1 time: 0.156218 Jul 24 02:40:10.647842 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3649/7406] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:10 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:11.665075 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:11.665604 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:11.672662 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:11.673122 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:11.673923 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:11.674368 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:11.811465 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:11.821277 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a6ff22cd-c95c-4f7f-897d-2b2fc82f9be4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1519 microversion: 2.1 time: 0.160166 Jul 24 02:40:11.822098 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3758/7407] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:11 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:12.838877 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:12.839594 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:12.846734 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:12.848361 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:12.849168 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:12.850100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:13.092163 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:13.099812 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-472e5994-69c1-4479-a6f5-7d0f5f778caf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.264802 Jul 24 02:40:13.100392 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3650/7408] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:12 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:13.943355 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-32c5f861-1c8c-4924-a439-e265d500f1a8 req-09286f63-f8cf-4f33-bd83-4f5be70a18c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:40:13.952721 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-32c5f861-1c8c-4924-a439-e265d500f1a8 req-09286f63-f8cf-4f33-bd83-4f5be70a18c3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:13.953434 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-32c5f861-1c8c-4924-a439-e265d500f1a8 req-09286f63-f8cf-4f33-bd83-4f5be70a18c3 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:13.966098 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-32c5f861-1c8c-4924-a439-e265d500f1a8 req-09286f63-f8cf-4f33-bd83-4f5be70a18c3 service nova] Creating event network-changed:3d5a2218-c8ef-4850-9149-0cf895b392d6 for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 on n-h1-master-1 Jul 24 02:40:13.972792 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-32c5f861-1c8c-4924-a439-e265d500f1a8 req-09286f63-f8cf-4f33-bd83-4f5be70a18c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032398 Jul 24 02:40:13.974108 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3759/7409] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:40:14.117642 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:14.118308 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:14.125440 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:14.125933 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:14.126727 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:14.127175 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:14.325450 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:14.333195 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4ef4f8d7-0538-4c6f-a0c8-e5c941d6cdd4 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.220628 Jul 24 02:40:14.333789 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3651/7410] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:14 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:15.351530 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:15.352344 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:15.358572 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:15.359020 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:15.359782 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:15.360217 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:15.527470 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:15.535697 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-2748b224-850b-49a8-b551-ae86b68fdc16 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.189693 Jul 24 02:40:15.536274 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3760/7411] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:15 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:16.552371 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:16.552998 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:16.559872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:16.560333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:16.561108 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:16.561555 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:16.690039 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:16.698123 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4444cc85-8db6-43a7-bcc5-f8e7c77ce640 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.149701 Jul 24 02:40:16.698690 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3652/7412] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:16 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:17.716262 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:17.716772 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:17.724143 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:17.724586 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:17.725383 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:17.725864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:17.860304 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:17.868512 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-eaa1388e-bfd8-49d3-afb0-1e2892775dbe tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.156300 Jul 24 02:40:17.869090 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3761/7413] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:17 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:18.885722 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:18.886387 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:18.893346 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:18.894880 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:18.895750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:18.896204 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:19.029318 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:19.037063 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-2166e148-f0de-4e48-ac1c-ea5f42ae626e tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.155365 Jul 24 02:40:19.037655 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3653/7414] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:18 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:20.054490 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:20.055115 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:20.062180 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:20.062633 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:20.063419 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:20.063864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:20.209078 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:20.216844 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-83ae3a5f-52ff-4337-853b-382859a31700 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.166874 Jul 24 02:40:20.217418 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3762/7415] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:20 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:21.234631 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:21.235283 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:21.242787 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:21.243251 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:21.244024 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:21.244474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:21.248355 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:40:21.376507 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:21.384404 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-bbf87848-6051-416f-922a-7bc3699a9c86 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.153775 Jul 24 02:40:21.384972 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3654/7416] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:21 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:22.400780 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:22.401318 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:22.404114 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=33 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:40:22.410404 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:22.410856 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:22.411617 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:22.412052 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:22.415953 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:40:22.543348 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:22.551507 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-f8c15889-2fb6-4b2e-aa1e-06bfc06308cc tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.154740 Jul 24 02:40:22.552068 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3763/7417] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:22 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:23.569444 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:23.570126 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:23.572104 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=33 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:40:23.577289 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:23.577772 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:23.578549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:23.578999 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:23.711985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:23.719568 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-01b34bfe-42cf-4bd0-88e6-9a74ac6e20fb tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.154602 Jul 24 02:40:23.720140 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3655/7418] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:23 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:40:24.736505 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:24.737118 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:24.744319 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:24.744770 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:24.745534 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:24.745997 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:24.816618 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-62c84d21-0cf6-4b93-8254-ecc673746549 req-cd1cdf46-99f6-41a0-8780-48ae3d2eb9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "name": "network-vif-plugged", "status": "completed", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:40:24.838462 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-62c84d21-0cf6-4b93-8254-ecc673746549 req-cd1cdf46-99f6-41a0-8780-48ae3d2eb9ee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:24.839062 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-62c84d21-0cf6-4b93-8254-ecc673746549 req-cd1cdf46-99f6-41a0-8780-48ae3d2eb9ee service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:24.851298 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-62c84d21-0cf6-4b93-8254-ecc673746549 req-cd1cdf46-99f6-41a0-8780-48ae3d2eb9ee service nova] Creating event network-vif-plugged:3d5a2218-c8ef-4850-9149-0cf895b392d6 for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 on n-h1-master-1 Jul 24 02:40:24.857152 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-62c84d21-0cf6-4b93-8254-ecc673746549 req-cd1cdf46-99f6-41a0-8780-48ae3d2eb9ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045403 Jul 24 02:40:24.858221 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3656/7419] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:40:24.893317 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:24.901771 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8f97292f-3d61-40ef-b14c-df8e265e0697 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.169184 Jul 24 02:40:24.902356 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3764/7420] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:24 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:25.920835 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:25.921558 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:25.928927 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:25.929390 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:25.930260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:25.930706 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:26.071095 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:26.078738 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a37c7d18-dcf6-41f4-a80a-2efd58d50b01 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1575 microversion: 2.1 time: 0.162218 Jul 24 02:40:26.079519 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3657/7421] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:25 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:40:27.097404 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:40:27.097985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:40:27.104706 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:27.105155 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:27.105945 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:40:27.106382 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:40:27.243558 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:40:27.251162 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-5431eb2f-f3e4-41ef-b49e-e994565fd02c tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1562 microversion: 2.1 time: 0.158180 Jul 24 02:40:27.251737 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3765/7422] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:40:27 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:41:43.889973 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=5 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:43.891198 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=18 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:43.894266 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3015b621-3135-4ac2-b178-d94eda876fe5 req-128043eb-c5db-4db1-bf88-6e0a6b48dd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:41:43.895705 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:43.896335 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:43.903183 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=5 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:43.903685 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:43.903997 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=17 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:43.904937 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:43.905860 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:43.906509 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:43.906625 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3015b621-3135-4ac2-b178-d94eda876fe5 req-128043eb-c5db-4db1-bf88-6e0a6b48dd73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:43.907065 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3015b621-3135-4ac2-b178-d94eda876fe5 req-128043eb-c5db-4db1-bf88-6e0a6b48dd73 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:43.921720 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3015b621-3135-4ac2-b178-d94eda876fe5 req-128043eb-c5db-4db1-bf88-6e0a6b48dd73 service nova] Creating event network-changed:3d5a2218-c8ef-4850-9149-0cf895b392d6 for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 on n-h1-master-1 Jul 24 02:41:43.927084 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3015b621-3135-4ac2-b178-d94eda876fe5 req-128043eb-c5db-4db1-bf88-6e0a6b48dd73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038134 Jul 24 02:41:43.928041 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3766/7423] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:41:43.933416 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Going to try to terminate instance {{(pid=119562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:41:44.022592 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-70ae7e44-e051-4375-a85c-7ad574c08507 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 204 len: 0 microversion: 2.1 time: 0.135321 Jul 24 02:41:44.025753 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3658/7424] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:41:43 2022] DELETE /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:41:44.035713 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:44.036758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:44.045189 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:44.045943 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:44.046981 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:44.047724 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:44.204449 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:41:44.212304 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-8a096f82-43d9-4e0d-b9bc-40c2155f4bd9 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.182703 Jul 24 02:41:44.213104 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3767/7425] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:41:44 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:41:45.230950 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:45.231934 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:45.240846 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:45.241318 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:45.242142 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:45.242598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:45.379188 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:41:45.386873 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-eb9e2d88-fe22-45c0-8cfe-5f5ca4179ae8 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1568 microversion: 2.1 time: 0.160212 Jul 24 02:41:45.387437 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3659/7426] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:41:45 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:41:46.030507 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-218d7f20-42f9-4b56-9953-8827c259bb1f req-65dea279-658d-4890-b86a-4cd5931c1881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5e6115-4880-47c2-9a6f-1cafb429f179", "name": "network-vif-deleted", "tag": "3d5a2218-c8ef-4850-9149-0cf895b392d6"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:41:46.042342 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-218d7f20-42f9-4b56-9953-8827c259bb1f req-65dea279-658d-4890-b86a-4cd5931c1881 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:46.043038 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-218d7f20-42f9-4b56-9953-8827c259bb1f req-65dea279-658d-4890-b86a-4cd5931c1881 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:46.055387 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-218d7f20-42f9-4b56-9953-8827c259bb1f req-65dea279-658d-4890-b86a-4cd5931c1881 service nova] Creating event network-vif-deleted:3d5a2218-c8ef-4850-9149-0cf895b392d6 for instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 on n-h1-master-1 Jul 24 02:41:46.061041 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-218d7f20-42f9-4b56-9953-8827c259bb1f req-65dea279-658d-4890-b86a-4cd5931c1881 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034946 Jul 24 02:41:46.061898 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3768/7427] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:41:46.405797 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:46.406861 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:46.415127 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:46.416001 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:46.416797 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:46.417248 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:46.496417 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:41:46.505074 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-af8b220f-0fa7-4cc4-80bf-85f709671daf tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1219 microversion: 2.1 time: 0.104268 Jul 24 02:41:46.505586 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3660/7428] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:41:46 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:41:47.524298 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:47.524959 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:47.531550 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:47.532012 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:47.532799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:47.533245 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:47.597402 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:41:47.605165 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-78bf9734-39c6-4b50-9f46-38ff20c954b3 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1219 microversion: 2.1 time: 0.086072 Jul 24 02:41:47.605763 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3769/7429] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:41:47 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:41:48.623357 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:48.623985 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:48.631218 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:48.631684 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:48.632459 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:48.632907 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:48.695177 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:41:48.703576 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b1427a20-834d-40c0-9f59-a55f72383c76 tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1219 microversion: 2.1 time: 0.084718 Jul 24 02:41:48.704247 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3661/7430] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:41:48 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:41:49.720396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:49.720924 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:49.727832 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:49.728281 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:49.729044 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:49.729481 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:49.795158 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73ce3dd61734afe9f5b876975b6bcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645e564a038c4ecfb26eac5a0cceb11b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:41:49.802805 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-bb848e4c-75a0-40c8-9b37-55a4c4e6108b tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 200 len: 1219 microversion: 2.1 time: 0.087016 Jul 24 02:41:49.803380 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3770/7431] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:41:49 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:41:50.819925 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:50.820486 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] [instance: 1f5e6115-4880-47c2-9a6f-1cafb429f179] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:41:50.828304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:50.828803 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:50.829626 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:41:50.830133 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:41:50.844115 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] HTTP exception thrown: Instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 could not be found. Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Request method failure captured: Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 HTTP/1.1 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3K8blt9AzEYY9-DdTfIzRC-WvoQFh5i6KqjME3FfLkXTpVcd224A8UYxOkd-Yh4ex459N9Ag5oWBcjeMC6biPUUlxy0ZMeKa1PE3S77O6RpdbuvjXIYphjDgfqD3CkbEWh6n6KAYGd76-KRSvR97XqLTDBZKBTvisoWxjX0gdRFFiQw Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: 645e564a038c4ecfb26eac5a0cceb11b Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestShelveInstance-1319108673 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/645e564a038c4ecfb26eac5a0cceb11b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645e564a038c4ecfb26eac5a0cceb11b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_645e564a038c4ecfb26eac5a0cceb11b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/645e564a038c4ecfb26eac5a0cceb11b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestShelveInstance-1319108673 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: 645e564a038c4ecfb26eac5a0cceb11b Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestShelveInstance-1319108673 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestShelveInstance-1319108673-project Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: c73ce3dd61734afe9f5b876975b6bcc9 Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestShelveInstance-1319108673-project Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: exception: Instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 could not be found. Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': '1f5e6115-4880-47c2-9a6f-1cafb429f179'} Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 could not be found. Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 could not be found. Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:41:50.845827 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 could not be found. Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Returning 404 to user: Instance 1f5e6115-4880-47c2-9a6f-1cafb429f179 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-4158d94b-7643-4b1c-abc8-3ac9254f591d tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179" status: 404 len: 111 microversion: 2.1 time: 0.031499 Jul 24 02:41:50.850002 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3662/7432] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:41:50 2022] GET /compute/v2.1/servers/1f5e6115-4880-47c2-9a6f-1cafb429f179 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 24 02:41:51.012140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-6a16b326-8d9c-4657-b36d-1abae50be65f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] Calling method '.version_select at 0x7f05e9fda160>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:41:51.061134 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-6a16b326-8d9c-4657-b36d-1abae50be65f tempest-TestShelveInstance-1319108673 tempest-TestShelveInstance-1319108673-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1894884669" status: 202 len: 0 microversion: 2.1 time: 0.052887 Jul 24 02:41:51.061717 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3771/7433] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 02:41:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1894884669 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:42:08.508914 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:08.510593 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:08.752004 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-aec3592b-510d-4a01-a259-046c1978fb0b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Action: 'create', calling method: .version_select at 0x7f05eb3745e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1835032738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErr2wo7cywVQhEKVU9KDWgdHH5NpLX4g8VjoDIsSj9WhQi61n5Q7Hd6XCSDjKLGCH0+1wZj+LaeN6HxtHSjIfoBQlcb2+JE7wVlj/6/+YjFKGEy52HBuToWx9zkBGO9KQ=="}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:42:08.767737 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-aec3592b-510d-4a01-a259-046c1978fb0b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Getting quotas for project f2c291c486e64d78851ea5ea19f3cde8. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:42:08.773432 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-aec3592b-510d-4a01-a259-046c1978fb0b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Getting quotas for user 8f0012c044964dd2853db1c71fe62f36 and project f2c291c486e64d78851ea5ea19f3cde8. Resources: {'key_pairs'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:42:08.807571 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-aec3592b-510d-4a01-a259-046c1978fb0b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.303864 Jul 24 02:42:08.808180 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3663/7434] 10.222.0.27 () {60 vars in 1158 bytes} [Sun Jul 24 02:42:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:42:09.863303 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1603517544", "imageRef": "9fcc346b-5e09-42b6-9557-a6eb28d96f08", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1835032738", "security_groups": [{"name": "tempest-secgroup-smoke-2093608616"}], "networks": [{"uuid": "d9ef99de-d12d-4bb1-9f88-37bf64f5aab5"}]}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:42:09.871422 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=22 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:09.872177 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:09.969167 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.network.neutron [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] validate_networks() for [('d9ef99de-d12d-4bb1-9f88-37bf64f5aab5', None, None, None, None, None)] {{(pid=119561) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:42:10.366967 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Flavor limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:42:10.367396 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Image limits 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:42:10.367880 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Flavor pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:42:10.368289 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Image pref 0:0:0 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:42:10.368708 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.virt.hardware [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119561) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:42:10.378215 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:10.379372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:10.380181 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:10.380618 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:10.398887 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Getting quotas for project f2c291c486e64d78851ea5ea19f3cde8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:42:10.404228 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.quota [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Getting quotas for user 8f0012c044964dd2853db1c71fe62f36 and project f2c291c486e64d78851ea5ea19f3cde8. Resources: {'instances', 'ram', 'cores'} {{(pid=119561) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:42:10.416544 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Going to run 1 instances... {{(pid=119561) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:42:10.419229 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcc346b-5e09-42b6-9557-a6eb28d96f08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119561) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:42:10.466804 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-c7215995-0fbe-48fc-84a2-53889c3ca365 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.607545 Jul 24 02:42:10.472265 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3772/7435] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:42:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 24 02:42:10.477850 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-14ae0e39-b195-4b35-b75b-d11aa9fadc09 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:10.478699 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-14ae0e39-b195-4b35-b75b-d11aa9fadc09 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:10.542761 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-14ae0e39-b195-4b35-b75b-d11aa9fadc09 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:10.550026 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-14ae0e39-b195-4b35-b75b-d11aa9fadc09 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1249 microversion: 2.1 time: 0.076454 Jul 24 02:42:10.550598 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3664/7436] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:10 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1249 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:11.570976 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:11.572590 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:11.582265 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:11.583121 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:11.584186 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:11.584881 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:11.666445 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:11.676693 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a89ea744-2e11-4228-8546-5f0644468d6a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1319 microversion: 2.1 time: 0.112130 Jul 24 02:42:11.686523 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3773/7437] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:11 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:12.694760 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:12.695408 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:12.706264 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:12.706739 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:12.707552 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:12.708005 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:12.855233 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:12.863181 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5449a180-44f8-43ad-ab5b-758827353bc8 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1375 microversion: 2.1 time: 0.172534 Jul 24 02:42:12.863763 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3665/7438] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:12 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:13.394373 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-85fbab2d-a2f6-41f6-a305-1587c8cd5a8b req-815a3b5c-a845-449b-9142-fad1513fc12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e3e1e3-9666-470f-99f3-e168573ae5a5", "tag": "1a65be4a-d78f-402c-8d48-701f67568aa0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:42:13.403473 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-85fbab2d-a2f6-41f6-a305-1587c8cd5a8b req-815a3b5c-a845-449b-9142-fad1513fc12e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:13.404078 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-85fbab2d-a2f6-41f6-a305-1587c8cd5a8b req-815a3b5c-a845-449b-9142-fad1513fc12e service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:13.419886 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-85fbab2d-a2f6-41f6-a305-1587c8cd5a8b req-815a3b5c-a845-449b-9142-fad1513fc12e service nova] Creating event network-changed:1a65be4a-d78f-402c-8d48-701f67568aa0 for instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 on n-h2-master-1 Jul 24 02:42:13.425550 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-85fbab2d-a2f6-41f6-a305-1587c8cd5a8b req-815a3b5c-a845-449b-9142-fad1513fc12e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112749 Jul 24 02:42:13.426860 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3774/7439] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:42:13.880713 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:13.881344 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:13.889256 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:13.889750 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:13.890549 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:13.891002 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:14.125655 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:14.133417 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-1ff90267-5158-4b54-be34-a6dca30fead3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1375 microversion: 2.1 time: 0.256864 Jul 24 02:42:14.134019 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3666/7440] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:13 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:15.152347 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:15.153100 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:15.159717 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:15.160165 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:15.160933 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:15.161366 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:15.342732 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:15.350118 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-3de4d07a-fa90-4306-a069-0b2f2d550f3a tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1375 microversion: 2.1 time: 0.202879 Jul 24 02:42:15.350683 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3775/7441] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:15 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:16.367496 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:16.368122 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:16.375173 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:16.375637 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:16.376413 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:16.376863 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:16.508021 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:16.515758 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-485afc34-1a41-4263-b363-c598a70540f6 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1375 microversion: 2.1 time: 0.152093 Jul 24 02:42:16.516538 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3667/7442] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:16 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:17.533955 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:17.534577 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:17.541046 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:17.541509 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:17.542344 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:17.542799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:17.690711 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:17.698349 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46b7435a-a24b-4e79-b347-cf0699dcb7f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1375 microversion: 2.1 time: 0.169758 Jul 24 02:42:17.698927 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3776/7443] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:17 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:18.715550 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:18.716692 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:18.723759 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:18.724232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:18.725020 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:18.725474 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:18.862464 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:18.869877 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ef211a96-2981-466c-9cdf-0661e50dc6f3 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1375 microversion: 2.1 time: 0.158224 Jul 24 02:42:18.870473 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3668/7444] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:18 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:19.163287 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-1fdbd887-c641-493b-a10a-0da256e3cf73 req-bb726059-03fc-4782-8442-83ca72d0c899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e3e1e3-9666-470f-99f3-e168573ae5a5", "name": "network-vif-plugged", "status": "completed", "tag": "1a65be4a-d78f-402c-8d48-701f67568aa0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:42:19.172387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1fdbd887-c641-493b-a10a-0da256e3cf73 req-bb726059-03fc-4782-8442-83ca72d0c899 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:19.172838 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-1fdbd887-c641-493b-a10a-0da256e3cf73 req-bb726059-03fc-4782-8442-83ca72d0c899 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:19.184490 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-1fdbd887-c641-493b-a10a-0da256e3cf73 req-bb726059-03fc-4782-8442-83ca72d0c899 service nova] Creating event network-vif-plugged:1a65be4a-d78f-402c-8d48-701f67568aa0 for instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 on n-h2-master-1 Jul 24 02:42:19.189556 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-1fdbd887-c641-493b-a10a-0da256e3cf73 req-bb726059-03fc-4782-8442-83ca72d0c899 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030023 Jul 24 02:42:19.190192 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3777/7445] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:42:19.888034 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:19.888606 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:19.895598 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:19.896067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:19.896853 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:19.897304 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:20.036476 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:20.044452 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-6298d056-787e-4b40-ad77-8a9171467257 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1375 microversion: 2.1 time: 0.160786 Jul 24 02:42:20.045149 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3669/7446] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:19 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:21.060163 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:21.060854 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=6 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:21.064940 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:21.065654 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:21.072796 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:21.073250 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:21.074071 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:21.074520 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:21.216475 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:21.224109 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df599560-9b1a-4f58-82fa-6787eba5bf0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1559 microversion: 2.1 time: 0.166353 Jul 24 02:42:21.224690 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3778/7447] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:21 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:21.241641 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:42:21.242301 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:42:21.244189 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:21.251583 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:21.252054 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:21.252847 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:21.253302 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:21.390087 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:42:21.397590 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-9670eac2-d179-4814-b025-ff39dbfb764e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1559 microversion: 2.1 time: 0.159853 Jul 24 02:42:21.398200 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3670/7448] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:42:21 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:42:23.362985 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-6e193b48-3a74-4818-820f-2a354e72d480 req-192c7695-c655-416f-be8b-57a8063a8082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e3e1e3-9666-470f-99f3-e168573ae5a5", "tag": "1a65be4a-d78f-402c-8d48-701f67568aa0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:42:23.373292 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e193b48-3a74-4818-820f-2a354e72d480 req-192c7695-c655-416f-be8b-57a8063a8082 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:42:23.373870 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-6e193b48-3a74-4818-820f-2a354e72d480 req-192c7695-c655-416f-be8b-57a8063a8082 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:42:23.385509 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-6e193b48-3a74-4818-820f-2a354e72d480 req-192c7695-c655-416f-be8b-57a8063a8082 service nova] Creating event network-changed:1a65be4a-d78f-402c-8d48-701f67568aa0 for instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 on n-h2-master-1 Jul 24 02:42:23.390888 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-6e193b48-3a74-4818-820f-2a354e72d480 req-192c7695-c655-416f-be8b-57a8063a8082 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031689 Jul 24 02:42:23.391489 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3779/7449] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:43:12.371187 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:43:12.371665 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:44:50.474114 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 24 02:44:50.475186 n-d-master-1 devstack@n-api.service[119562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 24 02:44:50.475708 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:44:50.476515 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=36 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:44:50.480520 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-26fa1b45-14bc-45e6-a6d5-3162a3ea88d7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1941108134"}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:44:50.481604 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-26fa1b45-14bc-45e6-a6d5-3162a3ea88d7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:44:50.489584 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26fa1b45-14bc-45e6-a6d5-3162a3ea88d7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:44:50.490067 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26fa1b45-14bc-45e6-a6d5-3162a3ea88d7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:44:50.490850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26fa1b45-14bc-45e6-a6d5-3162a3ea88d7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:44:50.491298 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-26fa1b45-14bc-45e6-a6d5-3162a3ea88d7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:44:50.762830 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-26fa1b45-14bc-45e6-a6d5-3162a3ea88d7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "POST /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5/action" status: 202 len: 0 microversion: 2.1 time: 0.290371 Jul 24 02:44:50.763392 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3671/7450] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:44:50 2022] POST /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 02:44:52.284699 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:44:52.285387 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:44:52.739351 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:44:52.739913 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:44:52.771195 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:44:52.771345 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:44:57.834966 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:44:57.835811 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c3f81d4f-5c47-4b48-92a8-e4559415656f] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:44:57.836419 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:44:57.837740 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=32 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:44:57.842596 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-207bcec2-0980-48ae-a5ae-6c49ee3c1c92 req-7ce8eb87-68a3-46f1-9ed5-97f78411004b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e3e1e3-9666-470f-99f3-e168573ae5a5", "name": "network-vif-plugged", "status": "completed", "tag": "1a65be4a-d78f-402c-8d48-701f67568aa0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:44:57.854235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-207bcec2-0980-48ae-a5ae-6c49ee3c1c92 req-7ce8eb87-68a3-46f1-9ed5-97f78411004b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:44:57.854686 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-207bcec2-0980-48ae-a5ae-6c49ee3c1c92 req-7ce8eb87-68a3-46f1-9ed5-97f78411004b service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:44:57.865330 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-207bcec2-0980-48ae-a5ae-6c49ee3c1c92 req-7ce8eb87-68a3-46f1-9ed5-97f78411004b service nova] Creating event network-vif-plugged:1a65be4a-d78f-402c-8d48-701f67568aa0 for instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 on n-h2-master-1 Jul 24 02:44:57.868941 n-d-master-1 devstack@n-api.service[119561]: ERROR oslo.messaging._drivers.impl_rabbit [req-207bcec2-0980-48ae-a5ae-6c49ee3c1c92 req-7ce8eb87-68a3-46f1-9ed5-97f78411004b service nova] [665e5d04-c89c-46dd-81e2-ad6644ee4f78] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 24 02:44:58.843278 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6d8e3e8-5601-40c0-86d8-24d576f3e287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39194. Jul 24 02:44:58.844798 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] [c3f81d4f-5c47-4b48-92a8-e4559415656f] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39196. Jul 24 02:44:58.875730 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [req-207bcec2-0980-48ae-a5ae-6c49ee3c1c92 req-7ce8eb87-68a3-46f1-9ed5-97f78411004b service nova] [665e5d04-c89c-46dd-81e2-ad6644ee4f78] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39198. Jul 24 02:44:58.878989 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-207bcec2-0980-48ae-a5ae-6c49ee3c1c92 req-7ce8eb87-68a3-46f1-9ed5-97f78411004b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.045803 Jul 24 02:44:58.879677 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3780/7451] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:45:09.402656 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:09.403523 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:09.408484 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-590755351", "imageRef": "f2603784-efa2-4f3b-9a5b-437698869721", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1835032738", "security_groups": [{"name": "tempest-secgroup-smoke-2093608616"}], "networks": [{"uuid": "d9ef99de-d12d-4bb1-9f88-37bf64f5aab5"}]}} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:45:09.432388 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d1c1e10-817a-408c-b7b7-786336dec10b] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39308. Jul 24 02:45:09.433169 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] [806d344e-d67c-4086-8c4b-3ebfa241de23] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39306. Jul 24 02:45:09.521773 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.network.neutron [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] validate_networks() for [('d9ef99de-d12d-4bb1-9f88-37bf64f5aab5', None, None, None, None, None)] {{(pid=119562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 24 02:45:09.950643 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Flavor limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 24 02:45:09.951082 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Image limits 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 24 02:45:09.951572 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Flavor pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 24 02:45:09.952049 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Image pref 0:0:0 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 24 02:45:09.952477 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.virt.hardware [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 24 02:45:09.961404 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:09.961899 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:09.962708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:09.963159 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:09.979649 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Getting quotas for project f2c291c486e64d78851ea5ea19f3cde8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 24 02:45:09.985590 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.quota [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Getting quotas for user 8f0012c044964dd2853db1c71fe62f36 and project f2c291c486e64d78851ea5ea19f3cde8. Resources: {'instances', 'ram', 'cores'} {{(pid=119562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 24 02:45:09.997809 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Going to run 1 instances... {{(pid=119562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 24 02:45:10.001048 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2603784-efa2-4f3b-9a5b-437698869721',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 24 02:45:10.047805 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b629f63d-47a6-44bc-8eb2-4eb11ec57323 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.647003 Jul 24 02:45:10.048457 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3672/7452] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 02:45:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 24 02:45:10.056521 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:10.057379 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:10.062529 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-a5ab48f8-1e79-4663-a30e-95baea7f8b73 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:10.063234 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-a5ab48f8-1e79-4663-a30e-95baea7f8b73 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:10.125119 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-a5ab48f8-1e79-4663-a30e-95baea7f8b73 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:10.132441 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-a5ab48f8-1e79-4663-a30e-95baea7f8b73 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1248 microversion: 2.1 time: 0.077647 Jul 24 02:45:10.133023 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3781/7453] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:10 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:11.149973 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:11.150613 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:11.159214 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:11.159687 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:11.160491 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:11.160948 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:11.236987 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:11.246490 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-a0737767-891d-4362-a249-7f251d3425ce tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1306 microversion: 2.1 time: 0.100426 Jul 24 02:45:11.247088 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3673/7454] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:11 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:12.266153 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:12.270358 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:12.282877 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:12.288567 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:12.297187 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:12.297985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:12.489065 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:12.498073 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-47d7ada1-49b0-4c05-9351-254938e87404 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.237013 Jul 24 02:45:12.509489 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3782/7455] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:12 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:13.517411 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:13.519209 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:13.527056 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:13.527820 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:13.529337 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:13.530872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:13.678916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:13.687638 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e476c5ce-3e04-43f9-b945-b7445915b8be tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.175028 Jul 24 02:45:13.688238 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3674/7456] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:13 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:13.976588 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-91a504e6-116f-4b35-a8ef-9d398709c82e req-c2730831-ff51-4213-84a5-10bee76c7664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e3e1e3-9666-470f-99f3-e168573ae5a5", "name": "network-vif-unplugged", "status": "completed", "tag": "1a65be4a-d78f-402c-8d48-701f67568aa0"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:45:13.991480 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-91a504e6-116f-4b35-a8ef-9d398709c82e req-c2730831-ff51-4213-84a5-10bee76c7664 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:13.993064 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-91a504e6-116f-4b35-a8ef-9d398709c82e req-c2730831-ff51-4213-84a5-10bee76c7664 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:14.008155 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-91a504e6-116f-4b35-a8ef-9d398709c82e req-c2730831-ff51-4213-84a5-10bee76c7664 service nova] Creating event network-vif-unplugged:1a65be4a-d78f-402c-8d48-701f67568aa0 for instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 on n-h2-master-1 Jul 24 02:45:14.014243 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-91a504e6-116f-4b35-a8ef-9d398709c82e req-c2730831-ff51-4213-84a5-10bee76c7664 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114503 Jul 24 02:45:14.015577 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3783/7457] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:45:14.706436 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:14.707102 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:14.714341 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:14.714828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:14.715713 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:14.716176 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:14.865179 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:14.874409 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-c8b9e58f-4a8f-4ce7-bb7e-efc1ebeaaa2f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.172266 Jul 24 02:45:14.875904 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3675/7458] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:14 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:15.894517 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:15.895548 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:15.903040 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:15.903885 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:15.904693 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:15.905407 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:16.062495 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:16.070193 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-91c0025c-9320-463a-bb4f-4cc8ffa15f5e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.181400 Jul 24 02:45:16.070765 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3784/7459] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:15 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:17.091920 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:17.094046 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:17.102260 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:17.103232 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:17.104587 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:17.105616 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:17.253909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:17.263859 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-ddb8ff79-ddcc-49a0-b977-5badb4cfae6f tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.176796 Jul 24 02:45:17.266352 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3676/7460] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:17 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:18.283157 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:18.284048 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:18.292556 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:18.293007 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:18.293895 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:18.294333 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:18.432527 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:18.440577 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-77c40d00-27db-4926-98e8-bc02a3029684 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.161621 Jul 24 02:45:18.441146 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3785/7461] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:18 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:19.461429 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:19.469206 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-8521a6af-0a19-4803-b852-8da7a22d228d req-a08d3fae-1b46-4d0b-8e0d-f295ae7755ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7e52c6-4ba3-4fe5-9263-b02e26b72dc7", "tag": "7ac1e61f-01e2-4d7f-82cb-7f206e42d656"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:45:19.471336 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:19.504237 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:19.504714 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:19.505827 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:19.508539 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8521a6af-0a19-4803-b852-8da7a22d228d req-a08d3fae-1b46-4d0b-8e0d-f295ae7755ea service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:19.508985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-8521a6af-0a19-4803-b852-8da7a22d228d req-a08d3fae-1b46-4d0b-8e0d-f295ae7755ea service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:19.509708 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:19.527787 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-8521a6af-0a19-4803-b852-8da7a22d228d req-a08d3fae-1b46-4d0b-8e0d-f295ae7755ea service nova] Creating event network-changed:7ac1e61f-01e2-4d7f-82cb-7f206e42d656 for instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 on n-h1-master-1 Jul 24 02:45:19.543433 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-8521a6af-0a19-4803-b852-8da7a22d228d req-a08d3fae-1b46-4d0b-8e0d-f295ae7755ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079500 Jul 24 02:45:19.544042 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3786/7462] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:45:19.677729 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:19.685345 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-b5fe6b6d-5d8d-475e-885b-9326b0a653b5 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.229707 Jul 24 02:45:19.688527 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3677/7463] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:19 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:20.704044 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:20.704748 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:20.707245 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell0:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:20.713864 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:20.714316 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:20.715095 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:20.715527 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:20.859478 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:20.867599 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-552cdfc7-1fbf-450a-8bd2-497f65888271 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.168231 Jul 24 02:45:20.868188 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3787/7464] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:20 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:21.887909 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:21.888583 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:21.890914 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=2 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:21.891634 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell0:SELECT=6 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:21.899828 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:21.901091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:21.901091 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:21.901554 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:22.052916 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:22.060385 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-e31bbbe4-eae7-4795-961c-eb911f7b8c9e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.177015 Jul 24 02:45:22.061212 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3678/7465] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:21 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:23.078550 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:23.079171 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:23.086258 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:23.086719 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:23.087503 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:23.087948 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:23.221283 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:23.228766 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-20ac1892-26fd-4f56-abbc-d8bf1b2754f7 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.154847 Jul 24 02:45:23.229343 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3788/7466] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:23 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:24.246964 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:24.247492 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:24.255445 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:24.255968 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:24.256744 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:24.257221 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:24.360808 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [req-3c369aff-51a9-4be4-86cb-e49935016471 req-5386f443-3dc2-4263-9a48-47d50aa4e8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7e52c6-4ba3-4fe5-9263-b02e26b72dc7", "name": "network-vif-plugged", "status": "completed", "tag": "7ac1e61f-01e2-4d7f-82cb-7f206e42d656"}]} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:45:24.373377 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3c369aff-51a9-4be4-86cb-e49935016471 req-5386f443-3dc2-4263-9a48-47d50aa4e8fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:24.374413 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [req-3c369aff-51a9-4be4-86cb-e49935016471 req-5386f443-3dc2-4263-9a48-47d50aa4e8fb service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:24.393653 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.compute.server_external_events [req-3c369aff-51a9-4be4-86cb-e49935016471 req-5386f443-3dc2-4263-9a48-47d50aa4e8fb service nova] Creating event network-vif-plugged:7ac1e61f-01e2-4d7f-82cb-7f206e42d656 for instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 on n-h1-master-1 Jul 24 02:45:24.399238 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [req-3c369aff-51a9-4be4-86cb-e49935016471 req-5386f443-3dc2-4263-9a48-47d50aa4e8fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043841 Jul 24 02:45:24.400146 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3789/7467] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:45:24.413164 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:24.422173 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-f3b0cce4-fddd-4e1b-ab4e-a66157a39d16 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.179114 Jul 24 02:45:24.423321 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3679/7468] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:24 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:25.441480 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:25.442199 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:25.448552 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:25.449001 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:25.449799 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:25.450236 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:25.586751 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:25.594869 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-1a45f5e9-809d-43cf-9e7e-80ea86e919fa tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1374 microversion: 2.1 time: 0.158902 Jul 24 02:45:25.595563 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3790/7469] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:25 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:26.612471 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:26.613098 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:26.621100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:26.621625 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:26.622411 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:26.622886 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:26.756502 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:26.764070 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5803938a-b927-4193-9da2-eafaa3d65f4e tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1558 microversion: 2.1 time: 0.155519 Jul 24 02:45:26.764867 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3680/7470] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:26 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:26.780839 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:45:26.781473 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:45:26.788387 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:26.788862 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:26.789620 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:26.790077 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:26.926799 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:45:26.934405 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-79080f7a-3091-4c80-aca5-b52d5d8ed081 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1558 microversion: 2.1 time: 0.157994 Jul 24 02:45:26.934975 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3791/7471] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:45:26 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:45:28.815363 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d6caf8d2-42fc-4cfb-9cc1-8f5293a7a823 req-1bb369f7-cdca-44ea-91f0-1361d7483ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7e52c6-4ba3-4fe5-9263-b02e26b72dc7", "tag": "7ac1e61f-01e2-4d7f-82cb-7f206e42d656"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:45:28.824499 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d6caf8d2-42fc-4cfb-9cc1-8f5293a7a823 req-1bb369f7-cdca-44ea-91f0-1361d7483ec5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:45:28.825100 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d6caf8d2-42fc-4cfb-9cc1-8f5293a7a823 req-1bb369f7-cdca-44ea-91f0-1361d7483ec5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:45:28.837171 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d6caf8d2-42fc-4cfb-9cc1-8f5293a7a823 req-1bb369f7-cdca-44ea-91f0-1361d7483ec5 service nova] Creating event network-changed:7ac1e61f-01e2-4d7f-82cb-7f206e42d656 for instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 on n-h1-master-1 Jul 24 02:45:28.843677 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d6caf8d2-42fc-4cfb-9cc1-8f5293a7a823 req-1bb369f7-cdca-44ea-91f0-1361d7483ec5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031718 Jul 24 02:45:28.844270 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3681/7472] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:46:50.051259 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-d2ccd86d-7360-443b-84e2-11c15d49ec1b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-65203018"}} {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:46:50.052299 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-d2ccd86d-7360-443b-84e2-11c15d49ec1b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:46:50.054510 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=24 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:46:50.055176 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=48 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:46:50.062135 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2ccd86d-7360-443b-84e2-11c15d49ec1b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:46:50.062596 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2ccd86d-7360-443b-84e2-11c15d49ec1b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:46:50.063372 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2ccd86d-7360-443b-84e2-11c15d49ec1b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:46:50.063823 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-d2ccd86d-7360-443b-84e2-11c15d49ec1b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:46:50.339205 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-d2ccd86d-7360-443b-84e2-11c15d49ec1b tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "POST /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7/action" status: 202 len: 0 microversion: 2.1 time: 0.292700 Jul 24 02:46:50.339777 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3792/7473] 10.222.0.27 () {60 vars in 1277 bytes} [Sun Jul 24 02:46:50 2022] POST /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 24 02:46:56.739315 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:46:56.740618 n-d-master-1 devstack@n-api.service[119562]: DEBUG dbcounter [-] [119562] Writing DB stats nova_cell1:SELECT=52 {{(pid=119562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:46:56.745902 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-92f9da22-197f-401d-8f95-8b662e84a21b req-3f33e8db-0a51-4780-aa49-9848f1ae1d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7e52c6-4ba3-4fe5-9263-b02e26b72dc7", "name": "network-vif-plugged", "status": "completed", "tag": "7ac1e61f-01e2-4d7f-82cb-7f206e42d656"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:46:56.765615 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-92f9da22-197f-401d-8f95-8b662e84a21b req-3f33e8db-0a51-4780-aa49-9848f1ae1d57 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:46:56.766117 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-92f9da22-197f-401d-8f95-8b662e84a21b req-3f33e8db-0a51-4780-aa49-9848f1ae1d57 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:46:56.779945 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-92f9da22-197f-401d-8f95-8b662e84a21b req-3f33e8db-0a51-4780-aa49-9848f1ae1d57 service nova] Creating event network-vif-plugged:7ac1e61f-01e2-4d7f-82cb-7f206e42d656 for instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 on n-h1-master-1 Jul 24 02:46:56.786252 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-92f9da22-197f-401d-8f95-8b662e84a21b req-3f33e8db-0a51-4780-aa49-9848f1ae1d57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048761 Jul 24 02:46:56.786752 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3682/7474] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:47:04.237041 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_api:SELECT=2 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:47:04.238218 n-d-master-1 devstack@n-api.service[119561]: DEBUG dbcounter [-] [119561] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:47:04.240901 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-e5393145-ca48-4e14-ab1e-1746558aab17 req-a58492f5-73a6-40aa-92b1-3fb1c7362c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7e52c6-4ba3-4fe5-9263-b02e26b72dc7", "tag": "7ac1e61f-01e2-4d7f-82cb-7f206e42d656"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:47:04.243523 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:04.244510 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:04.251190 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e5393145-ca48-4e14-ab1e-1746558aab17 req-a58492f5-73a6-40aa-92b1-3fb1c7362c05 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:04.251762 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-e5393145-ca48-4e14-ab1e-1746558aab17 req-a58492f5-73a6-40aa-92b1-3fb1c7362c05 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:04.253954 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:04.254621 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:04.255674 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:04.256911 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:04.269521 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-e5393145-ca48-4e14-ab1e-1746558aab17 req-a58492f5-73a6-40aa-92b1-3fb1c7362c05 service nova] Creating event network-changed:7ac1e61f-01e2-4d7f-82cb-7f206e42d656 for instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 on n-h1-master-1 Jul 24 02:47:04.274831 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-e5393145-ca48-4e14-ab1e-1746558aab17 req-a58492f5-73a6-40aa-92b1-3fb1c7362c05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038218 Jul 24 02:47:04.275962 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3683/7475] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:47:04.290859 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:47:04.374450 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-57d4f194-ebdc-441c-b491-f7dbc90691f9 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "DELETE /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 204 len: 0 microversion: 2.1 time: 0.139956 Jul 24 02:47:04.375407 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3793/7476] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:47:04 2022] DELETE /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:47:04.384826 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:04.385819 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:04.392593 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:04.393333 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:04.394174 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:04.394627 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:04.540169 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:47:04.548260 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-0653fdda-0bf4-4170-aeb1-32cf298a9958 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1683 microversion: 2.1 time: 0.168268 Jul 24 02:47:04.548849 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3684/7477] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:04 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:47:05.566908 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:05.567619 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:05.574639 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:05.574985 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:05.576197 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:05.576907 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:05.718850 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:47:05.726475 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-46979856-083c-454e-a361-ec0f5be14932 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1683 microversion: 2.1 time: 0.163894 Jul 24 02:47:05.727050 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3794/7478] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:05 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:47:06.467229 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-d483747f-0135-447a-bc14-1000ad3c6cc1 req-54a074f8-b5bb-4942-81ba-656ca3440d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7e52c6-4ba3-4fe5-9263-b02e26b72dc7", "name": "network-vif-deleted", "tag": "7ac1e61f-01e2-4d7f-82cb-7f206e42d656"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:47:06.475855 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d483747f-0135-447a-bc14-1000ad3c6cc1 req-54a074f8-b5bb-4942-81ba-656ca3440d0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:06.476323 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-d483747f-0135-447a-bc14-1000ad3c6cc1 req-54a074f8-b5bb-4942-81ba-656ca3440d0f service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:06.488232 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-d483747f-0135-447a-bc14-1000ad3c6cc1 req-54a074f8-b5bb-4942-81ba-656ca3440d0f service nova] Creating event network-vif-deleted:7ac1e61f-01e2-4d7f-82cb-7f206e42d656 for instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 on n-h1-master-1 Jul 24 02:47:06.493481 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-d483747f-0135-447a-bc14-1000ad3c6cc1 req-54a074f8-b5bb-4942-81ba-656ca3440d0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091164 Jul 24 02:47:06.494130 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3685/7479] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 24 02:47:06.744576 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:06.745203 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:06.756725 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:06.757314 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:06.758235 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:06.758728 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:06.800254 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:06.800710 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:06.801173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lazy-loading 'fault' on Instance uuid be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:47:06.853858 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:47:06.863626 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-b8d66509-3301-4a7a-a3bf-58ce3d139b0c tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 200 len: 1338 microversion: 2.1 time: 0.123232 Jul 24 02:47:06.864254 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3795/7480] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:06 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 1338 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:47:07.883738 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:07.884459 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: be7e52c6-4ba3-4fe5-9263-b02e26b72dc7] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:07.891406 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:07.891868 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:07.892647 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:07.893099 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:07.906302 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] HTTP exception thrown: Instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 could not be found. Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Request method failure captured: Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 HTTP/1.1 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3LF7JnYGIw9g9u4N-75MJSCH-aKg7vyALiuK9I1_Kh1WDkrfG85S4IE-xXL2hZHrDqDaOlXVJ5vr7Phd44w6SZ0VNvzgQIJKX1FcESpaabY-76lB0EmZ3I0jfM1pteHa7muWiS2kfLbNeQ3QJXPh1ENWpGdUYqtYkK69WMC_23AZGnY Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: f2c291c486e64d78851ea5ea19f3cde8 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestSnapshotPattern-828847126 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f2c291c486e64d78851ea5ea19f3cde8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f2c291c486e64d78851ea5ea19f3cde8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f2c291c486e64d78851ea5ea19f3cde8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f2c291c486e64d78851ea5ea19f3cde8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestSnapshotPattern-828847126 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: f2c291c486e64d78851ea5ea19f3cde8 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestSnapshotPattern-828847126 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestSnapshotPattern-828847126-project Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 8f0012c044964dd2853db1c71fe62f36 Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestSnapshotPattern-828847126-project Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: exception: Instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 could not be found. Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'be7e52c6-4ba3-4fe5-9263-b02e26b72dc7'} Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 could not be found. Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 could not be found. Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:47:07.907933 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 could not be found. Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Returning 404 to user: Instance be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-5312b583-e2e0-4e0f-983e-6f16ce792b68 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7" status: 404 len: 111 microversion: 2.1 time: 0.031252 Jul 24 02:47:07.912876 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3686/7481] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:07 2022] GET /compute/v2.1/servers/be7e52c6-4ba3-4fe5-9263-b02e26b72dc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:47:09.397729 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:09.398239 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:09.400924 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-32ac11eb-9e53-4069-977f-9a48808ff4d4 req-8d551b97-a7c3-454a-a34c-c4cd25a905cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e3e1e3-9666-470f-99f3-e168573ae5a5", "tag": "1a65be4a-d78f-402c-8d48-701f67568aa0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:47:09.405337 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:09.405930 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:09.406709 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:09.407148 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:09.411208 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-32ac11eb-9e53-4069-977f-9a48808ff4d4 req-8d551b97-a7c3-454a-a34c-c4cd25a905cf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:09.411676 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-32ac11eb-9e53-4069-977f-9a48808ff4d4 req-8d551b97-a7c3-454a-a34c-c4cd25a905cf service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:09.425227 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-32ac11eb-9e53-4069-977f-9a48808ff4d4 req-8d551b97-a7c3-454a-a34c-c4cd25a905cf service nova] Creating event network-changed:1a65be4a-d78f-402c-8d48-701f67568aa0 for instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 on n-h2-master-1 Jul 24 02:47:09.431214 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-32ac11eb-9e53-4069-977f-9a48808ff4d4 req-8d551b97-a7c3-454a-a34c-c4cd25a905cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034464 Jul 24 02:47:09.431816 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3687/7482] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:47:09.435173 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Going to try to terminate instance {{(pid=119561) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 24 02:47:09.522957 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-e2eb6903-492c-471c-aba3-0264c7789047 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 204 len: 0 microversion: 2.1 time: 0.129436 Jul 24 02:47:09.523580 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3796/7483] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 02:47:09 2022] DELETE /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 24 02:47:09.536302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:09.536302 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:09.542137 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:09.542606 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:09.543399 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:09.543850 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:09.691157 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.policy [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119562) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:47:09.698678 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-68294292-6011-4f21-92b0-c212726ce326 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1683 microversion: 2.1 time: 0.170090 Jul 24 02:47:09.699259 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3688/7484] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:09 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:47:10.718575 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:10.719264 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:10.726599 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:10.727055 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:10.727834 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:10.728276 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:10.868046 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:47:10.876159 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-52b8c29f-974c-4353-b164-1d73e4709eca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1683 microversion: 2.1 time: 0.162666 Jul 24 02:47:10.876732 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3797/7485] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:10 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 24 02:47:11.778114 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [req-22cf64f2-14b9-45e2-9071-472723638256 req-1a3e54bb-6c57-4946-9a83-157f0b45f8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e3e1e3-9666-470f-99f3-e168573ae5a5", "name": "network-vif-deleted", "tag": "1a65be4a-d78f-402c-8d48-701f67568aa0"}]} {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 24 02:47:11.787872 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-22cf64f2-14b9-45e2-9071-472723638256 req-1a3e54bb-6c57-4946-9a83-157f0b45f8e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:11.788313 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [req-22cf64f2-14b9-45e2-9071-472723638256 req-1a3e54bb-6c57-4946-9a83-157f0b45f8e5 service nova] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:11.800416 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.compute.server_external_events [req-22cf64f2-14b9-45e2-9071-472723638256 req-1a3e54bb-6c57-4946-9a83-157f0b45f8e5 service nova] Creating event network-vif-deleted:1a65be4a-d78f-402c-8d48-701f67568aa0 for instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 on n-h2-master-1 Jul 24 02:47:11.806126 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [req-22cf64f2-14b9-45e2-9071-472723638256 req-1a3e54bb-6c57-4946-9a83-157f0b45f8e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 Jul 24 02:47:11.807031 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3689/7486] 10.222.0.27 () {64 vars in 1317 bytes} [Sun Jul 24 02:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 24 02:47:11.894140 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:11.894752 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.compute.api [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119561) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:11.901868 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:11.902318 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:11.903118 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:11.903548 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:11.935138 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:11.936200 n-d-master-1 devstack@n-api.service[119561]: DEBUG oslo_concurrency.lockutils [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:11.936758 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.objects.instance [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lazy-loading 'fault' on Instance uuid f5e3e1e3-9666-470f-99f3-e168573ae5a5 {{(pid=119561) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 24 02:47:11.983545 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.policy [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0012c044964dd2853db1c71fe62f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c291c486e64d78851ea5ea19f3cde8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119561) authorize /opt/stack/nova/nova/policy.py:199}} Jul 24 02:47:11.991316 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-35d577ef-6502-498f-8c05-287a38276dca tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 200 len: 1339 microversion: 2.1 time: 0.101013 Jul 24 02:47:11.991824 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3798/7487] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:11 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 24 02:47:13.009372 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '>' {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:13.010121 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.compute.api [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] [instance: f5e3e1e3-9666-470f-99f3-e168573ae5a5] Fetching instance by UUID {{(pid=119562) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 24 02:47:13.018463 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:13.018934 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:13.019718 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 24 02:47:13.020171 n-d-master-1 devstack@n-api.service[119562]: DEBUG oslo_concurrency.lockutils [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Lock "0cd8cbf6-89a9-4578-8b79-4f13f771e70c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 24 02:47:13.034329 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.wsgi [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] HTTP exception thrown: Instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 could not be found. Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Request method failure captured: Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: request: GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 HTTP/1.1 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: Accept: application/json Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: Accept-Encoding: identity Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: Connection: close Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: Content-Length: 0 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: Content-Type: application/json Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: Host: 10.222.0.27 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: Openstack-System-Scope: None Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: User-Agent: python-urllib3/1.26.9 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Auth-Token: gAAAAABi3LF7JnYGIw9g9u4N-75MJSCH-aKg7vyALiuK9I1_Kh1WDkrfG85S4IE-xXL2hZHrDqDaOlXVJ5vr7Phd44w6SZ0VNvzgQIJKX1FcESpaabY-76lB0EmZ3I0jfM1pteHa7muWiS2kfLbNeQ3QJXPh1ENWpGdUYqtYkK69WMC_23AZGnY Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Id: None Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Domain-Name: None Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Identity-Status: Confirmed Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Is-Admin-Project: True Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Id: default Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Project-Domain-Name: Default Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Project-Id: f2c291c486e64d78851ea5ea19f3cde8 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Project-Name: tempest-TestSnapshotPattern-828847126 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Role: reader,member Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Roles: reader,member Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f2c291c486e64d78851ea5ea19f3cde8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f2c291c486e64d78851ea5ea19f3cde8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f2c291c486e64d78851ea5ea19f3cde8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f2c291c486e64d78851ea5ea19f3cde8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Tenant: tempest-TestSnapshotPattern-828847126 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Id: f2c291c486e64d78851ea5ea19f3cde8 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-Tenant-Name: tempest-TestSnapshotPattern-828847126 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-User: tempest-TestSnapshotPattern-828847126-project Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Id: default Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-User-Domain-Name: Default Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-User-Id: 8f0012c044964dd2853db1c71fe62f36 Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: X-User-Name: tempest-TestSnapshotPattern-828847126-project Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: method: > Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: exception: Instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 could not be found. Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: action_args: {'id': 'f5e3e1e3-9666-470f-99f3-e168573ae5a5'} Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: {{(pid=119562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 could not be found. Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 could not be found. Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 24 02:47:13.035965 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 could not be found. Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: ERROR nova.api.openstack.wsgi Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: DEBUG nova.api.openstack.wsgi [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Returning 404 to user: Instance f5e3e1e3-9666-470f-99f3-e168573ae5a5 could not be found. {{(pid=119562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: INFO nova.api.openstack.requestlog [None req-7d5bc3cc-5377-45a0-be4c-a78f37051c32 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5" status: 404 len: 111 microversion: 2.1 time: 0.032692 Jul 24 02:47:13.040774 n-d-master-1 devstack@n-api.service[119562]: [pid: 119562|app: 0|req: 3690/7488] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 02:47:13 2022] GET /compute/v2.1/servers/f5e3e1e3-9666-470f-99f3-e168573ae5a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 24 02:47:13.203150 n-d-master-1 devstack@n-api.service[119561]: DEBUG nova.api.openstack.wsgi [None req-df442d8e-a32b-4eb6-8d93-64da53f86dd2 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] Calling method '.version_select at 0x7f05eba57f70>' {{(pid=119561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 24 02:47:13.225461 n-d-master-1 devstack@n-api.service[119561]: INFO nova.api.openstack.requestlog [None req-df442d8e-a32b-4eb6-8d93-64da53f86dd2 tempest-TestSnapshotPattern-828847126 tempest-TestSnapshotPattern-828847126-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1835032738" status: 202 len: 0 microversion: 2.1 time: 0.027166 Jul 24 02:47:13.229211 n-d-master-1 devstack@n-api.service[119561]: [pid: 119561|app: 0|req: 3799/7489] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 02:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1835032738 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 24 02:48:12.293073 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:48:12.293691 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:48:12.381444 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:48:12.381727 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:48:12.779898 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:48:12.780440 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:49:52.750336 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:49:52.751090 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:49:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:50:12.820659 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:50:12.821243 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:51:32.301520 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:51:32.302319 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:51:32.388908 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:51:32.389055 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:51:32.788457 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:51:32.788956 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:52:09.630134 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:52:09.630862 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:52:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:53:12.758307 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:53:12.758905 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:53:32.829595 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:53:32.830143 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:54:52.309872 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:54:52.310557 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:54:52.396746 n-d-master-1 devstack@n-api.service[119562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:54:52.396921 n-d-master-1 devstack@n-api.service[119562]: Sun Jul 24 02:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:54:52.796645 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:54:52.797112 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 24 02:55:29.638730 n-d-master-1 devstack@n-api.service[119561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 24 02:55:29.639387 n-d-master-1 devstack@n-api.service[119561]: Sun Jul 24 02:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!